2024-05-20T17:11:56.507 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-20T17:11:56.508 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} --archive /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632 -- /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/orig.config.yaml 2024-05-20T17:11:56.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T17:11:56.668 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632 branch: wip-pdonnell-testing-20240517.203521-squid-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7715632' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240517.203521-squid-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240517.203521-squid-debug sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9749 sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d sleep_before_teardown: 0 subset: 272/512 suite: fs suite_branch: wip-pdonnell-testing-20240517.203521-squid-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWnJJoc+70YQjZcMEXg5Rme45c3KJsOy+KPvk5wUEgBk5o6o6racFLeQtNmq9WCEikCd7dFbGLo0IAg/vxVlaE= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJv+/Z0LcU+BWGHQYm5wGEghUvpTtH+JT47e9F39z2aSnCAnemJUYSy2TfF9LPulLcE37P2W6umgpdyi6wH1OLs= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWkXtL6TLkUpnulVcZGtDhW0PZ7VpEa/IMU+EqGnbtHKRYVOvDauM7C+7Y8eg8o/h5yjFMBF+r0Ti+juaRO8NI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-20_15:44:59 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-20T17:11:56.668 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa; will attempt to use it 2024-05-20T17:11:56.669 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks 2024-05-20T17:11:56.669 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-20T17:11:56.670 INFO:teuthology.task.internal:Checking packages... 2024-05-20T17:11:56.691 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2b507c724ef6c8295ee0a35d185cdab167fd61d' 2024-05-20T17:11:56.692 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-20T17:11:56.692 INFO:teuthology.packaging:ref: None 2024-05-20T17:11:56.692 INFO:teuthology.packaging:tag: None 2024-05-20T17:11:56.692 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:11:56.692 INFO:teuthology.packaging:sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:11:56.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:11:56.911 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2744.gd2b507c7 2024-05-20T17:11:56.912 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-20T17:11:56.918 INFO:teuthology.task.internal:no buildpackages task found 2024-05-20T17:11:56.918 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-20T17:11:56.931 INFO:teuthology.task.internal:Saving configuration 2024-05-20T17:11:56.952 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-20T17:11:56.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-20T17:11:56.986 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 17:06:47.411069', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWnJJoc+70YQjZcMEXg5Rme45c3KJsOy+KPvk5wUEgBk5o6o6racFLeQtNmq9WCEikCd7dFbGLo0IAg/vxVlaE='} 2024-05-20T17:11:57.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 17:06:47.407308', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJv+/Z0LcU+BWGHQYm5wGEghUvpTtH+JT47e9F39z2aSnCAnemJUYSy2TfF9LPulLcE37P2W6umgpdyi6wH1OLs='} 2024-05-20T17:11:57.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 17:06:47.409314', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWkXtL6TLkUpnulVcZGtDhW0PZ7VpEa/IMU+EqGnbtHKRYVOvDauM7C+7Y8eg8o/h5yjFMBF+r0Ti+juaRO8NI='} 2024-05-20T17:11:57.032 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-20T17:11:57.039 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-20T17:11:57.039 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-20T17:11:57.039 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-20T17:11:57.039 INFO:teuthology.run_tasks:Running task console_log... 2024-05-20T17:11:57.127 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f229f803ac0>, signals=[15]) 2024-05-20T17:11:57.127 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-20T17:11:57.133 INFO:teuthology.task.internal:Opening connections... 2024-05-20T17:11:57.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:11:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:11:57.213 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-05-20T17:11:57.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:11:57.291 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-05-20T17:11:57.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:11:57.370 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-20T17:11:57.376 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-20T17:11:57.393 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-20T17:11:57.393 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-20T17:11:57.450 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-05-20T17:11:57.450 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T17:11:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T17:11:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T17:11:57.452 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-20T17:11:57.472 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-05-20T17:11:57.490 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-05-20T17:11:57.490 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T17:11:57.547 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T17:11:57.548 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T17:11:57.548 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-05-20T17:11:57.580 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-05-20T17:11:57.598 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-05-20T17:11:57.598 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-05-20T17:11:57.655 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T17:11:57.656 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-05-20T17:11:57.657 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T17:11:57.657 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T17:11:57.657 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T17:11:57.657 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-05-20T17:11:57.680 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-20T17:11:57.691 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-20T17:11:57.696 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-20T17:11:57.696 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-20T17:11:57.699 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-05-20T17:11:57.701 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-05-20T17:11:57.716 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-20T17:11:57.724 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-20T17:11:57.724 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-20T17:11:57.755 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-05-20T17:11:57.759 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-05-20T17:11:57.848 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-20T17:11:57.923 INFO:teuthology.run_tasks:Running task kernel... 2024-05-20T17:11:57.937 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-20T17:11:57.937 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-20T17:11:57.937 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-20T17:11:57.937 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T17:11:57.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:11:57.954 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-20T17:11:58.011 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-437.el9.x86_64 2024-05-20T17:11:58.012 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-437.el9.x86_64 2024-05-20T17:11:58.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-05-20T17:12:06.572 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T17:12:14.744 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 19 MB 00:07 2024-05-20T17:12:25.401 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 900 kB/s | 6.2 MB 00:07 2024-05-20T17:12:27.862 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-05-20T17:12:30.086 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-20T17:12:35.272 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-20T17:12:37.145 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T17:12:37.145 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T17:12:37.242 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T17:12:37.253 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-05-20T17:12:37.254 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:12:37.255 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 78 M 2024-05-20T17:12:37.255 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 123 M 2024-05-20T17:12:37.255 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-20T17:12:37.574 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.576 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.576 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.684 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.686 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.704 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:37.728 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:37.730 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:37.748 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:37.849 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:37.849 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:37.872 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:38.124 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 984 kB/s | 576 kB 00:00 2024-05-20T17:12:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:38.181 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:12:38.204 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:38.226 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:12:40.933 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 10 MB/s | 34 MB 00:03 2024-05-20T17:12:41.141 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-core-5.14.0-447.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-05-20T17:12:43.024 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 5.7 MB/s | 28 MB 00:04 2024-05-20T17:12:43.029 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:12:43.029 INFO:teuthology.orchestra.run.smithi135.stdout:Total 14 MB/s | 78 MB 00:05 2024-05-20T17:12:43.716 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-20T17:12:44.050 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-20T17:12:44.051 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-20T17:12:44.990 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-20T17:12:44.991 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-20T17:12:47.400 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-20T17:12:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:12:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:12:50.777 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:12:50.910 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:12:55.613 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:12:55.731 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:00.468 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:30.251 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:30.289 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:30.642 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:30.642 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:13:30.642 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:13:30.642 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:13:31.433 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:13:31.434 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-20T17:13:31.802 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:13:31.874 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:13:31.874 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T17:13:31.875 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T17:13:31.875 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T17:13:31.875 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-20T17:13:31.875 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T17:13:31.875 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:13:31.925 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:13:31.925 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:13:31.925 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-05-20T17:13:31.955 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-05-20T17:13:31.955 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-05-20T17:13:31.955 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-05-20T17:13:31.955 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 68.el9 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8264254 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-05-20T17:13:31.956 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:13:31.957 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T17:13:31.958 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T17:13:31.958 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-447.el9.x86_64 2024-05-20T17:13:31.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T17:13:32.591 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-05-20T17:13:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T17:13:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-05-20T17:13:34.080 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-20T17:13:34.100 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.x1GIVJ07br 2024-05-20T17:13:34.101 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.x1GIVJ07br 2024-05-20T17:13:34.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.x1GIVJ07br 2024-05-20T17:13:34.318 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.x1GIVJ07br is 6KB 2024-05-20T17:13:34.369 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.x1GIVJ07br 2024-05-20T17:13:34.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T17:13:34.445 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T17:13:34.445 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T17:13:34.445 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T17:13:34.445 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T17:13:34.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T17:13:34.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-05-20T17:14:04.575 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-20T17:14:04.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:14:04.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:14:23.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-20T17:14:32.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:14:32.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:14:35.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-20T17:14:47.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:14:47.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:15:05.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-20T17:15:20.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:15:20.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:15:20.904 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-20T17:15:21.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:15:21.315 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-447.el9.x86_64"... 2024-05-20T17:15:21.316 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-20T17:15:21.330 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-447.el9.x86_64 2024-05-20T17:15:21.330 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T17:15:21.330 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T17:15:21.330 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T17:15:22.332 DEBUG:teuthology.parallel:result is None 2024-05-20T17:15:22.332 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-20T17:15:22.340 INFO:teuthology.task.internal:Creating test directory... 2024-05-20T17:15:22.340 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T17:15:22.342 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T17:15:22.345 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T17:15:22.363 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-20T17:15:22.369 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-20T17:15:22.379 INFO:teuthology.task.internal:Creating archive directory... 2024-05-20T17:15:22.379 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T17:15:22.398 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T17:15:22.403 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T17:15:22.509 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-20T17:15:22.516 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-20T17:15:22.517 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T17:15:22.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:15:22.533 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T17:15:22.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:15:22.549 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T17:15:22.551 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T17:15:22.575 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T17:15:22.614 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.623 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.628 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.643 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.661 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.687 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:15:22.688 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-20T17:15:22.696 INFO:teuthology.task.internal:Configuring sudo... 2024-05-20T17:15:22.696 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T17:15:22.699 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T17:15:22.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T17:15:22.729 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-20T17:15:22.740 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-20T17:15:22.740 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T17:15:22.764 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T17:15:22.767 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T17:15:22.786 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:22.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:22.913 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:22.995 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:23.036 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:15:23.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T17:15:23.112 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:23.154 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:23.202 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:23.290 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:23.326 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:15:23.326 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T17:15:23.391 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:23.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:15:23.494 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:23.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:15:23.620 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:15:23.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T17:15:23.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-20T17:15:23.688 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-05-20T17:15:23.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-05-20T17:15:23.722 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:15:23.766 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:15:23.781 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:15:24.260 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-20T17:15:24.269 INFO:teuthology.task.internal:Starting timer... 2024-05-20T17:15:24.269 INFO:teuthology.run_tasks:Running task pcp... 2024-05-20T17:15:24.288 INFO:teuthology.run_tasks:Running task selinux... 2024-05-20T17:15:24.297 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-20T17:15:24.297 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-20T17:15:24.353 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-20T17:15:24.355 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-05-20T17:15:24.421 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-05-20T17:15:24.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-05-20T17:15:24.483 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-05-20T17:15:24.485 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-20T17:15:24.486 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-20T17:15:24.581 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-20T17:15:24.581 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-05-20T17:15:24.605 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-05-20T17:15:24.605 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-05-20T17:15:24.632 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-05-20T17:15:24.633 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-05-20T17:15:24.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:15:24.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:15:24.661 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:15:24.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:15:24.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:15:24.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:15:24.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-20T17:15:24.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-20T17:15:24.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-05-20T17:15:24.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-05-20T17:15:24.885 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-20T17:15:24.895 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-20T17:15:24.906 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-20T17:15:24.907 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi160.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-20T17:20:05.702 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-05-20T17:20:05.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:20:05.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:20:05.782 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-20T17:20:05.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-20T17:20:05.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-20T17:20:05.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:20:05.939 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-20T17:20:06.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-20T17:20:06.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-20T17:20:06.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:20:06.089 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-05-20T17:20:06.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-20T17:20:06.170 INFO:teuthology.run_tasks:Running task clock... 2024-05-20T17:20:06.182 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-20T17:20:06.182 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T17:20:06.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:20:06.185 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T17:20:06.185 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:20:06.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T17:20:06.188 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:20:06.212 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T17:20:06.213 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T17:20:06.227 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T17:20:06.227 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T17:20:06.238 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T17:20:06.249 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-05-20T17:20:06.250 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T17:20:06.251 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-20T17:20:06.259 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-05-20T17:20:06.262 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-20T17:20:06.272 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T17:20:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-05-20T17:20:06.276 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T17:20:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-05-20T17:20:06.285 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T17:20:06.290 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T17:20:06.297 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T17:20:06.309 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T17:20:06.338 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.342 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.343 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:20:06.346 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:20:06.347 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-20T17:20:06.347 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.347 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.347 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.347 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.374 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.377 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:20:06.378 INFO:teuthology.run_tasks:Running task install... 2024-05-20T17:20:06.386 DEBUG:teuthology.task.install:project ceph 2024-05-20T17:20:06.386 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}} 2024-05-20T17:20:06.386 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'} 2024-05-20T17:20:06.386 INFO:teuthology.task.install:Using flavor: default 2024-05-20T17:20:06.391 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-20T17:20:06.391 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-20T17:20:06.392 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T17:20:06.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:20:06.394 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T17:20:06.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:20:06.395 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T17:20:06.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:20:06.553 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T17:20:06.553 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T17:20:06.632 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T17:20:06.632 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T17:20:06.637 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T17:20:06.637 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T17:20:06.728 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T17:20:06.728 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:20:06.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T17:20:06.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T17:20:06.756 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T17:20:06.791 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T17:20:06.791 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:20:06.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T17:20:06.816 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T17:20:06.816 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T17:20:06.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T17:20:06.856 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T17:20:06.856 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:20:06.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T17:20:06.881 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T17:20:06.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T17:20:06.882 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T17:20:06.897 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T17:20:06.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T17:20:06.954 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T17:20:06.961 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-20T17:20:06.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-20T17:20:07.017 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-05-20T17:20:07.019 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T17:20:07.020 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-05-20T17:20:07.082 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-05-20T17:20:07.084 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-05-20T17:20:07.189 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-05-20T17:20:07.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T17:20:07.243 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-05-20T17:20:07.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T17:20:07.308 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-05-20T17:20:07.335 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T17:20:07.894 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 206 kB/s | 83 kB 00:00 2024-05-20T17:20:07.998 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-05-20T17:20:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 197 kB/s | 83 kB 00:00 2024-05-20T17:20:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 27 kB/s | 11 kB 00:00 2024-05-20T17:20:08.503 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-05-20T17:20:08.507 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 25 kB/s | 11 kB 00:00 2024-05-20T17:20:08.895 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-05-20T17:20:08.974 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-05-20T17:20:09.096 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-05-20T17:20:11.266 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.1 MB 00:02 2024-05-20T17:20:13.403 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.1 MB 00:04 2024-05-20T17:20:13.995 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.1 MB 00:04 2024-05-20T17:20:15.137 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-20T17:20:15.735 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-20T17:20:17.485 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 19 MB 00:05 2024-05-20T17:20:20.777 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-20T17:20:21.199 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-20T17:20:22.599 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-20T17:20:22.821 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-20T17:20:23.703 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.2 MB 00:02 2024-05-20T17:20:23.751 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-20T17:20:25.084 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 16 kB 00:00 2024-05-20T17:20:28.614 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 21 MB 00:03 2024-05-20T17:20:28.868 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-20T17:20:30.042 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 21 MB 00:07 2024-05-20T17:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:31.045 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:31.056 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T17:20:31.057 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T17:20:31.058 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T17:20:31.058 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T17:20:31.060 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T17:20:31.062 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T17:20:31.063 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T17:20:31.125 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-20T17:20:31.144 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-20T17:20:31.144 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-20T17:20:31.144 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-20T17:20:31.144 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T17:20:31.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T17:20:31.146 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T17:20:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T17:20:31.148 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T17:20:31.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T17:20:31.150 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T17:20:31.151 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T17:20:31.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T17:20:31.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T17:20:31.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T17:20:31.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T17:20:31.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T17:20:31.157 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:20:31.158 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout:Install 148 Packages 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 11 Packages 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 222 M 2024-05-20T17:20:31.159 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-20T17:20:31.886 INFO:teuthology.orchestra.run.smithi135.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-05-20T17:20:32.137 INFO:teuthology.orchestra.run.smithi135.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 3.4 MB/s | 863 kB 00:00 2024-05-20T17:20:32.203 INFO:teuthology.orchestra.run.smithi135.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 2.2 MB/s | 147 kB 00:00 2024-05-20T17:20:32.279 INFO:teuthology.orchestra.run.smithi135.stdout:(4/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 9.5 MB/s | 5.4 MB 00:00 2024-05-20T17:20:32.588 INFO:teuthology.orchestra.run.smithi135.stdout:(5/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-05-20T17:20:32.655 INFO:teuthology.orchestra.run.smithi135.stdout:(6/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 5.0 MB/s | 2.3 MB 00:00 2024-05-20T17:20:33.047 INFO:teuthology.orchestra.run.smithi135.stdout:(7/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 11 MB/s | 4.9 MB 00:00 2024-05-20T17:20:33.644 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-20T17:20:33.905 INFO:teuthology.orchestra.run.smithi135.stdout:(8/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el9 11 MB/s | 9.8 MB 00:00 2024-05-20T17:20:33.956 INFO:teuthology.orchestra.run.smithi135.stdout:(9/159): ceph-selinux-19.0.0-2744.gd2b507c7.el9 504 kB/s | 25 kB 00:00 2024-05-20T17:20:34.840 INFO:teuthology.orchestra.run.smithi135.stdout:(10/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 8.1 MB/s | 18 MB 00:02 2024-05-20T17:20:34.948 INFO:teuthology.orchestra.run.smithi135.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.0 MB/s | 221 kB 00:00 2024-05-20T17:20:35.015 INFO:teuthology.orchestra.run.smithi135.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 406 kB/s | 27 kB 00:00 2024-05-20T17:20:35.074 INFO:teuthology.orchestra.run.smithi135.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 543 kB/s | 32 kB 00:00 2024-05-20T17:20:35.205 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-20T17:20:35.233 INFO:teuthology.orchestra.run.smithi135.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 4.7 MB/s | 756 kB 00:00 2024-05-20T17:20:35.299 INFO:teuthology.orchestra.run.smithi135.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 2.3 MB/s | 158 kB 00:00 2024-05-20T17:20:35.367 INFO:teuthology.orchestra.run.smithi135.stdout:(16/159): librados-devel-19.0.0-2744.gd2b507c7. 1.9 MB/s | 127 kB 00:00 2024-05-20T17:20:35.492 INFO:teuthology.orchestra.run.smithi135.stdout:(17/159): libradosstriper1-19.0.0-2744.gd2b507c 3.9 MB/s | 497 kB 00:00 2024-05-20T17:20:35.744 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:35.745 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:35.755 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T17:20:35.756 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T17:20:35.757 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T17:20:35.758 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T17:20:35.759 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T17:20:35.762 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T17:20:35.762 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T17:20:35.825 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-05-20T17:20:35.842 INFO:teuthology.orchestra.run.smithi135.stdout:(18/159): ceph-common-19.0.0-2744.gd2b507c7.el9 4.7 MB/s | 19 MB 00:04 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T17:20:35.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T17:20:35.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T17:20:35.847 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T17:20:35.848 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T17:20:35.849 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T17:20:35.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T17:20:35.851 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T17:20:35.852 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T17:20:35.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T17:20:35.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T17:20:35.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T17:20:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T17:20:35.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T17:20:35.858 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-05-20T17:20:35.859 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 11 Packages 2024-05-20T17:20:35.860 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:20:35.860 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 222 M 2024-05-20T17:20:35.860 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-05-20T17:20:35.926 INFO:teuthology.orchestra.run.smithi135.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 544 kB/s | 45 kB 00:00 2024-05-20T17:20:36.018 INFO:teuthology.orchestra.run.smithi135.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.4 MB/s | 135 kB 00:00 2024-05-20T17:20:36.110 INFO:teuthology.orchestra.run.smithi135.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 1.7 MB/s | 161 kB 00:00 2024-05-20T17:20:36.186 INFO:teuthology.orchestra.run.smithi135.stdout:(22/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 7.3 MB/s | 5.0 MB 00:00 2024-05-20T17:20:36.211 INFO:teuthology.orchestra.run.smithi135.stdout:(23/159): python3-rados-19.0.0-2744.gd2b507c7.e 3.1 MB/s | 320 kB 00:00 2024-05-20T17:20:36.244 INFO:teuthology.orchestra.run.smithi135.stdout:(24/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 5.0 MB/s | 299 kB 00:00 2024-05-20T17:20:36.286 INFO:teuthology.orchestra.run.smithi135.stdout:(25/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 1.3 MB/s | 99 kB 00:00 2024-05-20T17:20:36.312 INFO:teuthology.orchestra.run.smithi135.stdout:(26/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.2 MB/s | 86 kB 00:00 2024-05-20T17:20:36.379 INFO:teuthology.orchestra.run.smithi135.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 2.5 MB/s | 169 kB 00:00 2024-05-20T17:20:36.438 INFO:teuthology.orchestra.run.smithi135.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 542 kB/s | 32 kB 00:00 2024-05-20T17:20:36.497 INFO:teuthology.orchestra.run.smithi135.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 2.4 MB/s | 142 kB 00:00 2024-05-20T17:20:36.912 INFO:teuthology.orchestra.run.smithi172.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-05-20T17:20:37.139 INFO:teuthology.orchestra.run.smithi135.stdout:(30/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 15 MB/s | 46 MB 00:03 2024-05-20T17:20:37.206 INFO:teuthology.orchestra.run.smithi135.stdout:(31/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 3.3 MB/s | 3.0 MB 00:00 2024-05-20T17:20:37.264 INFO:teuthology.orchestra.run.smithi135.stdout:(32/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 4.6 MB/s | 3.5 MB 00:00 2024-05-20T17:20:37.295 INFO:teuthology.orchestra.run.smithi172.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 2.2 MB/s | 863 kB 00:00 2024-05-20T17:20:37.322 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:37.323 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:20:37.323 INFO:teuthology.orchestra.run.smithi135.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 846 kB/s | 49 kB 00:00 2024-05-20T17:20:37.334 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T17:20:37.334 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T17:20:37.335 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T17:20:37.336 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T17:20:37.337 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T17:20:37.340 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T17:20:37.341 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T17:20:37.390 INFO:teuthology.orchestra.run.smithi135.stdout:(34/159): ceph-mgr-modules-core-19.0.0-2744.gd2 1.3 MB/s | 249 kB 00:00 2024-05-20T17:20:37.395 INFO:teuthology.orchestra.run.smithi172.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 1.4 MB/s | 147 kB 00:00 2024-05-20T17:20:37.402 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-20T17:20:37.415 INFO:teuthology.orchestra.run.smithi135.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2744.gd 179 kB/s | 16 kB 00:00 2024-05-20T17:20:37.423 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-20T17:20:37.423 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-20T17:20:37.423 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-20T17:20:37.423 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-20T17:20:37.423 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T17:20:37.424 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T17:20:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T17:20:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T17:20:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T17:20:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T17:20:37.429 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T17:20:37.430 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T17:20:37.431 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T17:20:37.432 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T17:20:37.433 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T17:20:37.434 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T17:20:37.435 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T17:20:37.436 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout:Install 148 Packages 2024-05-20T17:20:37.437 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 11 Packages 2024-05-20T17:20:37.438 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:20:37.438 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 222 M 2024-05-20T17:20:37.438 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-20T17:20:37.516 INFO:teuthology.orchestra.run.smithi135.stdout:(36/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 2.1 MB/s | 264 kB 00:00 2024-05-20T17:20:37.616 INFO:teuthology.orchestra.run.smithi135.stdout:(37/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 3.7 MB/s | 763 kB 00:00 2024-05-20T17:20:37.642 INFO:teuthology.orchestra.run.smithi135.stdout:(38/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 145 kB/s | 18 kB 00:00 2024-05-20T17:20:37.725 INFO:teuthology.orchestra.run.smithi135.stdout:(39/159): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-05-20T17:20:37.842 INFO:teuthology.orchestra.run.smithi135.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 356 kB/s | 80 kB 00:00 2024-05-20T17:20:37.879 INFO:teuthology.orchestra.run.smithi172.stdout:(4/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 4.7 MB/s | 2.3 MB 00:00 2024-05-20T17:20:37.976 INFO:teuthology.orchestra.run.smithi135.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 780 kB/s | 195 kB 00:00 2024-05-20T17:20:38.001 INFO:teuthology.orchestra.run.smithi135.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-05-20T17:20:38.027 INFO:teuthology.orchestra.run.smithi135.stdout:(43/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-20T17:20:38.052 INFO:teuthology.orchestra.run.smithi135.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-20T17:20:38.071 INFO:teuthology.orchestra.run.smithi172.stdout:(5/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-05-20T17:20:38.086 INFO:teuthology.orchestra.run.smithi135.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-20T17:20:38.111 INFO:teuthology.orchestra.run.smithi135.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-20T17:20:38.129 INFO:teuthology.orchestra.run.smithi172.stdout:(6/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-05-20T17:20:38.153 INFO:teuthology.orchestra.run.smithi135.stdout:(47/159): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.2 MB 00:00 2024-05-20T17:20:38.178 INFO:teuthology.orchestra.run.smithi135.stdout:(48/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-20T17:20:38.245 INFO:teuthology.orchestra.run.smithi135.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-05-20T17:20:38.270 INFO:teuthology.orchestra.run.smithi135.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-05-20T17:20:38.305 INFO:teuthology.orchestra.run.smithi135.stdout:(51/159): bison-3.7.4-5.el9.x86_64.rpm 6.1 MB/s | 943 kB 00:00 2024-05-20T17:20:38.305 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:38.363 INFO:teuthology.orchestra.run.smithi135.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-05-20T17:20:38.397 INFO:teuthology.orchestra.run.smithi135.stdout:(53/159): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-05-20T17:20:38.398 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:38.406 INFO:teuthology.orchestra.run.smithi160.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-20T17:20:38.447 INFO:teuthology.orchestra.run.smithi135.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 368 kB/s | 18 kB 00:00 2024-05-20T17:20:38.549 INFO:teuthology.orchestra.run.smithi135.stdout:(55/159): elfutils-libelf-devel-0.191-4.el9.x86 92 kB/s | 22 kB 00:00 2024-05-20T17:20:38.549 INFO:teuthology.orchestra.run.smithi135.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-05-20T17:20:38.565 INFO:teuthology.orchestra.run.smithi135.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-05-20T17:20:38.590 INFO:teuthology.orchestra.run.smithi135.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-20T17:20:38.650 INFO:teuthology.orchestra.run.smithi135.stdout:(59/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-20T17:20:38.680 INFO:teuthology.orchestra.run.smithi172.stdout:(7/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 8.0 MB/s | 4.9 MB 00:00 2024-05-20T17:20:38.699 INFO:teuthology.orchestra.run.smithi135.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-05-20T17:20:38.725 INFO:teuthology.orchestra.run.smithi135.stdout:(61/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-20T17:20:38.775 INFO:teuthology.orchestra.run.smithi135.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 582 kB 00:00 2024-05-20T17:20:38.800 INFO:teuthology.orchestra.run.smithi135.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 470 kB/s | 47 kB 00:00 2024-05-20T17:20:38.854 INFO:teuthology.orchestra.run.smithi135.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-20T17:20:38.876 INFO:teuthology.orchestra.run.smithi135.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-05-20T17:20:38.902 INFO:teuthology.orchestra.run.smithi135.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-20T17:20:39.036 INFO:teuthology.orchestra.run.smithi135.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-20T17:20:39.144 INFO:teuthology.orchestra.run.smithi135.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-05-20T17:20:39.203 INFO:teuthology.orchestra.run.smithi135.stdout:(69/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-20T17:20:39.253 INFO:teuthology.orchestra.run.smithi135.stdout:(70/159): postgresql-contrib-13.14-1.el9.x86_64 4.1 MB/s | 911 kB 00:00 2024-05-20T17:20:39.287 INFO:teuthology.orchestra.run.smithi135.stdout:(71/159): postgresql-private-libs-13.14-1.el9.x 938 kB/s | 133 kB 00:00 2024-05-20T17:20:39.354 INFO:teuthology.orchestra.run.smithi135.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-20T17:20:39.356 INFO:teuthology.orchestra.run.smithi160.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 908 kB/s | 863 kB 00:00 2024-05-20T17:20:39.413 INFO:teuthology.orchestra.run.smithi135.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 6.3 MB/s | 1.0 MB 00:00 2024-05-20T17:20:39.434 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:39.440 INFO:teuthology.orchestra.run.smithi160.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 1.7 MB/s | 147 kB 00:00 2024-05-20T17:20:39.530 INFO:teuthology.orchestra.run.smithi172.stdout:(8/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 6.9 MB/s | 19 MB 00:02 2024-05-20T17:20:39.563 INFO:teuthology.orchestra.run.smithi135.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-05-20T17:20:39.564 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:39.597 INFO:teuthology.orchestra.run.smithi172.stdout:(9/159): ceph-selinux-19.0.0-2744.gd2b507c7.el9 378 kB/s | 25 kB 00:00 2024-05-20T17:20:39.647 INFO:teuthology.orchestra.run.smithi135.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-20T17:20:39.664 INFO:teuthology.orchestra.run.smithi135.stdout:(76/159): python3-colorama-0.4.6-3.el9.noarch.r 244 kB/s | 61 kB 00:00 2024-05-20T17:20:39.674 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:39.723 INFO:teuthology.orchestra.run.smithi135.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-05-20T17:20:39.736 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:39.806 INFO:teuthology.orchestra.run.smithi135.stdout:(78/159): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-05-20T17:20:39.832 INFO:teuthology.orchestra.run.smithi135.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-05-20T17:20:39.883 INFO:teuthology.orchestra.run.smithi135.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-20T17:20:39.897 INFO:teuthology.orchestra.run.smithi172.stdout:(10/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el 8.1 MB/s | 9.8 MB 00:01 2024-05-20T17:20:39.916 INFO:teuthology.orchestra.run.smithi135.stdout:(81/159): python3-jinja2-2.11.3-6.el9.noarch.rp 925 kB/s | 248 kB 00:00 2024-05-20T17:20:39.942 INFO:teuthology.orchestra.run.smithi135.stdout:(82/159): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-05-20T17:20:39.981 INFO:teuthology.orchestra.run.smithi172.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.6 MB/s | 221 kB 00:00 2024-05-20T17:20:39.983 INFO:teuthology.orchestra.run.smithi135.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-05-20T17:20:40.017 INFO:teuthology.orchestra.run.smithi135.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 2.2 MB/s | 77 kB 00:00 2024-05-20T17:20:40.056 INFO:teuthology.orchestra.run.smithi172.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 361 kB/s | 27 kB 00:00 2024-05-20T17:20:40.059 INFO:teuthology.orchestra.run.smithi135.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-20T17:20:40.101 INFO:teuthology.orchestra.run.smithi135.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-05-20T17:20:40.127 INFO:teuthology.orchestra.run.smithi135.stdout:(87/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-05-20T17:20:40.131 INFO:teuthology.orchestra.run.smithi172.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 422 kB/s | 32 kB 00:00 2024-05-20T17:20:40.152 INFO:teuthology.orchestra.run.smithi135.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-20T17:20:40.194 INFO:teuthology.orchestra.run.smithi135.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-20T17:20:40.219 INFO:teuthology.orchestra.run.smithi135.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-05-20T17:20:40.245 INFO:teuthology.orchestra.run.smithi135.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-20T17:20:40.290 INFO:teuthology.orchestra.run.smithi172.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 4.7 MB/s | 756 kB 00:00 2024-05-20T17:20:40.312 INFO:teuthology.orchestra.run.smithi135.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-20T17:20:40.337 INFO:teuthology.orchestra.run.smithi135.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-05-20T17:20:40.371 INFO:teuthology.orchestra.run.smithi135.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 6.4 MB/s | 221 kB 00:00 2024-05-20T17:20:40.413 INFO:teuthology.orchestra.run.smithi135.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-05-20T17:20:40.438 INFO:teuthology.orchestra.run.smithi135.stdout:(96/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 349 kB/s | 44 kB 00:00 2024-05-20T17:20:40.464 INFO:teuthology.orchestra.run.smithi135.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-05-20T17:20:40.482 INFO:teuthology.orchestra.run.smithi172.stdout:(15/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 7.5 MB/s | 18 MB 00:02 2024-05-20T17:20:40.506 INFO:teuthology.orchestra.run.smithi135.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-05-20T17:20:40.508 INFO:teuthology.orchestra.run.smithi172.stdout:(16/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 727 kB/s | 158 kB 00:00 2024-05-20T17:20:40.533 INFO:teuthology.orchestra.run.smithi172.stdout:(17/159): librados-devel-19.0.0-2744.gd2b507c7. 2.5 MB/s | 127 kB 00:00 2024-05-20T17:20:40.539 INFO:teuthology.orchestra.run.smithi135.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 2.9 MB/s | 305 kB 00:00 2024-05-20T17:20:40.565 INFO:teuthology.orchestra.run.smithi135.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-05-20T17:20:40.575 INFO:teuthology.orchestra.run.smithi172.stdout:(18/159): libradosstriper1-19.0.0-2744.gd2b507c 7.3 MB/s | 497 kB 00:00 2024-05-20T17:20:40.590 INFO:teuthology.orchestra.run.smithi135.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-20T17:20:40.615 INFO:teuthology.orchestra.run.smithi135.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 886 kB/s | 45 kB 00:00 2024-05-20T17:20:40.641 INFO:teuthology.orchestra.run.smithi135.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 440 kB/s | 22 kB 00:00 2024-05-20T17:20:40.641 INFO:teuthology.orchestra.run.smithi172.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 678 kB/s | 45 kB 00:00 2024-05-20T17:20:40.717 INFO:teuthology.orchestra.run.smithi172.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.8 MB/s | 135 kB 00:00 2024-05-20T17:20:40.757 INFO:teuthology.orchestra.run.smithi160.stdout:(4/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 1.7 MB/s | 2.3 MB 00:01 2024-05-20T17:20:40.792 INFO:teuthology.orchestra.run.smithi172.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 2.1 MB/s | 161 kB 00:00 2024-05-20T17:20:40.825 INFO:teuthology.orchestra.run.smithi135.stdout:(104/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-20T17:20:40.893 INFO:teuthology.orchestra.run.smithi172.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 3.1 MB/s | 320 kB 00:00 2024-05-20T17:20:40.992 INFO:teuthology.orchestra.run.smithi135.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-05-20T17:20:40.993 INFO:teuthology.orchestra.run.smithi172.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 2.9 MB/s | 299 kB 00:00 2024-05-20T17:20:41.085 INFO:teuthology.orchestra.run.smithi172.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 1.1 MB/s | 99 kB 00:00 2024-05-20T17:20:41.150 INFO:teuthology.orchestra.run.smithi135.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-20T17:20:41.168 INFO:teuthology.orchestra.run.smithi172.stdout:(25/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 7.9 MB/s | 5.0 MB 00:00 2024-05-20T17:20:41.176 INFO:teuthology.orchestra.run.smithi135.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 106 kB/s | 19 kB 00:00 2024-05-20T17:20:41.194 INFO:teuthology.orchestra.run.smithi172.stdout:(26/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 788 kB/s | 86 kB 00:00 2024-05-20T17:20:41.201 INFO:teuthology.orchestra.run.smithi135.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 880 kB/s | 309 kB 00:00 2024-05-20T17:20:41.235 INFO:teuthology.orchestra.run.smithi135.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-05-20T17:20:41.260 INFO:teuthology.orchestra.run.smithi135.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 825 kB/s | 49 kB 00:00 2024-05-20T17:20:41.277 INFO:teuthology.orchestra.run.smithi172.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-20T17:20:41.319 INFO:teuthology.orchestra.run.smithi135.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-20T17:20:41.344 INFO:teuthology.orchestra.run.smithi135.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 617 kB/s | 67 kB 00:00 2024-05-20T17:20:41.361 INFO:teuthology.orchestra.run.smithi172.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 380 kB/s | 32 kB 00:00 2024-05-20T17:20:41.420 INFO:teuthology.orchestra.run.smithi135.stdout:(113/159): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-20T17:20:41.432 INFO:teuthology.orchestra.run.smithi160.stdout:(5/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-20T17:20:41.462 INFO:teuthology.orchestra.run.smithi172.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.4 MB/s | 142 kB 00:00 2024-05-20T17:20:41.462 INFO:teuthology.orchestra.run.smithi135.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 839 kB 00:00 2024-05-20T17:20:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 647 kB/s | 43 kB 00:00 2024-05-20T17:20:41.513 INFO:teuthology.orchestra.run.smithi135.stdout:(116/159): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-20T17:20:41.538 INFO:teuthology.orchestra.run.smithi135.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 424 kB/s | 32 kB 00:00 2024-05-20T17:20:41.562 INFO:teuthology.orchestra.run.smithi172.stdout:(30/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 7.7 MB/s | 3.0 MB 00:00 2024-05-20T17:20:41.563 INFO:teuthology.orchestra.run.smithi135.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 197 kB/s | 15 kB 00:00 2024-05-20T17:20:41.589 INFO:teuthology.orchestra.run.smithi135.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-20T17:20:41.614 INFO:teuthology.orchestra.run.smithi135.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-05-20T17:20:41.639 INFO:teuthology.orchestra.run.smithi135.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-20T17:20:41.665 INFO:teuthology.orchestra.run.smithi135.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-20T17:20:41.690 INFO:teuthology.orchestra.run.smithi160.stdout:(6/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-20T17:20:41.698 INFO:teuthology.orchestra.run.smithi135.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-20T17:20:41.724 INFO:teuthology.orchestra.run.smithi135.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 181 kB/s | 11 kB 00:00 2024-05-20T17:20:41.774 INFO:teuthology.orchestra.run.smithi135.stdout:(125/159): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-05-20T17:20:41.800 INFO:teuthology.orchestra.run.smithi135.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-05-20T17:20:41.825 INFO:teuthology.orchestra.run.smithi135.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-05-20T17:20:41.850 INFO:teuthology.orchestra.run.smithi135.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-05-20T17:20:41.884 INFO:teuthology.orchestra.run.smithi135.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-05-20T17:20:41.909 INFO:teuthology.orchestra.run.smithi135.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 788 kB/s | 46 kB 00:00 2024-05-20T17:20:41.943 INFO:teuthology.orchestra.run.smithi135.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-05-20T17:20:41.968 INFO:teuthology.orchestra.run.smithi135.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 982 kB/s | 58 kB 00:00 2024-05-20T17:20:41.994 INFO:teuthology.orchestra.run.smithi135.stdout:(133/159): python3-more-itertools-8.12.0-2.el9. 721 kB/s | 79 kB 00:00 2024-05-20T17:20:41.995 INFO:teuthology.orchestra.run.smithi172.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 6.6 MB/s | 3.5 MB 00:00 2024-05-20T17:20:42.019 INFO:teuthology.orchestra.run.smithi135.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-20T17:20:42.044 INFO:teuthology.orchestra.run.smithi135.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-05-20T17:20:42.070 INFO:teuthology.orchestra.run.smithi135.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-20T17:20:42.095 INFO:teuthology.orchestra.run.smithi135.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 372 kB/s | 28 kB 00:00 2024-05-20T17:20:42.095 INFO:teuthology.orchestra.run.smithi172.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 2.4 MB/s | 249 kB 00:00 2024-05-20T17:20:42.120 INFO:teuthology.orchestra.run.smithi135.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 405 kB/s | 31 kB 00:00 2024-05-20T17:20:42.145 INFO:teuthology.orchestra.run.smithi135.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-05-20T17:20:42.171 INFO:teuthology.orchestra.run.smithi135.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 781 kB/s | 59 kB 00:00 2024-05-20T17:20:42.187 INFO:teuthology.orchestra.run.smithi172.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 538 kB/s | 49 kB 00:00 2024-05-20T17:20:42.196 INFO:teuthology.orchestra.run.smithi135.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-05-20T17:20:42.230 INFO:teuthology.orchestra.run.smithi135.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 605 kB/s | 51 kB 00:00 2024-05-20T17:20:42.256 INFO:teuthology.orchestra.run.smithi135.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-20T17:20:42.271 INFO:teuthology.orchestra.run.smithi172.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2744.gd 197 kB/s | 16 kB 00:00 2024-05-20T17:20:42.281 INFO:teuthology.orchestra.run.smithi135.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.0 MB/s | 230 kB 00:00 2024-05-20T17:20:42.306 INFO:teuthology.orchestra.run.smithi135.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-05-20T17:20:42.331 INFO:teuthology.orchestra.run.smithi135.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-05-20T17:20:42.357 INFO:teuthology.orchestra.run.smithi135.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-20T17:20:42.363 INFO:teuthology.orchestra.run.smithi172.stdout:(35/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 2.8 MB/s | 264 kB 00:00 2024-05-20T17:20:42.432 INFO:teuthology.orchestra.run.smithi135.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-20T17:20:42.588 INFO:teuthology.orchestra.run.smithi172.stdout:(36/159): ceph-mgr-diskprediction-local-19.0.0- 7.2 MB/s | 7.4 MB 00:01 2024-05-20T17:20:42.614 INFO:teuthology.orchestra.run.smithi172.stdout:(37/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 3.0 MB/s | 763 kB 00:00 2024-05-20T17:20:42.664 INFO:teuthology.orchestra.run.smithi172.stdout:(38/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 243 kB/s | 18 kB 00:00 2024-05-20T17:20:42.774 INFO:teuthology.orchestra.run.smithi135.stdout:(149/159): NetworkManager-1.47.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-05-20T17:20:42.781 INFO:teuthology.orchestra.run.smithi172.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-05-20T17:20:42.848 INFO:teuthology.orchestra.run.smithi172.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-05-20T17:20:42.873 INFO:teuthology.orchestra.run.smithi172.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-05-20T17:20:42.898 INFO:teuthology.orchestra.run.smithi172.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-05-20T17:20:42.958 INFO:teuthology.orchestra.run.smithi135.stdout:(150/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 5.1 MB/s | 3.1 MB 00:00 2024-05-20T17:20:43.008 INFO:teuthology.orchestra.run.smithi135.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 835 kB/s | 41 kB 00:00 2024-05-20T17:20:43.026 INFO:teuthology.orchestra.run.smithi172.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 8.0 MB/s | 1.2 MB 00:00 2024-05-20T17:20:43.050 INFO:teuthology.orchestra.run.smithi172.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 707 kB/s | 106 kB 00:00 2024-05-20T17:20:43.059 INFO:teuthology.orchestra.run.smithi135.stdout:(152/159): NetworkManager-libnm-1.47.90-1.el9.x 6.3 MB/s | 1.8 MB 00:00 2024-05-20T17:20:43.075 INFO:teuthology.orchestra.run.smithi172.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-05-20T17:20:43.100 INFO:teuthology.orchestra.run.smithi172.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-20T17:20:43.109 INFO:teuthology.orchestra.run.smithi135.stdout:(153/159): librados2-19.0.0-2744.gd2b507c7.el9. 4.3 MB/s | 3.3 MB 00:00 2024-05-20T17:20:43.110 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.125 INFO:teuthology.orchestra.run.smithi172.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-20T17:20:43.139 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.168 INFO:teuthology.orchestra.run.smithi135.stdout:(154/159): NetworkManager-tui-1.47.90-1.el9.x86 1.5 MB/s | 248 kB 00:00 2024-05-20T17:20:43.201 INFO:teuthology.orchestra.run.smithi172.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-05-20T17:20:43.243 INFO:teuthology.orchestra.run.smithi172.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-05-20T17:20:43.276 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.277 INFO:teuthology.orchestra.run.smithi172.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-05-20T17:20:43.309 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.338 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.368 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:43.457 INFO:teuthology.orchestra.run.smithi160.stdout:(7/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 2.4 MB/s | 4.9 MB 00:02 2024-05-20T17:20:43.694 INFO:teuthology.orchestra.run.smithi172.stdout:(51/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 11 MB/s | 46 MB 00:04 2024-05-20T17:20:43.694 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:43.752 INFO:teuthology.orchestra.run.smithi172.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-05-20T17:20:43.786 INFO:teuthology.orchestra.run.smithi172.stdout:(53/159): flex-2.6.4-9.el9.x86_64.rpm 616 kB/s | 313 kB 00:00 2024-05-20T17:20:43.787 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:43.806 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:43.815 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:43.836 INFO:teuthology.orchestra.run.smithi172.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 370 kB/s | 18 kB 00:00 2024-05-20T17:20:43.878 INFO:teuthology.orchestra.run.smithi172.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-05-20T17:20:43.881 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-05-20T17:20:43.962 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:44.028 INFO:teuthology.orchestra.run.smithi172.stdout:(57/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-20T17:20:44.095 INFO:teuthology.orchestra.run.smithi172.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-05-20T17:20:44.139 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:44.157 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.162 INFO:teuthology.orchestra.run.smithi172.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-05-20T17:20:44.192 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:44.196 INFO:teuthology.orchestra.run.smithi172.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-05-20T17:20:44.210 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.211 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.238 INFO:teuthology.orchestra.run.smithi172.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 343 kB/s | 25 kB 00:00 2024-05-20T17:20:44.261 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.263 INFO:teuthology.orchestra.run.smithi172.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-05-20T17:20:44.263 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.270 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:44.280 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.328 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.330 INFO:teuthology.orchestra.run.smithi172.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-20T17:20:44.355 INFO:teuthology.orchestra.run.smithi172.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-20T17:20:44.356 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:44.364 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.382 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.386 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.397 INFO:teuthology.orchestra.run.smithi172.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 525 kB/s | 35 kB 00:00 2024-05-20T17:20:44.400 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.414 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.423 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T17:20:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.486 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.497 INFO:teuthology.orchestra.run.smithi172.stdout:(66/159): elfutils-libelf-devel-0.191-4.el9.x86 17 kB/s | 22 kB 00:01 2024-05-20T17:20:44.538 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.561 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.586 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:44.605 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.623 INFO:teuthology.orchestra.run.smithi172.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-05-20T17:20:44.625 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.686 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.690 INFO:teuthology.orchestra.run.smithi172.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-20T17:20:44.743 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.748 INFO:teuthology.orchestra.run.smithi172.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-20T17:20:44.778 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.782 INFO:teuthology.orchestra.run.smithi172.stdout:(70/159): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-20T17:20:44.790 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.824 INFO:teuthology.orchestra.run.smithi172.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 4.4 MB/s | 911 kB 00:00 2024-05-20T17:20:44.837 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:44.837 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.883 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.883 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.891 INFO:teuthology.orchestra.run.smithi172.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-20T17:20:44.901 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.918 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:44.925 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:44.935 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:44.941 INFO:teuthology.orchestra.run.smithi172.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 6.3 MB/s | 1.0 MB 00:00 2024-05-20T17:20:44.942 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:44.944 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:44.949 INFO:teuthology.orchestra.run.smithi160.stdout:(8/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 2.8 MB/s | 19 MB 00:06 2024-05-20T17:20:44.959 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:44.980 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:44.980 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:45.020 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:45.058 INFO:teuthology.orchestra.run.smithi160.stdout:(9/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el9 6.2 MB/s | 9.8 MB 00:01 2024-05-20T17:20:45.070 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:45.071 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:45.074 INFO:teuthology.orchestra.run.smithi160.stdout:(10/159): ceph-selinux-19.0.0-2744.gd2b507c7.el 201 kB/s | 25 kB 00:00 2024-05-20T17:20:45.079 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:20:45.099 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.141 INFO:teuthology.orchestra.run.smithi160.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 3.2 MB/s | 221 kB 00:00 2024-05-20T17:20:45.175 INFO:teuthology.orchestra.run.smithi160.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 813 kB/s | 27 kB 00:00 2024-05-20T17:20:45.176 INFO:teuthology.orchestra.run.smithi172.stdout:(74/159): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-05-20T17:20:45.209 INFO:teuthology.orchestra.run.smithi160.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 951 kB/s | 32 kB 00:00 2024-05-20T17:20:45.238 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.240 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.242 INFO:teuthology.orchestra.run.smithi172.stdout:(75/159): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-20T17:20:45.242 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.244 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.259 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:45.317 INFO:teuthology.orchestra.run.smithi172.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-05-20T17:20:45.327 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:45.359 INFO:teuthology.orchestra.run.smithi160.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 4.9 MB/s | 756 kB 00:00 2024-05-20T17:20:45.367 INFO:teuthology.orchestra.run.smithi172.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 521 kB/s | 26 kB 00:00 2024-05-20T17:20:45.409 INFO:teuthology.orchestra.run.smithi160.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 3.1 MB/s | 158 kB 00:00 2024-05-20T17:20:45.418 INFO:teuthology.orchestra.run.smithi172.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-05-20T17:20:45.426 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.460 INFO:teuthology.orchestra.run.smithi160.stdout:(16/159): librados-devel-19.0.0-2744.gd2b507c7. 2.5 MB/s | 127 kB 00:00 2024-05-20T17:20:45.485 INFO:teuthology.orchestra.run.smithi172.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-20T17:20:45.506 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.535 INFO:teuthology.orchestra.run.smithi172.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-05-20T17:20:45.560 INFO:teuthology.orchestra.run.smithi160.stdout:(17/159): libradosstriper1-19.0.0-2744.gd2b507c 4.9 MB/s | 497 kB 00:00 2024-05-20T17:20:45.616 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.631 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.656 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:45.660 INFO:teuthology.orchestra.run.smithi172.stdout:(81/159): python3-jinja2-2.11.3-6.el9.noarch.rp 594 kB/s | 248 kB 00:00 2024-05-20T17:20:45.693 INFO:teuthology.orchestra.run.smithi135.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 14 kB/s | 37 kB 00:02 2024-05-20T17:20:45.719 INFO:teuthology.orchestra.run.smithi172.stdout:(82/159): python3-colorama-0.4.6-3.el9.noarch.r 79 kB/s | 61 kB 00:00 2024-05-20T17:20:45.727 INFO:teuthology.orchestra.run.smithi160.stdout:(18/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 4.4 MB/s | 18 MB 00:04 2024-05-20T17:20:45.744 INFO:teuthology.orchestra.run.smithi172.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-05-20T17:20:45.769 INFO:teuthology.orchestra.run.smithi160.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 1.1 MB/s | 45 kB 00:00 2024-05-20T17:20:45.801 INFO:teuthology.orchestra.run.smithi135.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 77 kB/s | 207 kB 00:02 2024-05-20T17:20:45.803 INFO:teuthology.orchestra.run.smithi172.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-20T17:20:45.819 INFO:teuthology.orchestra.run.smithi160.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 2.6 MB/s | 135 kB 00:00 2024-05-20T17:20:45.827 INFO:teuthology.orchestra.run.smithi135.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 100 kB/s | 260 kB 00:02 2024-05-20T17:20:45.828 INFO:teuthology.orchestra.run.smithi172.stdout:(85/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-20T17:20:45.869 INFO:teuthology.orchestra.run.smithi160.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 3.2 MB/s | 161 kB 00:00 2024-05-20T17:20:45.878 INFO:teuthology.orchestra.run.smithi172.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-05-20T17:20:45.945 INFO:teuthology.orchestra.run.smithi172.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-05-20T17:20:45.970 INFO:teuthology.orchestra.run.smithi160.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 3.1 MB/s | 320 kB 00:00 2024-05-20T17:20:46.004 INFO:teuthology.orchestra.run.smithi172.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-05-20T17:20:46.037 INFO:teuthology.orchestra.run.smithi160.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 4.4 MB/s | 299 kB 00:00 2024-05-20T17:20:46.054 INFO:teuthology.orchestra.run.smithi172.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-20T17:20:46.060 INFO:teuthology.orchestra.run.smithi135.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 1.3 MB 00:00 2024-05-20T17:20:46.087 INFO:teuthology.orchestra.run.smithi160.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 1.9 MB/s | 99 kB 00:00 2024-05-20T17:20:46.096 INFO:teuthology.orchestra.run.smithi172.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-05-20T17:20:46.113 INFO:teuthology.orchestra.run.smithi172.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 918 kB/s | 54 kB 00:00 2024-05-20T17:20:46.137 INFO:teuthology.orchestra.run.smithi160.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-20T17:20:46.163 INFO:teuthology.orchestra.run.smithi172.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-05-20T17:20:46.214 INFO:teuthology.orchestra.run.smithi172.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-05-20T17:20:46.306 INFO:teuthology.orchestra.run.smithi172.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-05-20T17:20:46.348 INFO:teuthology.orchestra.run.smithi172.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 861 kB/s | 36 kB 00:00 2024-05-20T17:20:46.379 INFO:teuthology.orchestra.run.smithi160.stdout:(26/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 6.1 MB/s | 5.0 MB 00:00 2024-05-20T17:20:46.398 INFO:teuthology.orchestra.run.smithi172.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-05-20T17:20:46.429 INFO:teuthology.orchestra.run.smithi160.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 3.3 MB/s | 169 kB 00:00 2024-05-20T17:20:46.480 INFO:teuthology.orchestra.run.smithi160.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 637 kB/s | 32 kB 00:00 2024-05-20T17:20:46.482 INFO:teuthology.orchestra.run.smithi172.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-20T17:20:46.494 INFO:teuthology.orchestra.run.smithi135.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-05-20T17:20:46.498 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:20:46.498 INFO:teuthology.orchestra.run.smithi135.stdout:Total 14 MB/s | 222 MB 00:15 2024-05-20T17:20:46.530 INFO:teuthology.orchestra.run.smithi160.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 2.8 MB/s | 142 kB 00:00 2024-05-20T17:20:46.540 INFO:teuthology.orchestra.run.smithi172.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 995 kB/s | 58 kB 00:00 2024-05-20T17:20:46.607 INFO:teuthology.orchestra.run.smithi172.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-05-20T17:20:46.622 INFO:teuthology.orchestra.run.smithi160.stdout:(30/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 6.3 MB/s | 3.0 MB 00:00 2024-05-20T17:20:46.766 INFO:teuthology.orchestra.run.smithi172.stdout:(100/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-05-20T17:20:46.808 INFO:teuthology.orchestra.run.smithi172.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-05-20T17:20:46.825 INFO:teuthology.orchestra.run.smithi172.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-05-20T17:20:46.867 INFO:teuthology.orchestra.run.smithi172.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 382 kB/s | 22 kB 00:00 2024-05-20T17:20:47.001 INFO:teuthology.orchestra.run.smithi172.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-05-20T17:20:47.014 INFO:teuthology.orchestra.run.smithi160.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 7.3 MB/s | 3.5 MB 00:00 2024-05-20T17:20:47.081 INFO:teuthology.orchestra.run.smithi160.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 3.7 MB/s | 249 kB 00:00 2024-05-20T17:20:47.131 INFO:teuthology.orchestra.run.smithi160.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 988 kB/s | 49 kB 00:00 2024-05-20T17:20:47.181 INFO:teuthology.orchestra.run.smithi160.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2744.gd 329 kB/s | 16 kB 00:00 2024-05-20T17:20:47.282 INFO:teuthology.orchestra.run.smithi160.stdout:(35/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 2.6 MB/s | 264 kB 00:00 2024-05-20T17:20:47.407 INFO:teuthology.orchestra.run.smithi160.stdout:(36/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 6.0 MB/s | 763 kB 00:00 2024-05-20T17:20:47.451 INFO:teuthology.orchestra.run.smithi172.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 939 kB/s | 548 kB 00:00 2024-05-20T17:20:47.457 INFO:teuthology.orchestra.run.smithi160.stdout:(37/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 364 kB/s | 18 kB 00:00 2024-05-20T17:20:47.516 INFO:teuthology.orchestra.run.smithi160.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-05-20T17:20:47.551 INFO:teuthology.orchestra.run.smithi172.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 195 kB/s | 19 kB 00:00 2024-05-20T17:20:47.625 INFO:teuthology.orchestra.run.smithi160.stdout:(39/159): ceph-mgr-diskprediction-local-19.0.0- 7.4 MB/s | 7.4 MB 00:01 2024-05-20T17:20:47.676 INFO:teuthology.orchestra.run.smithi172.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 457 kB/s | 309 kB 00:00 2024-05-20T17:20:47.695 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-20T17:20:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-05-20T17:20:47.725 INFO:teuthology.orchestra.run.smithi160.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-05-20T17:20:47.776 INFO:teuthology.orchestra.run.smithi172.stdout:(108/159): python3-numpy-1.20.1-5.el9.x86_64.rp 2.3 MB/s | 5.1 MB 00:02 2024-05-20T17:20:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-20T17:20:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-05-20T17:20:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-05-20T17:20:47.854 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-20T17:20:47.854 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-20T17:20:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-05-20T17:20:47.910 INFO:teuthology.orchestra.run.smithi172.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-05-20T17:20:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-05-20T17:20:47.977 INFO:teuthology.orchestra.run.smithi160.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-05-20T17:20:48.035 INFO:teuthology.orchestra.run.smithi160.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-20T17:20:48.128 INFO:teuthology.orchestra.run.smithi172.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 138 kB/s | 49 kB 00:00 2024-05-20T17:20:48.178 INFO:teuthology.orchestra.run.smithi172.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 567 kB/s | 151 kB 00:00 2024-05-20T17:20:48.361 INFO:teuthology.orchestra.run.smithi160.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-05-20T17:20:48.394 INFO:teuthology.orchestra.run.smithi160.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-05-20T17:20:48.428 INFO:teuthology.orchestra.run.smithi160.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-20T17:20:48.437 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:48.478 INFO:teuthology.orchestra.run.smithi172.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.3 MB/s | 839 kB 00:00 2024-05-20T17:20:48.578 INFO:teuthology.orchestra.run.smithi172.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2024-05-20T17:20:48.603 INFO:teuthology.orchestra.run.smithi160.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-05-20T17:20:48.646 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:48.670 INFO:teuthology.orchestra.run.smithi160.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 502 kB/s | 33 kB 00:00 2024-05-20T17:20:48.687 INFO:teuthology.orchestra.run.smithi172.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2024-05-20T17:20:48.719 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:48.729 INFO:teuthology.orchestra.run.smithi172.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 215 kB/s | 32 kB 00:00 2024-05-20T17:20:48.993 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:48.993 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:48.993 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:48.994 INFO:teuthology.orchestra.run.smithi172.stdout:(117/159): libarrow-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-20T17:20:48.994 INFO:teuthology.orchestra.run.smithi172.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-05-20T17:20:48.994 INFO:teuthology.orchestra.run.smithi172.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-20T17:20:48.994 INFO:teuthology.orchestra.run.smithi172.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-05-20T17:20:48.994 INFO:teuthology.orchestra.run.smithi172.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-05-20T17:20:48.996 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:49.055 INFO:teuthology.orchestra.run.smithi172.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-20T17:20:49.081 INFO:teuthology.orchestra.run.smithi172.stdout:(123/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-05-20T17:20:49.148 INFO:teuthology.orchestra.run.smithi172.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-05-20T17:20:49.173 INFO:teuthology.orchestra.run.smithi172.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-05-20T17:20:49.204 INFO:teuthology.orchestra.run.smithi160.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.6 MB/s | 3.0 MB 00:00 2024-05-20T17:20:49.254 INFO:teuthology.orchestra.run.smithi160.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-05-20T17:20:49.256 INFO:teuthology.orchestra.run.smithi172.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-05-20T17:20:49.264 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:49.274 INFO:teuthology.orchestra.run.smithi172.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-05-20T17:20:49.304 INFO:teuthology.orchestra.run.smithi160.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 227 kB/s | 11 kB 00:00 2024-05-20T17:20:49.338 INFO:teuthology.orchestra.run.smithi160.stdout:(56/159): elfutils-libelf-devel-0.191-4.el9.x86 23 kB/s | 22 kB 00:00 2024-05-20T17:20:49.341 INFO:teuthology.orchestra.run.smithi172.stdout:(128/159): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-05-20T17:20:49.358 INFO:teuthology.orchestra.run.smithi172.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-05-20T17:20:49.363 INFO:teuthology.orchestra.run.smithi160.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-20T17:20:49.425 INFO:teuthology.orchestra.run.smithi172.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 553 kB/s | 46 kB 00:00 2024-05-20T17:20:49.447 INFO:teuthology.orchestra.run.smithi160.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-05-20T17:20:49.458 INFO:teuthology.orchestra.run.smithi172.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-05-20T17:20:49.472 INFO:teuthology.orchestra.run.smithi160.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-20T17:20:49.509 INFO:teuthology.orchestra.run.smithi172.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-05-20T17:20:49.531 INFO:teuthology.orchestra.run.smithi160.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-05-20T17:20:49.559 INFO:teuthology.orchestra.run.smithi172.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-05-20T17:20:49.601 INFO:teuthology.orchestra.run.smithi172.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-05-20T17:20:49.606 INFO:teuthology.orchestra.run.smithi160.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 635 kB/s | 47 kB 00:00 2024-05-20T17:20:49.631 INFO:teuthology.orchestra.run.smithi160.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 582 kB 00:00 2024-05-20T17:20:49.651 INFO:teuthology.orchestra.run.smithi172.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 978 kB/s | 90 kB 00:00 2024-05-20T17:20:49.673 INFO:teuthology.orchestra.run.smithi160.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-05-20T17:20:49.693 INFO:teuthology.orchestra.run.smithi172.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-05-20T17:20:49.698 INFO:teuthology.orchestra.run.smithi160.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-05-20T17:20:49.732 INFO:teuthology.orchestra.run.smithi160.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-05-20T17:20:49.743 INFO:teuthology.orchestra.run.smithi172.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-05-20T17:20:49.794 INFO:teuthology.orchestra.run.smithi172.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-20T17:20:49.827 INFO:teuthology.orchestra.run.smithi172.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-05-20T17:20:49.894 INFO:teuthology.orchestra.run.smithi172.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-05-20T17:20:49.920 INFO:teuthology.orchestra.run.smithi172.stdout:(141/159): python3-kubernetes-26.1.0-2.el9.noar 1.6 MB/s | 1.0 MB 00:00 2024-05-20T17:20:49.945 INFO:teuthology.orchestra.run.smithi172.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 434 kB/s | 51 kB 00:00 2024-05-20T17:20:49.995 INFO:teuthology.orchestra.run.smithi172.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-20T17:20:49.997 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-20T17:20:49.998 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-20T17:20:50.021 INFO:teuthology.orchestra.run.smithi172.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-05-20T17:20:50.054 INFO:teuthology.orchestra.run.smithi172.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-05-20T17:20:50.087 INFO:teuthology.orchestra.run.smithi172.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-05-20T17:20:50.188 INFO:teuthology.orchestra.run.smithi172.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-20T17:20:50.238 INFO:teuthology.orchestra.run.smithi172.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-05-20T17:20:50.416 INFO:teuthology.orchestra.run.smithi160.stdout:(66/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 8.7 MB/s | 46 MB 00:05 2024-05-20T17:20:50.430 INFO:teuthology.orchestra.run.smithi172.stdout:(149/159): librados2-19.0.0-2744.gd2b507c7.el9. 9.7 MB/s | 3.3 MB 00:00 2024-05-20T17:20:50.491 INFO:teuthology.orchestra.run.smithi160.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 6.0 MB/s | 4.7 MB 00:00 2024-05-20T17:20:50.522 INFO:teuthology.orchestra.run.smithi172.stdout:(150/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-05-20T17:20:50.564 INFO:teuthology.orchestra.run.smithi172.stdout:(151/159): NetworkManager-1.47.90-1.el9.x86_64. 7.1 MB/s | 2.3 MB 00:00 2024-05-20T17:20:50.583 INFO:teuthology.orchestra.run.smithi160.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-05-20T17:20:50.614 INFO:teuthology.orchestra.run.smithi172.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-05-20T17:20:50.642 INFO:teuthology.orchestra.run.smithi160.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-20T17:20:50.656 INFO:teuthology.orchestra.run.smithi172.stdout:(153/159): NetworkManager-team-1.47.90-1.el9.x8 310 kB/s | 41 kB 00:00 2024-05-20T17:20:50.657 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.675 INFO:teuthology.orchestra.run.smithi160.stdout:(70/159): postgresql-contrib-13.14-1.el9.x86_64 4.8 MB/s | 911 kB 00:00 2024-05-20T17:20:50.681 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.782 INFO:teuthology.orchestra.run.smithi172.stdout:(154/159): NetworkManager-libnm-1.47.90-1.el9.x 5.1 MB/s | 1.8 MB 00:00 2024-05-20T17:20:50.784 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.784 INFO:teuthology.orchestra.run.smithi160.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-05-20T17:20:50.806 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.806 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.817 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:50.829 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:50.840 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:50.842 INFO:teuthology.orchestra.run.smithi160.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-20T17:20:50.846 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:50.876 INFO:teuthology.orchestra.run.smithi160.stdout:(73/159): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-05-20T17:20:50.885 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:50.909 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:50.914 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T17:20:50.947 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T17:20:50.966 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:20:50.972 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:50.995 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:20:51.018 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:20:51.031 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:51.041 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:20:51.058 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:51.063 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:51.115 INFO:teuthology.orchestra.run.smithi172.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 73 kB/s | 37 kB 00:00 2024-05-20T17:20:51.116 INFO:teuthology.orchestra.run.smithi172.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:51.160 INFO:teuthology.orchestra.run.smithi160.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-20T17:20:51.170 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:51.191 INFO:teuthology.orchestra.run.smithi172.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-05-20T17:20:51.216 INFO:teuthology.orchestra.run.smithi172.stdout:(157/159): elfutils-libelf-0.191-4.el9.x86_64.r 370 kB/s | 207 kB 00:00 2024-05-20T17:20:51.241 INFO:teuthology.orchestra.run.smithi172.stdout:(158/159): elfutils-libs-0.191-4.el9.x86_64.rpm 567 kB/s | 260 kB 00:00 2024-05-20T17:20:51.268 INFO:teuthology.orchestra.run.smithi160.stdout:(75/159): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-05-20T17:20:51.283 INFO:teuthology.orchestra.run.smithi172.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-05-20T17:20:51.287 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:20:51.287 INFO:teuthology.orchestra.run.smithi172.stdout:Total 14 MB/s | 222 MB 00:15 2024-05-20T17:20:51.294 INFO:teuthology.orchestra.run.smithi160.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-05-20T17:20:51.301 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T17:20:51.344 INFO:teuthology.orchestra.run.smithi160.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-05-20T17:20:51.344 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T17:20:51.361 INFO:teuthology.orchestra.run.smithi160.stdout:(78/159): python3-colorama-0.4.6-3.el9.noarch.r 126 kB/s | 61 kB 00:00 2024-05-20T17:20:51.364 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:20:51.403 INFO:teuthology.orchestra.run.smithi160.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-05-20T17:20:51.403 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:20:51.428 INFO:teuthology.orchestra.run.smithi160.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-20T17:20:51.428 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:20:51.453 INFO:teuthology.orchestra.run.smithi160.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-05-20T17:20:51.454 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:20:51.472 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:51.529 INFO:teuthology.orchestra.run.smithi160.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-05-20T17:20:51.539 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:20:51.588 INFO:teuthology.orchestra.run.smithi160.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-05-20T17:20:51.646 INFO:teuthology.orchestra.run.smithi160.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-20T17:20:51.688 INFO:teuthology.orchestra.run.smithi160.stdout:(85/159): python3-jinja2-2.11.3-6.el9.noarch.rp 592 kB/s | 248 kB 00:00 2024-05-20T17:20:51.713 INFO:teuthology.orchestra.run.smithi160.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-05-20T17:20:51.780 INFO:teuthology.orchestra.run.smithi160.stdout:(87/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-05-20T17:20:51.805 INFO:teuthology.orchestra.run.smithi160.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-20T17:20:51.831 INFO:teuthology.orchestra.run.smithi160.stdout:(89/159): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-05-20T17:20:51.856 INFO:teuthology.orchestra.run.smithi160.stdout:(90/159): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-20T17:20:51.881 INFO:teuthology.orchestra.run.smithi160.stdout:(91/159): python3-pytz-2021.1-5.el9.noarch.rpm 673 kB/s | 51 kB 00:00 2024-05-20T17:20:51.906 INFO:teuthology.orchestra.run.smithi160.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-05-20T17:20:51.940 INFO:teuthology.orchestra.run.smithi160.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-05-20T17:20:51.974 INFO:teuthology.orchestra.run.smithi160.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 658 kB/s | 44 kB 00:00 2024-05-20T17:20:51.999 INFO:teuthology.orchestra.run.smithi160.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-20T17:20:52.033 INFO:teuthology.orchestra.run.smithi160.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 609 kB/s | 36 kB 00:00 2024-05-20T17:20:52.066 INFO:teuthology.orchestra.run.smithi160.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-05-20T17:20:52.100 INFO:teuthology.orchestra.run.smithi160.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-05-20T17:20:52.126 INFO:teuthology.orchestra.run.smithi160.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 983 kB/s | 58 kB 00:00 2024-05-20T17:20:52.159 INFO:teuthology.orchestra.run.smithi160.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-05-20T17:20:52.184 INFO:teuthology.orchestra.run.smithi160.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-20T17:20:52.218 INFO:teuthology.orchestra.run.smithi160.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-05-20T17:20:52.251 INFO:teuthology.orchestra.run.smithi160.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-05-20T17:20:52.394 INFO:teuthology.orchestra.run.smithi160.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-05-20T17:20:52.467 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-05-20T17:20:52.552 INFO:teuthology.orchestra.run.smithi160.stdout:(105/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-05-20T17:20:52.577 INFO:teuthology.orchestra.run.smithi160.stdout:(106/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-05-20T17:20:52.611 INFO:teuthology.orchestra.run.smithi160.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-05-20T17:20:52.625 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-05-20T17:20:52.625 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-05-20T17:20:52.636 INFO:teuthology.orchestra.run.smithi160.stdout:(108/159): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-05-20T17:20:52.728 INFO:teuthology.orchestra.run.smithi160.stdout:(109/159): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-05-20T17:20:52.753 INFO:teuthology.orchestra.run.smithi160.stdout:(110/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2024-05-20T17:20:52.778 INFO:teuthology.orchestra.run.smithi160.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 341 kB/s | 49 kB 00:00 2024-05-20T17:20:52.804 INFO:teuthology.orchestra.run.smithi160.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 893 kB/s | 67 kB 00:00 2024-05-20T17:20:52.838 INFO:teuthology.orchestra.run.smithi160.stdout:(113/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-20T17:20:52.863 INFO:teuthology.orchestra.run.smithi160.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 9.1 MB/s | 548 kB 00:00 2024-05-20T17:20:52.888 INFO:teuthology.orchestra.run.smithi160.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-05-20T17:20:52.913 INFO:teuthology.orchestra.run.smithi160.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-05-20T17:20:52.939 INFO:teuthology.orchestra.run.smithi160.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-05-20T17:20:52.964 INFO:teuthology.orchestra.run.smithi160.stdout:(118/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-05-20T17:20:52.989 INFO:teuthology.orchestra.run.smithi160.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-20T17:20:53.014 INFO:teuthology.orchestra.run.smithi160.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-05-20T17:20:53.040 INFO:teuthology.orchestra.run.smithi160.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-20T17:20:53.065 INFO:teuthology.orchestra.run.smithi160.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-20T17:20:53.082 INFO:teuthology.orchestra.run.smithi160.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-20T17:20:53.099 INFO:teuthology.orchestra.run.smithi160.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 319 kB/s | 11 kB 00:00 2024-05-20T17:20:53.124 INFO:teuthology.orchestra.run.smithi160.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 419 kB/s | 18 kB 00:00 2024-05-20T17:20:53.150 INFO:teuthology.orchestra.run.smithi160.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 458 kB/s | 23 kB 00:00 2024-05-20T17:20:53.175 INFO:teuthology.orchestra.run.smithi160.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-05-20T17:20:53.200 INFO:teuthology.orchestra.run.smithi160.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-05-20T17:20:53.251 INFO:teuthology.orchestra.run.smithi160.stdout:(129/159): python3-grpcio-1.46.7-10.el9.x86_64. 8.6 MB/s | 2.0 MB 00:00 2024-05-20T17:20:53.276 INFO:teuthology.orchestra.run.smithi160.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-05-20T17:20:53.301 INFO:teuthology.orchestra.run.smithi160.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-20T17:20:53.335 INFO:teuthology.orchestra.run.smithi160.stdout:(132/159): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-05-20T17:20:53.360 INFO:teuthology.orchestra.run.smithi160.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-05-20T17:20:53.385 INFO:teuthology.orchestra.run.smithi160.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-05-20T17:20:53.411 INFO:teuthology.orchestra.run.smithi160.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-05-20T17:20:53.436 INFO:teuthology.orchestra.run.smithi160.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-05-20T17:20:53.461 INFO:teuthology.orchestra.run.smithi160.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-05-20T17:20:53.486 INFO:teuthology.orchestra.run.smithi160.stdout:(138/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-05-20T17:20:53.512 INFO:teuthology.orchestra.run.smithi160.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-20T17:20:53.537 INFO:teuthology.orchestra.run.smithi160.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-05-20T17:20:53.562 INFO:teuthology.orchestra.run.smithi160.stdout:(141/159): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-20T17:20:53.588 INFO:teuthology.orchestra.run.smithi160.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-05-20T17:20:53.613 INFO:teuthology.orchestra.run.smithi160.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-20T17:20:53.772 INFO:teuthology.orchestra.run.smithi160.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 980 kB/s | 230 kB 00:00 2024-05-20T17:20:53.797 INFO:teuthology.orchestra.run.smithi160.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 108 kB/s | 20 kB 00:00 2024-05-20T17:20:53.822 INFO:teuthology.orchestra.run.smithi160.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 1.8 MB/s | 427 kB 00:00 2024-05-20T17:20:53.847 INFO:teuthology.orchestra.run.smithi160.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-20T17:20:53.881 INFO:teuthology.orchestra.run.smithi160.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-20T17:20:54.064 INFO:teuthology.orchestra.run.smithi160.stdout:(149/159): NetworkManager-1.47.90-1.el9.x86_64. 18 MB/s | 2.3 MB 00:00 2024-05-20T17:20:54.198 INFO:teuthology.orchestra.run.smithi160.stdout:(150/159): NetworkManager-libnm-1.47.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-05-20T17:20:54.257 INFO:teuthology.orchestra.run.smithi160.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 715 kB/s | 41 kB 00:00 2024-05-20T17:20:54.332 INFO:teuthology.orchestra.run.smithi160.stdout:(152/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-05-20T17:20:54.350 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.391 INFO:teuthology.orchestra.run.smithi160.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 1.8 MB/s | 248 kB 00:00 2024-05-20T17:20:54.406 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-05-20T17:20:54.407 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-05-20T17:20:54.433 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.483 INFO:teuthology.orchestra.run.smithi160.stdout:(154/159): librados2-19.0.0-2744.gd2b507c7.el9. 5.0 MB/s | 3.3 MB 00:00 2024-05-20T17:20:54.509 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.553 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.558 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:54.561 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.578 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:20:54.586 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:54.594 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:20:54.719 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:54.744 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:54.754 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:55.078 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:55.093 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:55.132 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:20:55.158 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:55.167 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:55.239 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T17:20:55.296 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:55.331 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:55.355 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.362 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T17:20:55.410 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.410 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.491 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.526 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.527 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.544 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.595 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T17:20:55.612 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.615 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.633 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.634 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:20:55.657 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:55.704 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:55.704 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:55.799 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:55.799 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:55.821 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:20:56.265 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.289 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.317 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-20T17:20:56.322 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.409 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T17:20:56.455 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T17:20:56.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T17:20:56.550 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T17:20:56.576 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T17:20:56.598 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.614 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T17:20:56.640 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T17:20:56.724 INFO:teuthology.orchestra.run.smithi160.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 15 kB/s | 37 kB 00:02 2024-05-20T17:20:56.758 INFO:teuthology.orchestra.run.smithi160.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 88 kB/s | 207 kB 00:02 2024-05-20T17:20:56.783 INFO:teuthology.orchestra.run.smithi160.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 114 kB/s | 260 kB 00:02 2024-05-20T17:20:56.884 INFO:teuthology.orchestra.run.smithi160.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 8.6 MB/s | 1.3 MB 00:00 2024-05-20T17:20:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-20T17:20:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:20:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:Total 11 MB/s | 222 MB 00:19 2024-05-20T17:20:57.029 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T17:20:57.094 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:20:57.220 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:20:57.246 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:20:57.338 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:20:57.361 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:20:57.417 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T17:20:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T17:20:57.675 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T17:20:57.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:20:57.808 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:20:57.838 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:20:57.884 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:20:57.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:20:57.932 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:20:58.125 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:20:58.183 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-20T17:20:58.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:20:58.344 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-20T17:20:58.345 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-20T17:20:58.430 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:20:58.490 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:20:58.599 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:20:58.667 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:20:58.908 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:20:59.019 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T17:20:59.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T17:20:59.158 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T17:20:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T17:20:59.258 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T17:20:59.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T17:20:59.336 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T17:20:59.369 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T17:20:59.397 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T17:20:59.466 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T17:20:59.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T17:20:59.559 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T17:20:59.594 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T17:20:59.670 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T17:20:59.705 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T17:20:59.748 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T17:20:59.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T17:20:59.863 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T17:20:59.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T17:20:59.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T17:21:00.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T17:21:00.125 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-20T17:21:00.126 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-20T17:21:00.164 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T17:21:00.654 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-05-20T17:21:00.680 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T17:21:00.754 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T17:21:00.758 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T17:21:00.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T17:21:00.792 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T17:21:00.833 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T17:21:00.846 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T17:21:00.879 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T17:21:00.882 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T17:21:00.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T17:21:00.912 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T17:21:00.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T17:21:00.954 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T17:21:01.111 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T17:21:01.165 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T17:21:01.219 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T17:21:01.273 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T17:21:01.284 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T17:21:01.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T17:21:01.352 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T17:21:01.397 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T17:21:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:01.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T17:21:01.477 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T17:21:01.515 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:01.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T17:21:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:01.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T17:21:01.661 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:21:01.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T17:21:01.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T17:21:01.738 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T17:21:01.831 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T17:21:01.878 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T17:21:01.935 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T17:21:01.963 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:02.051 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:02.080 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T17:21:02.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:21:02.122 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T17:21:02.126 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:21:02.148 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:21:02.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T17:21:02.170 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:21:02.179 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T17:21:02.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T17:21:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:21:02.396 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T17:21:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T17:21:02.484 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:21:02.488 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T17:21:02.523 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T17:21:02.561 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T17:21:02.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T17:21:02.623 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T17:21:02.637 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:21:02.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T17:21:02.698 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:21:02.699 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T17:21:02.740 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T17:21:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T17:21:02.793 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T17:21:02.876 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:02.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T17:21:02.936 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T17:21:02.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T17:21:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T17:21:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T17:21:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T17:21:03.294 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T17:21:03.357 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T17:21:03.392 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T17:21:03.456 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T17:21:03.491 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T17:21:03.535 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T17:21:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T17:21:03.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T17:21:03.663 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T17:21:03.717 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T17:21:03.748 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T17:21:03.792 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T17:21:03.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T17:21:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T17:21:03.902 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T17:21:03.935 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T17:21:03.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T17:21:03.965 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T17:21:03.968 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T17:21:04.034 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T17:21:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T17:21:04.080 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T17:21:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T17:21:04.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T17:21:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T17:21:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T17:21:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T17:21:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T17:21:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T17:21:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T17:21:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T17:21:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T17:21:04.869 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T17:21:04.953 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T17:21:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T17:21:05.018 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T17:21:05.059 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T17:21:05.089 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T17:21:05.133 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T17:21:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T17:21:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T17:21:05.335 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T17:21:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T17:21:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T17:21:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T17:21:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T17:21:05.545 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T17:21:05.592 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T17:21:05.628 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T17:21:05.671 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T17:21:05.712 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T17:21:05.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T17:21:05.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T17:21:05.931 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T17:21:06.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T17:21:06.098 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T17:21:06.138 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T17:21:06.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T17:21:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T17:21:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T17:21:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T17:21:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T17:21:06.448 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T17:21:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T17:21:06.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T17:21:06.604 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-20T17:21:06.605 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T17:21:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T17:21:06.679 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T17:21:06.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T17:21:06.719 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T17:21:06.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T17:21:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T17:21:06.772 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T17:21:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T17:21:06.806 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T17:21:06.831 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T17:21:06.835 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T17:21:06.869 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T17:21:06.874 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T17:21:06.910 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T17:21:06.944 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T17:21:07.052 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T17:21:07.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T17:21:07.088 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:07.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T17:21:07.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T17:21:07.169 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:07.177 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T17:21:07.200 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T17:21:07.218 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T17:21:07.245 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T17:21:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T17:21:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T17:21:07.340 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:07.468 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:07.500 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:07.583 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:07.612 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:21:07.645 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T17:21:07.721 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T17:21:07.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:07.851 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T17:21:07.854 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:07.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T17:21:07.910 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T17:21:07.938 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:08.040 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T17:21:08.042 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:08.064 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:21:08.087 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T17:21:08.121 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T17:21:08.127 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:21:08.149 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:21:08.174 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:21:08.219 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T17:21:08.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T17:21:08.320 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T17:21:08.340 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:21:08.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T17:21:08.449 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T17:21:08.469 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:21:08.628 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T17:21:08.645 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:21:08.654 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T17:21:08.689 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:21:08.733 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T17:21:08.779 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:08.849 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:09.061 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:21:09.196 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T17:21:09.296 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T17:21:09.338 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T17:21:09.373 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T17:21:09.382 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T17:21:09.448 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T17:21:09.489 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T17:21:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T17:21:09.532 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T17:21:09.556 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T17:21:09.584 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T17:21:09.655 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T17:21:09.718 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T17:21:09.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T17:21:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T17:21:09.869 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T17:21:09.901 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T17:21:09.944 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T17:21:09.973 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T17:21:10.047 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T17:21:10.088 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T17:21:10.132 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:10.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:10.165 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T17:21:10.301 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T17:21:10.358 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T17:21:10.719 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T17:21:10.722 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:10.800 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T17:21:10.828 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T17:21:10.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T17:21:10.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T17:21:11.003 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:11.003 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T17:21:11.003 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T17:21:11.003 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:11.005 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T17:21:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:11.066 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T17:21:11.101 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T17:21:11.150 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T17:21:11.182 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T17:21:11.188 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T17:21:11.224 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:11.231 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T17:21:11.315 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:11.346 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T17:21:11.382 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T17:21:11.388 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T17:21:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T17:21:11.514 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T17:21:11.588 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T17:21:11.625 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T17:21:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T17:21:11.726 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T17:21:11.764 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T17:21:11.805 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T17:21:11.855 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T17:21:11.862 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T17:21:11.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:11.940 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:11.971 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T17:21:11.997 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T17:21:12.040 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T17:21:12.173 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T17:21:12.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T17:21:12.314 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T17:21:12.354 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T17:21:12.380 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T17:21:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T17:21:12.482 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T17:21:12.610 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T17:21:12.653 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T17:21:12.681 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T17:21:12.715 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T17:21:12.763 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T17:21:12.795 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T17:21:12.824 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T17:21:12.858 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T17:21:12.892 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T17:21:12.933 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T17:21:12.967 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T17:21:13.050 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T17:21:13.098 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T17:21:13.129 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T17:21:13.177 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T17:21:13.286 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T17:21:13.339 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T17:21:14.101 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T17:21:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:14.144 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T17:21:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:14.178 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T17:21:14.281 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T17:21:14.342 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T17:21:14.387 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T17:21:14.477 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T17:21:14.513 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T17:21:14.693 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T17:21:14.727 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T17:21:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:14.806 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T17:21:14.855 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:14.855 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T17:21:14.856 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T17:21:14.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:14.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:15.481 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T17:21:15.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T17:21:16.910 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T17:21:16.980 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T17:21:17.008 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T17:21:17.041 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T17:21:17.363 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T17:21:17.404 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:17.503 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:21:17.534 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T17:21:17.569 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T17:21:18.042 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T17:21:18.073 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:18.144 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:21:18.175 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T17:21:20.396 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:20.438 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:20.993 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:21:21.041 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:21.118 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:21:21.118 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T17:21:21.118 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T17:21:21.118 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:21.150 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-20T17:21:23.281 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:23.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:23.472 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:23.473 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:23.473 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T17:21:23.473 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:25.110 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:25.136 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:25.136 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:25.136 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T17:21:25.137 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:25.137 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:25.137 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:25.360 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:25.384 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:25.384 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:25.384 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T17:21:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:25.385 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:25.852 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:25.876 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:25.974 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T17:21:26.031 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T17:21:26.085 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T17:21:26.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T17:21:26.328 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-05-20T17:21:26.368 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-05-20T17:21:26.369 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:26.406 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T17:21:26.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T17:21:26.527 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:26.541 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:26.541 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:26.542 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T17:21:26.542 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:26.633 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T17:21:26.670 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T17:21:26.717 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T17:21:26.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T17:21:27.242 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:27.269 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:27.300 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T17:21:27.363 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T17:21:27.401 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:28.121 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:28.146 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:28.146 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:28.146 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T17:21:28.146 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:28.147 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:28.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:28.425 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:28.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:28.856 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:28.878 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:28.878 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:28.879 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T17:21:28.879 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:28.879 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:28.879 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:28.978 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T17:21:29.034 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T17:21:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T17:21:29.274 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T17:21:29.340 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T17:21:29.408 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T17:21:29.427 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:29.452 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:29.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T17:21:29.554 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:29.646 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T17:21:29.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T17:21:29.709 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T17:21:29.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T17:21:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:29.750 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T17:21:29.761 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:29.761 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:29.761 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T17:21:29.762 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:29.762 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:29.762 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:29.816 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:29.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T17:21:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T17:21:30.193 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:30.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:30.255 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T17:21:30.316 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T17:21:30.346 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:30.887 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T17:21:30.914 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:30.938 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:30.981 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:31.004 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:31.004 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T17:21:31.004 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:31.049 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:31.074 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:31.377 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:31.389 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:31.406 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:31.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:32.491 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:32.655 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T17:21:32.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:32.715 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:32.715 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T17:21:32.715 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:32.716 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:32.716 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:32.756 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:21:32.756 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-05-20T17:21:32.757 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:32.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:32.770 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:32.869 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T17:21:32.924 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T17:21:32.928 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:32.947 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:21:32.947 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:32.947 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T17:21:32.947 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T17:21:33.887 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:33.909 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:33.909 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:33.910 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T17:21:33.910 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:33.910 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:33.910 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:33.954 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:33.975 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:33.976 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:33.976 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T17:21:33.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:34.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:34.043 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:34.043 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:34.043 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T17:21:34.043 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:34.044 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:34.044 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:34.524 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:34.549 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:21:34.549 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:34.549 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T17:21:34.549 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:34.550 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:21:34.550 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:34.774 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:21:34.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:35.258 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:21:35.281 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:35.405 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T17:21:35.463 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T17:21:35.519 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T17:21:35.708 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T17:21:35.759 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T17:21:35.839 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T17:21:35.936 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T17:21:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T17:21:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T17:21:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T17:21:36.077 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T17:21:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T17:21:36.126 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T17:21:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T17:21:36.158 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T17:21:36.185 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T17:21:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T17:21:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T17:21:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T17:21:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T17:21:36.490 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T17:21:36.528 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:36.645 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:36.675 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:21:36.707 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T17:21:36.770 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T17:21:36.806 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:37.145 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:37.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:37.205 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:37.861 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:21:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:38.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T17:21:38.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T17:21:38.155 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T17:21:38.248 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T17:21:38.292 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T17:21:38.317 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:38.342 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T17:21:38.369 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:38.369 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:38.453 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:38.486 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T17:21:38.486 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:38.579 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:38.604 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T17:21:38.609 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:38.610 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:38.798 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:38.798 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:21:38.882 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:38.906 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T17:21:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:38.925 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T17:21:38.966 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T17:21:38.972 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:39.007 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T17:21:39.016 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:21:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T17:21:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T17:21:39.183 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T17:21:39.210 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:39.233 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:21:39.233 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:39.234 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T17:21:39.234 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:39.234 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:21:39.234 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:39.248 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T17:21:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:39.295 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T17:21:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:21:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T17:21:39.360 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T17:21:39.390 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T17:21:39.395 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T17:21:39.436 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:39.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T17:21:39.973 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:40.359 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T17:21:40.405 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:40.428 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:21:40.428 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:40.428 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T17:21:40.428 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:40.428 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:21:40.429 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:40.472 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:40.495 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:21:40.495 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:40.495 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T17:21:40.495 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:40.539 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:40.562 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:21:40.562 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:40.562 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T17:21:40.562 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:40.563 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:21:40.563 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:40.867 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T17:21:40.873 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:21:40.896 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:40.954 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T17:21:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T17:21:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T17:21:41.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T17:21:41.133 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:41.158 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T17:21:41.185 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:41.185 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:41.261 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:41.285 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T17:21:41.285 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:41.353 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T17:21:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:41.563 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:41.563 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:41.630 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:41.655 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T17:21:41.719 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:44.910 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:44.910 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T17:21:44.910 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T17:21:44.910 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T17:21:44.910 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T17:21:44.911 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T17:21:44.912 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T17:21:44.913 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T17:21:44.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T17:21:44.915 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T17:21:44.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T17:21:44.917 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T17:21:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T17:21:44.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T17:21:44.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T17:21:44.921 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T17:21:44.922 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T17:21:44.923 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T17:21:44.924 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T17:21:45.452 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T17:21:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T17:21:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T17:21:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T17:21:45.602 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T17:21:45.796 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T17:21:45.839 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T17:21:45.880 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T17:21:45.912 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T17:21:45.941 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T17:21:45.988 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:46.572 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:46.610 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:46.631 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:21:47.499 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T17:21:47.581 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:47.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T17:21:47.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T17:21:47.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T17:21:47.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T17:21:47.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T17:21:47.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T17:21:47.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T17:21:47.584 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T17:21:47.596 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T17:21:47.597 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T17:21:47.598 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T17:21:47.599 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T17:21:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T17:21:47.601 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T17:21:47.602 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T17:21:47.603 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T17:21:47.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T17:21:47.605 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T17:21:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T17:21:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T17:21:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T17:21:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T17:21:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T17:21:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T17:21:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T17:21:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T17:21:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T17:21:47.633 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T17:21:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T17:21:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:21:47.634 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-20T17:21:47.707 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T17:21:47.743 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T17:21:47.768 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:47.793 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T17:21:47.820 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:47.820 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:47.912 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:21:47.945 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T17:21:47.945 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:48.030 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:21:48.054 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T17:21:48.060 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:48.060 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:48.119 DEBUG:teuthology.parallel:result is None 2024-05-20T17:21:48.240 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:21:48.240 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:48.332 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:21:48.357 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T17:21:48.421 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:50.437 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T17:21:50.437 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:50.437 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-05-20T17:21:50.437 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:50.437 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T17:21:50.438 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.439 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T17:21:50.441 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T17:21:50.442 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T17:21:50.443 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.444 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T17:21:50.445 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T17:21:50.446 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T17:21:50.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T17:21:50.448 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T17:21:50.449 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T17:21:50.450 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T17:21:50.451 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T17:21:50.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:21:50.451 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-05-20T17:21:50.863 DEBUG:teuthology.parallel:result is None 2024-05-20T17:21:53.971 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:21:53.971 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T17:21:53.971 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T17:21:53.971 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T17:21:53.971 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T17:21:53.972 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T17:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T17:21:53.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T17:21:53.987 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T17:21:53.988 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T17:21:53.989 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T17:21:53.990 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T17:21:53.991 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T17:21:53.992 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T17:21:53.993 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T17:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T17:21:53.995 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T17:21:53.996 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T17:21:53.997 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T17:21:53.997 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T17:21:53.997 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T17:21:56.787 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T17:21:56.787 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.788 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.789 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.790 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T17:21:56.791 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T17:21:56.792 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T17:21:56.793 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T17:21:56.794 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T17:21:56.795 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T17:21:56.796 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T17:21:56.797 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.798 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T17:21:56.799 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T17:21:56.800 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-20T17:21:56.801 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-20T17:21:57.266 DEBUG:teuthology.parallel:result is None 2024-05-20T17:21:57.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:57.494 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T17:21:57.520 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.521 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.521 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T17:21:57.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:57.657 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T17:21:57.679 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.679 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.679 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T17:21:57.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:57.816 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T17:21:57.842 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.842 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T17:21:57.842 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T17:21:57.843 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-20T17:21:57.844 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:21:57.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T17:21:57.876 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:21:57.876 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T17:21:57.904 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:21:57.904 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T17:21:57.934 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-20T17:21:57.934 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:21:57.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T17:21:57.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T17:21:58.029 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:21:58.029 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T17:21:58.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T17:21:58.118 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:21:58.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T17:21:58.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T17:21:58.212 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-20T17:21:58.212 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:21:58.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T17:21:58.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T17:21:58.308 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:21:58.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T17:21:58.334 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T17:21:58.398 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:21:58.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T17:21:58.424 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T17:21:58.490 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-20T17:21:58.490 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:21:58.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T17:21:58.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T17:21:58.584 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:21:58.584 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T17:21:58.608 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T17:21:58.672 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:21:58.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T17:21:58.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T17:21:58.764 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-20T17:21:58.848 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-20T17:21:58.849 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:58.849 INFO:tasks.cephadm:Cluster fsid is 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:21:58.849 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-20T17:21:58.850 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.135', 'mon.b': '172.21.15.160', 'mon.c': '172.21.15.172'} 2024-05-20T17:21:58.850 INFO:tasks.cephadm:First mon is mon.a on smithi135 2024-05-20T17:21:58.850 INFO:tasks.cephadm:First mgr is x 2024-05-20T17:21:58.850 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-20T17:21:58.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-05-20T17:21:58.877 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-05-20T17:21:58.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-05-20T17:21:58.927 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-20T17:21:58.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:59.147 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79503/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2744-gd2b507c7', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2744.gd2b507c7'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-17 22:05:47.367530', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-20T17:21:59.366 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240517.203521-squid-debug, sha1 d2b507c724ef6c8295ee0a35d185cdab167fd61d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:21:59.368 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm 2024-05-20T17:21:59.368 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:00.370 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 17:22 /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:00.370 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:01.709 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 17:22 /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:01.709 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:03.198 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 17:22 /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:03.199 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:03.219 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:03.238 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T17:22:03.272 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d on all hosts... 2024-05-20T17:22:03.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T17:22:03.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T17:22:03.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T17:22:04.132 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T17:22:04.157 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T17:22:04.256 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T17:22:37.722 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-20T17:22:37.722 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:22:37.723 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T17:22:37.723 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-05-20T17:22:37.723 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T17:22:37.723 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-05-20T17:22:37.723 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-20T17:22:51.874 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:22:51.874 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:22:51.874 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T17:22:51.874 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-05-20T17:22:51.875 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T17:22:51.875 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:22:51.875 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:22:54.083 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-20T17:22:54.083 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:22:54.084 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T17:22:54.084 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-05-20T17:22:54.084 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T17:22:54.084 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-05-20T17:22:54.084 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-20T17:22:54.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-05-20T17:22:54.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-05-20T17:22:54.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-05-20T17:22:54.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-05-20T17:22:54.234 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-05-20T17:22:54.261 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-05-20T17:22:54.286 INFO:tasks.cephadm:Writing seed config... 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-20T17:22:54.287 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-20T17:22:54.288 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-20T17:22:54.289 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-20T17:22:54.290 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-20T17:22:54.291 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:22:54.291 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-20T17:22:54.310 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 76c4e726-16cd-11ef-bc9a-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-20T17:22:54.310 DEBUG:teuthology.orchestra.run.smithi135:mon.a> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service 2024-05-20T17:22:54.353 DEBUG:teuthology.orchestra.run.smithi135:mgr.x> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x.service 2024-05-20T17:22:54.396 INFO:tasks.cephadm:Bootstrapping... 2024-05-20T17:22:54.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d -v bootstrap --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.135 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:22:54.593 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:22:54.593 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d', '-v', 'bootstrap', '--fsid', '76c4e726-16cd-11ef-bc9a-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.135', '--skip-admin-label'] 2024-05-20T17:22:54.594 INFO:teuthology.orchestra.run.smithi135.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-20T17:22:54.594 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying podman|docker is present... 2024-05-20T17:22:54.619 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 5.0.2 2024-05-20T17:22:54.619 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying lvm2 is present... 2024-05-20T17:22:54.619 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying time synchronization is in place... 2024-05-20T17:22:54.627 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T17:22:54.627 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T17:22:54.633 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T17:22:54.633 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:22:54.639 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-05-20T17:22:54.646 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-05-20T17:22:54.646 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-05-20T17:22:54.646 INFO:teuthology.orchestra.run.smithi135.stdout:Repeating the final host check... 2024-05-20T17:22:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 5.0.2 2024-05-20T17:22:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-20T17:22:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl is present 2024-05-20T17:22:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:lvcreate is present 2024-05-20T17:22:54.676 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T17:22:54.676 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T17:22:54.682 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T17:22:54.682 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:22:54.689 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-05-20T17:22:54.695 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Host looks OK 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Cluster fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Acquiring lock 140494795011456 on /run/cephadm/76c4e726-16cd-11ef-bc9a-c7b262605968.lock 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Lock 140494795011456 acquired on /run/cephadm/76c4e726-16cd-11ef-bc9a-c7b262605968.lock 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 3300 ... 2024-05-20T17:22:54.696 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 6789 ... 2024-05-20T17:22:54.697 INFO:teuthology.orchestra.run.smithi135.stdout:Base mon IP(s) is [172.21.15.135:3300, 172.21.15.135:6789], mon addrv is [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-05-20T17:22:54.700 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.135 metric 100 2024-05-20T17:22:54.700 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.135 metric 100 2024-05-20T17:22:54.702 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-20T17:22:54.702 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-20T17:22:54.702 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2024-05-20T17:22:54.705 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T17:22:54.706 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-05-20T17:22:54.706 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-05-20T17:22:54.706 INFO:teuthology.orchestra.run.smithi135.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-20T17:22:54.706 INFO:teuthology.orchestra.run.smithi135.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-20T17:22:54.707 INFO:teuthology.orchestra.run.smithi135.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T17:22:55.152 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 2024-05-20T17:22:55.152 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T17:22:55.153 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Getting image source signatures 2024-05-20T17:22:55.153 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:506d33f63dccdaac2c87f708e3d3ef98b8f2fc00666d50b72896243431ca9bae 2024-05-20T17:22:55.153 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:d0e808cd455827ca3108db1b0125dcee9ffc148daa1d7dde963f550bc831d501 2024-05-20T17:22:55.153 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying config sha256:cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 2024-05-20T17:22:55.153 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-20T17:22:56.098 INFO:teuthology.orchestra.run.smithi135.stdout:ceph: stdout ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev) 2024-05-20T17:22:56.099 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph version: ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev) 2024-05-20T17:22:56.099 INFO:teuthology.orchestra.run.smithi135.stdout:Extracting ceph user uid/gid from container image... 2024-05-20T17:22:57.095 INFO:teuthology.orchestra.run.smithi135.stdout:stat: stdout 167 167 2024-05-20T17:22:57.095 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial keys... 2024-05-20T17:22:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDxhktm3jhdGRAA2+ojFpAo7zbocpQxhaxjzQ== 2024-05-20T17:22:58.814 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDyhktmnuIgFRAANk1XEdeByuuEq124hpJNHA== 2024-05-20T17:22:59.728 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDzhktm3XgACBAAVldWIZzaxJqcVkErfF8MtQ== 2024-05-20T17:22:59.728 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial monmap... 2024-05-20T17:23:00.541 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool for a [v2:172.21.15.135:3300,v1:172.21.15.135:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = quincy 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: set fsid to 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:23:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mon... 2024-05-20T17:23:01.489 INFO:teuthology.orchestra.run.smithi135.stdout:create mon.a on 2024-05-20T17:23:01.697 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-20T17:23:01.845 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-20T17:23:02.023 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target → /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target. 2024-05-20T17:23:02.023 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target → /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target. 2024-05-20T17:23:02.263 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a 2024-05-20T17:23:02.264 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service: Unit ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service not loaded. 2024-05-20T17:23:02.435 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target.wants/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service → /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@.service. 2024-05-20T17:23:02.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 podman[31635]: 2024-05-20 17:23:02.607726159 +0000 UTC m=+0.018122977 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:23:02.964 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T17:23:02.964 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon to start... 2024-05-20T17:23:02.971 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon... 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 podman[31635]: 2024-05-20 17:23:02.865900301 +0000 UTC m=+0.276297132 container init 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 podman[31635]: 2024-05-20 17:23:02.869126425 +0000 UTC m=+0.279523244 container start 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 ceph-mon[31656]: mkfs 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 ceph-mon[31656]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 bash[31635]: 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f 2024-05-20T17:23:03.084 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:02 smithi135 systemd[1]: Started Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:23:03.897 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout cluster: 2024-05-20T17:23:03.897 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout id: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:03.897 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout services: 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.515304s) 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout data: 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pgs: 2024-05-20T17:23:03.898 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faec543c700 1 Processor -- start 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faec543c700 1 -- start start 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faec543c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faec543c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faec01094e0 con 0x7faec0108ae0 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faebeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faebeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39262/0 (socket says 172.21.15.135:39262) 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.371+0000 7faebeffd700 1 -- 172.21.15.135:0/540790865 learned_addr learned my addr 172.21.15.135:0/540790865 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.372+0000 7faebeffd700 1 -- 172.21.15.135:0/540790865 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0109cb0 con 0x7faec0108ae0 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.372+0000 7faebeffd700 1 --2- 172.21.15.135:0/540790865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faeb80098a0 tx=0x7faeb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a108e7fc1e149c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.372+0000 7faebdffb700 1 -- 172.21.15.135:0/540790865 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb8004160 con 0x7faec0108ae0 2024-05-20T17:23:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.372+0000 7faebdffb700 1 -- 172.21.15.135:0/540790865 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb8004300 con 0x7faec0108ae0 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.372+0000 7faebdffb700 1 -- 172.21.15.135:0/540790865 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb80036a0 con 0x7faec0108ae0 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 -- 172.21.15.135:0/540790865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 msgr2=0x7faec0108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 --2- 172.21.15.135:0/540790865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faeb80098a0 tx=0x7faeb8009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 -- 172.21.15.135:0/540790865 shutdown_connections 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 --2- 172.21.15.135:0/540790865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec0108ef0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 -- 172.21.15.135:0/540790865 >> 172.21.15.135:0/540790865 conn(0x7faec01041c0 msgr2=0x7faec0106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 -- 172.21.15.135:0/540790865 shutdown_connections 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 -- 172.21.15.135:0/540790865 wait complete. 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.373+0000 7faec543c700 1 Processor -- start 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faec543c700 1 -- start start 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faec543c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:03.900 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faec543c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faec010a1e0 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faebeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faebeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39268/0 (socket says 172.21.15.135:39268) 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faebeffd700 1 -- 172.21.15.135:0/2646564208 learned_addr learned my addr 172.21.15.135:0/2646564208 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faebeffd700 1 -- 172.21.15.135:0/2646564208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec019cb30 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faebeffd700 1 --2- 172.21.15.135:0/2646564208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.374+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb8003db0 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb8011630 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec019cdc0 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb8011950 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec019f9d0 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faeb8011af0 con 0x7faec0108ae0 2024-05-20T17:23:03.901 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faeb801c450 con 0x7faec0108ae0 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.375+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec0063ca0 con 0x7faec0108ae0 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.378+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7faeb8032020 con 0x7faec0108ae0 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.447+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7faec002df60 con 0x7faec0108ae0 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.448+0000 7faeb7fff700 1 -- 172.21.15.135:0/2646564208 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7faeb8004260 con 0x7faec0108ae0 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.448+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 msgr2=0x7faec019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.448+0000 7faec543c700 1 --2- 172.21.15.135:0/2646564208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb8004750 comp rx=0 tx=0).stop 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.448+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 shutdown_connections 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.449+0000 7faec543c700 1 --2- 172.21.15.135:0/2646564208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec0108ae0 0x7faec019c5f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.449+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 >> 172.21.15.135:0/2646564208 conn(0x7faec01041c0 msgr2=0x7faec0192cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.449+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 shutdown_connections 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:03.449+0000 7faec543c700 1 -- 172.21.15.135:0/2646564208 wait complete. 2024-05-20T17:23:03.902 INFO:teuthology.orchestra.run.smithi135.stdout:mon is available 2024-05-20T17:23:03.903 INFO:teuthology.orchestra.run.smithi135.stdout:Assimilating anything we can from ceph.conf... 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: monmap epoch 1 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: last_changed 2024-05-20T17:23:00.069959+0000 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: min_mon_release 19 (squid) 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: election_strategy: 1 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:23:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: fsmap 2024-05-20T17:23:03.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: osdmap e1: 0 total, 0 up, 0 in 2024-05-20T17:23:03.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: mgrmap e1: no daemons active 2024-05-20T17:23:03.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:03 smithi135 ceph-mon[31656]: from='client.? 172.21.15.135:0/2646564208' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-20T17:23:05.054 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:04 smithi135 ceph-mon[31656]: from='client.? 172.21.15.135:0/1939429729' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T17:23:05.054 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:04 smithi135 ceph-mon[31656]: from='client.? 172.21.15.135:0/1939429729' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-20T17:23:05.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:05.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T17:23:05.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:05.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T17:23:05.064 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe172ca9700 1 Processor -- start 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe172ca9700 1 -- start start 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe172ca9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe172ca9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c07c6f0 con 0x7fe16c107410 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe170a45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:05.065 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe170a45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39270/0 (socket says 172.21.15.135:39270) 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.368+0000 7fe170a45700 1 -- 172.21.15.135:0/2111143214 learned_addr learned my addr 172.21.15.135:0/2111143214 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.369+0000 7fe170a45700 1 -- 172.21.15.135:0/2111143214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c107d60 con 0x7fe16c107410 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.369+0000 7fe170a45700 1 --2- 172.21.15.135:0/2111143214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe160009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e35a39d8e739ef server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.369+0000 7fe16b7fe700 1 -- 172.21.15.135:0/2111143214 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160004160 con 0x7fe16c107410 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.369+0000 7fe16b7fe700 1 -- 172.21.15.135:0/2111143214 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160004300 con 0x7fe16c107410 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.369+0000 7fe16b7fe700 1 -- 172.21.15.135:0/2111143214 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1600036a0 con 0x7fe16c107410 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- 172.21.15.135:0/2111143214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 msgr2=0x7fe16c107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 --2- 172.21.15.135:0/2111143214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe160009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- 172.21.15.135:0/2111143214 shutdown_connections 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 --2- 172.21.15.135:0/2111143214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c107820 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- 172.21.15.135:0/2111143214 >> 172.21.15.135:0/2111143214 conn(0x7fe16c1030c0 msgr2=0x7fe16c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:05.066 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- 172.21.15.135:0/2111143214 shutdown_connections 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- 172.21.15.135:0/2111143214 wait complete. 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 Processor -- start 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 -- start start 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.370+0000 7fe172ca9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe172ca9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c108290 con 0x7fe16c107410 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe170a45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe170a45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39274/0 (socket says 172.21.15.135:39274) 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe170a45700 1 -- 172.21.15.135:0/1939429729 learned_addr learned my addr 172.21.15.135:0/1939429729 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe170a45700 1 -- 172.21.15.135:0/1939429729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c19ed60 con 0x7fe16c107410 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe170a45700 1 --2- 172.21.15.135:0/1939429729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe160000c00 tx=0x7fe160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:05.067 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160003db0 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160011630 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c19eff0 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160011950 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.371+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c1a1c00 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.372+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe160011af0 con 0x7fe16c107410 2024-05-20T17:23:05.068 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.372+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe16001c450 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.372+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c063ca0 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.375+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe160032020 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.441+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe16c1a1dd0 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.445+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7fe160004260 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.446+0000 7fe169ffb700 1 -- 172.21.15.135:0/1939429729 <== mon.0 v2:172.21.15.135:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe16001cb60 con 0x7fe16c107410 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 msgr2=0x7fe16c19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:05.069 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 --2- 172.21.15.135:0/1939429729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe160000c00 tx=0x7fe160004750 comp rx=0 tx=0).stop 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 shutdown_connections 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 --2- 172.21.15.135:0/1939429729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe16c107410 0x7fe16c19e820 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 >> 172.21.15.135:0/1939429729 conn(0x7fe16c1030c0 msgr2=0x7fe16c194af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 shutdown_connections 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:04.447+0000 7fe172ca9700 1 -- 172.21.15.135:0/1939429729 wait complete. 2024-05-20T17:23:05.070 INFO:teuthology.orchestra.run.smithi135.stdout:Generating new minimal ceph.conf... 2024-05-20T17:23:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:05 smithi135 ceph-mon[31656]: from='client.? 172.21.15.135:0/3144628317' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:23:10.825 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f7a83700 1 Processor -- start 2024-05-20T17:23:10.825 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f7a83700 1 -- start start 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f7a83700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f7a83700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27f007c6f0 con 0x7f27f0109620 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f581f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f581f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39280/0 (socket says 172.21.15.135:39280) 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.505+0000 7f27f581f700 1 -- 172.21.15.135:0/1425873028 learned_addr learned my addr 172.21.15.135:0/1425873028 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.506+0000 7f27f581f700 1 -- 172.21.15.135:0/1425873028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f010bf80 con 0x7f27f0109620 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.506+0000 7f27f581f700 1 --2- 172.21.15.135:0/1425873028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098a0 tx=0x7f27ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc54d2565829dee0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.506+0000 7f27f481d700 1 -- 172.21.15.135:0/1425873028 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec004160 con 0x7f27f0109620 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.506+0000 7f27f481d700 1 -- 172.21.15.135:0/1425873028 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ec004300 con 0x7f27f0109620 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.506+0000 7f27f481d700 1 -- 172.21.15.135:0/1425873028 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec011b50 con 0x7f27f0109620 2024-05-20T17:23:10.826 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 -- 172.21.15.135:0/1425873028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 msgr2=0x7f27f010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 --2- 172.21.15.135:0/1425873028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098a0 tx=0x7f27ec009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 -- 172.21.15.135:0/1425873028 shutdown_connections 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 --2- 172.21.15.135:0/1425873028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f010ba40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 -- 172.21.15.135:0/1425873028 >> 172.21.15.135:0/1425873028 conn(0x7f27f01030c0 msgr2=0x7f27f0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 -- 172.21.15.135:0/1425873028 shutdown_connections 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 -- 172.21.15.135:0/1425873028 wait complete. 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.507+0000 7f27f7a83700 1 Processor -- start 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f7a83700 1 -- start start 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f7a83700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f7a83700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27f010cf40 con 0x7f27f0109620 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f581f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f581f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39292/0 (socket says 172.21.15.135:39292) 2024-05-20T17:23:10.827 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f581f700 1 -- 172.21.15.135:0/3144628317 learned_addr learned my addr 172.21.15.135:0/3144628317 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f581f700 1 -- 172.21.15.135:0/3144628317 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f019d440 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f581f700 1 --2- 172.21.15.135:0/3144628317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27ec011850 tx=0x7f27ec011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec003af0 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f019d6d0 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.508+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f01a02e0 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.509+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ec020070 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.509+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ec0195a0 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.509+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27ec019c80 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.509+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27ec011e00 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.509+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d4005360 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.512+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f27ec003c90 con 0x7f27f0109620 2024-05-20T17:23:10.828 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.579+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f27d4005920 con 0x7f27f0109620 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.579+0000 7f27e6ffd700 1 -- 172.21.15.135:0/3144628317 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f27ec01a430 con 0x7f27f0109620 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 msgr2=0x7f27f019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 --2- 172.21.15.135:0/3144628317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27ec011850 tx=0x7f27ec011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 shutdown_connections 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 --2- 172.21.15.135:0/3144628317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27f0109620 0x7f27f019cf00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 >> 172.21.15.135:0/3144628317 conn(0x7f27f01030c0 msgr2=0x7f27f0104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 shutdown_connections 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:05.580+0000 7f27f7a83700 1 -- 172.21.15.135:0/3144628317 wait complete. 2024-05-20T17:23:10.829 INFO:teuthology.orchestra.run.smithi135.stdout:Restarting the monitor... 2024-05-20T17:23:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:10 smithi135 systemd[1]: Stopping Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:23:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[31652]: 2024-05-20T17:23:12.209+0000 7ff95ebcb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:23:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[31652]: 2024-05-20T17:23:12.209+0000 7ff95ebcb700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-20T17:23:12.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:12 smithi135 podman[31900]: 2024-05-20 17:23:12.271401389 +0000 UTC m=+1.282903411 container died 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-20T17:23:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:15 smithi135 podman[31900]: 2024-05-20 17:23:15.930629213 +0000 UTC m=+4.942131218 container cleanup 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.build-date=20240514) 2024-05-20T17:23:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:15 smithi135 bash[31900]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a 2024-05-20T17:23:17.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 podman[31912]: 2024-05-20 17:23:17.220044256 +0000 UTC m=+4.945355210 container remove 0014b091c40e3918d4cc1588b45b2e99348edb7423799f06470565186d63925f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-20T17:23:17.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-20T17:23:17.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 systemd[1]: Stopped Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:23:17.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 systemd[1]: Starting Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:23:17.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 podman[32008]: 2024-05-20 17:23:17.537403275 +0000 UTC m=+0.096037493 container create 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.build-date=20240514, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:23:17.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 podman[32008]: 2024-05-20 17:23:17.458318969 +0000 UTC m=+0.016953141 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:23:17.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 podman[32008]: 2024-05-20 17:23:17.739820272 +0000 UTC m=+0.298454444 container init 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-05-20T17:23:17.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 podman[32008]: 2024-05-20 17:23:17.74331706 +0000 UTC m=+0.301951233 container start 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514) 2024-05-20T17:23:17.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: set uid:gid to 167:167 (ceph:ceph) 2024-05-20T17:23:17.790 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev), process ceph-mon, pid 2 2024-05-20T17:23:17.790 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: pidfile_write: ignore empty --pid-file 2024-05-20T17:23:17.790 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: load: jerasure load: lrc 2024-05-20T17:23:17.790 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: RocksDB version: 7.9.2 2024-05-20T17:23:17.790 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Git sha 0 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Compile date 2024-05-17 21:21:31 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: DB SUMMARY 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: DB Session ID: B2DI96HX4XVJI9DBUI5D 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: CURRENT file: CURRENT 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: IDENTITY file: IDENTITY 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-20T17:23:17.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105312 ; 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.error_if_exists: 0 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.create_if_missing: 0 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.paranoid_checks: 1 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.env: 0x5573a266a4a0 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.fs: PosixFileSystem 2024-05-20T17:23:17.793 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.info_log: 0x5573a4c87d40 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_file_opening_threads: 16 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.statistics: (nil) 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.use_fsync: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_log_file_size: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.keep_log_file_num: 1000 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.recycle_log_file_num: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_fallocate: 1 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_mmap_reads: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_mmap_writes: 0 2024-05-20T17:23:17.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.use_direct_reads: 0 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.create_missing_column_families: 0 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.db_log_dir: 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.wal_dir: 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T17:23:17.795 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.advise_random_on_open: 1 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.db_write_buffer_size: 0 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.write_buffer_manager: 0x5573a4c5b2c0 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.rate_limiter: (nil) 2024-05-20T17:23:17.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.wal_recovery_mode: 2 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enable_thread_tracking: 0 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enable_pipelined_write: 0 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.unordered_write: 0 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.row_cache: None 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.wal_filter: None 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T17:23:17.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_ingest_behind: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.two_write_queues: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.manual_wal_flush: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.wal_compression: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.atomic_flush: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.log_readahead_size: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.best_efforts_recovery: 0 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T17:23:17.798 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.allow_data_in_errors: 0 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.db_host_id: __hostname__ 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_background_jobs: 2 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_background_compactions: -1 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_subcompactions: 1 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_total_wal_size: 0 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T17:23:17.799 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_open_files: -1 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bytes_per_sync: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_readahead_size: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_background_flushes: -1 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Compression algorithms supported: 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kZSTD supported: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kXpressCompression supported: 0 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kLZ4HCCompression supported: 1 2024-05-20T17:23:17.800 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kZlibCompression supported: 1 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kSnappyCompression supported: 1 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kLZ4Compression supported: 1 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: kBZip2Compression supported: 0 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.merge_operator: 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_filter: None 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_filter_factory: None 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.sst_partitioner_factory: None 2024-05-20T17:23:17.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5573a4c87e40) 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_type: 0 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_index_type: 0 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_shortening: 1 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: checksum: 4 2024-05-20T17:23:17.802 INFO:journalctl@ceph.mon.a.smithi135.stdout: no_block_cache: 0 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache: 0x5573a4c8b090 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_options: 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: capacity : 536870912 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_shard_bits : 4 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: strict_capacity_limit : 0 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_compressed: (nil) 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: persistent_cache: (nil) 2024-05-20T17:23:17.803 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size: 4096 2024-05-20T17:23:17.804 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size_deviation: 10 2024-05-20T17:23:17.804 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_restart_interval: 16 2024-05-20T17:23:17.804 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_block_restart_interval: 1 2024-05-20T17:23:17.804 INFO:journalctl@ceph.mon.a.smithi135.stdout: metadata_block_size: 4096 2024-05-20T17:23:17.805 INFO:journalctl@ceph.mon.a.smithi135.stdout: partition_filters: 0 2024-05-20T17:23:17.805 INFO:journalctl@ceph.mon.a.smithi135.stdout: use_delta_encoding: 1 2024-05-20T17:23:17.805 INFO:journalctl@ceph.mon.a.smithi135.stdout: filter_policy: bloomfilter 2024-05-20T17:23:17.805 INFO:journalctl@ceph.mon.a.smithi135.stdout: whole_key_filtering: 1 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: verify_compression: 0 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: format_version: 5 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_index_compression: 1 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_align: 0 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: max_auto_readahead_size: 262144 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: prepopulate_block_cache: 0 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: initial_auto_readahead_size: 8192 2024-05-20T17:23:17.806 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.write_buffer_size: 33554432 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_write_buffer_number: 2 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression: NoCompression 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression: Disabled 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.prefix_extractor: nullptr 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.num_levels: 7 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T17:23:17.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.level: 32767 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.strategy: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T17:23:17.808 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.enabled: false 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.target_file_size_base: 67108864 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T17:23:17.809 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.arena_block_size: 1048576 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.disable_auto_compactions: 0 2024-05-20T17:23:17.810 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.table_properties_collectors: 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.inplace_update_support: 0 2024-05-20T17:23:17.811 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.bloom_locality: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.max_successive_merges: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.paranoid_file_checks: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.force_consistency_checks: 1 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.report_bg_io_stats: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.ttl: 2592000 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T17:23:17.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enable_blob_files: false 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.min_blob_size: 0 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_file_size: 268435456 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.blob_file_starting_level: 0 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d40bb3b4-d83e-43f5-a7c5-0abe8b2b382c 2024-05-20T17:23:17.813 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716225797783585, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716225797784787, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100341, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98261, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14298, "raw_average_key_size": 49, "raw_value_size": 90529, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716225797, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d40bb3b4-d83e-43f5-a7c5-0abe8b2b382c", "db_session_id": "B2DI96HX4XVJI9DBUI5D", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716225797784846, "job": 1, "event": "recovery_finished"} 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5573a4c71c00 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: DB pointer 0x5573a9a5e000 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** DB Stats ** 2024-05-20T17:23:17.814 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: L0 2/0 99.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Sum 2/0 99.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T17:23:17.815 INFO:journalctl@ceph.mon.a.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-20T17:23:17.816 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative compaction: 0.00 GB write, 16.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval compaction: 0.00 GB write, 16.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache BinnedLRUCache@0x5573a4c8b090#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: starting mon.a rank 0 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???) e1 preinit fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).mds e1 new map 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).mds e1 print_map 2024-05-20T17:23:17.817 INFO:journalctl@ceph.mon.a.smithi135.stdout: e1 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout: legacy client fscid: -1 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout: No filesystems configured 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:23:17.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-20T17:23:17.819 INFO:teuthology.orchestra.run.smithi135.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 bash[32008]: 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 systemd[1]: Started Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: monmap epoch 1 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:18.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: last_changed 2024-05-20T17:23:00.069959+0000 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: min_mon_release 19 (squid) 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: election_strategy: 1 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: fsmap 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: osdmap e1: 0 total, 0 up, 0 in 2024-05-20T17:23:18.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:17 smithi135 ceph-mon[32027]: mgrmap e1: no daemons active 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.299+0000 7f435b81a700 1 Processor -- start 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.299+0000 7f435b81a700 1 -- start start 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.299+0000 7f435b81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.299+0000 7f435b81a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4354108400 con 0x7f4354107a00 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f43595b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f43595b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39446/0 (socket says 172.21.15.135:39446) 2024-05-20T17:23:18.937 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f43595b6700 1 -- 172.21.15.135:0/1864054542 learned_addr learned my addr 172.21.15.135:0/1864054542 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f43595b6700 1 -- 172.21.15.135:0/1864054542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4354108bd0 con 0x7f4354107a00 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f43595b6700 1 --2- 172.21.15.135:0/1864054542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f43500098a0 tx=0x7f4350009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ecba2525b28a09 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f434bfff700 1 -- 172.21.15.135:0/1864054542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4350004160 con 0x7f4354107a00 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f434bfff700 1 -- 172.21.15.135:0/1864054542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4350004300 con 0x7f4354107a00 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.300+0000 7f434bfff700 1 -- 172.21.15.135:0/1864054542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4350011b50 con 0x7f4354107a00 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 -- 172.21.15.135:0/1864054542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 msgr2=0x7f4354107e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 --2- 172.21.15.135:0/1864054542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f43500098a0 tx=0x7f4350009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 -- 172.21.15.135:0/1864054542 shutdown_connections 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 --2- 172.21.15.135:0/1864054542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f4354107e10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 -- 172.21.15.135:0/1864054542 >> 172.21.15.135:0/1864054542 conn(0x7f43541030c0 msgr2=0x7f4354105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 -- 172.21.15.135:0/1864054542 shutdown_connections 2024-05-20T17:23:18.938 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.301+0000 7f435b81a700 1 -- 172.21.15.135:0/1864054542 wait complete. 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f435b81a700 1 Processor -- start 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f435b81a700 1 -- start start 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f435b81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f435b81a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f435410bf80 con 0x7f4354107a00 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f43595b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f43595b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39450/0 (socket says 172.21.15.135:39450) 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f43595b6700 1 -- 172.21.15.135:0/3189800389 learned_addr learned my addr 172.21.15.135:0/3189800389 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.302+0000 7f43595b6700 1 -- 172.21.15.135:0/3189800389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435407c7a0 con 0x7f4354107a00 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f43595b6700 1 --2- 172.21.15.135:0/3189800389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f43500046e0 tx=0x7f4350011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43500039e0 con 0x7f4354107a00 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4350003b80 con 0x7f4354107a00 2024-05-20T17:23:18.939 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4350024690 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435419fcf0 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541a01d0 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4350022020 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.303+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4350011e00 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.304+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4354063ca0 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.306+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4350003d30 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.372+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f43541a0590 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.374+0000 7f434a7fc700 1 -- 172.21.15.135:0/3189800389 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f435001a9f0 con 0x7f4354107a00 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 msgr2=0x7f435407c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 --2- 172.21.15.135:0/3189800389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f43500046e0 tx=0x7f4350011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 shutdown_connections 2024-05-20T17:23:18.940 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 --2- 172.21.15.135:0/3189800389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4354107a00 0x7f435407c260 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:18.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 >> 172.21.15.135:0/3189800389 conn(0x7f43541030c0 msgr2=0x7f4354104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:18.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 shutdown_connections 2024-05-20T17:23:18.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:18.375+0000 7f435b81a700 1 -- 172.21.15.135:0/3189800389 wait complete. 2024-05-20T17:23:18.941 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-20T17:23:18.962 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:23:18.962 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mgr... 2024-05-20T17:23:18.963 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-20T17:23:18.963 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-20T17:23:19.213 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x 2024-05-20T17:23:19.213 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x.service: Unit ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x.service not loaded. 2024-05-20T17:23:19.364 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968.target.wants/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@.service. 2024-05-20T17:23:19.600 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3189800389' entity='client.admin' 2024-05-20T17:23:19.600 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 systemd[1]: Starting Ceph mgr.x for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:23:19.867 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 podman[32241]: 2024-05-20 17:23:19.501735173 +0000 UTC m=+0.017003539 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:23:19.867 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 podman[32241]: 2024-05-20 17:23:19.614889374 +0000 UTC m=+0.130157723 container create 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:23:19.867 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 podman[32241]: 2024-05-20 17:23:19.792173333 +0000 UTC m=+0.307441694 container init 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=) 2024-05-20T17:23:19.868 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 podman[32241]: 2024-05-20 17:23:19.79484741 +0000 UTC m=+0.310115761 container start 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:23:19.868 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 bash[32241]: 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd 2024-05-20T17:23:19.883 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T17:23:19.883 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-20T17:23:19.891 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T17:23:19.891 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:23:19.891 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-20T17:23:19.891 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T17:23:19.900 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T17:23:19.900 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr to start... 2024-05-20T17:23:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr... 2024-05-20T17:23:20.122 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 systemd[1]: Started Ceph mgr.x for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:23:20.122 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:19.963+0000 7fa7df7b5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:23:20.440 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:20.154+0000 7fa7df7b5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:23:20.440 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:20.258+0000 7fa7df7b5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:23:20.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2281854106' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T17:23:20.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:20.586+0000 7fa7df7b5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:23:20.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:20.672+0000 7fa7df7b5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:23:20.976 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T17:23:20.986 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T17:23:20.987 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T17:23:20.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:20.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T17:23:02.935097+0000", 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4d2483700 1 Processor -- start 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4d2483700 1 -- start start 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4d2483700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4d2483700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc07be60 con 0x7fb4cc1095d0 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39630/0 (socket says 172.21.15.135:39630) 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.358+0000 7fb4cbfff700 1 -- 172.21.15.135:0/2333525646 learned_addr learned my addr 172.21.15.135:0/2333525646 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.359+0000 7fb4cbfff700 1 -- 172.21.15.135:0/2333525646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc10bf30 con 0x7fb4cc1095d0 2024-05-20T17:23:20.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.359+0000 7fb4cbfff700 1 --2- 172.21.15.135:0/2333525646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0098a0 tx=0x7fb4bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa50511374ce4ad server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.359+0000 7fb4caffd700 1 -- 172.21.15.135:0/2333525646 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc004160 con 0x7fb4cc1095d0 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.359+0000 7fb4caffd700 1 -- 172.21.15.135:0/2333525646 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4bc004300 con 0x7fb4cc1095d0 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.359+0000 7fb4caffd700 1 -- 172.21.15.135:0/2333525646 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc011b50 con 0x7fb4cc1095d0 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 -- 172.21.15.135:0/2333525646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 msgr2=0x7fb4cc10b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 --2- 172.21.15.135:0/2333525646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0098a0 tx=0x7fb4bc009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 -- 172.21.15.135:0/2333525646 shutdown_connections 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 --2- 172.21.15.135:0/2333525646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc10b9f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 -- 172.21.15.135:0/2333525646 >> 172.21.15.135:0/2333525646 conn(0x7fb4cc1030d0 msgr2=0x7fb4cc105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 -- 172.21.15.135:0/2333525646 shutdown_connections 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.360+0000 7fb4d2483700 1 -- 172.21.15.135:0/2333525646 wait complete. 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4d2483700 1 Processor -- start 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4d2483700 1 -- start start 2024-05-20T17:23:20.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4d2483700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4d2483700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10cef0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39638/0 (socket says 172.21.15.135:39638) 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.361+0000 7fb4cbfff700 1 -- 172.21.15.135:0/2281854106 learned_addr learned my addr 172.21.15.135:0/2281854106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4cbfff700 1 -- 172.21.15.135:0/2281854106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc19d3f0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4cbfff700 1 --2- 172.21.15.135:0/2281854106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc011850 tx=0x7fb4bc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc003af0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4bc020070 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc0195a0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc19d680 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.362+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1a0290 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.363+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4bc019be0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.363+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4bc011e00 con 0x7fb4cc1095d0 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.363+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc063ca0 con 0x7fb4cc1095d0 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.365+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb4bc003c90 con 0x7fb4cc1095d0 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.439+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb4cc1a0460 con 0x7fb4cc1095d0 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.439+0000 7fb4c97fa700 1 -- 172.21.15.135:0/2281854106 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb4bc025460 con 0x7fb4cc1095d0 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 msgr2=0x7fb4cc19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 --2- 172.21.15.135:0/2281854106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc011850 tx=0x7fb4bc011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 shutdown_connections 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 --2- 172.21.15.135:0/2281854106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc1095d0 0x7fb4cc19ceb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 >> 172.21.15.135:0/2281854106 conn(0x7fb4cc1030d0 msgr2=0x7fb4cc1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 shutdown_connections 2024-05-20T17:23:20.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:20.440+0000 7fb4d2483700 1 -- 172.21.15.135:0/2281854106 wait complete. 2024-05-20T17:23:20.995 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (1/15)... 2024-05-20T17:23:22.205 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:21 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:21.870+0000 7fa7df7b5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:23:22.205 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:22 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:22.037+0000 7fa7df7b5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:23:22.480 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:22 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:22.208+0000 7fa7df7b5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:23:22.822 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:22 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:22.510+0000 7fa7df7b5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:23:22.822 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:22 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:22.609+0000 7fa7df7b5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:23:22.822 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:22 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:22.821+0000 7fa7df7b5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:23:23.107 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:23 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:23.026+0000 7fa7df7b5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:23:23.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:23 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:23.645+0000 7fa7df7b5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:23:24.174 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:24 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:24.070+0000 7fa7df7b5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:23:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2506639269' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T17:23:24.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:24 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:24.173+0000 7fa7df7b5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:23:24.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:24 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:24.420+0000 7fa7df7b5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:23:24.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:24.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:24.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:23:24.941 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:24.942 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T17:23:24.943 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T17:23:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T17:23:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T17:23:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T17:23:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:24.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:24.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T17:23:02.935097+0000", 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.184+0000 7f63af9d1700 1 Processor -- start 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63af9d1700 1 -- start start 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63af9d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63af9d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63a81083b0 con 0x7f63a81079b0 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63ad76d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63ad76d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39646/0 (socket says 172.21.15.135:39646) 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.185+0000 7f63ad76d700 1 -- 172.21.15.135:0/4178105234 learned_addr learned my addr 172.21.15.135:0/4178105234 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.186+0000 7f63ad76d700 1 -- 172.21.15.135:0/4178105234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a8108b80 con 0x7f63a81079b0 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.186+0000 7f63ad76d700 1 --2- 172.21.15.135:0/4178105234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63a40098a0 tx=0x7f63a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c755dc360e84a691 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.186+0000 7f639ffff700 1 -- 172.21.15.135:0/4178105234 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a4004160 con 0x7f63a81079b0 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.186+0000 7f639ffff700 1 -- 172.21.15.135:0/4178105234 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63a4004300 con 0x7f63a81079b0 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.186+0000 7f639ffff700 1 -- 172.21.15.135:0/4178105234 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a4011b50 con 0x7f63a81079b0 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 -- 172.21.15.135:0/4178105234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 msgr2=0x7f63a8107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 --2- 172.21.15.135:0/4178105234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63a40098a0 tx=0x7f63a4009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 -- 172.21.15.135:0/4178105234 shutdown_connections 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 --2- 172.21.15.135:0/4178105234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a8107dc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 -- 172.21.15.135:0/4178105234 >> 172.21.15.135:0/4178105234 conn(0x7f63a81030d0 msgr2=0x7f63a8105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:24.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 -- 172.21.15.135:0/4178105234 shutdown_connections 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.187+0000 7f63af9d1700 1 -- 172.21.15.135:0/4178105234 wait complete. 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63af9d1700 1 Processor -- start 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63af9d1700 1 -- start start 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63af9d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63af9d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63a810bf30 con 0x7f63a81079b0 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63ad76d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63ad76d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39650/0 (socket says 172.21.15.135:39650) 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63ad76d700 1 -- 172.21.15.135:0/2506639269 learned_addr learned my addr 172.21.15.135:0/2506639269 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63ad76d700 1 -- 172.21.15.135:0/2506639269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a819c350 con 0x7f63a81079b0 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.188+0000 7f63ad76d700 1 --2- 172.21.15.135:0/2506639269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63a40046e0 tx=0x7f63a4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40039e0 con 0x7f63a81079b0 2024-05-20T17:23:24.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a819c5e0 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63a4003b80 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a4024690 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a819f1f0 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63a4022020 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.189+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63a4011e00 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.190+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a8063ca0 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.192+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f63a4003d30 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.313+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f63a819f3c0 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.313+0000 7f639e7fc700 1 -- 172.21.15.135:0/2506639269 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f63a402dca0 con 0x7f63a81079b0 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.314+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 msgr2=0x7f63a819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.314+0000 7f63af9d1700 1 --2- 172.21.15.135:0/2506639269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63a40046e0 tx=0x7f63a4011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:24.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.314+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 shutdown_connections 2024-05-20T17:23:24.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.314+0000 7f63af9d1700 1 --2- 172.21.15.135:0/2506639269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63a81079b0 0x7f63a819be10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:24.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.314+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 >> 172.21.15.135:0/2506639269 conn(0x7f63a81030d0 msgr2=0x7f63a81049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:24.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.315+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 shutdown_connections 2024-05-20T17:23:24.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:24.315+0000 7f63af9d1700 1 -- 172.21.15.135:0/2506639269 wait complete. 2024-05-20T17:23:24.958 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (2/15)... 2024-05-20T17:23:25.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:24 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:24.953+0000 7fa7df7b5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:23:25.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.045+0000 7fa7df7b5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:23:25.635 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.288+0000 7fa7df7b5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:23:25.635 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.421+0000 7fa7df7b5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:23:25.635 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.517+0000 7fa7df7b5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:23:25.636 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.634+0000 7fa7df7b5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:23:26.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:25 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:25.936+0000 7fa7df7b5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:23:26.811 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:26 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:26.533+0000 7fa7df7b5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:23:26.811 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:26 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:26.754+0000 7fa7df7b5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:23:27.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: Activating manager daemon x 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: mgrmap e2: x(active, starting, since 0.00356866s) 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: Manager daemon x is now available 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' 2024-05-20T17:23:27.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' 2024-05-20T17:23:27.069 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:26 smithi135 ceph-mon[32027]: from='mgr.14100 172.21.15.135:0/625715802' entity='mgr.x' 2024-05-20T17:23:28.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:27 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2376105245' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T17:23:28.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:27 smithi135 ceph-mon[32027]: mgrmap e3: x(active, since 1.00713s) 2024-05-20T17:23:28.048 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:28.049 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T17:23:28.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T17:23:28.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T17:23:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T17:23:02.935097+0000", 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.353+0000 7f0fe83ba700 1 Processor -- start 2024-05-20T17:23:28.053 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.353+0000 7f0fe83ba700 1 -- start start 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe83ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe83ba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe007d050 con 0x7f0fe007e640 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe6156700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe6156700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39750/0 (socket says 172.21.15.135:39750) 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe6156700 1 -- 172.21.15.135:0/121840130 learned_addr learned my addr 172.21.15.135:0/121840130 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe6156700 1 -- 172.21.15.135:0/121840130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe007d1d0 con 0x7f0fe007e640 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.354+0000 7f0fe6156700 1 --2- 172.21.15.135:0/121840130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00098a0 tx=0x7f0fd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905e40b0f65ba5cb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe5154700 1 -- 172.21.15.135:0/121840130 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0004160 con 0x7f0fe007e640 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe5154700 1 -- 172.21.15.135:0/121840130 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd0004300 con 0x7f0fe007e640 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe5154700 1 -- 172.21.15.135:0/121840130 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0011b50 con 0x7f0fe007e640 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe83ba700 1 -- 172.21.15.135:0/121840130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 msgr2=0x7f0fe007cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe83ba700 1 --2- 172.21.15.135:0/121840130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00098a0 tx=0x7f0fd0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:28.054 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe83ba700 1 -- 172.21.15.135:0/121840130 shutdown_connections 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe83ba700 1 --2- 172.21.15.135:0/121840130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe007cb10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.355+0000 7f0fe83ba700 1 -- 172.21.15.135:0/121840130 >> 172.21.15.135:0/121840130 conn(0x7f0fe0104230 msgr2=0x7f0fe0106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 -- 172.21.15.135:0/121840130 shutdown_connections 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 -- 172.21.15.135:0/121840130 wait complete. 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 Processor -- start 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 -- start start 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe83ba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010f150 con 0x7f0fe007e640 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe6156700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe6156700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39766/0 (socket says 172.21.15.135:39766) 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.356+0000 7f0fe6156700 1 -- 172.21.15.135:0/2376105245 learned_addr learned my addr 172.21.15.135:0/2376105245 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:28.055 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fe6156700 1 -- 172.21.15.135:0/2376105245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe019f680 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fe6156700 1 --2- 172.21.15.135:0/2376105245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009fb0 tx=0x7f0fd0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd00038b0 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe019f910 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd0011e50 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0019550 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.357+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01a2520 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.358+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 2) ==== 46043+0+0 (secure 0 0 0) 0x7f0fd0019850 con 0x7f0fe007e640 2024-05-20T17:23:28.056 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.358+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe0063ca0 con 0x7f0fe007e640 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.358+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0fd004cee0 con 0x7f0fe007e640 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.360+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0fd0016dd0 con 0x7f0fe007e640 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.429+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0fe01a2ba0 con 0x7f0fe007e640 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fd77fe700 1 -- 172.21.15.135:0/2376105245 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0fd0019bf0 con 0x7f0fe007e640 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 msgr2=0x7f0fe019f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 --2- 172.21.15.135:0/2376105245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009fb0 tx=0x7f0fd0011bf0 comp rx=0 tx=0).stop 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 shutdown_connections 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 --2- 172.21.15.135:0/2376105245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe007e640 0x7f0fe019f140 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 >> 172.21.15.135:0/2376105245 conn(0x7f0fe0104230 msgr2=0x7f0fe0104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:28.057 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 shutdown_connections 2024-05-20T17:23:28.058 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:27.430+0000 7f0fe83ba700 1 -- 172.21.15.135:0/2376105245 wait complete. 2024-05-20T17:23:28.058 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (3/15)... 2024-05-20T17:23:30.170 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:29 smithi135 ceph-mon[32027]: mgrmap e4: x(active, since 2s) 2024-05-20T17:23:31.179 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:30 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2927384950' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T17:23:31.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T17:23:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T17:23:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T17:23:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T17:23:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T17:23:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T17:23:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T17:23:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:31.317 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T17:23:02.935097+0000", 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb9504f700 1 Processor -- start 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb9504f700 1 -- start start 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb9504f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb9504f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9007c6b0 con 0x7ffb90109660 2024-05-20T17:23:31.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb8ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb8ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49044/0 (socket says 172.21.15.135:49044) 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb8ed9d700 1 -- 172.21.15.135:0/2147256519 learned_addr learned my addr 172.21.15.135:0/2147256519 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb8ed9d700 1 -- 172.21.15.135:0/2147256519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9010bfc0 con 0x7ffb90109660 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.486+0000 7ffb8ed9d700 1 --2- 172.21.15.135:0/2147256519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb800098a0 tx=0x7ffb80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a98bb8e3857d35 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb8dd9b700 1 -- 172.21.15.135:0/2147256519 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80004160 con 0x7ffb90109660 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb8dd9b700 1 -- 172.21.15.135:0/2147256519 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb80004300 con 0x7ffb90109660 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb8dd9b700 1 -- 172.21.15.135:0/2147256519 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80011b50 con 0x7ffb90109660 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 -- 172.21.15.135:0/2147256519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 msgr2=0x7ffb9010ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2147256519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb800098a0 tx=0x7ffb80009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 -- 172.21.15.135:0/2147256519 shutdown_connections 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2147256519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb9010ba80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:31.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 -- 172.21.15.135:0/2147256519 >> 172.21.15.135:0/2147256519 conn(0x7ffb901030c0 msgr2=0x7ffb90105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 -- 172.21.15.135:0/2147256519 shutdown_connections 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.487+0000 7ffb9504f700 1 -- 172.21.15.135:0/2147256519 wait complete. 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.488+0000 7ffb9504f700 1 Processor -- start 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb9504f700 1 -- start start 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb9504f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb9504f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9010cf80 con 0x7ffb90109660 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb8ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb8ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49052/0 (socket says 172.21.15.135:49052) 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb8ed9d700 1 -- 172.21.15.135:0/2927384950 learned_addr learned my addr 172.21.15.135:0/2927384950 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb8ed9d700 1 -- 172.21.15.135:0/2927384950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb90109320 con 0x7ffb90109660 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.489+0000 7ffb8ed9d700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009fb0 tx=0x7ffb80011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb800038b0 con 0x7ffb90109660 2024-05-20T17:23:31.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb80011e50 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb90107570 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80019550 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb90107a50 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.490+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ffb80019800 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.491+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb90063ca0 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.491+0000 7ffb77fff700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 0x7ffb7803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.491+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffb8004e1f0 con 0x7ffb90109660 2024-05-20T17:23:31.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.491+0000 7ffb8e59c700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 0x7ffb7803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.491+0000 7ffb8e59c700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 0x7ffb7803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb84006fd0 tx=0x7ffb84006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.496+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffb8000fda0 con 0x7ffb90109660 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.769+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffb90108190 con 0x7ffb90109660 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.770+0000 7ffb77fff700 1 -- 172.21.15.135:0/2927384950 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ffb8002d960 con 0x7ffb90109660 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 msgr2=0x7ffb7803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 0x7ffb7803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb84006fd0 tx=0x7ffb84006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 msgr2=0x7ffb90108de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009fb0 tx=0x7ffb80011bf0 comp rx=0 tx=0).stop 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 shutdown_connections 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7ffb78039000 0x7ffb7803b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 --2- 172.21.15.135:0/2927384950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90109660 0x7ffb90108de0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:31.322 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 >> 172.21.15.135:0/2927384950 conn(0x7ffb901030c0 msgr2=0x7ffb90104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.772+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 shutdown_connections 2024-05-20T17:23:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:30.773+0000 7ffb9504f700 1 -- 172.21.15.135:0/2927384950 wait complete. 2024-05-20T17:23:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:mgr is available 2024-05-20T17:23:32.306 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:32 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/295191137' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T17:23:32.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T17:23:32.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T17:23:32.595 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.748+0000 7f63054c5700 1 Processor -- start 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.748+0000 7f63054c5700 1 -- start start 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.748+0000 7f63054c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.748+0000 7f63054c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f630010bce0 con 0x7f630007c580 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62feffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62feffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49068/0 (socket says 172.21.15.135:49068) 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62feffd700 1 -- 172.21.15.135:0/1623842015 learned_addr learned my addr 172.21.15.135:0/1623842015 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62feffd700 1 -- 172.21.15.135:0/1623842015 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630010be60 con 0x7f630007c580 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62feffd700 1 --2- 172.21.15.135:0/1623842015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62f00098a0 tx=0x7f62f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bf97b20005386 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:32.596 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62fe7fc700 1 -- 172.21.15.135:0/1623842015 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f0004160 con 0x7f630007c580 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62fe7fc700 1 -- 172.21.15.135:0/1623842015 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62f0004300 con 0x7f630007c580 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.749+0000 7f62fe7fc700 1 -- 172.21.15.135:0/1623842015 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f0011b50 con 0x7f630007c580 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 -- 172.21.15.135:0/1623842015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 msgr2=0x7f630010b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 --2- 172.21.15.135:0/1623842015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62f00098a0 tx=0x7f62f0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 -- 172.21.15.135:0/1623842015 shutdown_connections 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 --2- 172.21.15.135:0/1623842015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630010b6d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 -- 172.21.15.135:0/1623842015 >> 172.21.15.135:0/1623842015 conn(0x7f63001030c0 msgr2=0x7f6300105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:32.597 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 -- 172.21.15.135:0/1623842015 shutdown_connections 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.750+0000 7f63054c5700 1 -- 172.21.15.135:0/1623842015 wait complete. 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f63054c5700 1 Processor -- start 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f63054c5700 1 -- start start 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f63054c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f63054c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f630010cf40 con 0x7f630007c580 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f62feffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f62feffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49078/0 (socket says 172.21.15.135:49078) 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.751+0000 7f62feffd700 1 -- 172.21.15.135:0/295191137 learned_addr learned my addr 172.21.15.135:0/295191137 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f62feffd700 1 -- 172.21.15.135:0/295191137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630019d440 con 0x7f630007c580 2024-05-20T17:23:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f62feffd700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009fb0 tx=0x7f62f0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f00038b0 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62f0011e50 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630019d6d0 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f0019550 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.752+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a02e0 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.753+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f62f0019800 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.753+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6300063ca0 con 0x7f630007c580 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.753+0000 7f62fcff9700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 0x7f62ec03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:32.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.753+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f62f004d150 con 0x7f630007c580 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.753+0000 7f62f7fff700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 0x7f62ec03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.754+0000 7f62f7fff700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 0x7f62ec03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006fd0 tx=0x7f62e8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.758+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f62f000bc10 con 0x7f630007c580 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.950+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f63001a04b0 con 0x7f630007c580 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.951+0000 7f62fcff9700 1 -- 172.21.15.135:0/295191137 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f62f000fda0 con 0x7f630007c580 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 msgr2=0x7f62ec03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 0x7f62ec03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006fd0 tx=0x7f62e8006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 msgr2=0x7f630019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009fb0 tx=0x7f62f0011bf0 comp rx=0 tx=0).stop 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 shutdown_connections 2024-05-20T17:23:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f62ec039000 0x7f62ec03b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 --2- 172.21.15.135:0/295191137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630007c580 0x7f630019cf00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 >> 172.21.15.135:0/295191137 conn(0x7f63001030c0 msgr2=0x7f6300104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 shutdown_connections 2024-05-20T17:23:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:31.954+0000 7f63054c5700 1 -- 172.21.15.135:0/295191137 wait complete. 2024-05-20T17:23:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling cephadm module... 2024-05-20T17:23:33.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:33 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2337226664' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-20T17:23:33.512 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setuser ceph since I am not root 2024-05-20T17:23:33.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setgroup ceph since I am not root 2024-05-20T17:23:33.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:33.511+0000 7fd792ede200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:23:33.806 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:33.702+0000 7fd792ede200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:23:33.806 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:33.805+0000 7fd792ede200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3ddb2ee700 1 Processor -- start 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3ddb2ee700 1 -- start start 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3ddb2ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3ddb2ee700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4109590 con 0x7f3dd4108b90 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3dd908a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3dd908a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49088/0 (socket says 172.21.15.135:49088) 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.991+0000 7f3dd908a700 1 -- 172.21.15.135:0/1744555978 learned_addr learned my addr 172.21.15.135:0/1744555978 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.992+0000 7f3dd908a700 1 -- 172.21.15.135:0/1744555978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd4109cc0 con 0x7f3dd4108b90 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.992+0000 7f3dd908a700 1 --2- 172.21.15.135:0/1744555978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00098a0 tx=0x7f3dd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c47404b22924f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:33.921 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.992+0000 7f3dcbfff700 1 -- 172.21.15.135:0/1744555978 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dd0004160 con 0x7f3dd4108b90 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.992+0000 7f3dcbfff700 1 -- 172.21.15.135:0/1744555978 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3dd0004300 con 0x7f3dd4108b90 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.992+0000 7f3dcbfff700 1 -- 172.21.15.135:0/1744555978 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dd0011b50 con 0x7f3dd4108b90 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/1744555978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 msgr2=0x7f3dd4108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/1744555978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00098a0 tx=0x7f3dd0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/1744555978 shutdown_connections 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/1744555978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd4108fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/1744555978 >> 172.21.15.135:0/1744555978 conn(0x7f3dd4104230 msgr2=0x7f3dd4106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/1744555978 shutdown_connections 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.993+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/1744555978 wait complete. 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3ddb2ee700 1 Processor -- start 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3ddb2ee700 1 -- start start 2024-05-20T17:23:33.922 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3ddb2ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3ddb2ee700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd410d070 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dd908a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dd908a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49102/0 (socket says 172.21.15.135:49102) 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dd908a700 1 -- 172.21.15.135:0/2337226664 learned_addr learned my addr 172.21.15.135:0/2337226664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dd908a700 1 -- 172.21.15.135:0/2337226664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd419d500 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dd908a700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009fb0 tx=0x7f3dd0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dd00038b0 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3dd0011e50 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.994+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd419d790 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.995+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dd001a430 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.995+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41a03a0 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f3dd001a6e0 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd4063ca0 con 0x7f3dd4108b90 2024-05-20T17:23:33.923 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3dca7fc700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 0x7f3dc003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3dd004d0b0 con 0x7f3dd4108b90 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3dd8889700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 0x7f3dc003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:32.996+0000 7f3dd8889700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 0x7f3dc003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006fd0 tx=0x7f3dc4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.001+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3dd0024440 con 0x7f3dd4108b90 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.249+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f3dd41a0a20 con 0x7f3dd4108b90 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.301+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f3dd002d770 con 0x7f3dd4108b90 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.303+0000 7f3dca7fc700 1 -- 172.21.15.135:0/2337226664 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f3dd0018350 con 0x7f3dd4108b90 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 msgr2=0x7f3dc003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 0x7f3dc003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006fd0 tx=0x7f3dc4006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 msgr2=0x7f3dd419cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009fb0 tx=0x7f3dd0011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 shutdown_connections 2024-05-20T17:23:33.924 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f3dc0039000 0x7f3dc003b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:33.925 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 --2- 172.21.15.135:0/2337226664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd4108b90 0x7f3dd419cfc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:33.925 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.304+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 >> 172.21.15.135:0/2337226664 conn(0x7f3dd4104230 msgr2=0x7f3dd4104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:33.925 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.305+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 shutdown_connections 2024-05-20T17:23:33.925 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:33.305+0000 7f3ddb2ee700 1 -- 172.21.15.135:0/2337226664 wait complete. 2024-05-20T17:23:34.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:34 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2337226664' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-20T17:23:34.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:34 smithi135 ceph-mon[32027]: mgrmap e5: x(active, since 6s) 2024-05-20T17:23:34.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:34 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:34.122+0000 7fd792ede200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:23:34.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:34 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:34.212+0000 7fd792ede200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:23:35.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:35.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-20T17:23:35.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0d495a700 1 Processor -- start 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0d495a700 1 -- start start 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0d495a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0d495a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d0109980 con 0x7fb0d0108f60 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49130/0 (socket says 172.21.15.135:49130) 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.352+0000 7fb0ce59c700 1 -- 172.21.15.135:0/1690376505 learned_addr learned my addr 172.21.15.135:0/1690376505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.353+0000 7fb0ce59c700 1 -- 172.21.15.135:0/1690376505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d0107b90 con 0x7fb0d0108f60 2024-05-20T17:23:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.353+0000 7fb0ce59c700 1 --2- 172.21.15.135:0/1690376505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00098a0 tx=0x7fb0c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0add345855f6b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.353+0000 7fb0cd59a700 1 -- 172.21.15.135:0/1690376505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0004160 con 0x7fb0d0108f60 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.353+0000 7fb0cd59a700 1 -- 172.21.15.135:0/1690376505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0c0004300 con 0x7fb0d0108f60 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.353+0000 7fb0cd59a700 1 -- 172.21.15.135:0/1690376505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0011b50 con 0x7fb0d0108f60 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 -- 172.21.15.135:0/1690376505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 msgr2=0x7fb0d0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 --2- 172.21.15.135:0/1690376505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00098a0 tx=0x7fb0c0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 -- 172.21.15.135:0/1690376505 shutdown_connections 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 --2- 172.21.15.135:0/1690376505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d0109370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 -- 172.21.15.135:0/1690376505 >> 172.21.15.135:0/1690376505 conn(0x7fb0d0102810 msgr2=0x7fb0d0104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 -- 172.21.15.135:0/1690376505 shutdown_connections 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.354+0000 7fb0d495a700 1 -- 172.21.15.135:0/1690376505 wait complete. 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0d495a700 1 Processor -- start 2024-05-20T17:23:35.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0d495a700 1 -- start start 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0d495a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0d495a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d010bf50 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0ce59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49136/0 (socket says 172.21.15.135:49136) 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.355+0000 7fb0ce59c700 1 -- 172.21.15.135:0/2438222825 learned_addr learned my addr 172.21.15.135:0/2438222825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0ce59c700 1 -- 172.21.15.135:0/2438222825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d019c330 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0ce59c700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009fb0 tx=0x7fb0c0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0c00038b0 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0c0011e50 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d019c5c0 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0c0019550 con 0x7fb0d0108f60 2024-05-20T17:23:35.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.356+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d019f190 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d0063ca0 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb0c0019800 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0bf7fe700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 0x7fb0b803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0c004d210 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0cdd9b700 1 -- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 msgr2=0x7fb0b803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.357+0000 7fb0cdd9b700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 0x7fb0b803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.362+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb0c000bc10 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.558+0000 7fb0cdd9b700 1 -- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 msgr2=0x7fb0b803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.558+0000 7fb0cdd9b700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 0x7fb0b803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.637+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb0d019f7d0 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.639+0000 7fb0bf7fe700 1 -- 172.21.15.135:0/2438222825 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb0c000fda0 con 0x7fb0d0108f60 2024-05-20T17:23:35.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.643+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 msgr2=0x7fb0b803b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.643+0000 7fb0d495a700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 0x7fb0b803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.643+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 msgr2=0x7fb0d019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.643+0000 7fb0d495a700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009fb0 tx=0x7fb0c0011bf0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.647+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 shutdown_connections 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.647+0000 7fb0d495a700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7fb0b8039050 0x7fb0b803b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.647+0000 7fb0d495a700 1 --2- 172.21.15.135:0/2438222825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d0108f60 0x7fb0d019bdf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.647+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 >> 172.21.15.135:0/2438222825 conn(0x7fb0d0102810 msgr2=0x7fb0d01041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.651+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 shutdown_connections 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:34.651+0000 7fb0d495a700 1 -- 172.21.15.135:0/2438222825 wait complete. 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-05-20T17:23:35.224 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 5... 2024-05-20T17:23:35.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:35 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2438222825' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T17:23:35.481 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:35.454+0000 7fd792ede200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:23:35.799 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:35.636+0000 7fd792ede200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:23:36.104 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:35.809+0000 7fd792ede200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:23:36.104 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:36.102+0000 7fd792ede200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:23:36.405 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:36.197+0000 7fd792ede200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:23:36.405 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:36.404+0000 7fd792ede200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:23:36.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:36.600+0000 7fd792ede200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:23:37.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:37.200+0000 7fd792ede200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:23:37.930 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:37.625+0000 7fd792ede200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:23:37.930 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:37.724+0000 7fd792ede200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:23:37.930 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:37.929+0000 7fd792ede200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:23:38.797 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:38.459+0000 7fd792ede200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:23:38.797 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:38.550+0000 7fd792ede200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:23:39.146 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:38.795+0000 7fd792ede200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:23:39.146 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:38.930+0000 7fd792ede200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:23:39.146 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:39.027+0000 7fd792ede200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:23:39.146 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:39.144+0000 7fd792ede200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:23:39.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:39.447+0000 7fd792ede200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:23:40.323 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:40.049+0000 7fd792ede200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:23:40.323 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:40.268+0000 7fd792ede200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: Active manager daemon x restarted 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: Activating manager daemon x 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: osdmap e2: 0 total, 0 up, 0 in 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: mgrmap e6: x(active, starting, since 0.00368985s) 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:23:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: Manager daemon x is now available 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:23:40.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:40 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:23:41.651 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: Found migration_current of "None". Setting to last migration. 2024-05-20T17:23:41.651 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:23:41.652 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:41.652 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:41.652 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:23:41.652 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:41 smithi135 ceph-mon[32027]: mgrmap e7: x(active, since 1.00633s) 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e7535700 1 Processor -- start 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e7535700 1 -- start start 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e7535700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:41.928 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e7535700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0109960 con 0x7f84e0108f60 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e52d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e52d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49138/0 (socket says 172.21.15.135:49138) 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.592+0000 7f84e52d1700 1 -- 172.21.15.135:0/3363787473 learned_addr learned my addr 172.21.15.135:0/3363787473 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.593+0000 7f84e52d1700 1 -- 172.21.15.135:0/3363787473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e0107be0 con 0x7f84e0108f60 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.593+0000 7f84e52d1700 1 --2- 172.21.15.135:0/3363787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098a0 tx=0x7f84dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e49c811e2e02ed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.593+0000 7f84d7fff700 1 -- 172.21.15.135:0/3363787473 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc004160 con 0x7f84e0108f60 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.593+0000 7f84d7fff700 1 -- 172.21.15.135:0/3363787473 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84dc004300 con 0x7f84e0108f60 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.593+0000 7f84d7fff700 1 -- 172.21.15.135:0/3363787473 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc011b50 con 0x7f84e0108f60 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 -- 172.21.15.135:0/3363787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 msgr2=0x7f84e0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 --2- 172.21.15.135:0/3363787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098a0 tx=0x7f84dc009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 -- 172.21.15.135:0/3363787473 shutdown_connections 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 --2- 172.21.15.135:0/3363787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0109370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 -- 172.21.15.135:0/3363787473 >> 172.21.15.135:0/3363787473 conn(0x7f84e0102760 msgr2=0x7f84e0104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:41.929 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 -- 172.21.15.135:0/3363787473 shutdown_connections 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.594+0000 7f84e7535700 1 -- 172.21.15.135:0/3363787473 wait complete. 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e7535700 1 Processor -- start 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e7535700 1 -- start start 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e7535700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e7535700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e010bfa0 con 0x7f84e0108f60 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e52d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e52d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49142/0 (socket says 172.21.15.135:49142) 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.595+0000 7f84e52d1700 1 -- 172.21.15.135:0/4290031961 learned_addr learned my addr 172.21.15.135:0/4290031961 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:41.930 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84e52d1700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e0107990 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84e52d1700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84dc011710 tx=0x7f84dc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc0038b0 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84dc011e50 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e019fd70 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc0193c0 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.596+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01a01f0 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f84dc019630 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84d67fc700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84cc03bc70 con 0x7f84cc039050 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84dc04d0f0 con 0x7f84e0108f60 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84e4ad0700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.597+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:23:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.798+0000 7f84e4ad0700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:35.798+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:36.199+0000 7f84e4ad0700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:36.199+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:37.000+0000 7f84e4ad0700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:37.000+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:38.601+0000 7f84e4ad0700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3053430682 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:38.601+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:40.272+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f84dc019cf0 con 0x7f84e0108f60 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:40.272+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 msgr2=0x7f84cc03b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:40.272+0000 7f84d67fc700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.274+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f84dc04f040 con 0x7f84e0108f60 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.274+0000 7f84d67fc700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 0x7f84cc03edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.274+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84cc03bc70 con 0x7f84cc03c9d0 2024-05-20T17:23:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.274+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 0x7f84cc03edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.275+0000 7f84e4ad0700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 0x7f84cc03edf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d0003a10 tx=0x7f84d00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.276+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f84cc03bc70 con 0x7f84cc03c9d0 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.282+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f84e0063ca0 con 0x7f84cc03c9d0 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84d67fc700 1 -- 172.21.15.135:0/4290031961 <== mgr.14120 v2:172.21.15.135:6800/45942653 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f84e0063ca0 con 0x7f84cc03c9d0 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 msgr2=0x7f84cc03edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 0x7f84cc03edf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d0003a10 tx=0x7f84d00092b0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 msgr2=0x7f84e0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84dc011710 tx=0x7f84dc011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 shutdown_connections 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f84cc03c9d0 0x7f84cc03edf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e0108f60 0x7f84e0107450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 --2- 172.21.15.135:0/4290031961 >> [v2:172.21.15.135:6800/3053430682,v1:172.21.15.135:6801/3053430682] conn(0x7f84cc039050 0x7f84cc03b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:41.933 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 >> 172.21.15.135:0/4290031961 conn(0x7f84e0102760 msgr2=0x7f84e0103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:41.934 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 shutdown_connections 2024-05-20T17:23:41.934 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:41.283+0000 7f84e7535700 1 -- 172.21.15.135:0/4290031961 wait complete. 2024-05-20T17:23:41.934 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 5 is available 2024-05-20T17:23:41.934 INFO:teuthology.orchestra.run.smithi135.stdout:Setting orchestrator backend to cephadm... 2024-05-20T17:23:42.627 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: [20/May/2024:17:23:40] ENGINE Bus STARTING 2024-05-20T17:23:42.627 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: [20/May/2024:17:23:40] ENGINE Serving on https://172.21.15.135:7150 2024-05-20T17:23:42.627 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: [20/May/2024:17:23:41] ENGINE Serving on http://172.21.15.135:8765 2024-05-20T17:23:42.627 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: [20/May/2024:17:23:41] ENGINE Bus STARTED 2024-05-20T17:23:42.628 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-20T17:23:42.628 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:42 smithi135 ceph-mon[32027]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-20T17:23:43.239 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf8f63700 1 Processor -- start 2024-05-20T17:23:43.239 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf8f63700 1 -- start start 2024-05-20T17:23:43.239 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf8f63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:43.239 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf8f63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf407c6b0 con 0x7f6cf4107450 2024-05-20T17:23:43.239 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60590/0 (socket says 172.21.15.135:60590) 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf259c700 1 -- 172.21.15.135:0/1216524012 learned_addr learned my addr 172.21.15.135:0/1216524012 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.407+0000 7f6cf259c700 1 -- 172.21.15.135:0/1216524012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf4107da0 con 0x7f6cf4107450 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf259c700 1 --2- 172.21.15.135:0/1216524012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40098a0 tx=0x7f6ce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95910143ef928e9e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf1d9b700 1 -- 172.21.15.135:0/1216524012 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce4004160 con 0x7f6cf4107450 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf1d9b700 1 -- 172.21.15.135:0/1216524012 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ce4004300 con 0x7f6cf4107450 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf1d9b700 1 -- 172.21.15.135:0/1216524012 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce4011b50 con 0x7f6cf4107450 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf8f63700 1 -- 172.21.15.135:0/1216524012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 msgr2=0x7f6cf4107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.408+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/1216524012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40098a0 tx=0x7f6ce4009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 -- 172.21.15.135:0/1216524012 shutdown_connections 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/1216524012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf4107860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 -- 172.21.15.135:0/1216524012 >> 172.21.15.135:0/1216524012 conn(0x7f6cf41030c0 msgr2=0x7f6cf4105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:43.240 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 -- 172.21.15.135:0/1216524012 shutdown_connections 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 -- 172.21.15.135:0/1216524012 wait complete. 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 Processor -- start 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.409+0000 7f6cf8f63700 1 -- start start 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf8f63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf8f63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf4108e80 con 0x7f6cf4107450 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60604/0 (socket says 172.21.15.135:60604) 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf259c700 1 -- 172.21.15.135:0/2625052412 learned_addr learned my addr 172.21.15.135:0/2625052412 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf259c700 1 -- 172.21.15.135:0/2625052412 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf419f700 con 0x7f6cf4107450 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf259c700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4011850 tx=0x7f6ce4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce4003af0 con 0x7f6cf4107450 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ce4020070 con 0x7f6cf4107450 2024-05-20T17:23:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf419f990 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce40195a0 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.410+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf41a25a0 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.411+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf4063ca0 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.411+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6ce40198a0 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.412+0000 7f6ceb7fe700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 0x7f6ce003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.412+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6ce4011e00 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.412+0000 7f6cebfff700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 0x7f6ce003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.412+0000 7f6cebfff700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 0x7f6ce003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc006fd0 tx=0x7f6cdc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.417+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ce4003c90 con 0x7f6cf4107450 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.626+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6cf402dfd0 con 0x7f6ce0039050 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.634+0000 7f6ceb7fe700 1 -- 172.21.15.135:0/2625052412 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6cf402dfd0 con 0x7f6ce0039050 2024-05-20T17:23:43.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 msgr2=0x7f6ce003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 0x7f6ce003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc006fd0 tx=0x7f6cdc006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 msgr2=0x7f6cf419f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4011850 tx=0x7f6ce4011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 shutdown_connections 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f6ce0039050 0x7f6ce003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 --2- 172.21.15.135:0/2625052412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf4107450 0x7f6cf419f1c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.636+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 >> 172.21.15.135:0/2625052412 conn(0x7f6cf41030c0 msgr2=0x7f6cf41931a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.637+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 shutdown_connections 2024-05-20T17:23:43.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:42.637+0000 7f6cf8f63700 1 -- 172.21.15.135:0/2625052412 wait complete. 2024-05-20T17:23:43.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:43 smithi135 ceph-mon[32027]: mgrmap e8: x(active, since 2s) 2024-05-20T17:23:43.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:43 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:43.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:43 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:23:44.422 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:44 smithi135 ceph-mon[32027]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:44.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.645+0000 7fe6356cc700 1 Processor -- start 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.645+0000 7fe6356cc700 1 -- start start 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.645+0000 7fe6356cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe6356cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6301083f0 con 0x7fe6301079f0 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60612/0 (socket says 172.21.15.135:60612) 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62effd700 1 -- 172.21.15.135:0/426846401 learned_addr learned my addr 172.21.15.135:0/426846401 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62effd700 1 -- 172.21.15.135:0/426846401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe630108bc0 con 0x7fe6301079f0 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62effd700 1 --2- 172.21.15.135:0/426846401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6200098a0 tx=0x7fe620009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c1ba98fa7d94a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:44.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62e7fc700 1 -- 172.21.15.135:0/426846401 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe620004160 con 0x7fe6301079f0 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62e7fc700 1 -- 172.21.15.135:0/426846401 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe620004300 con 0x7fe6301079f0 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.646+0000 7fe62e7fc700 1 -- 172.21.15.135:0/426846401 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe620011b50 con 0x7fe6301079f0 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 -- 172.21.15.135:0/426846401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 msgr2=0x7fe630107e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 --2- 172.21.15.135:0/426846401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6200098a0 tx=0x7fe620009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 -- 172.21.15.135:0/426846401 shutdown_connections 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 --2- 172.21.15.135:0/426846401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe630107e00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 -- 172.21.15.135:0/426846401 >> 172.21.15.135:0/426846401 conn(0x7fe630103030 msgr2=0x7fe6301054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 -- 172.21.15.135:0/426846401 shutdown_connections 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.647+0000 7fe6356cc700 1 -- 172.21.15.135:0/426846401 wait complete. 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe6356cc700 1 Processor -- start 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe6356cc700 1 -- start start 2024-05-20T17:23:44.431 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe6356cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe6356cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe63010bf70 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe62effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe62effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60622/0 (socket says 172.21.15.135:60622) 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.648+0000 7fe62effd700 1 -- 172.21.15.135:0/1239889946 learned_addr learned my addr 172.21.15.135:0/1239889946 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe62effd700 1 -- 172.21.15.135:0/1239889946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63007c8e0 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe62effd700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6200046e0 tx=0x7fe620011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6200039e0 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63019fd90 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe620003b80 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe620024690 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.649+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6301a0210 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.650+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe630063ca0 con 0x7fe6301079f0 2024-05-20T17:23:44.432 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.650+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe620022020 con 0x7fe6301079f0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.650+0000 7fe62cff9700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 0x7fe61c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.650+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe620011e00 con 0x7fe6301079f0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.650+0000 7fe6267fc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 0x7fe61c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.651+0000 7fe6267fc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 0x7fe61c03b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe618006fd0 tx=0x7fe618006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.656+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe620003d30 con 0x7fe6301079f0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.851+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe630104150 con 0x7fe61c0390a0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.852+0000 7fe62cff9700 1 -- 172.21.15.135:0/1239889946 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe630104150 con 0x7fe61c0390a0 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 msgr2=0x7fe61c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 0x7fe61c03b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe618006fd0 tx=0x7fe618006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 msgr2=0x7fe63007c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6200046e0 tx=0x7fe620011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 shutdown_connections 2024-05-20T17:23:44.433 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fe61c0390a0 0x7fe61c03b5b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:44.434 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 --2- 172.21.15.135:0/1239889946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6301079f0 0x7fe63007c3a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:44.434 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.854+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 >> 172.21.15.135:0/1239889946 conn(0x7fe630103030 msgr2=0x7fe6301039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:44.434 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.855+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 shutdown_connections 2024-05-20T17:23:44.434 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:43.855+0000 7fe6356cc700 1 -- 172.21.15.135:0/1239889946 wait complete. 2024-05-20T17:23:44.434 INFO:teuthology.orchestra.run.smithi135.stdout:Generating ssh key... 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: Generating public/private rsa key pair. 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: Your identification has been saved in /tmp/tmppw6d6lsy/key. 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: Your public key has been saved in /tmp/tmppw6d6lsy/key.pub. 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: The key fingerprint is: 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: SHA256:m7Rvi1wJs/cpzF+nCGvq3NI4meUqzJsP7wPIgYq6uhs ceph-76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: The key's randomart image is: 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: +---[RSA 3072]----+ 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: | | 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: | | 2024-05-20T17:23:45.331 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: | . | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: | . . | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: |.. . o S | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: |o o .. B.. | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: |E o..=X= . .| 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: |.. +*B*O+ + o | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: |*+ o*@O=+= . | 2024-05-20T17:23:45.332 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: +----[SHA256]-----+ 2024-05-20T17:23:45.594 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:45 smithi135 ceph-mon[32027]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:45.594 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:45 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:45.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:45 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.857+0000 7f3e962e1700 1 Processor -- start 2024-05-20T17:23:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e962e1700 1 -- start start 2024-05-20T17:23:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e962e1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e962e1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9007d2a0 con 0x7f3e9007e8a0 2024-05-20T17:23:45.860 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60636/0 (socket says 172.21.15.135:60636) 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e8ffff700 1 -- 172.21.15.135:0/1854983800 learned_addr learned my addr 172.21.15.135:0/1854983800 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e8ffff700 1 -- 172.21.15.135:0/1854983800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9007d420 con 0x7f3e9007e8a0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.858+0000 7f3e8ffff700 1 --2- 172.21.15.135:0/1854983800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098a0 tx=0x7f3e80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8846a6d38bcccaf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e8effd700 1 -- 172.21.15.135:0/1854983800 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e80004160 con 0x7f3e9007e8a0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e8effd700 1 -- 172.21.15.135:0/1854983800 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e80004300 con 0x7f3e9007e8a0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e8effd700 1 -- 172.21.15.135:0/1854983800 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e80011b50 con 0x7f3e9007e8a0 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 -- 172.21.15.135:0/1854983800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 msgr2=0x7f3e9007ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 --2- 172.21.15.135:0/1854983800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098a0 tx=0x7f3e80009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 -- 172.21.15.135:0/1854983800 shutdown_connections 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 --2- 172.21.15.135:0/1854983800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9007ccd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:45.861 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 -- 172.21.15.135:0/1854983800 >> 172.21.15.135:0/1854983800 conn(0x7f3e90104190 msgr2=0x7f3e901065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 -- 172.21.15.135:0/1854983800 shutdown_connections 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.859+0000 7f3e962e1700 1 -- 172.21.15.135:0/1854983800 wait complete. 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.860+0000 7f3e962e1700 1 Processor -- start 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.860+0000 7f3e962e1700 1 -- start start 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.860+0000 7f3e962e1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.860+0000 7f3e962e1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9010f110 con 0x7f3e9007e8a0 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60652/0 (socket says 172.21.15.135:60652) 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8ffff700 1 -- 172.21.15.135:0/2812159603 learned_addr learned my addr 172.21.15.135:0/2812159603 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8ffff700 1 -- 172.21.15.135:0/2812159603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9019f650 con 0x7f3e9007e8a0 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8ffff700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009fb0 tx=0x7f3e80011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:45.862 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e800038b0 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9019f8e0 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e80011e50 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e80019550 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.861+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901a24f0 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.862+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3e80019850 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.862+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e90063ca0 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.862+0000 7f3e8d7fa700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 0x7f3e7803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.862+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e8004d310 con 0x7f3e9007e8a0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.863+0000 7f3e8f7fe700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 0x7f3e7803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.863+0000 7f3e8f7fe700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 0x7f3e7803b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e84006fd0 tx=0x7f3e84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:45.863 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:44.868+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3e8000bc40 con 0x7f3e9007e8a0 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.065+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3e901062b0 con 0x7f3e78039000 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.286+0000 7f3e8d7fa700 1 -- 172.21.15.135:0/2812159603 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e901062b0 con 0x7f3e78039000 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.288+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 msgr2=0x7f3e7803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.288+0000 7f3e962e1700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 0x7f3e7803b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e84006fd0 tx=0x7f3e84006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.288+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 msgr2=0x7f3e9019f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.288+0000 7f3e962e1700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009fb0 tx=0x7f3e80011bf0 comp rx=0 tx=0).stop 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 shutdown_connections 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f3e78039000 0x7f3e7803b510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 --2- 172.21.15.135:0/2812159603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9007e8a0 0x7f3e9019f110 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 >> 172.21.15.135:0/2812159603 conn(0x7f3e90104190 msgr2=0x7f3e90105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 shutdown_connections 2024-05-20T17:23:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:45.289+0000 7f3e962e1700 1 -- 172.21.15.135:0/2812159603 wait complete. 2024-05-20T17:23:46.441 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:46 smithi135 ceph-mon[32027]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:46.441 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:46 smithi135 ceph-mon[32027]: Generating ssh key... 2024-05-20T17:23:47.000 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f4174f97700 1 Processor -- start 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f4174f97700 1 -- start start 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f4174f97700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f4174f97700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f417007c6d0 con 0x7f4170109640 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f416e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f416e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60668/0 (socket says 172.21.15.135:60668) 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f416e59c700 1 -- 172.21.15.135:0/3205723902 learned_addr learned my addr 172.21.15.135:0/3205723902 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f416e59c700 1 -- 172.21.15.135:0/3205723902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417010bfa0 con 0x7f4170109640 2024-05-20T17:23:47.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.232+0000 7f416e59c700 1 --2- 172.21.15.135:0/3205723902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddf335a19cffe35 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f416d59a700 1 -- 172.21.15.135:0/3205723902 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164004160 con 0x7f4170109640 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f416d59a700 1 -- 172.21.15.135:0/3205723902 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4164004300 con 0x7f4170109640 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f416d59a700 1 -- 172.21.15.135:0/3205723902 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164011b50 con 0x7f4170109640 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f4174f97700 1 -- 172.21.15.135:0/3205723902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 msgr2=0x7f417010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f4174f97700 1 --2- 172.21.15.135:0/3205723902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f4174f97700 1 -- 172.21.15.135:0/3205723902 shutdown_connections 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f4174f97700 1 --2- 172.21.15.135:0/3205723902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417010ba60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.233+0000 7f4174f97700 1 -- 172.21.15.135:0/3205723902 >> 172.21.15.135:0/3205723902 conn(0x7f41701030c0 msgr2=0x7f4170105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.234+0000 7f4174f97700 1 -- 172.21.15.135:0/3205723902 shutdown_connections 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.234+0000 7f4174f97700 1 -- 172.21.15.135:0/3205723902 wait complete. 2024-05-20T17:23:47.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.234+0000 7f4174f97700 1 Processor -- start 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.234+0000 7f4174f97700 1 -- start start 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.234+0000 7f4174f97700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f4174f97700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f417010cf60 con 0x7f4170109640 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f416e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f416e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60670/0 (socket says 172.21.15.135:60670) 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f416e59c700 1 -- 172.21.15.135:0/2851468474 learned_addr learned my addr 172.21.15.135:0/2851468474 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f416e59c700 1 -- 172.21.15.135:0/2851468474 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417019d440 con 0x7f4170109640 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f416e59c700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4164011850 tx=0x7f4164011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164003af0 con 0x7f4170109640 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4164020070 con 0x7f4170109640 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417019d6d0 con 0x7f4170109640 2024-05-20T17:23:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41640195a0 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.235+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41701a02e0 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.236+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4170063ca0 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.236+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f41640198a0 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.236+0000 7f415f7fe700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 0x7f415803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.236+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4164011e00 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.237+0000 7f416dd9b700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 0x7f415803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.237+0000 7f416dd9b700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 0x7f415803b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4160006fd0 tx=0x7f4160006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.242+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4164003c90 con 0x7f4170109640 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.440+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f41701050c0 con 0x7f4158039050 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.440+0000 7f415f7fe700 1 -- 172.21.15.135:0/2851468474 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f41701050c0 con 0x7f4158039050 2024-05-20T17:23:47.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 msgr2=0x7f415803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 0x7f415803b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4160006fd0 tx=0x7f4160006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 msgr2=0x7f417019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4164011850 tx=0x7f4164011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 shutdown_connections 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f4158039050 0x7f415803b560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 --2- 172.21.15.135:0/2851468474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4170109640 0x7f417019cf00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 >> 172.21.15.135:0/2851468474 conn(0x7f41701030c0 msgr2=0x7f41701049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 shutdown_connections 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:46.443+0000 7f4174f97700 1 -- 172.21.15.135:0/2851468474 wait complete. 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:Adding key to root@localhost authorized_keys... 2024-05-20T17:23:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:Adding host smithi135... 2024-05-20T17:23:47.582 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:47 smithi135 ceph-mon[32027]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:48 smithi135 ceph-mon[32027]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:48.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:48 smithi135 ceph-mon[32027]: Deploying cephadm binary to smithi135 2024-05-20T17:23:52.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Added host 'smithi135' with addr '172.21.15.135' 2024-05-20T17:23:52.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.374+0000 7f94d9ed5700 1 Processor -- start 2024-05-20T17:23:52.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d9ed5700 1 -- start start 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d9ed5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d9ed5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41094e0 con 0x7f94d4108ae0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60682/0 (socket says 172.21.15.135:60682) 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d37fe700 1 -- 172.21.15.135:0/2979570342 learned_addr learned my addr 172.21.15.135:0/2979570342 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d37fe700 1 -- 172.21.15.135:0/2979570342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d4109cb0 con 0x7f94d4108ae0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.375+0000 7f94d37fe700 1 --2- 172.21.15.135:0/2979570342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0098a0 tx=0x7f94bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2189a8f12369e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d27fc700 1 -- 172.21.15.135:0/2979570342 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94bc004160 con 0x7f94d4108ae0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d27fc700 1 -- 172.21.15.135:0/2979570342 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94bc004300 con 0x7f94d4108ae0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d27fc700 1 -- 172.21.15.135:0/2979570342 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94bc011b50 con 0x7f94d4108ae0 2024-05-20T17:23:52.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2979570342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 msgr2=0x7f94d4108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2979570342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0098a0 tx=0x7f94bc009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2979570342 shutdown_connections 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2979570342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d4108ef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2979570342 >> 172.21.15.135:0/2979570342 conn(0x7f94d41041c0 msgr2=0x7f94d4106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2979570342 shutdown_connections 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.376+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2979570342 wait complete. 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.377+0000 7f94d9ed5700 1 Processor -- start 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.377+0000 7f94d9ed5700 1 -- start start 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.377+0000 7f94d9ed5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.377+0000 7f94d9ed5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94d410d060 con 0x7f94d4108ae0 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60684/0 (socket says 172.21.15.135:60684) 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d37fe700 1 -- 172.21.15.135:0/2009176069 learned_addr learned my addr 172.21.15.135:0/2009176069 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d37fe700 1 -- 172.21.15.135:0/2009176069 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d419d4a0 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d37fe700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009fb0 tx=0x7f94bc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94bc0038b0 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94bc011e50 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d419d730 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94bc01a430 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.378+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d41a0340 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.379+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f94bc01a6e0 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.379+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d4063ca0 con 0x7f94d4108ae0 2024-05-20T17:23:52.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.379+0000 7f94d0ff9700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 0x7f94c003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.379+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f94bc04d3b0 con 0x7f94d4108ae0 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.379+0000 7f94d2ffd700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 0x7f94c003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.380+0000 7f94d2ffd700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 0x7f94c003b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006fd0 tx=0x7f94c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.385+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f94bc024440 con 0x7f94d4108ae0 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:47.581+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}) -- 0x7f94d4106290 con 0x7f94c0039050 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.686+0000 7f94d0ff9700 1 -- 172.21.15.135:0/2009176069 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f94d4106290 con 0x7f94c0039050 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 msgr2=0x7f94c003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 0x7f94c003b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006fd0 tx=0x7f94c4006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 msgr2=0x7f94d419cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009fb0 tx=0x7f94bc011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 shutdown_connections 2024-05-20T17:23:52.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f94c0039050 0x7f94c003b560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 --2- 172.21.15.135:0/2009176069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d4108ae0 0x7f94d419cf60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 >> 172.21.15.135:0/2009176069 conn(0x7f94d41041c0 msgr2=0x7f94d4105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 shutdown_connections 2024-05-20T17:23:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:51.689+0000 7f94d9ed5700 1 -- 172.21.15.135:0/2009176069 wait complete. 2024-05-20T17:23:52.330 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mon service... 2024-05-20T17:23:52.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:52 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:52.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:52 smithi135 ceph-mon[32027]: Added host smithi135 2024-05-20T17:23:52.957 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:52 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.775+0000 7f71d38f8700 1 Processor -- start 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d38f8700 1 -- start start 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d38f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d38f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc109590 con 0x7f71cc108b90 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d1694700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d1694700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43670/0 (socket says 172.21.15.135:43670) 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d1694700 1 -- 172.21.15.135:0/2664931281 learned_addr learned my addr 172.21.15.135:0/2664931281 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.776+0000 7f71d1694700 1 -- 172.21.15.135:0/2664931281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc109cc0 con 0x7f71cc108b90 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71d1694700 1 --2- 172.21.15.135:0/2664931281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e80 tx=0x7f71bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b785f172974f189 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71cbfff700 1 -- 172.21.15.135:0/2664931281 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc017070 con 0x7f71cc108b90 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71cbfff700 1 -- 172.21.15.135:0/2664931281 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71bc00b8c0 con 0x7f71cc108b90 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71cbfff700 1 -- 172.21.15.135:0/2664931281 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc0045c0 con 0x7f71cc108b90 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71d38f8700 1 -- 172.21.15.135:0/2664931281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 msgr2=0x7f71cc108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.777+0000 7f71d38f8700 1 --2- 172.21.15.135:0/2664931281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e80 tx=0x7f71bc00b330 comp rx=0 tx=0).stop 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 -- 172.21.15.135:0/2664931281 shutdown_connections 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 --2- 172.21.15.135:0/2664931281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc108fa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 -- 172.21.15.135:0/2664931281 >> 172.21.15.135:0/2664931281 conn(0x7f71cc104230 msgr2=0x7f71cc106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 -- 172.21.15.135:0/2664931281 shutdown_connections 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 -- 172.21.15.135:0/2664931281 wait complete. 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 Processor -- start 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.778+0000 7f71d38f8700 1 -- start start 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d38f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d38f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc10d070 con 0x7f71cc108b90 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d1694700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d1694700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43684/0 (socket says 172.21.15.135:43684) 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d1694700 1 -- 172.21.15.135:0/4071562614 learned_addr learned my addr 172.21.15.135:0/4071562614 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d1694700 1 -- 172.21.15.135:0/4071562614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc19d4b0 con 0x7f71cc108b90 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d1694700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71bc004350 tx=0x7f71bc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:53.672 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc020020 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71bc012430 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc017040 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc19d740 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.779+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc1a0350 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.780+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc063ca0 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.780+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f71bc023020 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.780+0000 7f71ca7fc700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 0x7f71b403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.780+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f71bc00f050 con 0x7f71cc108b90 2024-05-20T17:23:53.673 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.781+0000 7f71d0e93700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 0x7f71b403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.781+0000 7f71d0e93700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 0x7f71b403b5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f71c0006fd0 tx=0x7f71c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:52.786+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f71bc02a020 con 0x7f71cc108b90 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.000+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f71cc1051b0 con 0x7f71b40390a0 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.005+0000 7f71ca7fc700 1 -- 172.21.15.135:0/4071562614 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f71cc1051b0 con 0x7f71b40390a0 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 msgr2=0x7f71b403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 0x7f71b403b5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f71c0006fd0 tx=0x7f71c0006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 msgr2=0x7f71cc19cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71bc004350 tx=0x7f71bc00bd30 comp rx=0 tx=0).stop 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 shutdown_connections 2024-05-20T17:23:53.674 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f71b40390a0 0x7f71b403b5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:53.675 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 --2- 172.21.15.135:0/4071562614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71cc108b90 0x7f71cc19cf70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:53.675 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 >> 172.21.15.135:0/4071562614 conn(0x7f71cc104230 msgr2=0x7f71cc104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:53.675 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 shutdown_connections 2024-05-20T17:23:53.675 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:53.008+0000 7f71d38f8700 1 -- 172.21.15.135:0/4071562614 wait complete. 2024-05-20T17:23:53.675 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mgr service... 2024-05-20T17:23:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:54 smithi135 ceph-mon[32027]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:54 smithi135 ceph-mon[32027]: Saving service mon spec with placement count:5 2024-05-20T17:23:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:54 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:55.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:55 smithi135 ceph-mon[32027]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:23:55.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:55 smithi135 ceph-mon[32027]: Saving service mgr spec with placement count:2 2024-05-20T17:23:55.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:55 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:55.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:55 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.057+0000 7fd85f6fc700 1 Processor -- start 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.057+0000 7fd85f6fc700 1 -- start start 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.057+0000 7fd85f6fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.057+0000 7fd85f6fc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581083b0 con 0x7fd8581079b0 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd85d498700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd85d498700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43692/0 (socket says 172.21.15.135:43692) 2024-05-20T17:23:55.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd85d498700 1 -- 172.21.15.135:0/504875180 learned_addr learned my addr 172.21.15.135:0/504875180 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd85d498700 1 -- 172.21.15.135:0/504875180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858108b80 con 0x7fd8581079b0 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd85d498700 1 --2- 172.21.15.135:0/504875180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098a0 tx=0x7fd854009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40beb3facd3a7eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd84ffff700 1 -- 172.21.15.135:0/504875180 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854004160 con 0x7fd8581079b0 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd84ffff700 1 -- 172.21.15.135:0/504875180 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd854004300 con 0x7fd8581079b0 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.058+0000 7fd84ffff700 1 -- 172.21.15.135:0/504875180 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854011b50 con 0x7fd8581079b0 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 -- 172.21.15.135:0/504875180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 msgr2=0x7fd858107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/504875180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098a0 tx=0x7fd854009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 -- 172.21.15.135:0/504875180 shutdown_connections 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/504875180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd858107dc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 -- 172.21.15.135:0/504875180 >> 172.21.15.135:0/504875180 conn(0x7fd8581030d0 msgr2=0x7fd858105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 -- 172.21.15.135:0/504875180 shutdown_connections 2024-05-20T17:23:55.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.059+0000 7fd85f6fc700 1 -- 172.21.15.135:0/504875180 wait complete. 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85f6fc700 1 Processor -- start 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85f6fc700 1 -- start start 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85f6fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85f6fc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd85810bf30 con 0x7fd8581079b0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85d498700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85d498700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43698/0 (socket says 172.21.15.135:43698) 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.060+0000 7fd85d498700 1 -- 172.21.15.135:0/2784363033 learned_addr learned my addr 172.21.15.135:0/2784363033 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd85d498700 1 -- 172.21.15.135:0/2784363033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85819c350 con 0x7fd8581079b0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd85d498700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd854009fb0 tx=0x7fd854011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8540038b0 con 0x7fd8581079b0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd854011e50 con 0x7fd8581079b0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85819c5e0 con 0x7fd8581079b0 2024-05-20T17:23:55.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85401a430 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.061+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85819f1f0 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.062+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd85401a6e0 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.062+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd858063ca0 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.062+0000 7fd84e7fc700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 0x7fd84403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.062+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd85404d2f0 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.062+0000 7fd85cc97700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 0x7fd84403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.063+0000 7fd85cc97700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 0x7fd84403b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.067+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd854024440 con 0x7fd8581079b0 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.284+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fd8581050f0 con 0x7fd844039050 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.289+0000 7fd84e7fc700 1 -- 172.21.15.135:0/2784363033 <== mgr.14120 v2:172.21.15.135:6800/45942653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd8581050f0 con 0x7fd844039050 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 msgr2=0x7fd84403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 0x7fd84403b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:55.624 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 msgr2=0x7fd85819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd854009fb0 tx=0x7fd854011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 shutdown_connections 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fd844039050 0x7fd84403b560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 --2- 172.21.15.135:0/2784363033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8581079b0 0x7fd85819be10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 >> 172.21.15.135:0/2784363033 conn(0x7fd8581030d0 msgr2=0x7fd8581049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 shutdown_connections 2024-05-20T17:23:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:54.291+0000 7fd85f6fc700 1 -- 172.21.15.135:0/2784363033 wait complete. 2024-05-20T17:23:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:56 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:56 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2459884064' entity='client.admin' 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.140+0000 7f62c5453700 1 Processor -- start 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.140+0000 7f62c5453700 1 -- start start 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.140+0000 7f62c5453700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.140+0000 7f62c5453700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62c010bc90 con 0x7f62c007bcf0 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43712/0 (socket says 172.21.15.135:43712) 2024-05-20T17:23:56.962 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62beffd700 1 -- 172.21.15.135:0/322919824 learned_addr learned my addr 172.21.15.135:0/322919824 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62beffd700 1 -- 172.21.15.135:0/322919824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c010be10 con 0x7f62c007bcf0 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62beffd700 1 --2- 172.21.15.135:0/322919824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62b00098a0 tx=0x7f62b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11a98724db56b74 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62bdffb700 1 -- 172.21.15.135:0/322919824 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62b0004160 con 0x7f62c007bcf0 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62bdffb700 1 -- 172.21.15.135:0/322919824 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b0004300 con 0x7f62c007bcf0 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.141+0000 7f62bdffb700 1 -- 172.21.15.135:0/322919824 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62b0011b20 con 0x7f62c007bcf0 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 -- 172.21.15.135:0/322919824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 msgr2=0x7f62c010b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 --2- 172.21.15.135:0/322919824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62b00098a0 tx=0x7f62b0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:56.963 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 -- 172.21.15.135:0/322919824 shutdown_connections 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 --2- 172.21.15.135:0/322919824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c010b680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 -- 172.21.15.135:0/322919824 >> 172.21.15.135:0/322919824 conn(0x7f62c01030d0 msgr2=0x7f62c0105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 -- 172.21.15.135:0/322919824 shutdown_connections 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.142+0000 7f62c5453700 1 -- 172.21.15.135:0/322919824 wait complete. 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.143+0000 7f62c5453700 1 Processor -- start 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.143+0000 7f62c5453700 1 -- start start 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.143+0000 7f62c5453700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.143+0000 7f62c5453700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62c010cf30 con 0x7f62c007bcf0 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43716/0 (socket says 172.21.15.135:43716) 2024-05-20T17:23:56.964 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62beffd700 1 -- 172.21.15.135:0/2459884064 learned_addr learned my addr 172.21.15.135:0/2459884064 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62beffd700 1 -- 172.21.15.135:0/2459884064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c019d3f0 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62beffd700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62b0003b60 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b001a910 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c019d680 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62b0024930 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.144+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c01a0290 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.145+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f62b0022020 con 0x7f62c007bcf0 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.145+0000 7f62a7fff700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 0x7f62a803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:56.965 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.146+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f62b004e230 con 0x7f62c007bcf0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.146+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c0063ca0 con 0x7f62c007bcf0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.146+0000 7f62be7fc700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 0x7f62a803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.146+0000 7f62be7fc700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 0x7f62a803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.151+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f62b0021d80 con 0x7f62c007bcf0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.354+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f62c019dae0 con 0x7f62c007bcf0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.357+0000 7f62a7fff700 1 -- 172.21.15.135:0/2459884064 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f62b002dc90 con 0x7f62c007bcf0 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 msgr2=0x7f62a803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 0x7f62a803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 msgr2=0x7f62c019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b0011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 shutdown_connections 2024-05-20T17:23:56.966 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f62a8039050 0x7f62a803b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:56.967 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 --2- 172.21.15.135:0/2459884064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c007bcf0 0x7f62c019ceb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:56.967 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.360+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 >> 172.21.15.135:0/2459884064 conn(0x7f62c01030d0 msgr2=0x7f62c0104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:56.967 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.361+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 shutdown_connections 2024-05-20T17:23:56.967 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:56.361+0000 7f62c5453700 1 -- 172.21.15.135:0/2459884064 wait complete. 2024-05-20T17:23:58.390 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bf396700 1 Processor -- start 2024-05-20T17:23:58.396 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bf396700 1 -- start start 2024-05-20T17:23:58.396 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bf396700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:58.396 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bf396700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8108400 con 0x7fc9b8107a00 2024-05-20T17:23:58.396 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bd132700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bd132700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43728/0 (socket says 172.21.15.135:43728) 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.385+0000 7fc9bd132700 1 -- 172.21.15.135:0/4190362380 learned_addr learned my addr 172.21.15.135:0/4190362380 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.386+0000 7fc9bd132700 1 -- 172.21.15.135:0/4190362380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8108bd0 con 0x7fc9b8107a00 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.386+0000 7fc9bd132700 1 --2- 172.21.15.135:0/4190362380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40098a0 tx=0x7fc9b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb6b1f009de00f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.386+0000 7fc9affff700 1 -- 172.21.15.135:0/4190362380 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b4004160 con 0x7fc9b8107a00 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.386+0000 7fc9affff700 1 -- 172.21.15.135:0/4190362380 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4004300 con 0x7fc9b8107a00 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.386+0000 7fc9affff700 1 -- 172.21.15.135:0/4190362380 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b4011b20 con 0x7fc9b8107a00 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 -- 172.21.15.135:0/4190362380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 msgr2=0x7fc9b8107e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 --2- 172.21.15.135:0/4190362380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40098a0 tx=0x7fc9b4009bb0 comp rx=0 tx=0).stop 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 -- 172.21.15.135:0/4190362380 shutdown_connections 2024-05-20T17:23:58.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 --2- 172.21.15.135:0/4190362380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b8107e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 -- 172.21.15.135:0/4190362380 >> 172.21.15.135:0/4190362380 conn(0x7fc9b81030c0 msgr2=0x7fc9b8105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 -- 172.21.15.135:0/4190362380 shutdown_connections 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.387+0000 7fc9bf396700 1 -- 172.21.15.135:0/4190362380 wait complete. 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bf396700 1 Processor -- start 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bf396700 1 -- start start 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bf396700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bf396700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b810bf80 con 0x7fc9b8107a00 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bd132700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bd132700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43738/0 (socket says 172.21.15.135:43738) 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bd132700 1 -- 172.21.15.135:0/1473913723 learned_addr learned my addr 172.21.15.135:0/1473913723 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:23:58.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bd132700 1 -- 172.21.15.135:0/1473913723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b819d4e0 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bd132700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009fb0 tx=0x7fc9b4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b4003930 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4003ad0 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b819d770 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.388+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b4019670 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.389+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b81a0380 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.389+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc9b4019970 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.389+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b819dbd0 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.390+0000 7fc9ae7fc700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 0x7fc9a403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.390+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc9b404d680 con 0x7fc9b8107a00 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.390+0000 7fc9bc931700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 0x7fc9a403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:23:58.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.390+0000 7fc9bc931700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 0x7fc9a403b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8006fd0 tx=0x7fc9a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.395+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc9b4011e20 con 0x7fc9b8107a00 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.596+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc9b802de20 con 0x7fc9b8107a00 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.599+0000 7fc9ae7fc700 1 -- 172.21.15.135:0/1473913723 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc9b4019d60 con 0x7fc9b8107a00 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 msgr2=0x7fc9a403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 0x7fc9a403b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8006fd0 tx=0x7fc9a8006e40 comp rx=0 tx=0).stop 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 msgr2=0x7fc9b819cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009fb0 tx=0x7fc9b4011c10 comp rx=0 tx=0).stop 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 shutdown_connections 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc9a4039000 0x7fc9a403b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 --2- 172.21.15.135:0/1473913723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b8107a00 0x7fc9b819cfa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:23:58.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 >> 172.21.15.135:0/1473913723 conn(0x7fc9b81030c0 msgr2=0x7fc9b8193530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:23:58.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 shutdown_connections 2024-05-20T17:23:58.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:57.601+0000 7fc9bf396700 1 -- 172.21.15.135:0/1473913723 wait complete. 2024-05-20T17:23:58.401 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling the dashboard module... 2024-05-20T17:23:58.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:58 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1473913723' entity='client.admin' 2024-05-20T17:23:59.920 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:59 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4242859100' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-20T17:23:59.920 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:23:59 smithi135 ceph-mon[32027]: from='mgr.14120 172.21.15.135:0/4233377045' entity='mgr.x' 2024-05-20T17:23:59.920 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setuser ceph since I am not root 2024-05-20T17:23:59.920 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setgroup ceph since I am not root 2024-05-20T17:23:59.921 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:23:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:59.810+0000 7f58b5dcd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:24:00.196 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:23:59.999+0000 7f58b5dcd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:24:00.196 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:00.105+0000 7f58b5dcd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.809+0000 7fc3c9148700 1 Processor -- start 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.809+0000 7fc3c9148700 1 -- start start 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.809+0000 7fc3c9148700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.809+0000 7fc3c9148700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c407c6d0 con 0x7fc3c4109610 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43754/0 (socket says 172.21.15.135:43754) 2024-05-20T17:24:00.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c2d9d700 1 -- 172.21.15.135:0/704936753 learned_addr learned my addr 172.21.15.135:0/704936753 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c2d9d700 1 -- 172.21.15.135:0/704936753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c410bf70 con 0x7fc3c4109610 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c2d9d700 1 --2- 172.21.15.135:0/704936753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40098a0 tx=0x7fc3b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6eeec466404434 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c259c700 1 -- 172.21.15.135:0/704936753 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4004160 con 0x7fc3c4109610 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c259c700 1 -- 172.21.15.135:0/704936753 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b4004300 con 0x7fc3c4109610 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.810+0000 7fc3c259c700 1 -- 172.21.15.135:0/704936753 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4011b20 con 0x7fc3c4109610 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 -- 172.21.15.135:0/704936753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 msgr2=0x7fc3c410ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 --2- 172.21.15.135:0/704936753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40098a0 tx=0x7fc3b4009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 -- 172.21.15.135:0/704936753 shutdown_connections 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 --2- 172.21.15.135:0/704936753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c410ba30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 -- 172.21.15.135:0/704936753 >> 172.21.15.135:0/704936753 conn(0x7fc3c41030b0 msgr2=0x7fc3c4105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 -- 172.21.15.135:0/704936753 shutdown_connections 2024-05-20T17:24:00.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.811+0000 7fc3c9148700 1 -- 172.21.15.135:0/704936753 wait complete. 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c9148700 1 Processor -- start 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c9148700 1 -- start start 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c9148700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c9148700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c410cf70 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43766/0 (socket says 172.21.15.135:43766) 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.812+0000 7fc3c2d9d700 1 -- 172.21.15.135:0/4242859100 learned_addr learned my addr 172.21.15.135:0/4242859100 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c2d9d700 1 -- 172.21.15.135:0/4242859100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c419d3e0 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c2d9d700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4000c00 tx=0x7fc3b4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4003b60 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b401a910 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c419d670 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4024930 con 0x7fc3c4109610 2024-05-20T17:24:00.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.813+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c41a0280 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.814+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc3b4022020 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.814+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c419dad0 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.814+0000 7fc3c0d99700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 0x7fc3b003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.814+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc3b404d1d0 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.814+0000 7fc3bbfff700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 0x7fc3b003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.815+0000 7fc3bbfff700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 0x7fc3b003b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006fd0 tx=0x7fc3ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:58.819+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc3b402c510 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.073+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc3c41a0450 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.603+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc3b402ad60 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.604+0000 7fc3c0d99700 1 -- 172.21.15.135:0/4242859100 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fc3b402dc90 con 0x7fc3c4109610 2024-05-20T17:24:00.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 msgr2=0x7fc3b003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 0x7fc3b003b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006fd0 tx=0x7fc3ac006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 msgr2=0x7fc3c419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4000c00 tx=0x7fc3b4011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 shutdown_connections 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7fc3b00390a0 0x7fc3b003b5b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 --2- 172.21.15.135:0/4242859100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3c4109610 0x7fc3c419cea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 >> 172.21.15.135:0/4242859100 conn(0x7fc3c41030b0 msgr2=0x7fc3c4104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 shutdown_connections 2024-05-20T17:24:00.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:23:59.606+0000 7fc3c9148700 1 -- 172.21.15.135:0/4242859100 wait complete. 2024-05-20T17:24:00.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:00.438+0000 7f58b5dcd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:24:00.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:00 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4242859100' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-20T17:24:00.818 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:00 smithi135 ceph-mon[32027]: mgrmap e9: x(active, since 19s) 2024-05-20T17:24:00.818 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:00.529+0000 7f58b5dcd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:24:01.447 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.610+0000 7ff2ac639700 1 Processor -- start 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.610+0000 7ff2ac639700 1 -- start start 2024-05-20T17:24:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.610+0000 7ff2ac639700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.610+0000 7ff2ac639700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41083c0 con 0x7ff2a41079c0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.611+0000 7ff2aa3d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.611+0000 7ff2aa3d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49958/0 (socket says 172.21.15.135:49958) 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.611+0000 7ff2aa3d5700 1 -- 172.21.15.135:0/3992476618 learned_addr learned my addr 172.21.15.135:0/3992476618 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.611+0000 7ff2aa3d5700 1 -- 172.21.15.135:0/3992476618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a4108b90 con 0x7ff2a41079c0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.611+0000 7ff2aa3d5700 1 --2- 172.21.15.135:0/3992476618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00098a0 tx=0x7ff2a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fe46868f998a57 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.612+0000 7ff2a93d3700 1 -- 172.21.15.135:0/3992476618 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2a0004160 con 0x7ff2a41079c0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.612+0000 7ff2a93d3700 1 -- 172.21.15.135:0/3992476618 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a0004300 con 0x7ff2a41079c0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.612+0000 7ff2a93d3700 1 -- 172.21.15.135:0/3992476618 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2a0011b20 con 0x7ff2a41079c0 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.612+0000 7ff2ac639700 1 -- 172.21.15.135:0/3992476618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 msgr2=0x7ff2a4107dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.612+0000 7ff2ac639700 1 --2- 172.21.15.135:0/3992476618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00098a0 tx=0x7ff2a0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:01.454 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 -- 172.21.15.135:0/3992476618 shutdown_connections 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 --2- 172.21.15.135:0/3992476618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a4107dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 -- 172.21.15.135:0/3992476618 >> 172.21.15.135:0/3992476618 conn(0x7ff2a4103060 msgr2=0x7ff2a41054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 -- 172.21.15.135:0/3992476618 shutdown_connections 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 -- 172.21.15.135:0/3992476618 wait complete. 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 Processor -- start 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.613+0000 7ff2ac639700 1 -- start start 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2ac639700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2ac639700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a410bf40 con 0x7ff2a41079c0 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2aa3d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2aa3d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49968/0 (socket says 172.21.15.135:49968) 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2aa3d5700 1 -- 172.21.15.135:0/2218802944 learned_addr learned my addr 172.21.15.135:0/2218802944 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2aa3d5700 1 -- 172.21.15.135:0/2218802944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a419c3b0 con 0x7ff2a41079c0 2024-05-20T17:24:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2aa3d5700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009fb0 tx=0x7ff2a0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2a0003930 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a419c640 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a0003ad0 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.614+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2a0019670 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.615+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a419f250 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a419caa0 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff2a0019980 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff29b7fe700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 0x7ff29003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff2a004d8f0 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff2a9bd4700 1 -- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 msgr2=0x7ff29003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.616+0000 7ff2a9bd4700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 0x7ff29003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.621+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2a0011e20 con 0x7ff2a41079c0 2024-05-20T17:24:01.456 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.817+0000 7ff2a9bd4700 1 -- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 msgr2=0x7ff29003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.817+0000 7ff2a9bd4700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 0x7ff29003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.873+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff2a407be90 con 0x7ff2a41079c0 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.873+0000 7ff29b7fe700 1 -- 172.21.15.135:0/2218802944 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff2a0019dc0 con 0x7ff2a41079c0 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.875+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 msgr2=0x7ff29003b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.875+0000 7ff2ac639700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 0x7ff29003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.875+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 msgr2=0x7ff2a419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.875+0000 7ff2ac639700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009fb0 tx=0x7ff2a0011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 shutdown_connections 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7ff2900390b0 0x7ff29003b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 --2- 172.21.15.135:0/2218802944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2a41079c0 0x7ff2a419be70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 >> 172.21.15.135:0/2218802944 conn(0x7ff2a4103060 msgr2=0x7ff2a41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 shutdown_connections 2024-05-20T17:24:01.457 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:00.876+0000 7ff2ac639700 1 -- 172.21.15.135:0/2218802944 wait complete. 2024-05-20T17:24:01.458 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-05-20T17:24:01.458 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 9... 2024-05-20T17:24:01.830 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:01 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2218802944' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T17:24:01.830 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:01.744+0000 7f58b5dcd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:24:02.100 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:01.926+0000 7f58b5dcd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:24:02.100 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:02.099+0000 7f58b5dcd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:24:02.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:02.397+0000 7f58b5dcd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:24:02.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:02.492+0000 7f58b5dcd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:24:02.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:02.699+0000 7f58b5dcd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:24:02.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:02.901+0000 7f58b5dcd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:24:03.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:03.503+0000 7f58b5dcd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:24:04.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:03.938+0000 7f58b5dcd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:24:04.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:04.037+0000 7f58b5dcd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:24:04.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:04.246+0000 7f58b5dcd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:24:05.135 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:04.792+0000 7f58b5dcd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:24:05.135 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:04.886+0000 7f58b5dcd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:24:05.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:05.134+0000 7f58b5dcd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:24:05.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:05.270+0000 7f58b5dcd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:24:05.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:05.367+0000 7f58b5dcd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:24:05.790 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:05.486+0000 7f58b5dcd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:24:05.790 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:05.789+0000 7f58b5dcd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:24:06.670 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:06.394+0000 7f58b5dcd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:24:06.670 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:06.616+0000 7f58b5dcd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: Active manager daemon x restarted 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: Activating manager daemon x 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: osdmap e3: 0 total, 0 up, 0 in 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: mgrmap e10: x(active, starting, since 0.00374399s) 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:24:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: Manager daemon x is now available 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:24:07.851 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:24:07.851 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:07 smithi135 ceph-mon[32027]: mgrmap e11: x(active, since 1.00728s) 2024-05-20T17:24:08.587 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f6699e5f700 1 Processor -- start 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f6699e5f700 1 -- start start 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f6699e5f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f6699e5f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6694108370 con 0x7f6694107970 2024-05-20T17:24:08.588 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f66937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f66937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49970/0 (socket says 172.21.15.135:49970) 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.943+0000 7f66937fe700 1 -- 172.21.15.135:0/118084551 learned_addr learned my addr 172.21.15.135:0/118084551 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.944+0000 7f66937fe700 1 -- 172.21.15.135:0/118084551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6694108b40 con 0x7f6694107970 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.944+0000 7f66937fe700 1 --2- 172.21.15.135:0/118084551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66840098a0 tx=0x7f6684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5846f84fd5961846 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.944+0000 7f66927fc700 1 -- 172.21.15.135:0/118084551 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684004160 con 0x7f6694107970 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.944+0000 7f66927fc700 1 -- 172.21.15.135:0/118084551 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6684004300 con 0x7f6694107970 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.944+0000 7f66927fc700 1 -- 172.21.15.135:0/118084551 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684011b20 con 0x7f6694107970 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 -- 172.21.15.135:0/118084551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 msgr2=0x7f6694107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 --2- 172.21.15.135:0/118084551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66840098a0 tx=0x7f6684009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 -- 172.21.15.135:0/118084551 shutdown_connections 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 --2- 172.21.15.135:0/118084551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f6694107d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.589 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 -- 172.21.15.135:0/118084551 >> 172.21.15.135:0/118084551 conn(0x7f6694103010 msgr2=0x7f6694105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 -- 172.21.15.135:0/118084551 shutdown_connections 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.945+0000 7f6699e5f700 1 -- 172.21.15.135:0/118084551 wait complete. 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f6699e5f700 1 Processor -- start 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f6699e5f700 1 -- start start 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f6699e5f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f6699e5f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f669407b170 con 0x7f6694107970 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f66937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f66937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49976/0 (socket says 172.21.15.135:49976) 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f66937fe700 1 -- 172.21.15.135:0/1965749795 learned_addr learned my addr 172.21.15.135:0/1965749795 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.946+0000 7f66937fe700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669419b250 con 0x7f6694107970 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f66937fe700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6684011af0 tx=0x7f6684011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:08.590 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684003af0 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6684003c90 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684024840 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669419b4e0 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.947+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669419e0e0 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6684022020 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6690ff9700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f667c03df70 con 0x7f667c03b350 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6692ffd700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f668404d330 con 0x7f6694107970 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:01.948+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:02.149+0000 7f6692ffd700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:02.149+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:24:08.591 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:02.550+0000 7f6692ffd700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:02.550+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:03.351+0000 7f6692ffd700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:03.351+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:04.952+0000 7f6692ffd700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/45942653 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:04.952+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:06.620+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f668402d3f0 con 0x7f6694107970 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:06.620+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 msgr2=0x7f667c03d860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:06.620+0000 7f6690ff9700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.621+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f668404eec0 con 0x7f6694107970 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.622+0000 7f6690ff9700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 0x7f667c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.622+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f668402be50 con 0x7f668404cec0 2024-05-20T17:24:08.592 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.622+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 0x7f667c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.623+0000 7f6692ffd700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 0x7f667c040e70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6688003a10 tx=0x7f6688009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.624+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f668402be50 con 0x7f668404cec0 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6694063ca0 con 0x7f668404cec0 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6690ff9700 1 -- 172.21.15.135:0/1965749795 <== mgr.14152 v2:172.21.15.135:6800/3106262554 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f6694063ca0 con 0x7f668404cec0 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 msgr2=0x7f667c040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6699e5f700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 0x7f667c040e70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6688003a10 tx=0x7f6688009270 comp rx=0 tx=0).stop 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 msgr2=0x7f669419ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.631+0000 7f6699e5f700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6684011af0 tx=0x7f6684011bd0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 shutdown_connections 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f668404cec0 0x7f667c040e70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6694107970 0x7f669419ad10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 --2- 172.21.15.135:0/1965749795 >> [v2:172.21.15.135:6800/45942653,v1:172.21.15.135:6801/45942653] conn(0x7f667c03b350 0x7f667c03d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:08.593 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 >> 172.21.15.135:0/1965749795 conn(0x7f6694103010 msgr2=0x7f6694190fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:08.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 shutdown_connections 2024-05-20T17:24:08.594 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:07.632+0000 7f6699e5f700 1 -- 172.21.15.135:0/1965749795 wait complete. 2024-05-20T17:24:08.594 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 9 is available 2024-05-20T17:24:08.594 INFO:teuthology.orchestra.run.smithi135.stdout:Generating a dashboard self-signed certificate... 2024-05-20T17:24:08.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:08 smithi135 ceph-mon[32027]: [20/May/2024:17:24:07] ENGINE Bus STARTING 2024-05-20T17:24:08.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:08 smithi135 ceph-mon[32027]: [20/May/2024:17:24:07] ENGINE Serving on http://172.21.15.135:8765 2024-05-20T17:24:08.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:08 smithi135 ceph-mon[32027]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-20T17:24:08.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:08 smithi135 ceph-mon[32027]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-20T17:24:08.932 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:09.943 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:09 smithi135 ceph-mon[32027]: [20/May/2024:17:24:07] ENGINE Serving on https://172.21.15.135:7150 2024-05-20T17:24:09.943 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:09 smithi135 ceph-mon[32027]: [20/May/2024:17:24:07] ENGINE Bus STARTED 2024-05-20T17:24:09.943 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:09 smithi135 ceph-mon[32027]: mgrmap e12: x(active, since 2s) 2024-05-20T17:24:09.943 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:09.943 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:09.950 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.039+0000 7f4fb7a5e700 1 Processor -- start 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.039+0000 7f4fb7a5e700 1 -- start start 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb7a5e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb7a5e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb01083b0 con 0x7f4fb01079b0 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb57fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb57fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50048/0 (socket says 172.21.15.135:50048) 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb57fa700 1 -- 172.21.15.135:0/347357511 learned_addr learned my addr 172.21.15.135:0/347357511 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb57fa700 1 -- 172.21.15.135:0/347357511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb0108b80 con 0x7f4fb01079b0 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.040+0000 7f4fb57fa700 1 --2- 172.21.15.135:0/347357511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009e80 tx=0x7f4fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a366d150d8df5ab server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.041+0000 7f4fa7fff700 1 -- 172.21.15.135:0/347357511 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac017070 con 0x7f4fb01079b0 2024-05-20T17:24:09.951 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.041+0000 7f4fa7fff700 1 -- 172.21.15.135:0/347357511 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fac00b8c0 con 0x7f4fb01079b0 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.041+0000 7f4fa7fff700 1 -- 172.21.15.135:0/347357511 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac0045c0 con 0x7f4fb01079b0 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.041+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/347357511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 msgr2=0x7f4fb0107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.041+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/347357511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009e80 tx=0x7f4fac00b330 comp rx=0 tx=0).stop 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/347357511 shutdown_connections 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/347357511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb0107dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/347357511 >> 172.21.15.135:0/347357511 conn(0x7f4fb01030d0 msgr2=0x7f4fb0105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/347357511 shutdown_connections 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/347357511 wait complete. 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 Processor -- start 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.042+0000 7f4fb7a5e700 1 -- start start 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb7a5e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:09.952 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb7a5e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb010bf30 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb57fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb57fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50056/0 (socket says 172.21.15.135:50056) 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb57fa700 1 -- 172.21.15.135:0/462937134 learned_addr learned my addr 172.21.15.135:0/462937134 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb57fa700 1 -- 172.21.15.135:0/462937134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb019c330 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb57fa700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009fd0 tx=0x7f4fac004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac020020 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fac012430 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb019c5c0 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac017040 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.043+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb019f190 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.044+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f4fac023020 con 0x7f4fb01079b0 2024-05-20T17:24:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.044+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb0063ca0 con 0x7f4fb01079b0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.045+0000 7f4fa67fc700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 0x7f4f9c03b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.045+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4fac00f050 con 0x7f4fb01079b0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.045+0000 7f4fb4ff9700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 0x7f4f9c03b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.045+0000 7f4fb4ff9700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 0x7f4f9c03b4a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0006fd0 tx=0x7f4fa0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.050+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fac02a020 con 0x7f4fb01079b0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.229+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f4fac025400 con 0x7f4fb01079b0 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.260+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4fb0105070 con 0x7f4f9c038f90 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.336+0000 7f4fa67fc700 1 -- 172.21.15.135:0/462937134 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4fb0105070 con 0x7f4f9c038f90 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 msgr2=0x7f4f9c03b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 0x7f4f9c03b4a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0006fd0 tx=0x7f4fa0006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:09.954 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 msgr2=0x7f4fb019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009fd0 tx=0x7f4fac004050 comp rx=0 tx=0).stop 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 shutdown_connections 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4f9c038f90 0x7f4f9c03b4a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 --2- 172.21.15.135:0/462937134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb01079b0 0x7f4fb019bdf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 >> 172.21.15.135:0/462937134 conn(0x7f4fb01030d0 msgr2=0x7f4fb0104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 shutdown_connections 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:09.338+0000 7f4fb7a5e700 1 -- 172.21.15.135:0/462937134 wait complete. 2024-05-20T17:24:09.955 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial admin user... 2024-05-20T17:24:10.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:10 smithi135 ceph-mon[32027]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Cl2kiTlNiMMFqYcR7wo2UeDM7sMcvcs69iU4T1bS3B66ip8zmh5Q.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1716225850, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dd1a86700 1 Processor -- start 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dd1a86700 1 -- start start 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dd1a86700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dd1a86700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc07d050 con 0x7f1dcc07e640 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52224/0 (socket says 172.21.15.135:52224) 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.352+0000 7f1dcb7fe700 1 -- 172.21.15.135:0/169587835 learned_addr learned my addr 172.21.15.135:0/169587835 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.353+0000 7f1dcb7fe700 1 -- 172.21.15.135:0/169587835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc07d1d0 con 0x7f1dcc07e640 2024-05-20T17:24:11.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.353+0000 7f1dcb7fe700 1 --2- 172.21.15.135:0/169587835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00098a0 tx=0x7f1dc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a2dcec96229570 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.353+0000 7f1dca7fc700 1 -- 172.21.15.135:0/169587835 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc0004160 con 0x7f1dcc07e640 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.353+0000 7f1dca7fc700 1 -- 172.21.15.135:0/169587835 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc0004300 con 0x7f1dcc07e640 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.353+0000 7f1dca7fc700 1 -- 172.21.15.135:0/169587835 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc0011b20 con 0x7f1dcc07e640 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 -- 172.21.15.135:0/169587835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 msgr2=0x7f1dcc07cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/169587835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00098a0 tx=0x7f1dc0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 -- 172.21.15.135:0/169587835 shutdown_connections 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/169587835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc07cb10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 -- 172.21.15.135:0/169587835 >> 172.21.15.135:0/169587835 conn(0x7f1dcc104230 msgr2=0x7f1dcc106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 -- 172.21.15.135:0/169587835 shutdown_connections 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 -- 172.21.15.135:0/169587835 wait complete. 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.354+0000 7f1dd1a86700 1 Processor -- start 2024-05-20T17:24:11.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dd1a86700 1 -- start start 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dd1a86700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dd1a86700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10f190 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dcb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52230/0 (socket says 172.21.15.135:52230) 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dcb7fe700 1 -- 172.21.15.135:0/1943655747 learned_addr learned my addr 172.21.15.135:0/1943655747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dcb7fe700 1 -- 172.21.15.135:0/1943655747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc19f630 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dcb7fe700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0000c00 tx=0x7f1dc0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.355+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc0003b60 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.356+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc001a910 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.356+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc19f8c0 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.356+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc0024930 con 0x7f1dcc07e640 2024-05-20T17:24:11.401 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.356+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc1a24d0 con 0x7f1dcc07e640 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc063ca0 con 0x7f1dcc07e640 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1dc0022020 con 0x7f1dcc07e640 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dc8ff9700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 0x7f1db403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1dc004d3e0 con 0x7f1dcc07e640 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dcaffd700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 0x7f1db403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.357+0000 7f1dcaffd700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 0x7f1db403b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc006fd0 tx=0x7f1dbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.362+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1dc000b5a0 con 0x7f1dcc07e640 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.582+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f1dcc1a2760 con 0x7f1db40390a0 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.810+0000 7f1dc8ff9700 1 -- 172.21.15.135:0/1943655747 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f1dcc1a2760 con 0x7f1db40390a0 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 msgr2=0x7f1db403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:11.402 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 0x7f1db403b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc006fd0 tx=0x7f1dbc006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 msgr2=0x7f1dcc19f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0000c00 tx=0x7f1dc0011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 shutdown_connections 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1db40390a0 0x7f1db403b5b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 --2- 172.21.15.135:0/1943655747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc07e640 0x7f1dcc19f0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 >> 172.21.15.135:0/1943655747 conn(0x7f1dcc104230 msgr2=0x7f1dcc104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 shutdown_connections 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:10.812+0000 7f1dd1a86700 1 -- 172.21.15.135:0/1943655747 wait complete. 2024-05-20T17:24:11.403 INFO:teuthology.orchestra.run.smithi135.stdout:Fetching dashboard port number... 2024-05-20T17:24:11.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:11 smithi135 ceph-mon[32027]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:11.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:12 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/437432575' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-20T17:24:13.059 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 8443 2024-05-20T17:24:13.059 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.877+0000 7fddab490700 1 Processor -- start 2024-05-20T17:24:13.059 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.877+0000 7fddab490700 1 -- start start 2024-05-20T17:24:13.059 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fddab490700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fddab490700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41094e0 con 0x7fdda4108ae0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fdda922c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fdda922c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52244/0 (socket says 172.21.15.135:52244) 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fdda922c700 1 -- 172.21.15.135:0/2732599930 learned_addr learned my addr 172.21.15.135:0/2732599930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fdda922c700 1 -- 172.21.15.135:0/2732599930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4109cb0 con 0x7fdda4108ae0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.878+0000 7fdda922c700 1 --2- 172.21.15.135:0/2732599930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098a0 tx=0x7fdda0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a96025392a5ad5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.879+0000 7fdd9bfff700 1 -- 172.21.15.135:0/2732599930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda0004160 con 0x7fdda4108ae0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.879+0000 7fdd9bfff700 1 -- 172.21.15.135:0/2732599930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0004300 con 0x7fdda4108ae0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.879+0000 7fdd9bfff700 1 -- 172.21.15.135:0/2732599930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda0011b20 con 0x7fdda4108ae0 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 -- 172.21.15.135:0/2732599930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 msgr2=0x7fdda4108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 --2- 172.21.15.135:0/2732599930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098a0 tx=0x7fdda0009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 -- 172.21.15.135:0/2732599930 shutdown_connections 2024-05-20T17:24:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 --2- 172.21.15.135:0/2732599930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda4108ef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 -- 172.21.15.135:0/2732599930 >> 172.21.15.135:0/2732599930 conn(0x7fdda41041c0 msgr2=0x7fdda4106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 -- 172.21.15.135:0/2732599930 shutdown_connections 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.880+0000 7fddab490700 1 -- 172.21.15.135:0/2732599930 wait complete. 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.881+0000 7fddab490700 1 Processor -- start 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.881+0000 7fddab490700 1 -- start start 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.881+0000 7fddab490700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.881+0000 7fddab490700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdda410d060 con 0x7fdda4108ae0 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdda922c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdda922c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52250/0 (socket says 172.21.15.135:52250) 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdda922c700 1 -- 172.21.15.135:0/437432575 learned_addr learned my addr 172.21.15.135:0/437432575 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdda922c700 1 -- 172.21.15.135:0/437432575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda419d4b0 con 0x7fdda4108ae0 2024-05-20T17:24:13.061 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdda922c700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009fb0 tx=0x7fdda0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda0003930 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0003ad0 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda0019670 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda419d740 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.882+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41a0350 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.883+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fdda0019920 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.884+0000 7fdd9a7fc700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 0x7fdd9003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.884+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdda004d750 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.884+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda4063ca0 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.884+0000 7fdda8a2b700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 0x7fdd9003b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.885+0000 7fdda8a2b700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 0x7fdd9003b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd94006fd0 tx=0x7fdd94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:11.890+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdda0011e20 con 0x7fdda4108ae0 2024-05-20T17:24:13.062 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.090+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fdda41a0520 con 0x7fdda4108ae0 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.091+0000 7fdd9a7fc700 1 -- 172.21.15.135:0/437432575 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fdda0019c10 con 0x7fdda4108ae0 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 msgr2=0x7fdd9003b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 0x7fdd9003b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd94006fd0 tx=0x7fdd94006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 msgr2=0x7fdda419cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009fb0 tx=0x7fdda0011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 shutdown_connections 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdd900390b0 0x7fdd9003b5c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 --2- 172.21.15.135:0/437432575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda4108ae0 0x7fdda419cf70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 >> 172.21.15.135:0/437432575 conn(0x7fdda41041c0 msgr2=0x7fdda4105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 shutdown_connections 2024-05-20T17:24:13.063 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:12.093+0000 7fddab490700 1 -- 172.21.15.135:0/437432575 wait complete. 2024-05-20T17:24:13.066 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T17:24:13.067 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-20T17:24:13.074 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T17:24:13.074 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-20T17:24:13.074 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-20T17:24:13.075 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph Dashboard is now available at: 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout: URL: https://smithi135.front.sepia.ceph.com:8443/ 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout: User: admin 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout: Password: ujqbhkt10o 2024-05-20T17:24:13.076 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:13.077 INFO:teuthology.orchestra.run.smithi135.stdout:Saving cluster configuration to /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config directory 2024-05-20T17:24:13.077 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling autotune for osd_memory_target 2024-05-20T17:24:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:13 smithi135 ceph-mon[32027]: mgrmap e13: x(active, since 6s) 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcf0d6c700 1 Processor -- start 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcf0d6c700 1 -- start start 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcf0d6c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcf0d6c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efcec07c6d0 con 0x7efcec109640 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52264/0 (socket says 172.21.15.135:52264) 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.897+0000 7efcea59c700 1 -- 172.21.15.135:0/2882237522 learned_addr learned my addr 172.21.15.135:0/2882237522 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:14.652 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.898+0000 7efcea59c700 1 -- 172.21.15.135:0/2882237522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec10bfa0 con 0x7efcec109640 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.898+0000 7efcea59c700 1 --2- 172.21.15.135:0/2882237522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098a0 tx=0x7efcdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1a3f8d641f8ab2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.898+0000 7efce959a700 1 -- 172.21.15.135:0/2882237522 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcdc004160 con 0x7efcec109640 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.898+0000 7efce959a700 1 -- 172.21.15.135:0/2882237522 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcdc004300 con 0x7efcec109640 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.898+0000 7efce959a700 1 -- 172.21.15.135:0/2882237522 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcdc011b20 con 0x7efcec109640 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 -- 172.21.15.135:0/2882237522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 msgr2=0x7efcec10ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/2882237522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098a0 tx=0x7efcdc009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 -- 172.21.15.135:0/2882237522 shutdown_connections 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/2882237522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec10ba60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 -- 172.21.15.135:0/2882237522 >> 172.21.15.135:0/2882237522 conn(0x7efcec1030c0 msgr2=0x7efcec105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 -- 172.21.15.135:0/2882237522 shutdown_connections 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.899+0000 7efcf0d6c700 1 -- 172.21.15.135:0/2882237522 wait complete. 2024-05-20T17:24:14.653 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcf0d6c700 1 Processor -- start 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcf0d6c700 1 -- start start 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcf0d6c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcf0d6c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10cfa0 con 0x7efcec109640 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52268/0 (socket says 172.21.15.135:52268) 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcea59c700 1 -- 172.21.15.135:0/4074573085 learned_addr learned my addr 172.21.15.135:0/4074573085 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcea59c700 1 -- 172.21.15.135:0/4074573085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec19d3e0 con 0x7efcec109640 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.900+0000 7efcea59c700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcdc000c00 tx=0x7efcdc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.901+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcdc003b60 con 0x7efcec109640 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.901+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcdc01a910 con 0x7efcec109640 2024-05-20T17:24:14.654 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.901+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcec19d670 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.901+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcdc024930 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.901+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcec1a0280 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcec19dad0 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7efcdc022020 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efcdb7fe700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 0x7efcd403b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efcdc04d4a0 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efce9d9b700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 0x7efcd403b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.902+0000 7efce9d9b700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 0x7efcd403b650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:13.907+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efcdc00b3e0 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.103+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7efcec1a0450 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.104+0000 7efcdb7fe700 1 -- 172.21.15.135:0/4074573085 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7efcdc0172b0 con 0x7efcec109640 2024-05-20T17:24:14.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 msgr2=0x7efcd403b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 0x7efcd403b650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 msgr2=0x7efcec19cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcdc000c00 tx=0x7efcdc011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 shutdown_connections 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efcd4039140 0x7efcd403b650 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 --2- 172.21.15.135:0/4074573085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcec109640 0x7efcec19cea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 >> 172.21.15.135:0/4074573085 conn(0x7efcec1030c0 msgr2=0x7efcec104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 shutdown_connections 2024-05-20T17:24:14.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:14.106+0000 7efcf0d6c700 1 -- 172.21.15.135:0/4074573085 wait complete. 2024-05-20T17:24:16.075 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9f0e61700 1 Processor -- start 2024-05-20T17:24:16.075 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9f0e61700 1 -- start start 2024-05-20T17:24:16.075 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9f0e61700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9f0e61700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1083b0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9ea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9ea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52284/0 (socket says 172.21.15.135:52284) 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9ea59c700 1 -- 172.21.15.135:0/2395076840 learned_addr learned my addr 172.21.15.135:0/2395076840 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9ea59c700 1 -- 172.21.15.135:0/2395076840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec108b80 con 0x7fd9ec1079b0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9ea59c700 1 --2- 172.21.15.135:0/2395076840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098a0 tx=0x7fd9d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98de09f04f47595e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9e959a700 1 -- 172.21.15.135:0/2395076840 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d4004160 con 0x7fd9ec1079b0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.206+0000 7fd9e959a700 1 -- 172.21.15.135:0/2395076840 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d4004300 con 0x7fd9ec1079b0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9e959a700 1 -- 172.21.15.135:0/2395076840 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d4011b20 con 0x7fd9ec1079b0 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 -- 172.21.15.135:0/2395076840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 msgr2=0x7fd9ec107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:16.076 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/2395076840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098a0 tx=0x7fd9d4009bb0 comp rx=0 tx=0).stop 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 -- 172.21.15.135:0/2395076840 shutdown_connections 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/2395076840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec107dc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 -- 172.21.15.135:0/2395076840 >> 172.21.15.135:0/2395076840 conn(0x7fd9ec1030d0 msgr2=0x7fd9ec105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 -- 172.21.15.135:0/2395076840 shutdown_connections 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.207+0000 7fd9f0e61700 1 -- 172.21.15.135:0/2395076840 wait complete. 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9f0e61700 1 Processor -- start 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9f0e61700 1 -- start start 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9f0e61700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9f0e61700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec10bf30 con 0x7fd9ec1079b0 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9ea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9ea59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52290/0 (socket says 172.21.15.135:52290) 2024-05-20T17:24:16.077 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.208+0000 7fd9ea59c700 1 -- 172.21.15.135:0/3943703638 learned_addr learned my addr 172.21.15.135:0/3943703638 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9ea59c700 1 -- 172.21.15.135:0/3943703638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec07beb0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9ea59c700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009fb0 tx=0x7fd9d4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d4003930 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d4003ad0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec19fcc0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d4019670 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.209+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec1a00c0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.210+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd9d4019970 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.210+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ec063ca0 con 0x7fd9ec1079b0 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.210+0000 7fd9e37fe700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 0x7fd9d803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:16.078 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.210+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd9d404db70 con 0x7fd9ec1079b0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.210+0000 7fd9e9d9b700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 0x7fd9d803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.211+0000 7fd9e9d9b700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 0x7fd9d803b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc006fd0 tx=0x7fd9dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.215+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd9d4011e20 con 0x7fd9ec1079b0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.519+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fd9ec1a0340 con 0x7fd9ec1079b0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.521+0000 7fd9e37fe700 1 -- 172.21.15.135:0/3943703638 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fd9d4020240 con 0x7fd9ec1079b0 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 msgr2=0x7fd9d803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 0x7fd9d803b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc006fd0 tx=0x7fd9dc006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 msgr2=0x7fd9ec07b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009fb0 tx=0x7fd9d4011c10 comp rx=0 tx=0).stop 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 shutdown_connections 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9d80390f0 0x7fd9d803b600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:16.079 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 --2- 172.21.15.135:0/3943703638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9ec1079b0 0x7fd9ec07b970 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 >> 172.21.15.135:0/3943703638 conn(0x7fd9ec1030d0 msgr2=0x7fd9ec104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 shutdown_connections 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-20T17:24:15.524+0000 7fd9f0e61700 1 -- 172.21.15.135:0/3943703638 wait complete. 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:Or, if you are only running a single cluster on this host: 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-20T17:24:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: ceph telemetry on 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout:For more information see: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:16.081 INFO:teuthology.orchestra.run.smithi135.stdout:Bootstrap complete. 2024-05-20T17:24:16.118 INFO:tasks.cephadm:Fetching config... 2024-05-20T17:24:16.119 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:24:16.119 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-20T17:24:16.135 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-20T17:24:16.135 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:24:16.136 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-20T17:24:16.192 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-20T17:24:16.192 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:24:16.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-20T17:24:16.256 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-20T17:24:16.256 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:24:16.257 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-20T17:24:16.313 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-20T17:24:16.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T17:24:16.388 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:24:16.400 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T17:24:16.439 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:24:16.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T17:24:16.490 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+99O6RELzDRmN5sHTE6oOulyx2/2WkNG3/S1ox1kjmUm/SuJw6wIdDxV/TQuRJH7ot+ojbogHhALmUo+hZ5UF0s/mzXuM1og/+gD4BsAgEEpMuLTumRPs/toLLtIeYNDZlezdZPKPZP71rIKbQeZ5lJTgswWz5CsT51eY0VlDThhTwPlwVarRfTR9OyQp8bJ6W0BWka85UctMJhQFFSkDIOZQGMtzQw/0wcmh7j2Is2Csx9zhMpNgYliR0VB5sQTiYPRJTF1lelGT9Kb0aE1Cv9EFWPPUnEMkM3CmsUppyvs6wBNq0XdmH+ZYI1ZTmtLCoaUyccLmsyu0/knBy5r3BPnb3tYvQFzUR/8bz4bICMUfs4wKk1a4jaED91wxgHQrwwLky4L6YDmOlowH4XZ0yjZl6wDvK/gvO8HLCxOb/javAzvzkRPez78OBXEbPQa92kbb05Sk1SFFNOORM0oAt6svubVOBR/9BSceGvHOqUZBAUqzMJcIFTYGpAwaZz8= ceph-76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:24:16.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-20T17:24:16.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:16 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3943703638' entity='client.admin' 2024-05-20T17:24:16.745 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 -- 172.21.15.135:0/1192145880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 msgr2=0x7fc89c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/1192145880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c102e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc898009910 tx=0x7fc898009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 -- 172.21.15.135:0/1192145880 shutdown_connections 2024-05-20T17:24:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/1192145880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c102e90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 -- 172.21.15.135:0/1192145880 >> 172.21.15.135:0/1192145880 conn(0x7fc89c0fe0e0 msgr2=0x7fc89c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 -- 172.21.15.135:0/1192145880 shutdown_connections 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.990+0000 7fc8a3b39700 1 -- 172.21.15.135:0/1192145880 wait complete. 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a3b39700 1 Processor -- start 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a3b39700 1 -- start start 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a3b39700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a3b39700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c108b90 con 0x7fc89c102a80 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a18d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a18d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52316/0 (socket says 172.21.15.135:52316) 2024-05-20T17:24:18.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a18d5700 1 -- 172.21.15.135:0/3762878891 learned_addr learned my addr 172.21.15.135:0/3762878891 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:18.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.991+0000 7fc8a18d5700 1 -- 172.21.15.135:0/3762878891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c198bc0 con 0x7fc89c102a80 2024-05-20T17:24:18.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc8a18d5700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b5c0 tx=0x7fc898005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:18.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc898027070 con 0x7fc89c102a80 2024-05-20T17:24:18.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c198e50 con 0x7fc89c102a80 2024-05-20T17:24:18.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc898022470 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89800f5d0 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.992+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c19ba60 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc89802a070 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c109310 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc892ffd700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 0x7fc88803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc89801e030 con 0x7fc89c102a80 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc8a10d4700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 0x7fc88803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:18.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.993+0000 7fc8a10d4700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 0x7fc88803b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc88c006fd0 tx=0x7fc88c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:18.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:18.998+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc898013070 con 0x7fc89c102a80 2024-05-20T17:24:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.191+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fc89c02dd70 con 0x7fc89c102a80 2024-05-20T17:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.194+0000 7fc892ffd700 1 -- 172.21.15.135:0/3762878891 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fc89800d340 con 0x7fc89c102a80 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 msgr2=0x7fc88803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 0x7fc88803b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc88c006fd0 tx=0x7fc88c006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 msgr2=0x7fc89c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b5c0 tx=0x7fc898005050 comp rx=0 tx=0).stop 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 shutdown_connections 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8880390f0 0x7fc88803b600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 --2- 172.21.15.135:0/3762878891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc89c102a80 0x7fc89c198680 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.196+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 >> 172.21.15.135:0/3762878891 conn(0x7fc89c0fe0e0 msgr2=0x7fc89c0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.197+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 shutdown_connections 2024-05-20T17:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:19.197+0000 7fc8a3b39700 1 -- 172.21.15.135:0/3762878891 wait complete. 2024-05-20T17:24:19.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:24:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:19.765 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-20T17:24:19.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-20T17:24:19.998 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:20.423 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3762878891' entity='client.admin' 2024-05-20T17:24:20.423 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:20 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:20.423 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:20 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:21.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 -- 172.21.15.135:0/2693493692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 msgr2=0x7fc4781059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 --2- 172.21.15.135:0/2693493692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc4781059d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc474009910 tx=0x7fc474009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 -- 172.21.15.135:0/2693493692 shutdown_connections 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 --2- 172.21.15.135:0/2693493692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc4781059d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 -- 172.21.15.135:0/2693493692 >> 172.21.15.135:0/2693493692 conn(0x7fc4780fcf90 msgr2=0x7fc4780ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.411+0000 7fc47fba6700 1 -- 172.21.15.135:0/2693493692 shutdown_connections 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47fba6700 1 -- 172.21.15.135:0/2693493692 wait complete. 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47fba6700 1 Processor -- start 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47fba6700 1 -- start start 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47fba6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47fba6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc478108b70 con 0x7fc4781035b0 2024-05-20T17:24:21.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47d942700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:21.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47d942700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51052/0 (socket says 172.21.15.135:51052) 2024-05-20T17:24:21.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.412+0000 7fc47d942700 1 -- 172.21.15.135:0/1374109845 learned_addr learned my addr 172.21.15.135:0/1374109845 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:21.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc47d942700 1 -- 172.21.15.135:0/1374109845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc478198ba0 con 0x7fc4781035b0 2024-05-20T17:24:21.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc47d942700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4740052c0 tx=0x7fc474005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:21.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc474026070 con 0x7fc4781035b0 2024-05-20T17:24:21.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4740044a0 con 0x7fc4781035b0 2024-05-20T17:24:21.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc478198e30 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc474003ba0 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.413+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47819ba40 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.414+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc474029070 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.414+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4781092f0 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.414+0000 7fc46effd700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 0x7fc46403b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.414+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc47401e070 con 0x7fc4781035b0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.414+0000 7fc47d141700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 0x7fc46403b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:21.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.415+0000 7fc47d141700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 0x7fc46403b660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc468006fd0 tx=0x7fc468006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:21.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.419+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc474013070 con 0x7fc4781035b0 2024-05-20T17:24:21.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.620+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc47802dd70 con 0x7fc464039150 2024-05-20T17:24:21.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.624+0000 7fc46effd700 1 -- 172.21.15.135:0/1374109845 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc47802dd70 con 0x7fc464039150 2024-05-20T17:24:21.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 msgr2=0x7fc46403b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:21.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 0x7fc46403b660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc468006fd0 tx=0x7fc468006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:21.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 msgr2=0x7fc478198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:21.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4740052c0 tx=0x7fc474005030 comp rx=0 tx=0).stop 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 shutdown_connections 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc464039150 0x7fc46403b660 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 --2- 172.21.15.135:0/1374109845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4781035b0 0x7fc478198660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 >> 172.21.15.135:0/1374109845 conn(0x7fc4780fcf90 msgr2=0x7fc4780fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 shutdown_connections 2024-05-20T17:24:21.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:21.626+0000 7fc47fba6700 1 -- 172.21.15.135:0/1374109845 wait complete. 2024-05-20T17:24:22.467 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-05-20T17:24:22.467 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:24:22.467 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-05-20T17:24:22.485 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:24:22.485 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:22.542 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-05-20T17:24:22.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch host add smithi160 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:24:22.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:24:22.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:22.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:22.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:22.775 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:23.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:23 smithi135 ceph-mon[32027]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:24:23.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:23 smithi135 ceph-mon[32027]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:23.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:23 smithi135 ceph-mon[32027]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:24:24.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.213+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2436600193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 msgr2=0x7f4ce4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:24.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.213+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2436600193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce4107d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009910 tx=0x7f4cd4009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.214+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2436600193 shutdown_connections 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.214+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2436600193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce4107d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.214+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2436600193 >> 172.21.15.135:0/2436600193 conn(0x7f4ce4077430 msgr2=0x7f4ce4077870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.214+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2436600193 shutdown_connections 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.214+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2436600193 wait complete. 2024-05-20T17:24:24.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce8e51700 1 Processor -- start 2024-05-20T17:24:24.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce8e51700 1 -- start start 2024-05-20T17:24:24.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce8e51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce8e51700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce410bfa0 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51068/0 (socket says 172.21.15.135:51068) 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce259c700 1 -- 172.21.15.135:0/2917599670 learned_addr learned my addr 172.21.15.135:0/2917599670 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce259c700 1 -- 172.21.15.135:0/2917599670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce4197ce0 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.215+0000 7f4ce259c700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4004f80 tx=0x7f4cd4005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4026070 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce4197fd0 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cd400b6f0 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4003910 con 0x7f4ce4107900 2024-05-20T17:24:24.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce419bfd0 con 0x7f4ce4107900 2024-05-20T17:24:24.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.216+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4cd4029070 con 0x7f4ce4107900 2024-05-20T17:24:24.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.217+0000 7f4cd37fe700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 0x7f4ccc03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:24.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.217+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4cd401e070 con 0x7f4ce4107900 2024-05-20T17:24:24.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.217+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce4103010 con 0x7f4ce4107900 2024-05-20T17:24:24.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.217+0000 7f4ce1d9b700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 0x7f4ccc03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:24.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.217+0000 7f4ce1d9b700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 0x7f4ccc03b600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8006fd0 tx=0x7f4cd8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:24.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.222+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4cd4030020 con 0x7f4ce4107900 2024-05-20T17:24:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:24.421+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) -- 0x7f4ce4198b00 con 0x7f4ccc0390f0 2024-05-20T17:24:25.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:24 smithi135 ceph-mon[32027]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:26.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:25 smithi135 ceph-mon[32027]: Deploying cephadm binary to smithi160 2024-05-20T17:24:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:27 smithi135 ceph-mon[32027]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.511+0000 7f4cd37fe700 1 -- 172.21.15.135:0/2917599670 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4ce4198b00 con 0x7f4ccc0390f0 2024-05-20T17:24:28.512 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 msgr2=0x7f4ccc03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 0x7f4ccc03b600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8006fd0 tx=0x7f4cd8006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 msgr2=0x7f4ce41977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4004f80 tx=0x7f4cd4005060 comp rx=0 tx=0).stop 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 shutdown_connections 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4ccc0390f0 0x7f4ccc03b600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 --2- 172.21.15.135:0/2917599670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4107900 0x7f4ce41977a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.513+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 >> 172.21.15.135:0/2917599670 conn(0x7f4ce4077430 msgr2=0x7f4ce4100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.514+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 shutdown_connections 2024-05-20T17:24:28.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:28.514+0000 7f4ce8e51700 1 -- 172.21.15.135:0/2917599670 wait complete. 2024-05-20T17:24:29.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch host ls --format=json 2024-05-20T17:24:29.368 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:29.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:29.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:29 smithi135 ceph-mon[32027]: Added host smithi160 2024-05-20T17:24:29.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:29.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:29 smithi135 ceph-mon[32027]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:29.801 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:30.671 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:30 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 -- 172.21.15.135:0/1171761284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 msgr2=0x7f2884107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 --2- 172.21.15.135:0/1171761284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f2884107d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2880009910 tx=0x7f2880009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 -- 172.21.15.135:0/1171761284 shutdown_connections 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 --2- 172.21.15.135:0/1171761284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f2884107d00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 -- 172.21.15.135:0/1171761284 >> 172.21.15.135:0/1171761284 conn(0x7f28840fd3e0 msgr2=0x7f28840ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 -- 172.21.15.135:0/1171761284 shutdown_connections 2024-05-20T17:24:30.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.902+0000 7f288bed7700 1 -- 172.21.15.135:0/1171761284 wait complete. 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.903+0000 7f288bed7700 1 Processor -- start 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.903+0000 7f288bed7700 1 -- start start 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f288bed7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f288bed7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f288410bf90 con 0x7f28841078f0 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f2889c73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f2889c73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47032/0 (socket says 172.21.15.135:47032) 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f2889c73700 1 -- 172.21.15.135:0/2193171773 learned_addr learned my addr 172.21.15.135:0/2193171773 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f2889c73700 1 -- 172.21.15.135:0/2193171773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2884100100 con 0x7f28841078f0 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f2889c73700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2880004f80 tx=0x7f2880005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880026070 con 0x7f28841078f0 2024-05-20T17:24:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f288000b6f0 con 0x7f28841078f0 2024-05-20T17:24:30.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28840fe7f0 con 0x7f28841078f0 2024-05-20T17:24:30.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880003910 con 0x7f28841078f0 2024-05-20T17:24:30.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.904+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28840fecb0 con 0x7f28841078f0 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.905+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2884103000 con 0x7f28841078f0 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.906+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2880029070 con 0x7f28841078f0 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.906+0000 7f287affd700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 0x7f287003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.906+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f288001e070 con 0x7f28841078f0 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.906+0000 7f2889472700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 0x7f287003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.907+0000 7f2889472700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 0x7f287003b600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2874006fd0 tx=0x7f2874006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:30.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:30.911+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2880030080 con 0x7f28841078f0 2024-05-20T17:24:31.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.115+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28840ff880 con 0x7f28700390f0 2024-05-20T17:24:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.116+0000 7f287affd700 1 -- 172.21.15.135:0/2193171773 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f28840ff880 con 0x7f28700390f0 2024-05-20T17:24:31.118 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:31.118 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 msgr2=0x7f287003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 0x7f287003b600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2874006fd0 tx=0x7f2874006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 msgr2=0x7f28840fe2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2880004f80 tx=0x7f2880005060 comp rx=0 tx=0).stop 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 shutdown_connections 2024-05-20T17:24:31.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f28700390f0 0x7f287003b600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:31.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 --2- 172.21.15.135:0/2193171773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28841078f0 0x7f28840fe2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:31.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 >> 172.21.15.135:0/2193171773 conn(0x7f28840fd3e0 msgr2=0x7f28841053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:31.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 shutdown_connections 2024-05-20T17:24:31.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:31.119+0000 7f288bed7700 1 -- 172.21.15.135:0/2193171773 wait complete. 2024-05-20T17:24:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:31 smithi135 ceph-mon[32027]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:31.737 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-05-20T17:24:31.737 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:24:31.737 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-05-20T17:24:31.756 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:24:31.756 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:31.814 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-05-20T17:24:31.814 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch host add smithi172 2024-05-20T17:24:32.053 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:32.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:32 smithi135 ceph-mon[32027]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 -- 172.21.15.135:0/3014928614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 msgr2=0x7fce54107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 --2- 172.21.15.135:0/3014928614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54107d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fce44009910 tx=0x7fce44009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 -- 172.21.15.135:0/3014928614 shutdown_connections 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 --2- 172.21.15.135:0/3014928614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54107d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 -- 172.21.15.135:0/3014928614 >> 172.21.15.135:0/3014928614 conn(0x7fce540fd3f0 msgr2=0x7fce540ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 -- 172.21.15.135:0/3014928614 shutdown_connections 2024-05-20T17:24:33.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.547+0000 7fce59048700 1 -- 172.21.15.135:0/3014928614 wait complete. 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce59048700 1 Processor -- start 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce59048700 1 -- start start 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce59048700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce59048700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce5410bfa0 con 0x7fce54107900 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce52d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce52d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47062/0 (socket says 172.21.15.135:47062) 2024-05-20T17:24:33.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.548+0000 7fce52d9d700 1 -- 172.21.15.135:0/3193861627 learned_addr learned my addr 172.21.15.135:0/3193861627 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce52d9d700 1 -- 172.21.15.135:0/3193861627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5406b820 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce52d9d700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce44004f80 tx=0x7fce44005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44026070 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce4400b750 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce54199d00 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440038d0 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.549+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5419a1c0 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.550+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fce44029070 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.550+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce54103010 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.550+0000 7fce50d99700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 0x7fce4003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.550+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fce4401e070 con 0x7fce54107900 2024-05-20T17:24:33.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.550+0000 7fce4bfff700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 0x7fce4003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:33.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.551+0000 7fce4bfff700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 0x7fce4003b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce3c006fd0 tx=0x7fce3c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:33.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.555+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fce5406b820 con 0x7fce54107900 2024-05-20T17:24:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:33 smithi135 ceph-mon[32027]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:33.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:33.760+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7fce5406af70 con 0x7fce400390f0 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:24:35.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:24:35.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: Deploying cephadm binary to smithi172 2024-05-20T17:24:35.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:24:35.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:35 smithi135 ceph-mon[32027]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:36.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:36 smithi135 ceph-mon[32027]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:37 smithi135 ceph-mon[32027]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:37.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.802+0000 7fce50d99700 1 -- 172.21.15.135:0/3193861627 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fce5406af70 con 0x7fce400390f0 2024-05-20T17:24:37.804 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-05-20T17:24:37.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 msgr2=0x7fce4003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:37.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 0x7fce4003b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce3c006fd0 tx=0x7fce3c006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:37.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 msgr2=0x7fce54199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce44004f80 tx=0x7fce44005060 comp rx=0 tx=0).stop 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 shutdown_connections 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fce400390f0 0x7fce4003b600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 --2- 172.21.15.135:0/3193861627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54107900 0x7fce54199700 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 >> 172.21.15.135:0/3193861627 conn(0x7fce540fd3f0 msgr2=0x7fce540fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 shutdown_connections 2024-05-20T17:24:37.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:37.805+0000 7fce59048700 1 -- 172.21.15.135:0/3193861627 wait complete. 2024-05-20T17:24:38.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch host ls --format=json 2024-05-20T17:24:38.674 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:39.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:39 smithi135 ceph-mon[32027]: Added host smithi172 2024-05-20T17:24:39.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:39 smithi135 ceph-mon[32027]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:40.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 -- 172.21.15.135:0/3488880604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 msgr2=0x7f9708108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 --2- 172.21.15.135:0/3488880604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f9708108e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9704009910 tx=0x7f9704009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 -- 172.21.15.135:0/3488880604 shutdown_connections 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 --2- 172.21.15.135:0/3488880604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f9708108e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 -- 172.21.15.135:0/3488880604 >> 172.21.15.135:0/3488880604 conn(0x7f97080fe520 msgr2=0x7f9708100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 -- 172.21.15.135:0/3488880604 shutdown_connections 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.193+0000 7f970fb49700 1 -- 172.21.15.135:0/3488880604 wait complete. 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970fb49700 1 Processor -- start 2024-05-20T17:24:40.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970fb49700 1 -- start start 2024-05-20T17:24:40.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970fb49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:40.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970fb49700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f970810d0b0 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970d8e5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970d8e5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55230/0 (socket says 172.21.15.135:55230) 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970d8e5700 1 -- 172.21.15.135:0/1328446638 learned_addr learned my addr 172.21.15.135:0/1328446638 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970d8e5700 1 -- 172.21.15.135:0/1328446638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970819eab0 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.194+0000 7f970d8e5700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9704004f80 tx=0x7f9704005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.195+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9704026070 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.195+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970400b6f0 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.195+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9704003910 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.195+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970819eda0 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.195+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97081988d0 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f9704029070 con 0x7f9708108a10 2024-05-20T17:24:40.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9708104120 con 0x7f9708108a10 2024-05-20T17:24:40.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f96feffd700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 0x7f96f403b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:40.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f970401e070 con 0x7f9708108a10 2024-05-20T17:24:40.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f970d0e4700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 0x7f96f403b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:40.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.196+0000 7f970d0e4700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 0x7f96f403b600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006fd0 tx=0x7f96f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.201+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9704013070 con 0x7f9708108a10 2024-05-20T17:24:40.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.402+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9708199c40 con 0x7f96f40390f0 2024-05-20T17:24:40.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.403+0000 7f96feffd700 1 -- 172.21.15.135:0/1328446638 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f9708199c40 con 0x7f96f40390f0 2024-05-20T17:24:40.405 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:24:40.405 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 msgr2=0x7f96f403b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 0x7f96f403b600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006fd0 tx=0x7f96f8006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 msgr2=0x7f970819e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9704004f80 tx=0x7f9704005060 comp rx=0 tx=0).stop 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 shutdown_connections 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f40390f0 0x7f96f403b600 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:40.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 --2- 172.21.15.135:0/1328446638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9708108a10 0x7f970819e570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:40.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 >> 172.21.15.135:0/1328446638 conn(0x7f97080fe520 msgr2=0x7f97080ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:40.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 shutdown_connections 2024-05-20T17:24:40.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:40.406+0000 7f970fb49700 1 -- 172.21.15.135:0/1328446638 wait complete. 2024-05-20T17:24:41.039 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-20T17:24:41.039 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd crush tunables default 2024-05-20T17:24:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:24:41.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:41 smithi135 ceph-mon[32027]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:24:41.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:41.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:41 smithi135 ceph-mon[32027]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 -- 172.21.15.135:0/3301953254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 msgr2=0x7f598c101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 --2- 172.21.15.135:0/3301953254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c101710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5980009910 tx=0x7f5980009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 -- 172.21.15.135:0/3301953254 shutdown_connections 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 --2- 172.21.15.135:0/3301953254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c101710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 -- 172.21.15.135:0/3301953254 >> 172.21.15.135:0/3301953254 conn(0x7f598c077be0 msgr2=0x7f598c078020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 -- 172.21.15.135:0/3301953254 shutdown_connections 2024-05-20T17:24:42.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.897+0000 7f5992a6a700 1 -- 172.21.15.135:0/3301953254 wait complete. 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5992a6a700 1 Processor -- start 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5992a6a700 1 -- start start 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5992a6a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5992a6a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f598c10b740 con 0x7f598c101300 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5990806700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5990806700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55254/0 (socket says 172.21.15.135:55254) 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.898+0000 7f5990806700 1 -- 172.21.15.135:0/2827733054 learned_addr learned my addr 172.21.15.135:0/2827733054 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5990806700 1 -- 172.21.15.135:0/2827733054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c19eac0 con 0x7f598c101300 2024-05-20T17:24:42.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5990806700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5980005850 tx=0x7f5980005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5980026070 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c19edb0 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f598000bbd0 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5980003970 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.899+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c1988e0 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.900+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5980029070 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.900+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c1027b0 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.900+0000 7f5989ffb700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 0x7f597c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.900+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f598001e070 con 0x7f598c101300 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.901+0000 7f598bfff700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 0x7f597c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:42.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.901+0000 7f598bfff700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 0x7f597c03b600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5978006fd0 tx=0x7f5978006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:42.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:42.906+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5980013070 con 0x7f598c101300 2024-05-20T17:24:43.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.108+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f598c199c20 con 0x7f598c101300 2024-05-20T17:24:43.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.683+0000 7f5989ffb700 1 -- 172.21.15.135:0/2827733054 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f598000e3e0 con 0x7f598c101300 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 msgr2=0x7f597c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 0x7f597c03b600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5978006fd0 tx=0x7f5978006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 msgr2=0x7f598c19e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5980005850 tx=0x7f5980005030 comp rx=0 tx=0).stop 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 shutdown_connections 2024-05-20T17:24:43.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f597c0390f0 0x7f597c03b600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:43.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 --2- 172.21.15.135:0/2827733054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f598c101300 0x7f598c19e580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:43.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 >> 172.21.15.135:0/2827733054 conn(0x7f598c077be0 msgr2=0x7f598c1093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:43.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 shutdown_connections 2024-05-20T17:24:43.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:24:43.686+0000 7f5992a6a700 1 -- 172.21.15.135:0/2827733054 wait complete. 2024-05-20T17:24:43.688 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-05-20T17:24:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2827733054' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T17:24:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:43.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:43.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:24:43.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:43.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:24:44.372 INFO:tasks.cephadm:Adding mon.a on smithi135 2024-05-20T17:24:44.373 INFO:tasks.cephadm:Adding mon.b on smithi160 2024-05-20T17:24:44.373 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-05-20T17:24:44.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch apply mon '3;smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c' 2024-05-20T17:24:44.600 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2827733054' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:44 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:45 smithi135 ceph-mon[32027]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:24:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:45 smithi135 ceph-mon[32027]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:24:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:45 smithi135 ceph-mon[32027]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:24:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:45 smithi135 ceph-mon[32027]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.083+0000 7f11b41b0700 1 -- 172.21.15.172:0/3197189308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 msgr2=0x7f11ac1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.083+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3197189308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac1031f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009910 tx=0x7f11a8009c20 comp rx=0 tx=0).stop 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 -- 172.21.15.172:0/3197189308 shutdown_connections 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3197189308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac1031f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 -- 172.21.15.172:0/3197189308 >> 172.21.15.172:0/3197189308 conn(0x7f11ac0fe540 msgr2=0x7f11ac100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 -- 172.21.15.172:0/3197189308 shutdown_connections 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 -- 172.21.15.172:0/3197189308 wait complete. 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 Processor -- start 2024-05-20T17:24:46.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.084+0000 7f11b41b0700 1 -- start start 2024-05-20T17:24:46.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b41b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:46.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b41b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac10d230 con 0x7f11ac102de0 2024-05-20T17:24:46.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b1f4c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:46.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b1f4c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.172:39654/0 (socket says 172.21.15.172:39654) 2024-05-20T17:24:46.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b1f4c700 1 -- 172.21.15.172:0/3604862012 learned_addr learned my addr 172.21.15.172:0/3604862012 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:24:46.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b1f4c700 1 -- 172.21.15.172:0/3604862012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac19eae0 con 0x7f11ac102de0 2024-05-20T17:24:46.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.085+0000 7f11b1f4c700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006010 tx=0x7f11a8005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11a8026070 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac19ed70 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a800bc30 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11a8003ab0 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac1987e0 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.086+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ac104140 con 0x7f11ac102de0 2024-05-20T17:24:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.087+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f11a8029070 con 0x7f11ac102de0 2024-05-20T17:24:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.087+0000 7f11a2ffd700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 0x7f119803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.087+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f11a801e070 con 0x7f11ac102de0 2024-05-20T17:24:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.087+0000 7f11b174b700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 0x7f119803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.088+0000 7f11b174b700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 0x7f119803b600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f119c006fd0 tx=0x7f119c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:46.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.092+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f11a8013070 con 0x7f11ac102de0 2024-05-20T17:24:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.295+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}) -- 0x7f11ac199cf0 con 0x7f11980390f0 2024-05-20T17:24:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.302+0000 7f11a2ffd700 1 -- 172.21.15.172:0/3604862012 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f11ac199cf0 con 0x7f11980390f0 2024-05-20T17:24:46.304 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-05-20T17:24:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 msgr2=0x7f119803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 0x7f119803b600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f119c006fd0 tx=0x7f119c006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 msgr2=0x7f11ac19e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006010 tx=0x7f11a8005050 comp rx=0 tx=0).stop 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 shutdown_connections 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f11980390f0 0x7f119803b600 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 --2- 172.21.15.172:0/3604862012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac102de0 0x7f11ac19e5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.304+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 >> 172.21.15.172:0/3604862012 conn(0x7f11ac0fe540 msgr2=0x7f11ac1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.305+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 shutdown_connections 2024-05-20T17:24:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:46.305+0000 7f11b41b0700 1 -- 172.21.15.172:0/3604862012 wait complete. 2024-05-20T17:24:46.854 DEBUG:teuthology.orchestra.run.smithi160:mon.b> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.b.service 2024-05-20T17:24:46.856 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.c.service 2024-05-20T17:24:46.859 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T17:24:46.859 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c;count:3 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:24:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:24:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: Deploying daemon mon.c on smithi172 2024-05-20T17:24:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:47 smithi135 ceph-mon[32027]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:48.018 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:24:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:49 smithi135 ceph-mon[32027]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 -- 172.21.15.172:0/3494470557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 msgr2=0x7fc7b0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 --2- 172.21.15.172:0/3494470557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0107ce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800b0a0 tx=0x7fc7a800b3b0 comp rx=0 tx=0).stop 2024-05-20T17:24:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 -- 172.21.15.172:0/3494470557 shutdown_connections 2024-05-20T17:24:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 --2- 172.21.15.172:0/3494470557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0107ce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 -- 172.21.15.172:0/3494470557 >> 172.21.15.172:0/3494470557 conn(0x7fc7b00fd3e0 msgr2=0x7fc7b00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 -- 172.21.15.172:0/3494470557 shutdown_connections 2024-05-20T17:24:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.810+0000 7fc7b7654700 1 -- 172.21.15.172:0/3494470557 wait complete. 2024-05-20T17:24:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.811+0000 7fc7b7654700 1 Processor -- start 2024-05-20T17:24:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.811+0000 7fc7b7654700 1 -- start start 2024-05-20T17:24:50.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.811+0000 7fc7b7654700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:50.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.811+0000 7fc7b7654700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b010bf70 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7b53f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7b53f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.172:39672/0 (socket says 172.21.15.172:39672) 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7b53f0700 1 -- 172.21.15.172:0/1265748967 learned_addr learned my addr 172.21.15.172:0/1265748967 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7b53f0700 1 -- 172.21.15.172:0/1265748967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0197ca0 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7b53f0700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80062a0 tx=0x7fc7a8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.812+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a8017040 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.813+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b0197f30 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.813+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a8022070 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.813+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a801d440 con 0x7fc7b01078d0 2024-05-20T17:24:50.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.813+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b019bf90 con 0x7fc7b01078d0 2024-05-20T17:24:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.814+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc7a801d710 con 0x7fc7b01078d0 2024-05-20T17:24:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.814+0000 7fc7a67fc700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 0x7fc79c03b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.814+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc7a800f050 con 0x7fc7b01078d0 2024-05-20T17:24:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.814+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b0102fe0 con 0x7fc7b01078d0 2024-05-20T17:24:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.814+0000 7fc7b4bef700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 0x7fc79c03b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.815+0000 7fc7b4bef700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 0x7fc79c03b660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006fd0 tx=0x7fc7a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:50.820+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc7a8007e20 con 0x7fc7b01078d0 2024-05-20T17:24:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.110+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc7b0198ac0 con 0x7fc7b01078d0 2024-05-20T17:24:51.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.111+0000 7fc7a67fc700 1 -- 172.21.15.172:0/1265748967 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fc7a8025e40 con 0x7fc7b01078d0 2024-05-20T17:24:51.112 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:24:51.112 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","modified":"2024-05-20T17:23:00.069959Z","created":"2024-05-20T17:23:00.069959Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-20T17:24:51.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 msgr2=0x7fc79c03b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:51.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 0x7fc79c03b660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006fd0 tx=0x7fc7a0006e40 comp rx=0 tx=0).stop 2024-05-20T17:24:51.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 msgr2=0x7fc7b0197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80062a0 tx=0x7fc7a8003ce0 comp rx=0 tx=0).stop 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 shutdown_connections 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc79c039150 0x7fc79c03b660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 --2- 172.21.15.172:0/1265748967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7b01078d0 0x7fc7b0197760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 >> 172.21.15.172:0/1265748967 conn(0x7fc7b00fd3e0 msgr2=0x7fc7b00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 shutdown_connections 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:51.113+0000 7fc7b7654700 1 -- 172.21.15.172:0/1265748967 wait complete. 2024-05-20T17:24:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-05-20T17:24:51.400 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:51 smithi172 ceph-mon[36511]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-20T17:24:51.400 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:51 smithi172 bash[36478]: f67153ce685b9b4e8ab5b2e835e44d6f5f236c26d3a66a22e64f496e0ff36fc9 2024-05-20T17:24:51.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:51 smithi172 systemd[1]: Started Ceph mon.c for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:24:52.821 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T17:24:52.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T17:24:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: mon.a calling monitor election 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: mon.c calling monitor election 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: monmap epoch 2 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: last_changed 2024-05-20T17:24:51.228066+0000 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: min_mon_release 19 (squid) 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: election_strategy: 1 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: fsmap 2024-05-20T17:24:56.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:24:56.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: mgrmap e13: x(active, since 49s) 2024-05-20T17:24:56.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: overall HEALTH_OK 2024-05-20T17:24:56.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:56.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: mon.a calling monitor election 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: mon.c calling monitor election 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: monmap epoch 2 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:24:56.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: last_changed 2024-05-20T17:24:51.228066+0000 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: min_mon_release 19 (squid) 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: election_strategy: 1 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: fsmap 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:24:56.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: mgrmap e13: x(active, since 49s) 2024-05-20T17:24:56.708 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: overall HEALTH_OK 2024-05-20T17:24:56.708 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:56.708 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:57.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 -- 172.21.15.172:0/1745818687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71600035c0 msgr2=0x7f7160005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:57.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 --2- 172.21.15.172:0/1745818687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71600035c0 0x7f7160005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71741018f0 tx=0x7f715c00feb0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 -- 172.21.15.172:0/1745818687 shutdown_connections 2024-05-20T17:24:57.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 --2- 172.21.15.172:0/1745818687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71600035c0 0x7f7160005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 -- 172.21.15.172:0/1745818687 >> 172.21.15.172:0/1745818687 conn(0x7f7174078660 msgr2=0x7f7174078aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:57.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 -- 172.21.15.172:0/1745818687 shutdown_connections 2024-05-20T17:24:57.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.387+0000 7f7179ca6700 1 -- 172.21.15.172:0/1745818687 wait complete. 2024-05-20T17:24:57.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.388+0000 7f7179ca6700 1 Processor -- start 2024-05-20T17:24:57.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7179ca6700 1 -- start start 2024-05-20T17:24:57.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7179ca6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:57.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7179ca6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 0x7f7174198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:57.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7179ca6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7174109af0 con 0x7f717419ebb0 2024-05-20T17:24:57.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7179ca6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7174109970 con 0x7f71600035c0 2024-05-20T17:24:57.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50806/0 (socket says 172.21.15.172:50806) 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 -- 172.21.15.172:0/371700061 learned_addr learned my addr 172.21.15.172:0/371700061 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7172ffd700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 0x7f7174198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 -- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 msgr2=0x7f717419e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 -- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 msgr2=0x7f717419e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f71737fe700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.389+0000 7f7172ffd700 1 -- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 msgr2=0x7f717419e670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7172ffd700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7172ffd700 1 -- 172.21.15.172:0/371700061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717419f180 con 0x7f717419ebb0 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7172ffd700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 0x7f7174198890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f716400b4d0 tx=0x7f716400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:57.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7164011630 con 0x7f717419ebb0 2024-05-20T17:24:57.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7164011cb0 con 0x7f717419ebb0 2024-05-20T17:24:57.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7174198e30 con 0x7f717419ebb0 2024-05-20T17:24:57.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7164010e60 con 0x7f717419ebb0 2024-05-20T17:24:57.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.390+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71741993c0 con 0x7f717419ebb0 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.391+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f7164018020 con 0x7f717419ebb0 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.391+0000 7f7170ff9700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 0x7f715403b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.391+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f716404cbc0 con 0x7f717419ebb0 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.391+0000 7f71737fe700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 0x7f715403b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.392+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71741996d0 con 0x7f717419ebb0 2024-05-20T17:24:57.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.392+0000 7f71737fe700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 0x7f715403b3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f715c00fa60 tx=0x7f715c00f4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:24:57.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.397+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f716401f020 con 0x7f717419ebb0 2024-05-20T17:24:57.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:57.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:24:57.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: Deploying daemon mon.b on smithi160 2024-05-20T17:24:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:57.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.683+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7174199dc0 con 0x7f717419ebb0 2024-05-20T17:24:57.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.683+0000 7f7170ff9700 1 -- 172.21.15.172:0/371700061 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f7164018570 con 0x7f717419ebb0 2024-05-20T17:24:57.684 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:24:57.685 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","modified":"2024-05-20T17:24:51.228066Z","created":"2024-05-20T17:23:00.069959Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 msgr2=0x7f715403b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 0x7f715403b3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f715c00fa60 tx=0x7f715c00f4a0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 msgr2=0x7f7174198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 0x7f7174198890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f716400b4d0 tx=0x7f716400b890 comp rx=0 tx=0).stop 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 shutdown_connections 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7154038e90 0x7f715403b3a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71600035c0 0x7f717419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 --2- 172.21.15.172:0/371700061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f717419ebb0 0x7f7174198890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:24:57.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 >> 172.21.15.172:0/371700061 conn(0x7f7174078660 msgr2=0x7f717406b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:24:57.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 shutdown_connections 2024-05-20T17:24:57.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:24:57.686+0000 7f7179ca6700 1 -- 172.21.15.172:0/371700061 wait complete. 2024-05-20T17:24:57.688 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-05-20T17:24:57.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:24:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:24:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:24:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: Deploying daemon mon.b on smithi160 2024-05-20T17:24:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:24:58.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:58 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/371700061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:24:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:58 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/371700061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:24:58.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:24:58 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:24:58.242+0000 7f5873050700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-20T17:24:59.236 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T17:24:59.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T17:24:59.481 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:24:59.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:24:59 smithi172 ceph-mon[36511]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:24:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:24:59 smithi135 ceph-mon[32027]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.297 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-20T17:25:00.297 INFO:journalctl@ceph.mon.b.smithi160.stdout: e1 2024-05-20T17:25:00.297 INFO:journalctl@ceph.mon.b.smithi160.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout: legacy client fscid: -1 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout: No filesystems configured 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-20T17:25:00.298 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-20T17:25:00.559 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T17:25:00.559 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:25:00.559 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:25:00.559 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T17:25:00.559 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:00.560 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Deploying cephadm binary to smithi172 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.561 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Added host smithi172 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2827733054' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:25:00.562 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2827733054' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:00.563 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c;count:3 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Deploying daemon mon.c on smithi172 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:25:00.564 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.a calling monitor election 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.c calling monitor election 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.565 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: monmap epoch 2 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: last_changed 2024-05-20T17:24:51.228066+0000 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: min_mon_release 19 (squid) 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: election_strategy: 1 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: fsmap 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mgrmap e13: x(active, since 49s) 2024-05-20T17:25:00.566 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: overall HEALTH_OK 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: Deploying daemon mon.b on smithi160 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/371700061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:00.567 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 ceph-mon[36261]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-20T17:25:00.568 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 bash[36242]: d69df5f96247e24e5e965cf33a61f5641b8dd5a4684d24347542178d9478271f 2024-05-20T17:25:00.568 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:00 smithi160 systemd[1]: Started Ceph mon.b for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: mon.a calling monitor election 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: mon.c calling monitor election 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: mon.b calling monitor election 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: monmap epoch 3 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: last_changed 2024-05-20T17:25:00.303372+0000 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:25:05.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: min_mon_release 19 (squid) 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: election_strategy: 1 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: 2: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: fsmap 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: mgrmap e13: x(active, since 58s) 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: overall HEALTH_OK 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: mon.a calling monitor election 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: mon.c calling monitor election 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: mon.b calling monitor election 2024-05-20T17:25:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: monmap epoch 3 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: last_changed 2024-05-20T17:25:00.303372+0000 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: min_mon_release 19 (squid) 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: election_strategy: 1 2024-05-20T17:25:05.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: 2: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: fsmap 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: mgrmap e13: x(active, since 58s) 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: overall HEALTH_OK 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: mon.a calling monitor election 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: mon.c calling monitor election 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:25:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: mon.b calling monitor election 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: monmap epoch 3 2024-05-20T17:25:05.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: last_changed 2024-05-20T17:25:00.303372+0000 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: created 2024-05-20T17:23:00.069959+0000 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: min_mon_release 19 (squid) 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: election_strategy: 1 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: 2: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: fsmap 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: mgrmap e13: x(active, since 58s) 2024-05-20T17:25:05.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: overall HEALTH_OK 2024-05-20T17:25:05.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:05.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:06.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:25:06.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 -- 172.21.15.172:0/568599034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f478c0035c0 msgr2=0x7f478c005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:06.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/568599034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f478c0035c0 0x7f478c005aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47a41018f0 tx=0x7f479400ff50 comp rx=0 tx=0).stop 2024-05-20T17:25:06.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 -- 172.21.15.172:0/568599034 shutdown_connections 2024-05-20T17:25:06.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/568599034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f478c0035c0 0x7f478c005aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 -- 172.21.15.172:0/568599034 >> 172.21.15.172:0/568599034 conn(0x7f47a4078660 msgr2=0x7f47a4078aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 -- 172.21.15.172:0/568599034 shutdown_connections 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.902+0000 7f47aa5e7700 1 -- 172.21.15.172:0/568599034 wait complete. 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 Processor -- start 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 -- start start 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f478c0035c0 0x7f47a419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a419ed60 0x7f47a4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47a4109a80 con 0x7f47a4198f80 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f47a4109900 con 0x7f478c0035c0 2024-05-20T17:25:06.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47aa5e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47a4109c00 con 0x7f47a419ed60 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47a8b84700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47a8b84700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.172:43118/0 (socket says 172.21.15.172:43118) 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47a3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f478c0035c0 0x7f47a419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47a8b84700 1 -- 172.21.15.172:0/3761795905 learned_addr learned my addr 172.21.15.172:0/3761795905 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.903+0000 7f47a37fe700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a419ed60 0x7f47a4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 -- 172.21.15.172:0/3761795905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a419ed60 msgr2=0x7f47a4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a419ed60 0x7f47a4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 -- 172.21.15.172:0/3761795905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f478c0035c0 msgr2=0x7f47a419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f478c0035c0 0x7f47a419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 -- 172.21.15.172:0/3761795905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a41a56b0 con 0x7f47a4198f80 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a8b84700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f479c00ba50 tx=0x7f479c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:06.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c019070 con 0x7f47a4198f80 2024-05-20T17:25:06.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f479c00ce10 con 0x7f47a4198f80 2024-05-20T17:25:06.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a41a5940 con 0x7f47a4198f80 2024-05-20T17:25:06.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c007350 con 0x7f47a4198f80 2024-05-20T17:25:06.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.904+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a41a5e50 con 0x7f47a4198f80 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.905+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a4063ca0 con 0x7f47a4198f80 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.905+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f479c01c070 con 0x7f47a4198f80 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.905+0000 7f47a17fa700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 0x7f479003ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.905+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f479c04b720 con 0x7f47a4198f80 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.906+0000 7f47a3fff700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 0x7f479003ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.906+0000 7f47a3fff700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 0x7f479003ba90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f479400fb00 tx=0x7f47940037a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:06.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:06.911+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f479c012500 con 0x7f47a4198f80 2024-05-20T17:25:07.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.205+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f47a41a6170 con 0x7f47a4198f80 2024-05-20T17:25:07.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.206+0000 7f47a17fa700 1 -- 172.21.15.172:0/3761795905 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f479c014440 con 0x7f47a4198f80 2024-05-20T17:25:07.207 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-20T17:25:07.207 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","modified":"2024-05-20T17:25:00.303372Z","created":"2024-05-20T17:23:00.069959Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-20T17:25:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 msgr2=0x7f479003ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 0x7f479003ba90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f479400fb00 tx=0x7f47940037a0 comp rx=0 tx=0).stop 2024-05-20T17:25:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 msgr2=0x7f47a4199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f479c00ba50 tx=0x7f479c00bd60 comp rx=0 tx=0).stop 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 shutdown_connections 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f478c0035c0 0x7f47a419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4790039580 0x7f479003ba90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4198f80 0x7f47a4199390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.208+0000 7f47aa5e7700 1 --2- 172.21.15.172:0/3761795905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a419ed60 0x7f47a4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.209+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 >> 172.21.15.172:0/3761795905 conn(0x7f47a4078660 msgr2=0x7f47a41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.209+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 shutdown_connections 2024-05-20T17:25:07.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:07.209+0000 7f47aa5e7700 1 -- 172.21.15.172:0/3761795905 wait complete. 2024-05-20T17:25:07.211 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-05-20T17:25:07.776 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-20T17:25:07.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph config generate-minimal-conf 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/3761795905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/3761795905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:07.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:07.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:07.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/3761795905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:08.871 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T17:25:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:08 smithi135 ceph-mon[32027]: Reconfiguring daemon mon.a on smithi135 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T17:25:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:08 smithi160 ceph-mon[36261]: Reconfiguring daemon mon.a on smithi135 2024-05-20T17:25:09.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T17:25:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:08 smithi172 ceph-mon[36511]: Reconfiguring daemon mon.a on smithi135 2024-05-20T17:25:09.779 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:09.779 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:09.779 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:09.779 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:09.779 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:09.780 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:09.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:09.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:09.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:09.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:09.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:09.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:10.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 -- 172.21.15.135:0/2691448708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8201075e0 msgr2=0x7fb82010ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 --2- 172.21.15.135:0/2691448708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8201075e0 0x7fb82010ef40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b0d0 tx=0x7fb81800b3e0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 -- 172.21.15.135:0/2691448708 shutdown_connections 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 --2- 172.21.15.135:0/2691448708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8201075e0 0x7fb82010ef40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 --2- 172.21.15.135:0/2691448708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 0x7fb820102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 --2- 172.21.15.135:0/2691448708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820106c90 0x7fb8201070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 -- 172.21.15.135:0/2691448708 >> 172.21.15.135:0/2691448708 conn(0x7fb8200fddb0 msgr2=0x7fb8201001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:10.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 -- 172.21.15.135:0/2691448708 shutdown_connections 2024-05-20T17:25:10.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.407+0000 7fb82707a700 1 -- 172.21.15.135:0/2691448708 wait complete. 2024-05-20T17:25:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 Processor -- start 2024-05-20T17:25:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 -- start start 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 0x7fb82019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8201075e0 0x7fb82019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb820112360 con 0x7fb820106c90 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201121e0 con 0x7fb8201075e0 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb82707a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201124e0 con 0x7fb820102360 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41058/0 (socket says 172.21.15.135:41058) 2024-05-20T17:25:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 -- 172.21.15.135:0/1339369849 learned_addr learned my addr 172.21.15.135:0/1339369849 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb824e16700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 0x7fb82019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb825617700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8201075e0 0x7fb82019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 -- 172.21.15.135:0/1339369849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 msgr2=0x7fb82019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 0x7fb82019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 -- 172.21.15.135:0/1339369849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8201075e0 msgr2=0x7fb82019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8201075e0 0x7fb82019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.408+0000 7fb81ffff700 1 -- 172.21.15.135:0/1339369849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8201a5f70 con 0x7fb820106c90 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb81ffff700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e970 tx=0x7fb80c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004a30 con 0x7fb820106c90 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb80c00ccc0 con 0x7fb820106c90 2024-05-20T17:25:10.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8201a6260 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c005650 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.409+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8201a67a0 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb80c021440 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb820050170 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb81dffb700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 0x7fb81003b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb80c04c880 con 0x7fb820106c90 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb824e16700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 0x7fb81003b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:10.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.410+0000 7fb824e16700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 0x7fb81003b840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb814005950 tx=0x7fb81400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:10.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.415+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb80c00fc50 con 0x7fb820106c90 2024-05-20T17:25:10.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.612+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb82002dc60 con 0x7fb820106c90 2024-05-20T17:25:10.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.613+0000 7fb81dffb700 1 -- 172.21.15.135:0/1339369849 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fb80c004bd0 con 0x7fb820106c90 2024-05-20T17:25:10.614 INFO:teuthology.orchestra.run.smithi135.stdout:# minimal ceph.conf for 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:10.614 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-05-20T17:25:10.614 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:25:10.614 INFO:teuthology.orchestra.run.smithi135.stdout: mon_host = [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 msgr2=0x7fb81003b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 0x7fb81003b840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb814005950 tx=0x7fb81400b410 comp rx=0 tx=0).stop 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 msgr2=0x7fb82019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e970 tx=0x7fb80c00ec80 comp rx=0 tx=0).stop 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 shutdown_connections 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8201075e0 0x7fb82019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb810039330 0x7fb81003b840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb820102360 0x7fb82019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 --2- 172.21.15.135:0/1339369849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb820106c90 0x7fb82019b140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:10.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 >> 172.21.15.135:0/1339369849 conn(0x7fb8200fddb0 msgr2=0x7fb820106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:10.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 shutdown_connections 2024-05-20T17:25:10.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:10.615+0000 7fb82707a700 1 -- 172.21.15.135:0/1339369849 wait complete. 2024-05-20T17:25:10.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: Reconfiguring mon.b (monmap changed)... 2024-05-20T17:25:10.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: Reconfiguring daemon mon.b on smithi160 2024-05-20T17:25:10.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:10.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:10.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:10.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1339369849' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: Reconfiguring mon.b (monmap changed)... 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: Reconfiguring daemon mon.b on smithi160 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:10.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1339369849' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:11.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: Reconfiguring mon.b (monmap changed)... 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: Reconfiguring daemon mon.b on smithi160 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1339369849' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:11.177 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-20T17:25:11.178 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:25:11.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T17:25:11.206 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:25:11.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:25:11.271 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:25:11.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T17:25:11.302 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:25:11.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:25:11.371 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:25:11.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T17:25:11.398 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:25:11.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:25:11.462 INFO:tasks.cephadm:Adding mgr.x on smithi135 2024-05-20T17:25:11.462 INFO:tasks.cephadm:Adding mgr.y on smithi160 2024-05-20T17:25:11.463 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-05-20T17:25:11.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch apply mgr '3;smithi135=x;smithi160=y;smithi172=z' 2024-05-20T17:25:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:11 smithi135 ceph-mon[32027]: Reconfiguring mon.c (monmap changed)... 2024-05-20T17:25:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:11 smithi135 ceph-mon[32027]: Reconfiguring daemon mon.c on smithi172 2024-05-20T17:25:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:11 smithi135 ceph-mon[32027]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:11.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:11 smithi172 ceph-mon[36511]: Reconfiguring mon.c (monmap changed)... 2024-05-20T17:25:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:11 smithi172 ceph-mon[36511]: Reconfiguring daemon mon.c on smithi172 2024-05-20T17:25:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:11 smithi172 ceph-mon[36511]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:11 smithi160 ceph-mon[36261]: Reconfiguring mon.c (monmap changed)... 2024-05-20T17:25:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:11 smithi160 ceph-mon[36261]: Reconfiguring daemon mon.c on smithi172 2024-05-20T17:25:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:11 smithi160 ceph-mon[36261]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:12.066 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:25:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:13 smithi160 ceph-mon[36261]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:13 smithi172 ceph-mon[36511]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:13 smithi135 ceph-mon[32027]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/3765416404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc01020d0 msgr2=0x7f8bc01024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/3765416404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc01020d0 0x7f8bc01024e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009990 tx=0x7f8bb0009ca0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/3765416404 shutdown_connections 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/3765416404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc0103ba0 0x7f8bc010a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/3765416404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc01020d0 0x7f8bc01024e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/3765416404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103200 0x7f8bc0103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/3765416404 >> 172.21.15.172:0/3765416404 conn(0x7f8bc00fd710 msgr2=0x7f8bc00ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.574+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/3765416404 shutdown_connections 2024-05-20T17:25:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.575+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/3765416404 wait complete. 2024-05-20T17:25:13.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.575+0000 7f8bc4bd4700 1 Processor -- start 2024-05-20T17:25:13.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.575+0000 7f8bc4bd4700 1 -- start start 2024-05-20T17:25:13.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc01020d0 0x7f8bc0199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:13.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:13.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103ba0 0x7f8bc01a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc010dd30 con 0x7f8bc01020d0 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc010dbb0 con 0x7f8bc0103ba0 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc010deb0 con 0x7f8bc0103200 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60096/0 (socket says 172.21.15.172:60096) 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 -- 172.21.15.172:0/1881340492 learned_addr learned my addr 172.21.15.172:0/1881340492 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbe59c700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc01020d0 0x7f8bc0199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbed9d700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103ba0 0x7f8bc01a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 -- 172.21.15.172:0/1881340492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103ba0 msgr2=0x7f8bc01a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103ba0 0x7f8bc01a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 -- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc01020d0 msgr2=0x7f8bc0199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc01020d0 0x7f8bc0199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 -- 172.21.15.172:0/1881340492 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc01a14a0 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bbdd9b700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400b530 tx=0x7f8bb400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4015020 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bb4011d10 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc01a1790 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.576+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400f2e0 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.577+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc01a1d20 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.577+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f8bb4018020 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.577+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc0050170 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.578+0000 7f8baf7fe700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 0x7f8ba803b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.578+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8bb404bcf0 con 0x7f8bc0103200 2024-05-20T17:25:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.578+0000 7f8bbe59c700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 0x7f8ba803b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:13.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.578+0000 7f8bbe59c700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 0x7f8ba803b840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00039c0 tx=0x7f8bb001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.583+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8bb401f020 con 0x7f8bc0103200 2024-05-20T17:25:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.790+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi160=y;smithi172=z", "target": ["mon-mgr", ""]}) -- 0x7f8bc00ff740 con 0x7f8ba8039330 2024-05-20T17:25:13.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.798+0000 7f8baf7fe700 1 -- 172.21.15.172:0/1881340492 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8bc00ff740 con 0x7f8ba8039330 2024-05-20T17:25:13.800 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 msgr2=0x7f8ba803b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 0x7f8ba803b840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00039c0 tx=0x7f8bb001a040 comp rx=0 tx=0).stop 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 msgr2=0x7f8bc0199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400b530 tx=0x7f8bb400b840 comp rx=0 tx=0).stop 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 shutdown_connections 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc0103ba0 0x7f8bc01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8ba8039330 0x7f8ba803b840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bc01020d0 0x7f8bc0199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 --2- 172.21.15.172:0/1881340492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0103200 0x7f8bc0199e80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 >> 172.21.15.172:0/1881340492 conn(0x7f8bc00fd710 msgr2=0x7f8bc00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 shutdown_connections 2024-05-20T17:25:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:25:13.801+0000 7f8bc4bd4700 1 -- 172.21.15.172:0/1881340492 wait complete. 2024-05-20T17:25:14.335 DEBUG:teuthology.orchestra.run.smithi160:mgr.y> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.y.service 2024-05-20T17:25:14.338 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.z.service 2024-05-20T17:25:14.340 INFO:tasks.cephadm:Deploying OSDs... 2024-05-20T17:25:14.341 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:25:14.341 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T17:25:14.360 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T17:25:14.360 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:14.419 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-20 17:24:17.036918167 +0000 2024-05-20T17:25:14.420 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-20 17:19:05.778576703 +0000 2024-05-20T17:25:14.420 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-20 17:19:05.778576703 +0000 2024-05-20T17:25:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-20 17:19:05.778576703 +0000 2024-05-20T17:25:14.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T17:25:14.487 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-20T17:25:14.488 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-20T17:25:14.488 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000219256 s, 2.3 MB/s 2024-05-20T17:25:14.489 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T17:25:14.547 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-20T17:25:14.604 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-20 17:24:17.069917465 +0000 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-20 17:19:06.114568544 +0000 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-20 17:19:06.114568544 +0000 2024-05-20T17:25:14.605 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-20 17:19:06.114568544 +0000 2024-05-20T17:25:14.606 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T17:25:14.670 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-20T17:25:14.670 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-20T17:25:14.671 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000200264 s, 2.6 MB/s 2024-05-20T17:25:14.672 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T17:25:14.731 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-20T17:25:14.787 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T17:25:14.787 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:14.787 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-20 17:24:17.100916805 +0000 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-20 17:19:06.447560458 +0000 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-20 17:19:06.447560458 +0000 2024-05-20T17:25:14.788 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-20 17:19:06.447560458 +0000 2024-05-20T17:25:14.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T17:25:14.853 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-20T17:25:14.853 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-20T17:25:14.853 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.0002061 s, 2.5 MB/s 2024-05-20T17:25:14.854 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T17:25:14.912 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-20 17:24:17.132916125 +0000 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-20 17:19:06.789552153 +0000 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-20 17:19:06.789552153 +0000 2024-05-20T17:25:14.969 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-20 17:19:06.789552153 +0000 2024-05-20T17:25:14.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T17:25:15.033 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-20T17:25:15.033 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-20T17:25:15.033 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000216118 s, 2.4 MB/s 2024-05-20T17:25:15.034 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T17:25:15.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi160=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:15.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: Saving service mgr spec with placement smithi135=x;smithi160=y;smithi172=z;count:3 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: Deploying daemon mgr.z on smithi172 2024-05-20T17:25:15.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:14 smithi172 ceph-mon[36511]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:15.091 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-20T17:25:15.092 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T17:25:15.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T17:25:15.110 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-20 17:24:59.736610924 +0000 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-20 17:19:26.071500251 +0000 2024-05-20T17:25:15.168 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-20 17:19:26.071500251 +0000 2024-05-20T17:25:15.169 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-20 17:19:26.071500251 +0000 2024-05-20T17:25:15.169 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi160=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: Saving service mgr spec with placement smithi135=x;smithi160=y;smithi172=z;count:3 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:15.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:15.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: Deploying daemon mgr.z on smithi172 2024-05-20T17:25:15.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:14 smithi135 ceph-mon[32027]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi160=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: Saving service mgr spec with placement smithi135=x;smithi160=y;smithi172=z;count:3 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:15.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: Deploying daemon mgr.z on smithi172 2024-05-20T17:25:15.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:14 smithi160 ceph-mon[36261]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:15.235 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-20T17:25:15.235 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-20T17:25:15.235 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000283744 s, 1.8 MB/s 2024-05-20T17:25:15.237 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T17:25:15.296 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-20 17:24:59.736610924 +0000 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-20 17:19:26.419494609 +0000 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-20 17:19:26.419494609 +0000 2024-05-20T17:25:15.354 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-20 17:19:26.419494609 +0000 2024-05-20T17:25:15.355 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T17:25:15.419 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-20T17:25:15.420 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-20T17:25:15.420 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000238749 s, 2.1 MB/s 2024-05-20T17:25:15.421 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T17:25:15.483 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-05-20T17:25:15.547 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T17:25:15.547 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-20 17:24:59.737610909 +0000 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-20 17:19:26.769488935 +0000 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-20 17:19:26.769488935 +0000 2024-05-20T17:25:15.548 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-20 17:19:26.769488935 +0000 2024-05-20T17:25:15.548 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T17:25:15.615 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-20T17:25:15.615 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-20T17:25:15.615 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000193166 s, 2.7 MB/s 2024-05-20T17:25:15.617 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T17:25:15.675 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-05-20T17:25:15.734 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T17:25:15.734 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:15.734 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-20T17:25:15.734 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:15.735 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:15.735 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-20 17:24:59.737610909 +0000 2024-05-20T17:25:15.735 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-20 17:19:27.098483601 +0000 2024-05-20T17:25:15.735 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-20 17:19:27.098483601 +0000 2024-05-20T17:25:15.735 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-20 17:19:27.098483601 +0000 2024-05-20T17:25:15.735 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T17:25:15.798 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-20T17:25:15.798 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-20T17:25:15.798 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000205271 s, 2.5 MB/s 2024-05-20T17:25:15.799 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T17:25:15.855 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-20T17:25:15.856 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T17:25:15.873 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T17:25:15.873 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-20 17:25:15.721635638 +0000 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-20 17:19:26.422710661 +0000 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-20 17:19:26.422710661 +0000 2024-05-20T17:25:15.928 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-20 17:19:26.422710661 +0000 2024-05-20T17:25:15.928 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T17:25:15.989 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:15 smithi172 systemd[1]: Starting Ceph mgr.z for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:25:15.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-20T17:25:15.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-20T17:25:15.992 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000195238 s, 2.6 MB/s 2024-05-20T17:25:15.993 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T17:25:16.049 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-20 17:25:15.721635638 +0000 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-20 17:19:26.768701629 +0000 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-20 17:19:26.768701629 +0000 2024-05-20T17:25:16.105 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-20 17:19:26.768701629 +0000 2024-05-20T17:25:16.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T17:25:16.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-20T17:25:16.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-20T17:25:16.198 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000207425 s, 2.5 MB/s 2024-05-20T17:25:16.199 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T17:25:16.256 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-05-20T17:25:16.266 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:15 smithi172 podman[38150]: 2024-05-20 17:25:15.900713109 +0000 UTC m=+0.017114473 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:25:16.266 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 podman[38150]: 2024-05-20 17:25:16.01943217 +0000 UTC m=+0.135833516 container create 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=) 2024-05-20T17:25:16.266 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 podman[38150]: 2024-05-20 17:25:16.227312819 +0000 UTC m=+0.343714170 container init 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-20T17:25:16.266 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 podman[38150]: 2024-05-20 17:25:16.230557471 +0000 UTC m=+0.346958823 container start 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:25:16.266 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 ceph-mgr[38256]: -- 172.21.15.172:0/1228401665 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56222663a5a0 con 0x562226778900 2024-05-20T17:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T17:25:16.280 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-20 17:25:15.722635614 +0000 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-20 17:19:27.106692805 +0000 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-20 17:19:27.106692805 +0000 2024-05-20T17:25:16.281 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-20 17:19:27.106692805 +0000 2024-05-20T17:25:16.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T17:25:16.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-20T17:25:16.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-20T17:25:16.345 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000224873 s, 2.3 MB/s 2024-05-20T17:25:16.346 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T17:25:16.404 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-05-20T17:25:16.458 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T17:25:16.458 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:25:16.458 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-20T17:25:16.458 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:25:16.459 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:25:16.459 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-20 17:25:15.722635614 +0000 2024-05-20T17:25:16.459 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-20 17:19:27.414684764 +0000 2024-05-20T17:25:16.459 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-20 17:19:27.414684764 +0000 2024-05-20T17:25:16.459 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-20 17:19:27.414684764 +0000 2024-05-20T17:25:16.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T17:25:16.519 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 bash[38150]: 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 2024-05-20T17:25:16.519 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 systemd[1]: Started Ceph mgr.z for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:25:16.519 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:16.398+0000 7fce59cc8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:25:16.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-20T17:25:16.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-20T17:25:16.521 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000211439 s, 2.4 MB/s 2024-05-20T17:25:16.523 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T17:25:16.578 INFO:tasks.cephadm:Deploying osd.0 on smithi135 with /dev/vg_nvme/lv_4... 2024-05-20T17:25:16.578 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T17:25:16.821 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:25:16.829 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:16.591+0000 7fce59cc8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:25:16.830 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:16.692+0000 7fce59cc8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:25:17.329 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:16.996+0000 7fce59cc8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:25:17.329 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:17.079+0000 7fce59cc8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: Deploying daemon mgr.y on smithi160 2024-05-20T17:25:17.585 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:17 smithi135 ceph-mon[32027]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:17.617 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:17.618 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: Deploying daemon mgr.y on smithi160 2024-05-20T17:25:17.618 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:17 smithi160 ceph-mon[36261]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:17.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: Deploying daemon mgr.y on smithi160 2024-05-20T17:25:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:17 smithi172 ceph-mon[36511]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:18.579 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:18.302+0000 7fce59cc8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:25:18.580 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:18.473+0000 7fce59cc8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:25:18.585 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 systemd[1]: Starting Ceph mgr.y for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:25:18.689 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T17:25:18.690 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T17:25:18.690 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-20T17:25:18.690 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-20T17:25:18.690 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132926 s, 789 MB/s 2024-05-20T17:25:18.690 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-20T17:25:18.892 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 podman[37665]: 2024-05-20 17:25:18.578654056 +0000 UTC m=+0.022277127 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:25:18.892 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 podman[37665]: 2024-05-20 17:25:18.689570838 +0000 UTC m=+0.133193885 container create 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-20T17:25:18.892 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 podman[37665]: 2024-05-20 17:25:18.891732508 +0000 UTC m=+0.335355561 container init 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS) 2024-05-20T17:25:18.940 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:18.646+0000 7fce59cc8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:25:18.940 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:18.938+0000 7fce59cc8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:25:19.239 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:19.030+0000 7fce59cc8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:25:19.239 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:19.238+0000 7fce59cc8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:25:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 podman[37665]: 2024-05-20 17:25:18.89444119 +0000 UTC m=+0.338064255 container start 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-20T17:25:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 ceph-mgr[37686]: -- 172.21.15.160:0/1322755852 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55808f5d65a0 con 0x55808f714900 2024-05-20T17:25:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 bash[37665]: 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 2024-05-20T17:25:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:18 smithi160 systemd[1]: Started Ceph mgr.y for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:25:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:19.065+0000 7f111b590200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:25:19.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-05-20T17:25:19.578 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:25:19.579 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:19.439+0000 7fce59cc8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:25:19.688 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:19.255+0000 7f111b590200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:25:19.688 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:19.363+0000 7f111b590200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:25:19.688 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:19.686+0000 7f111b590200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:19.980 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:19.788+0000 7f111b590200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:25:19.980 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:19.981 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.981 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.981 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.981 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.981 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:19.983 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:20.330 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:20.078+0000 7fce59cc8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:25:20.822 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:20.518+0000 7fce59cc8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:25:20.992 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:20.617+0000 7fce59cc8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:25:20.992 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:20.820+0000 7fce59cc8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/1618028822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff41031e0 msgr2=0x7f4ff41035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/1618028822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff41031e0 0x7f4ff41035f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009990 tx=0x7f4ff0009ca0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/1618028822 shutdown_connections 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/1618028822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff4104cb0 0x7f4ff410b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/1618028822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff41031e0 0x7f4ff41035f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/1618028822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/1618028822 >> 172.21.15.135:0/1618028822 conn(0x7f4ff40fe840 msgr2=0x7f4ff4100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/1618028822 shutdown_connections 2024-05-20T17:25:21.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.074+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/1618028822 wait complete. 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.075+0000 7f4ffb2fd700 1 Processor -- start 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.075+0000 7f4ffb2fd700 1 -- start start 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.075+0000 7f4ffb2fd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff41031e0 0x7f4ff4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.075+0000 7f4ffb2fd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ffb2fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff4104cb0 0x7f4ff41a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:21.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ffb2fd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410edc0 con 0x7f4ff4104cb0 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ffb2fd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410ec40 con 0x7f4ff41031e0 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ffb2fd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410ef40 con 0x7f4ff4104310 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff989a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff4104cb0 0x7f4ff41a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:48684/0 (socket says 172.21.15.135:48684) 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 -- 172.21.15.135:0/3891469819 learned_addr learned my addr 172.21.15.135:0/3891469819 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff9099700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff41031e0 0x7f4ff4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 -- 172.21.15.135:0/3891469819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff41031e0 msgr2=0x7f4ff4199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:21.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff41031e0 0x7f4ff4199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 -- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff4104cb0 msgr2=0x7f4ff41a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff4104cb0 0x7f4ff41a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 -- 172.21.15.135:0/3891469819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41a1490 con 0x7f4ff4104310 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4ff8898700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9a0 tx=0x7f4fe400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.076+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400ca10 con 0x7f4ff4104310 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.077+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a1780 con 0x7f4ff4104310 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.077+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe400cbb0 con 0x7f4ff4104310 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.077+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4018680 con 0x7f4ff4104310 2024-05-20T17:25:21.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.077+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a1cc0 con 0x7f4ff4104310 2024-05-20T17:25:21.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4fe4018820 con 0x7f4ff4104310 2024-05-20T17:25:21.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff4050170 con 0x7f4ff4104310 2024-05-20T17:25:21.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4fea7fc700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 0x7f4fe003b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:21.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fe404c910 con 0x7f4ff4104310 2024-05-20T17:25:21.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4ff9099700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 0x7f4fe003b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:21.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.078+0000 7f4ff9099700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 0x7f4fe003b840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000b8e0 tx=0x7f4ff0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:21.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.088+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fe400cd60 con 0x7f4ff4104310 2024-05-20T17:25:21.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:21.307+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4ff4062a80 con 0x7f4fe0039330 2024-05-20T17:25:21.357 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.017+0000 7f111b590200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:25:21.357 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.185+0000 7f111b590200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:25:21.357 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.356+0000 7f111b590200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:21.644 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.645 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: Reconfiguring daemon mgr.x on smithi135 2024-05-20T17:25:21.645 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:21.645 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:21.645 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:21.645 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.697 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:21.354+0000 7fce59cc8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:25:21.697 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:21.448+0000 7fce59cc8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:21.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: Reconfiguring daemon mgr.x on smithi135 2024-05-20T17:25:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: Reconfiguring daemon mgr.x on smithi135 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:21.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:21.938 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.642+0000 7f111b590200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:25:21.939 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.734+0000 7f111b590200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:25:21.939 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:21.937+0000 7f111b590200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:25:22.041 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:21.696+0000 7fce59cc8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:25:22.041 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:21.830+0000 7fce59cc8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:25:22.042 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:21.925+0000 7fce59cc8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:25:22.042 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:22.040+0000 7fce59cc8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:25:22.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:22.129+0000 7f111b590200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:25:22.682 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:22.340+0000 7fce59cc8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:25:22.727 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:22.727 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.727 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.728 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.728 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:22.728 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:22.728 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:22.728 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:22.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:22.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:22.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:22.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:22.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:22.734+0000 7f111b590200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:23.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:23.329 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:22.943+0000 7fce59cc8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:25:23.330 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:25:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:25:23.161+0000 7fce59cc8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:25:23.447 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:23.152+0000 7f111b590200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:25:23.447 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:23.247+0000 7f111b590200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:25:23.447 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:23.445+0000 7f111b590200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:25:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:23.690+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f4fe40178f0 con 0x7f4ff4104310 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: Standby manager daemon z started 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:25:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:23 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: Standby manager daemon z started 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:25:23.861 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:23 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: Standby manager daemon z started 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:25:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:23 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/2815752752' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:24.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:23.972+0000 7f111b590200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:25:24.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.064+0000 7f111b590200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:25:24.649 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.305+0000 7f111b590200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:25:24.650 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.439+0000 7f111b590200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:25:24.650 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.533+0000 7f111b590200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:25:24.650 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.648+0000 7f111b590200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]: dispatch 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]': finished 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T17:25:24.952 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:24 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]: dispatch 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]': finished 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T17:25:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:24 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:25.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-20T17:25:25.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:25:25.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]: dispatch 2024-05-20T17:25:25.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3145673033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2f64d8-041a-4069-ac15-ee66c1c8566e"}]': finished 2024-05-20T17:25:25.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T17:25:25.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:24 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:25.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:24.950+0000 7f111b590200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:25:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:25 smithi135 ceph-mon[32027]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:25.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:25 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2332685635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:25 smithi160 ceph-mon[36261]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:25 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2332685635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:26.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:25.549+0000 7f111b590200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:25:26.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:25:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:25:25.764+0000 7f111b590200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:25:26.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:25 smithi172 ceph-mon[36511]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:26.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:25 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2332685635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:26.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:26.699+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f4fe40173d0 con 0x7f4ff4104310 2024-05-20T17:25:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:26 smithi135 ceph-mon[32027]: Standby manager daemon y started 2024-05-20T17:25:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:26 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:25:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:26 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:26 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:25:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:26 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:26 smithi160 ceph-mon[36261]: Standby manager daemon y started 2024-05-20T17:25:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:26 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:25:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:26 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:26 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:25:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:26 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:27.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:26 smithi172 ceph-mon[36511]: Standby manager daemon y started 2024-05-20T17:25:27.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:26 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:25:27.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:26 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:25:27.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:26 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:25:27.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:26 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/3397488462' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:25:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:27 smithi135 ceph-mon[32027]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:27 smithi135 ceph-mon[32027]: mgrmap e15: x(active, since 80s), standbys: y, z 2024-05-20T17:25:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:27 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:25:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:27 smithi160 ceph-mon[36261]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:27 smithi160 ceph-mon[36261]: mgrmap e15: x(active, since 80s), standbys: y, z 2024-05-20T17:25:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:27 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:25:28.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:27 smithi172 ceph-mon[36511]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:28.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:27 smithi172 ceph-mon[36511]: mgrmap e15: x(active, since 80s), standbys: y, z 2024-05-20T17:25:28.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:27 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:25:29.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:29 smithi135 ceph-mon[32027]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:29 smithi160 ceph-mon[36261]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:30.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:29 smithi172 ceph-mon[36511]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:31.726 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:31 smithi135 ceph-mon[32027]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:31 smithi160 ceph-mon[36261]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:32.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:31 smithi172 ceph-mon[36511]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:33.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T17:25:33.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:33.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T17:25:33.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:33.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T17:25:33.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:33 smithi135 ceph-mon[32027]: Deploying daemon osd.0 on smithi135 2024-05-20T17:25:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:33 smithi135 ceph-mon[32027]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:33 smithi160 ceph-mon[36261]: Deploying daemon osd.0 on smithi135 2024-05-20T17:25:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:33 smithi160 ceph-mon[36261]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:34.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:33 smithi172 ceph-mon[36511]: Deploying daemon osd.0 on smithi135 2024-05-20T17:25:34.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:33 smithi172 ceph-mon[36511]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:35.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:34 smithi172 ceph-mon[36511]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:35.132 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:34 smithi135 ceph-mon[32027]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:35.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:34 smithi160 ceph-mon[36261]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:37 smithi135 ceph-mon[32027]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:37 smithi160 ceph-mon[36261]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:38.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:37 smithi172 ceph-mon[36511]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:38.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:38.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:38.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:40.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:41.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.112+0000 7f4fea7fc700 1 -- 172.21.15.135:0/3891469819 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ff4062a80 con 0x7f4fe0039330 2024-05-20T17:25:41.114 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 0 on host 'smithi135' 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 msgr2=0x7f4fe003b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 0x7f4fe003b840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000b8e0 tx=0x7f4ff0005fd0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 msgr2=0x7f4ff4199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9a0 tx=0x7f4fe400ecb0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 shutdown_connections 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ff41031e0 0x7f4ff4199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4fe0039330 0x7f4fe003b840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff4104cb0 0x7f4ff41a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 --2- 172.21.15.135:0/3891469819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4104310 0x7f4ff4199e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:41.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.114+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 >> 172.21.15.135:0/3891469819 conn(0x7f4ff40fe840 msgr2=0x7f4ff4107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:41.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.115+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 shutdown_connections 2024-05-20T17:25:41.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:25:41.115+0000 7f4ffb2fd700 1 -- 172.21.15.135:0/3891469819 wait complete. 2024-05-20T17:25:41.758 DEBUG:teuthology.orchestra.run.smithi135:osd.0> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.0.service 2024-05-20T17:25:41.760 INFO:tasks.cephadm:Deploying osd.1 on smithi160 with /dev/vg_nvme/lv_4... 2024-05-20T17:25:41.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T17:25:41.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:41 smithi135 ceph-mon[32027]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:41.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:41.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:41.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:41.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:41 smithi135 ceph-mon[32027]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T17:25:42.006 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:25:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:41 smithi160 ceph-mon[36261]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:41 smithi160 ceph-mon[36261]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T17:25:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:41 smithi172 ceph-mon[36511]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:25:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:41 smithi172 ceph-mon[36511]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T17:25:43.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:43 smithi160 ceph-mon[36261]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T17:25:43.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:43 smithi160 ceph-mon[36261]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T17:25:43.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:43 smithi160 ceph-mon[36261]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:25:43.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:43.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:43 smithi160 ceph-mon[36261]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:43.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:43 smithi135 ceph-mon[32027]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T17:25:43.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:43 smithi135 ceph-mon[32027]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T17:25:43.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:43 smithi135 ceph-mon[32027]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:25:43.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:43.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:43 smithi135 ceph-mon[32027]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:43.433 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:25:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0[44459]: 2024-05-20T17:25:43.096+0000 7fedc610c700 -1 osd.0 0 waiting for initial osdmap 2024-05-20T17:25:43.433 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:25:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0[44459]: 2024-05-20T17:25:43.100+0000 7fedc1ec1700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:25:43.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:43 smithi172 ceph-mon[36511]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T17:25:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:43 smithi172 ceph-mon[36511]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T17:25:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:43 smithi172 ceph-mon[36511]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:25:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:43 smithi172 ceph-mon[36511]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113184 s, 926 MB/s 2024-05-20T17:25:43.803 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-20T17:25:44.358 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:44 smithi160 ceph-mon[36261]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:25:44.358 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:44 smithi160 ceph-mon[36261]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T17:25:44.358 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:44 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.358 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:44 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.385 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-05-20T17:25:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:44 smithi135 ceph-mon[32027]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:25:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:44 smithi135 ceph-mon[32027]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T17:25:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:44 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:44 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:44 smithi172 ceph-mon[36511]: from='osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:25:44.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:44 smithi172 ceph-mon[36511]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T17:25:44.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:44 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:44 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:44.622 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] boot 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:45.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] boot 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:45.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: osd.0 [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] boot 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:25:45.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:45.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:45.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:25:45.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:25:46.224 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 -- 172.21.15.160:0/1236871923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4103ba0 msgr2=0x7f7af410a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 --2- 172.21.15.160:0/1236871923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4103ba0 0x7f7af410a450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b0a0 tx=0x7f7aec00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 -- 172.21.15.160:0/1236871923 shutdown_connections 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 --2- 172.21.15.160:0/1236871923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4103ba0 0x7f7af410a450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 --2- 172.21.15.160:0/1236871923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af41020d0 0x7f7af41024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 --2- 172.21.15.160:0/1236871923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103200 0x7f7af4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 -- 172.21.15.160:0/1236871923 >> 172.21.15.160:0/1236871923 conn(0x7f7af40fd710 msgr2=0x7f7af40ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 -- 172.21.15.160:0/1236871923 shutdown_connections 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 -- 172.21.15.160:0/1236871923 wait complete. 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.220+0000 7f7afae15700 1 Processor -- start 2024-05-20T17:25:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 -- start start 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 0x7f7af4198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103ba0 0x7f7af419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7af410dca0 con 0x7f7af4103200 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7af410db20 con 0x7f7af41020d0 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7afae15700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7af410de20 con 0x7f7af4103ba0 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:46264/0 (socket says 172.21.15.160:46264) 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 -- 172.21.15.160:0/3834441796 learned_addr learned my addr 172.21.15.160:0/3834441796 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af3fff700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 0x7f7af4198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af93b2700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103ba0 0x7f7af419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 -- 172.21.15.160:0/3834441796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103ba0 msgr2=0x7f7af419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103ba0 0x7f7af419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 -- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 msgr2=0x7f7af4198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 0x7f7af4198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 -- 172.21.15.160:0/3834441796 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af41a0230 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af3fff700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 0x7f7af4198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af8bb1700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d950 tx=0x7f7ae800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.221+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8017070 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.222+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ae800de30 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.222+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8003c70 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.222+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af41a0520 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.222+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af41a0a10 con 0x7f7af41020d0 2024-05-20T17:25:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.223+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af4050170 con 0x7f7af41020d0 2024-05-20T17:25:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.224+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f7ae8009940 con 0x7f7af41020d0 2024-05-20T17:25:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.225+0000 7f7af1ffb700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 0x7f7ae40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:25:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.225+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f7ae80cd8f0 con 0x7f7af41020d0 2024-05-20T17:25:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.225+0000 7f7af3fff700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 0x7f7ae40a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:25:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.226+0000 7f7af3fff700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 0x7f7ae40a50a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7ae0005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:25:46.230 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.229+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7ae8020030 con 0x7f7af41020d0 2024-05-20T17:25:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:46 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi135 2024-05-20T17:25:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:46 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 17088M 2024-05-20T17:25:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:46 smithi160 ceph-mon[36261]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T17:25:46.437 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:25:46.436+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7af4062b40 con 0x7f7ae40a2b90 2024-05-20T17:25:46.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:46 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi135 2024-05-20T17:25:46.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:46 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 17088M 2024-05-20T17:25:46.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:46 smithi135 ceph-mon[32027]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T17:25:46.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:46 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi135 2024-05-20T17:25:46.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:46 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 17088M 2024-05-20T17:25:46.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:46 smithi172 ceph-mon[36511]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T17:25:47.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:47 smithi160 ceph-mon[36261]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:47.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:47.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:47.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:47.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:47 smithi160 ceph-mon[36261]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:47.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:47 smithi135 ceph-mon[32027]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:47.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:47.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:47.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:47.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:47 smithi135 ceph-mon[32027]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:47 smithi172 ceph-mon[36511]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:25:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:25:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:25:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:47 smithi172 ceph-mon[36511]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/2794457778' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]': finished 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T17:25:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:25:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/2794457778' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:50.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:50.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]': finished 2024-05-20T17:25:50.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T17:25:50.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:25:50.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:50.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/2794457778' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:50.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]: dispatch 2024-05-20T17:25:50.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6293c0f-9f2a-42bc-9625-0b20b435ccad"}]': finished 2024-05-20T17:25:50.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T17:25:50.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:25:50.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:50 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/4208033171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:51.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:50 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/4208033171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:51.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:50 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/4208033171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:25:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:51 smithi135 ceph-mon[32027]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:51 smithi160 ceph-mon[36261]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:52.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:51 smithi172 ceph-mon[36511]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:53 smithi160 ceph-mon[36261]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:54.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:53 smithi172 ceph-mon[36511]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:53 smithi135 ceph-mon[32027]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:55 smithi135 ceph-mon[32027]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:56.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:55 smithi160 ceph-mon[36261]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:56.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:55 smithi172 ceph-mon[36511]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:57.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T17:25:57.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:57.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T17:25:57.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:57.131 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T17:25:57.131 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:25:57.911 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:57 smithi160 ceph-mon[36261]: Deploying daemon osd.1 on smithi160 2024-05-20T17:25:57.911 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:57 smithi160 ceph-mon[36261]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:58.064 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:57 smithi135 ceph-mon[32027]: Deploying daemon osd.1 on smithi160 2024-05-20T17:25:58.064 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:57 smithi135 ceph-mon[32027]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:58.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:57 smithi172 ceph-mon[36511]: Deploying daemon osd.1 on smithi160 2024-05-20T17:25:58.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:57 smithi172 ceph-mon[36511]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:59.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:25:58 smithi160 ceph-mon[36261]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:59.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:25:58 smithi172 ceph-mon[36511]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:25:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:25:58 smithi135 ceph-mon[32027]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:01 smithi135 ceph-mon[32027]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:01 smithi160 ceph-mon[36261]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:02.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:01 smithi172 ceph-mon[36511]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:02.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:03 smithi135 ceph-mon[32027]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:03 smithi160 ceph-mon[36261]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:04.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:03 smithi172 ceph-mon[36511]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.352 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:05 smithi160 ceph-mon[36261]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:05.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.349+0000 7f7af1ffb700 1 -- 172.21.15.160:0/3834441796 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7af4062b40 con 0x7f7ae40a2b90 2024-05-20T17:26:05.353 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 1 on host 'smithi160' 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 msgr2=0x7f7ae40a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 0x7f7ae40a50a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7ae0005de0 comp rx=0 tx=0).stop 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 msgr2=0x7f7af41986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d950 tx=0x7f7ae800dd10 comp rx=0 tx=0).stop 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 shutdown_connections 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af41020d0 0x7f7af41986d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7ae40a2b90 0x7f7ae40a50a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af4103ba0 0x7f7af419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:05.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 --2- 172.21.15.160:0/3834441796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7af4103200 0x7f7af4198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:05.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 >> 172.21.15.160:0/3834441796 conn(0x7f7af40fd710 msgr2=0x7f7af4106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:05.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 shutdown_connections 2024-05-20T17:26:05.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:05.352+0000 7f7afae15700 1 -- 172.21.15.160:0/3834441796 wait complete. 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:05 smithi135 ceph-mon[32027]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:05.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:05 smithi172 ceph-mon[36511]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:06.014 DEBUG:teuthology.orchestra.run.smithi160:osd.1> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.1.service 2024-05-20T17:26:06.016 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-05-20T17:26:06.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T17:26:06.267 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:26:06.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:06 smithi172 ceph-mon[36511]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:06 smithi172 ceph-mon[36511]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:06 smithi135 ceph-mon[32027]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:06 smithi135 ceph-mon[32027]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:06 smithi160 ceph-mon[36261]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:06 smithi160 ceph-mon[36261]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.374 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:07 smithi160 ceph-mon[36261]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:07.375 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1[40851]: 2024-05-20T17:26:07.331+0000 7f454979b700 -1 osd.1 0 waiting for initial osdmap 2024-05-20T17:26:07.375 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1[40851]: 2024-05-20T17:26:07.334+0000 7f4545550700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:26:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T17:26:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T17:26:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:07 smithi135 ceph-mon[32027]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T17:26:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: from='osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T17:26:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:26:07.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:07 smithi172 ceph-mon[36511]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:07.946 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T17:26:07.946 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T17:26:07.946 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-20T17:26:07.946 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-20T17:26:07.947 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113139 s, 927 MB/s 2024-05-20T17:26:07.947 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-20T17:26:08.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:08 smithi135 ceph-mon[32027]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:26:08.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:08 smithi135 ceph-mon[32027]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T17:26:08.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.477 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:08 smithi160 ceph-mon[36261]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:26:08.477 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:08 smithi160 ceph-mon[36261]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T17:26:08.477 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.477 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:08 smithi172 ceph-mon[36511]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:26:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:08 smithi172 ceph-mon[36511]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T17:26:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:08.542 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-05-20T17:26:08.786 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:26:09.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] boot 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:09.454 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.455 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:09.455 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:09.455 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:09 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] boot 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:09.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:09 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:26:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: osd.1 [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] boot 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:09 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 -- 172.21.15.172:0/1650060389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981031f0 msgr2=0x7fe398103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 --2- 172.21.15.172:0/1650060389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981031f0 0x7fe398103600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009990 tx=0x7fe38c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 -- 172.21.15.172:0/1650060389 shutdown_connections 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 --2- 172.21.15.172:0/1650060389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3981020c0 0x7fe3981024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 --2- 172.21.15.172:0/1650060389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398103b90 0x7fe39810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 --2- 172.21.15.172:0/1650060389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981031f0 0x7fe398103600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.228+0000 7fe39d937700 1 -- 172.21.15.172:0/1650060389 >> 172.21.15.172:0/1650060389 conn(0x7fe3980fd700 msgr2=0x7fe3980ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:10.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.229+0000 7fe39d937700 1 -- 172.21.15.172:0/1650060389 shutdown_connections 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.229+0000 7fe39d937700 1 -- 172.21.15.172:0/1650060389 wait complete. 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.229+0000 7fe39d937700 1 Processor -- start 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.229+0000 7fe39d937700 1 -- start start 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3981031f0 0x7fe39819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 0x7fe3981a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810dc90 con 0x7fe3981031f0 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810db10 con 0x7fe398103b90 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe39d937700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810de10 con 0x7fe3981020c0 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:57892/0 (socket says 172.21.15.172:57892) 2024-05-20T17:26:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 -- 172.21.15.172:0/2300296366 learned_addr learned my addr 172.21.15.172:0/2300296366 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe3967fc700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3981031f0 0x7fe39819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe3977fe700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 0x7fe3981a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 -- 172.21.15.172:0/2300296366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 msgr2=0x7fe3981a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 0x7fe3981a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 -- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3981031f0 msgr2=0x7fe39819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3981031f0 0x7fe39819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 -- 172.21.15.172:0/2300296366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981a13a0 con 0x7fe3981020c0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe3977fe700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 0x7fe3981a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.230+0000 7fe396ffd700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe38800d950 tx=0x7fe38800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.231+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388017070 con 0x7fe3981020c0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.231+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981a1690 con 0x7fe3981020c0 2024-05-20T17:26:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.231+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe388009c10 con 0x7fe3981020c0 2024-05-20T17:26:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.231+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388003b40 con 0x7fe3981020c0 2024-05-20T17:26:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.231+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981a1c20 con 0x7fe3981020c0 2024-05-20T17:26:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.232+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398050170 con 0x7fe3981020c0 2024-05-20T17:26:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.233+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fe388003ce0 con 0x7fe3981020c0 2024-05-20T17:26:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.233+0000 7fe39c935700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 0x7fe3800a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.233+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fe3880cd320 con 0x7fe3981020c0 2024-05-20T17:26:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.234+0000 7fe3967fc700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 0x7fe3800a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.234+0000 7fe3967fc700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 0x7fe3800a50a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b5c0 tx=0x7fe38c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:10.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.238+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe388020030 con 0x7fe3981020c0 2024-05-20T17:26:10.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:10.442+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe398062a80 con 0x7fe3800a2b90 2024-05-20T17:26:10.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:10 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi160 2024-05-20T17:26:10.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:10 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-20T17:26:10.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:10 smithi172 ceph-mon[36511]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T17:26:10.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:10 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi160 2024-05-20T17:26:10.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:10 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-20T17:26:10.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:10 smithi135 ceph-mon[32027]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T17:26:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:10 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi160 2024-05-20T17:26:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:10 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 17088M 2024-05-20T17:26:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:10 smithi160 ceph-mon[36261]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T17:26:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:11 smithi172 ceph-mon[36511]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:11 smithi172 ceph-mon[36511]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:11 smithi135 ceph-mon[32027]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:11 smithi135 ceph-mon[32027]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:11 smithi160 ceph-mon[36261]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:11.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:11.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:11.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:11 smithi160 ceph-mon[36261]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/292327153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]': finished 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T17:26:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:13.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:13 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/2587602863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/292327153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]': finished 2024-05-20T17:26:14.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T17:26:14.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:14.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:13 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/2587602863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:14.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:14.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/292327153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]: dispatch 2024-05-20T17:26:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70accd73-e32c-49e3-b39e-57fe0ec0feeb"}]': finished 2024-05-20T17:26:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T17:26:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:13 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/2587602863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:15.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:15 smithi135 ceph-mon[32027]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:16.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:15 smithi160 ceph-mon[36261]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:16.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:15 smithi172 ceph-mon[36511]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:17.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:17 smithi172 ceph-mon[36511]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:18.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:17 smithi160 ceph-mon[36261]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:17 smithi135 ceph-mon[32027]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:19.974 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:19 smithi172 ceph-mon[36511]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:19 smithi160 ceph-mon[36261]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:19 smithi135 ceph-mon[32027]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:20.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:20 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T17:26:20.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:20 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:20 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T17:26:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:20 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:20 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T17:26:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:20 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:21.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:21 smithi172 ceph-mon[36511]: Deploying daemon osd.2 on smithi172 2024-05-20T17:26:21.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:21 smithi172 ceph-mon[36511]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:22.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:21 smithi160 ceph-mon[36261]: Deploying daemon osd.2 on smithi172 2024-05-20T17:26:22.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:21 smithi160 ceph-mon[36261]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:21 smithi135 ceph-mon[32027]: Deploying daemon osd.2 on smithi172 2024-05-20T17:26:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:21 smithi135 ceph-mon[32027]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:23.045 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:22 smithi172 ceph-mon[36511]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:22 smithi135 ceph-mon[32027]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:22 smithi160 ceph-mon[36261]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:25 smithi135 ceph-mon[32027]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:25.987 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:25 smithi172 ceph-mon[36511]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:25.987 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:25.987 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:25.987 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:25 smithi160 ceph-mon[36261]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:27.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:27 smithi172 ceph-mon[36511]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:27 smithi160 ceph-mon[36261]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:27 smithi135 ceph-mon[32027]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:29.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.103+0000 7fe39c935700 1 -- 172.21.15.172:0/2300296366 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe398062a80 con 0x7fe3800a2b90 2024-05-20T17:26:29.105 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-05-20T17:26:29.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 msgr2=0x7fe3800a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:29.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 0x7fe3800a50a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b5c0 tx=0x7fe38c01a040 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 msgr2=0x7fe39806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe38800d950 tx=0x7fe38800dc60 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 shutdown_connections 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe398103b90 0x7fe3981a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe3800a2b90 0x7fe3800a50a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3981020c0 0x7fe39806aef0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 --2- 172.21.15.172:0/2300296366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3981031f0 0x7fe39819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.105+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 >> 172.21.15.172:0/2300296366 conn(0x7fe3980fd700 msgr2=0x7fe398106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.106+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 shutdown_connections 2024-05-20T17:26:29.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:26:29.106+0000 7fe39d937700 1 -- 172.21.15.172:0/2300296366 wait complete. 2024-05-20T17:26:29.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:29.700 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.2.service 2024-05-20T17:26:29.702 INFO:tasks.cephadm:Deploying osd.3 on smithi135 with /dev/vg_nvme/lv_3... 2024-05-20T17:26:29.703 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:26:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:26:30.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:30 smithi172 ceph-mon[36511]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:30.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:30 smithi172 ceph-mon[36511]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:30.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:30 smithi135 ceph-mon[32027]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:30.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:30 smithi135 ceph-mon[32027]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:30.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:30 smithi160 ceph-mon[36261]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:30.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:30 smithi160 ceph-mon[36261]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:26:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:26:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:26:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:31 smithi172 ceph-mon[36511]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:31.331 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2[41648]: 2024-05-20T17:26:31.192+0000 7f1b0cef7700 -1 osd.2 0 waiting for initial osdmap 2024-05-20T17:26:31.331 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2[41648]: 2024-05-20T17:26:31.198+0000 7f1b08cac700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:26:31.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:26:31.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:26:31.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:31.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.416 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.416 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:31 smithi135 ceph-mon[32027]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:31.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:26:31.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:26:31.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:31.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: from='osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:26:31.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:31 smithi160 ceph-mon[36261]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113816 s, 921 MB/s 2024-05-20T17:26:31.982 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-20T17:26:32.284 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:32 smithi135 ceph-mon[32027]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:26:32.284 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:32 smithi135 ceph-mon[32027]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:26:32.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:32 smithi172 ceph-mon[36511]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:26:32.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:32 smithi172 ceph-mon[36511]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:26:32.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:32 smithi160 ceph-mon[36261]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:26:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:32 smithi160 ceph-mon[36261]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:26:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:32.608 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-05-20T17:26:32.854 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:26:33.242 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] boot 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi172 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:33.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.244 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:33.244 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:26:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] boot 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi172 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:33.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:33.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: osd.2 [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] boot 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi172 2024-05-20T17:26:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 17088M 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:26:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:34.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:34 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:34.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:34 smithi135 ceph-mon[32027]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:26:34.269 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:34 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:34.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:34 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:34.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:34 smithi160 ceph-mon[36261]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:26:34.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:34 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 -- 172.21.15.135:0/3399294386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324108f80 msgr2=0x7fc32410b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 --2- 172.21.15.135:0/3399294386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324108f80 0x7fc32410b3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00b0a0 tx=0x7fc31c00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 -- 172.21.15.135:0/3399294386 shutdown_connections 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 --2- 172.21.15.135:0/3399294386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324103cc0 0x7fc3241060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 --2- 172.21.15.135:0/3399294386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324108f80 0x7fc32410b3a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 --2- 172.21.15.135:0/3399294386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 0x7fc324108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 -- 172.21.15.135:0/3399294386 >> 172.21.15.135:0/3399294386 conn(0x7fc3240fd700 msgr2=0x7fc3240ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 -- 172.21.15.135:0/3399294386 shutdown_connections 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.514+0000 7fc32aaec700 1 -- 172.21.15.135:0/3399294386 wait complete. 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 Processor -- start 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 -- start start 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 0x7fc324101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324108f80 0x7fc324102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410eda0 con 0x7fc324103cc0 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410ec20 con 0x7fc324108f80 2024-05-20T17:26:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc32aaec700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410ef20 con 0x7fc324106620 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc328888700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc328888700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49338/0 (socket says 172.21.15.135:49338) 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc328888700 1 -- 172.21.15.135:0/409789574 learned_addr learned my addr 172.21.15.135:0/409789574 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc329089700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324108f80 0x7fc324102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.515+0000 7fc323fff700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 0x7fc324101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 -- 172.21.15.135:0/409789574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 msgr2=0x7fc324101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 0x7fc324101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 -- 172.21.15.135:0/409789574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324108f80 msgr2=0x7fc324102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324108f80 0x7fc324102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 -- 172.21.15.135:0/409789574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc324102870 con 0x7fc324103cc0 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc328888700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc31800d950 tx=0x7fc31800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:34.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318016070 con 0x7fc324103cc0 2024-05-20T17:26:34.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc318004d10 con 0x7fc324103cc0 2024-05-20T17:26:34.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318005600 con 0x7fc324103cc0 2024-05-20T17:26:34.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3241a38a0 con 0x7fc324103cc0 2024-05-20T17:26:34.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.516+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3241a3dd0 con 0x7fc324103cc0 2024-05-20T17:26:34.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.517+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc324050170 con 0x7fc324103cc0 2024-05-20T17:26:34.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.520+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fc318004220 con 0x7fc324103cc0 2024-05-20T17:26:34.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.520+0000 7fc321ffb700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 0x7fc3140a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:34.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.520+0000 7fc323fff700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 0x7fc3140a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:34.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.520+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3237+0+0 (secure 0 0 0) 0x7fc3180cdd60 con 0x7fc324103cc0 2024-05-20T17:26:34.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.521+0000 7fc323fff700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 0x7fc3140a5120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc324102ed0 tx=0x7fc310009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:34.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.524+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc31801f020 con 0x7fc324103cc0 2024-05-20T17:26:34.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:34 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:34.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:34 smithi172 ceph-mon[36511]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:26:34.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:34 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:26:34.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:34.734+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc324062a80 con 0x7fc3140a2c10 2024-05-20T17:26:34.865 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49121]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:34.865 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49121]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:34.865 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49121]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:34.865 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49121]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:35.204 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49191]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:35.204 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49191]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:35.204 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49191]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:35.204 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:26:34 smithi135 sudo[49191]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:35.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:35.227+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc3180980e0 con 0x7fc324103cc0 2024-05-20T17:26:35.392 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:35.392 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:35.392 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44559]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:35.392 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44559]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:35.393 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:35.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:35.516 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:35.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44562]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:35.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44562]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:35.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44562]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:35.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:26:35 smithi160 sudo[44562]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:35.912 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:35.912 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:35.912 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45702]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:35.912 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45702]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:36.329 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:36.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:36.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45705]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:36.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:26:35 smithi172 sudo[45705]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:36.372 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49269]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:36.372 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49269]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:36.372 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49269]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:36.372 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49269]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:36.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:36.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49293]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 sudo[49293]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.686 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:36 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:36.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:36.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45708]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:36.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45708]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:26:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:26:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:26:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:36 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:37.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:37.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45711]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:37.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:36 smithi172 sudo[45711]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:37.442 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44565]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:26:37.442 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44565]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:37.442 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44565]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:37.442 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44565]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44568]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:26:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44568]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44568]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 sudo[44568]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:37.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:37 smithi160 ceph-mon[36261]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:37 smithi172 ceph-mon[36511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.947 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:26:37.948 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:26:37.949 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:37 smithi135 ceph-mon[32027]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:26:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:38 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]: dispatch 2024-05-20T17:26:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:38 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]': finished 2024-05-20T17:26:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:38 smithi160 ceph-mon[36261]: osdmap e22: 4 total, 3 up, 4 in 2024-05-20T17:26:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:38 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:38 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/954136350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:38.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:38 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]: dispatch 2024-05-20T17:26:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:38 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]': finished 2024-05-20T17:26:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:38 smithi172 ceph-mon[36511]: osdmap e22: 4 total, 3 up, 4 in 2024-05-20T17:26:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:38 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:38 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/954136350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:38.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:38 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]: dispatch 2024-05-20T17:26:38.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:38 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3563040194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b46ffe6-ac15-448e-b812-4c6971b5f472"}]': finished 2024-05-20T17:26:38.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:38 smithi135 ceph-mon[32027]: osdmap e22: 4 total, 3 up, 4 in 2024-05-20T17:26:38.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:38.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:38 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/954136350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:26:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:39 smithi160 ceph-mon[36261]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:39.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:39 smithi172 ceph-mon[36511]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:39 smithi135 ceph-mon[32027]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:41.925 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:41 smithi135 ceph-mon[32027]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 305 KiB/s wr, 23 op/s 2024-05-20T17:26:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:41 smithi160 ceph-mon[36261]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 305 KiB/s wr, 23 op/s 2024-05-20T17:26:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:41 smithi172 ceph-mon[36511]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 305 KiB/s wr, 23 op/s 2024-05-20T17:26:43.880 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:43 smithi135 ceph-mon[32027]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 228 KiB/s wr, 17 op/s 2024-05-20T17:26:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:43 smithi160 ceph-mon[36261]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 228 KiB/s wr, 17 op/s 2024-05-20T17:26:44.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:43 smithi172 ceph-mon[36511]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 228 KiB/s wr, 17 op/s 2024-05-20T17:26:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:45 smithi135 ceph-mon[32027]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 194 KiB/s wr, 14 op/s 2024-05-20T17:26:45.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:26:45.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:45 smithi160 ceph-mon[36261]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 194 KiB/s wr, 14 op/s 2024-05-20T17:26:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:26:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:46.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:45 smithi172 ceph-mon[36511]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 194 KiB/s wr, 14 op/s 2024-05-20T17:26:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:26:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:46.898 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:46 smithi135 ceph-mon[32027]: Deploying daemon osd.3 on smithi135 2024-05-20T17:26:46.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:46 smithi172 ceph-mon[36511]: Deploying daemon osd.3 on smithi135 2024-05-20T17:26:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:46 smithi160 ceph-mon[36261]: Deploying daemon osd.3 on smithi135 2024-05-20T17:26:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:47 smithi160 ceph-mon[36261]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 183 KiB/s wr, 14 op/s 2024-05-20T17:26:48.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:47 smithi135 ceph-mon[32027]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 183 KiB/s wr, 14 op/s 2024-05-20T17:26:48.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:47 smithi172 ceph-mon[36511]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 183 KiB/s wr, 14 op/s 2024-05-20T17:26:49.897 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:49 smithi135 ceph-mon[32027]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 165 KiB/s wr, 12 op/s 2024-05-20T17:26:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:49 smithi160 ceph-mon[36261]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 165 KiB/s wr, 12 op/s 2024-05-20T17:26:50.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:49 smithi172 ceph-mon[36511]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 165 KiB/s wr, 12 op/s 2024-05-20T17:26:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:51 smithi135 ceph-mon[32027]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-05-20T17:26:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:51 smithi160 ceph-mon[36261]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-05-20T17:26:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:51 smithi172 ceph-mon[36511]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-05-20T17:26:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:52.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:52 smithi135 ceph-mon[32027]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:53.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:52 smithi172 ceph-mon[36511]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:52 smithi160 ceph-mon[36261]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:54.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.302+0000 7fc321ffb700 1 -- 172.21.15.135:0/409789574 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc324062a80 con 0x7fc3140a2c10 2024-05-20T17:26:54.305 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 3 on host 'smithi135' 2024-05-20T17:26:54.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 msgr2=0x7fc3140a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:54.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 0x7fc3140a5120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc324102ed0 tx=0x7fc310009260 comp rx=0 tx=0).stop 2024-05-20T17:26:54.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 msgr2=0x7fc324103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:54.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc31800d950 tx=0x7fc31800dc60 comp rx=0 tx=0).stop 2024-05-20T17:26:54.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 shutdown_connections 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc324108f80 0x7fc324102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc3140a2c10 0x7fc3140a5120 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc324103cc0 0x7fc324103520 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 --2- 172.21.15.135:0/409789574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc324106620 0x7fc324101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 >> 172.21.15.135:0/409789574 conn(0x7fc3240fd700 msgr2=0x7fc324104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 shutdown_connections 2024-05-20T17:26:54.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:26:54.306+0000 7fc32aaec700 1 -- 172.21.15.135:0/409789574 wait complete. 2024-05-20T17:26:55.052 DEBUG:teuthology.orchestra.run.smithi135:osd.3> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.3.service 2024-05-20T17:26:55.054 INFO:tasks.cephadm:Deploying osd.4 on smithi160 with /dev/vg_nvme/lv_3... 2024-05-20T17:26:55.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:26:55.299 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:26:55.421 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.421 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.421 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.422 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.422 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:55.422 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:55 smithi160 ceph-mon[36261]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:55 smithi172 ceph-mon[36511]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:26:55.609 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.609 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.609 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.609 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:55.610 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:55.610 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:55 smithi135 ceph-mon[32027]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:26:56.735 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:56 smithi160 ceph-mon[36261]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:26:56.735 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:56 smithi160 ceph-mon[36261]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:26:56.735 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:56 smithi160 ceph-mon[36261]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:26:56.735 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:56 smithi135 ceph-mon[32027]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:26:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:56 smithi135 ceph-mon[32027]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:26:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:56 smithi135 ceph-mon[32027]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:26:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:56 smithi172 ceph-mon[36511]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:26:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:56 smithi172 ceph-mon[36511]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:26:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:56 smithi172 ceph-mon[36511]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:26:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.322 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:26:57.322 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:26:57.322 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-20T17:26:57.322 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-20T17:26:57.322 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131753 s, 796 MB/s 2024-05-20T17:26:57.323 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-20T17:26:57.402 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:26:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:26:57.085+0000 7f452d975700 -1 osd.3 0 waiting for initial osdmap 2024-05-20T17:26:57.402 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:26:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:26:57.094+0000 7f4525722700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:57 smithi135 ceph-mon[32027]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' 2024-05-20T17:26:57.945 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:26:57.945 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:26:57.945 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.946 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:57.946 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:57.946 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:57 smithi160 ceph-mon[36261]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' 2024-05-20T17:26:57.975 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-05-20T17:26:58.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:26:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:26:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:26:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:57 smithi172 ceph-mon[36511]: from='osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158]' entity='osd.3' 2024-05-20T17:26:58.216 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:26:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:26:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:26:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] boot 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: osdmap e25: 4 total, 4 up, 4 in 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:58.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] boot 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: osdmap e25: 4 total, 4 up, 4 in 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: osd.3 [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] boot 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: osdmap e25: 4 total, 4 up, 4 in 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:26:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.914 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 -- 172.21.15.160:0/3082455162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c103860 msgr2=0x7f390c10b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:59.914 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 --2- 172.21.15.160:0/3082455162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c103860 0x7f390c10b570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3904009990 tx=0x7f3904009ca0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.914 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 -- 172.21.15.160:0/3082455162 shutdown_connections 2024-05-20T17:26:59.914 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 --2- 172.21.15.160:0/3082455162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c103860 0x7f390c10b570 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.915 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 --2- 172.21.15.160:0/3082455162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c104830 0x7f390c104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.915 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 --2- 172.21.15.160:0/3082455162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c102de0 0x7f390c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.915 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 -- 172.21.15.160:0/3082455162 >> 172.21.15.160:0/3082455162 conn(0x7f390c0fe850 msgr2=0x7f390c100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:26:59.915 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 -- 172.21.15.160:0/3082455162 shutdown_connections 2024-05-20T17:26:59.915 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.912+0000 7f3912f13700 1 -- 172.21.15.160:0/3082455162 wait complete. 2024-05-20T17:26:59.915 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi135 2024-05-20T17:26:59.915 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 8544M 2024-05-20T17:26:59.915 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:26:59.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:59.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:59.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:59.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:26:59 smithi160 ceph-mon[36261]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 Processor -- start 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 -- start start 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c103860 0x7f390c199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c104830 0x7f390c1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10eec0 con 0x7f390c104830 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10ed40 con 0x7f390c102de0 2024-05-20T17:26:59.918 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3912f13700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10f040 con 0x7f390c103860 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3910caf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3910caf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38064/0 (socket says 172.21.15.160:38064) 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3910caf700 1 -- 172.21.15.160:0/598503951 learned_addr learned my addr 172.21.15.160:0/598503951 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f39114b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c104830 0x7f390c1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.913+0000 7f3903fff700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c103860 0x7f390c199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 -- 172.21.15.160:0/598503951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c103860 msgr2=0x7f390c199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c103860 0x7f390c199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 -- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c104830 msgr2=0x7f390c1a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c104830 0x7f390c1a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 -- 172.21.15.160:0/598503951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1a1410 con 0x7f390c102de0 2024-05-20T17:26:59.919 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3910caf700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f390800ada0 tx=0x7f390800c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908017020 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c1a1700 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390800a0d0 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908004280 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.914+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c1a1c40 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.916+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c050170 con 0x7f390c102de0 2024-05-20T17:26:59.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.916+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3908003a20 con 0x7f390c102de0 2024-05-20T17:26:59.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.917+0000 7f3901ffb700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 0x7f38f40a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:26:59.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.917+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f39080cd460 con 0x7f390c102de0 2024-05-20T17:26:59.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.917+0000 7f3903fff700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 0x7f38f40a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:26:59.921 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.918+0000 7f3903fff700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 0x7f38f40a5130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005950 tx=0x7f38fc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:26:59.923 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:26:59.922+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3908021020 con 0x7f390c102de0 2024-05-20T17:26:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi135 2024-05-20T17:26:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 8544M 2024-05-20T17:26:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:26:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:26:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:26:59.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:26:59.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:26:59.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:26:59 smithi135 ceph-mon[32027]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:27:00.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi135 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 8544M 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:26:59 smithi172 ceph-mon[36511]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:27:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:00.126+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f390c02dfd0 con 0x7f38f40a2c20 2024-05-20T17:27:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:00.983 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:00.984 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:00.984 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:01.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:01 smithi135 ceph-mon[32027]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:01 smithi135 ceph-mon[32027]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:01 smithi135 ceph-mon[32027]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:27:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:01 smithi135 ceph-mon[32027]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:27:02.003 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:01 smithi160 ceph-mon[36261]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:02.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:01 smithi160 ceph-mon[36261]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:02.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:01 smithi160 ceph-mon[36261]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:27:02.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:01 smithi160 ceph-mon[36261]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:27:02.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:01 smithi172 ceph-mon[36511]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:01 smithi172 ceph-mon[36511]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:01 smithi172 ceph-mon[36511]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:27:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:01 smithi172 ceph-mon[36511]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:27:02.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:02 smithi135 ceph-mon[32027]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:27:03.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:02 smithi160 ceph-mon[36261]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:27:03.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:02 smithi172 ceph-mon[36511]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/377684217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]': finished 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: osdmap e30: 5 total, 4 up, 5 in 2024-05-20T17:27:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:03.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:03 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/2672892929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/377684217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]': finished 2024-05-20T17:27:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: osdmap e30: 5 total, 4 up, 5 in 2024-05-20T17:27:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:03 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/2672892929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/377684217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]: dispatch 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29001f18-bab2-47ab-b41e-20cdb7f07e02"}]': finished 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: osdmap e30: 5 total, 4 up, 5 in 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:03 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/2672892929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:04 smithi160 ceph-mon[36261]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:27:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:04 smithi160 ceph-mon[36261]: Cluster is now healthy 2024-05-20T17:27:05.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:04 smithi172 ceph-mon[36511]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:27:05.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:04 smithi172 ceph-mon[36511]: Cluster is now healthy 2024-05-20T17:27:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:04 smithi135 ceph-mon[32027]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:27:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:04 smithi135 ceph-mon[32027]: Cluster is now healthy 2024-05-20T17:27:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:05 smithi160 ceph-mon[36261]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:06.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:05 smithi172 ceph-mon[36511]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:05 smithi135 ceph-mon[32027]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:06 smithi160 ceph-mon[36261]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:27:07.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:06 smithi172 ceph-mon[36511]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:27:07.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:06 smithi135 ceph-mon[32027]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:27:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:09 smithi160 ceph-mon[36261]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:27:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:09 smithi172 ceph-mon[36511]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:27:10.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:09 smithi135 ceph-mon[32027]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:27:11.002 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:27:11.002 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:27:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:27:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:11.879 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:11 smithi160 ceph-mon[36261]: Deploying daemon osd.4 on smithi160 2024-05-20T17:27:11.880 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:11 smithi160 ceph-mon[36261]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-20T17:27:12.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:11 smithi172 ceph-mon[36511]: Deploying daemon osd.4 on smithi160 2024-05-20T17:27:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:11 smithi172 ceph-mon[36511]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-20T17:27:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:11 smithi135 ceph-mon[32027]: Deploying daemon osd.4 on smithi160 2024-05-20T17:27:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:11 smithi135 ceph-mon[32027]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-20T17:27:13.914 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:13 smithi160 ceph-mon[36261]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:27:14.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:13 smithi172 ceph-mon[36511]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:27:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:13 smithi135 ceph-mon[32027]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:27:16.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:15 smithi160 ceph-mon[36261]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-20T17:27:16.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:15 smithi172 ceph-mon[36511]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-20T17:27:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:15 smithi135 ceph-mon[32027]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-20T17:27:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:16 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:16 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:16 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:16 smithi135 ceph-mon[32027]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:16 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:16 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:16 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:16 smithi160 ceph-mon[36261]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:17.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:16 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:16 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:17.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:16 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:17.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:16 smithi172 ceph-mon[36511]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:19.545 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 4 on host 'smithi160' 2024-05-20T17:27:19.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.543+0000 7f3901ffb700 1 -- 172.21.15.160:0/598503951 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f390c02dfd0 con 0x7f38f40a2c20 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 msgr2=0x7f38f40a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 0x7f38f40a5130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005950 tx=0x7f38fc00a300 comp rx=0 tx=0).stop 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 msgr2=0x7f390c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f390800ada0 tx=0x7f390800c330 comp rx=0 tx=0).stop 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 shutdown_connections 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390c102de0 0x7f390c1998b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f38f40a2c20 0x7f38f40a5130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f390c104830 0x7f390c1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:19.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 --2- 172.21.15.160:0/598503951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f390c103860 0x7f390c199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:19.550 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 >> 172.21.15.160:0/598503951 conn(0x7f390c0fe850 msgr2=0x7f390c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:27:19.550 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 shutdown_connections 2024-05-20T17:27:19.550 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:27:19.547+0000 7f3912f13700 1 -- 172.21.15.160:0/598503951 wait complete. 2024-05-20T17:27:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:19 smithi160 ceph-mon[36261]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:19 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:19 smithi172 ceph-mon[36511]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:19 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:19 smithi135 ceph-mon[32027]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:19 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:20.250 DEBUG:teuthology.orchestra.run.smithi160:osd.4> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.4.service 2024-05-20T17:27:20.252 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-05-20T17:27:20.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:27:20.499 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:27:20.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:20 smithi172 ceph-mon[36511]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:20.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:20 smithi172 ceph-mon[36511]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:20 smithi160 ceph-mon[36261]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:20 smithi160 ceph-mon[36261]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:20 smithi135 ceph-mon[32027]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:20 smithi135 ceph-mon[32027]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:27:21.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:21.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:27:21.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:21.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:27:21.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:21.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:21 smithi172 ceph-mon[36511]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:21 smithi160 ceph-mon[36261]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:27:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: from='osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:22.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:27:22.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:21 smithi135 ceph-mon[32027]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:27:22.408 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:27:22.409 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:27:22.409 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-20T17:27:22.409 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-20T17:27:22.409 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116212 s, 902 MB/s 2024-05-20T17:27:22.409 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-20T17:27:22.507 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:27:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:27:22.161+0000 7f0c8e496700 -1 osd.4 0 waiting for initial osdmap 2024-05-20T17:27:22.507 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:27:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:27:22.167+0000 7f0c86243700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:27:22.855 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:27:22.855 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:27:22.855 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.855 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.856 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: from='osd.4 ' entity='osd.4' 2024-05-20T17:27:22.856 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:22.856 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: from='osd.4 ' entity='osd.4' 2024-05-20T17:27:22.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:22.999 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:23.026 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-05-20T17:27:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:27:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:27:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: from='osd.4 ' entity='osd.4' 2024-05-20T17:27:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-20T17:27:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:23.265 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:27:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:27:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:27:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] boot 2024-05-20T17:27:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: osdmap e33: 5 total, 5 up, 5 in 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi160 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] boot 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: osdmap e33: 5 total, 5 up, 5 in 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi160 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:27:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:27:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: osd.4 [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] boot 2024-05-20T17:27:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: osdmap e33: 5 total, 5 up, 5 in 2024-05-20T17:27:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi160 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 -- 172.21.15.172:0/825810253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9101020c0 msgr2=0x7ff9101024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 --2- 172.21.15.172:0/825810253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9101020c0 0x7ff9101024d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009990 tx=0x7ff90c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 -- 172.21.15.172:0/825810253 shutdown_connections 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 --2- 172.21.15.172:0/825810253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff910103b90 0x7ff91010a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 --2- 172.21.15.172:0/825810253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9101020c0 0x7ff9101024d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 --2- 172.21.15.172:0/825810253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff910103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 -- 172.21.15.172:0/825810253 >> 172.21.15.172:0/825810253 conn(0x7ff9100fd700 msgr2=0x7ff9100ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 -- 172.21.15.172:0/825810253 shutdown_connections 2024-05-20T17:27:24.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.871+0000 7ff917478700 1 -- 172.21.15.172:0/825810253 wait complete. 2024-05-20T17:27:24.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 Processor -- start 2024-05-20T17:27:24.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 -- start start 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 0x7ff91006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff91019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff91010dc60 con 0x7ff9101020c0 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff91010dae0 con 0x7ff9101031f0 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.872+0000 7ff917478700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff91010dde0 con 0x7ff910103b90 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45362/0 (socket says 172.21.15.172:45362) 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 -- 172.21.15.172:0/1672495194 learned_addr learned my addr 172.21.15.172:0/1672495194 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff914a13700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff91019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915214700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 0x7ff91006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 -- 172.21.15.172:0/1672495194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 msgr2=0x7ff91019e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff91019e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 -- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 msgr2=0x7ff91006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 0x7ff91006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 -- 172.21.15.172:0/1672495194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9101a13d0 con 0x7ff910103b90 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff914a13700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff91019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915214700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 0x7ff91006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff915a15700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff908007ee0 tx=0x7ff90800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90800ddd0 con 0x7ff910103b90 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff910198460 con 0x7ff910103b90 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff908004020 con 0x7ff910103b90 2024-05-20T17:27:24.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908015660 con 0x7ff910103b90 2024-05-20T17:27:24.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.873+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9101989a0 con 0x7ff910103b90 2024-05-20T17:27:24.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.874+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff910050170 con 0x7ff910103b90 2024-05-20T17:27:24.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.875+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff9080041d0 con 0x7ff910103b90 2024-05-20T17:27:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.876+0000 7ff9067fc700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 0x7ff8fc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.876+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7ff9080ce2a0 con 0x7ff910103b90 2024-05-20T17:27:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.876+0000 7ff915214700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 0x7ff8fc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.877+0000 7ff915214700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 0x7ff8fc0a5130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0039c0 tx=0x7ff90c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:27:24.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:24.880+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff908010070 con 0x7ff910103b90 2024-05-20T17:27:25.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:24 smithi160 ceph-mon[36261]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:25.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:24 smithi172 ceph-mon[36511]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:25.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:25.083+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff910062a80 con 0x7ff8fc0a2c20 2024-05-20T17:27:25.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:24 smithi135 ceph-mon[32027]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:25 smithi160 ceph-mon[36261]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:27:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:25 smithi160 ceph-mon[36261]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:26.036 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:25 smithi172 ceph-mon[36511]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:27:26.036 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:25 smithi172 ceph-mon[36511]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:26.036 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:26.036 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:26.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:25 smithi135 ceph-mon[32027]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:27:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:25 smithi135 ceph-mon[32027]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:26.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:26 smithi172 ceph-mon[36511]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:27.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:26 smithi160 ceph-mon[36261]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:27.105 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:26 smithi135 ceph-mon[32027]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:27 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/2435012640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:27 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:27 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]': finished 2024-05-20T17:27:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:27 smithi160 ceph-mon[36261]: osdmap e35: 6 total, 5 up, 6 in 2024-05-20T17:27:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:27 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:28.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:27 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/2435012640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:27 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:27 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]': finished 2024-05-20T17:27:28.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:27 smithi172 ceph-mon[36511]: osdmap e35: 6 total, 5 up, 6 in 2024-05-20T17:27:28.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:27 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:27 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/2435012640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:27 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]: dispatch 2024-05-20T17:27:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:27 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc6409a5-0a57-4e8a-8022-5a724f80b78a"}]': finished 2024-05-20T17:27:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:27 smithi135 ceph-mon[32027]: osdmap e35: 6 total, 5 up, 6 in 2024-05-20T17:27:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:27 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:29.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:28 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/1794939636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:29.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:28 smithi160 ceph-mon[36261]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:29.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:28 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/1794939636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:28 smithi172 ceph-mon[36511]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:29.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:28 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/1794939636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:29.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:28 smithi135 ceph-mon[32027]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:31.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:31 smithi172 ceph-mon[36511]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:31 smithi160 ceph-mon[36261]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:32.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:31 smithi135 ceph-mon[32027]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:33.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:33 smithi172 ceph-mon[36511]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:33 smithi160 ceph-mon[36261]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:33 smithi135 ceph-mon[32027]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:35.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:35 smithi172 ceph-mon[36511]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:35.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:27:35.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:36.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:35 smithi160 ceph-mon[36261]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:36.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:27:36.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:36.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:35 smithi135 ceph-mon[32027]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:36.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:27:36.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:36.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:36 smithi172 ceph-mon[36511]: Deploying daemon osd.5 on smithi172 2024-05-20T17:27:37.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:36 smithi160 ceph-mon[36261]: Deploying daemon osd.5 on smithi172 2024-05-20T17:27:37.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:36 smithi135 ceph-mon[32027]: Deploying daemon osd.5 on smithi172 2024-05-20T17:27:37.991 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:37 smithi172 ceph-mon[36511]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:37 smithi160 ceph-mon[36261]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:38.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:37 smithi135 ceph-mon[32027]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:39.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:38 smithi172 ceph-mon[36511]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:38 smithi135 ceph-mon[32027]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:38 smithi160 ceph-mon[36261]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:41 smithi135 ceph-mon[32027]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:42.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:42.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:42.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:41 smithi172 ceph-mon[36511]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:42.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:41 smithi160 ceph-mon[36261]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:44.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:44.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:44.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:44.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:44.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:44.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.502+0000 7ff9067fc700 1 -- 172.21.15.172:0/1672495194 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff910062a80 con 0x7ff8fc0a2c20 2024-05-20T17:27:44.505 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-05-20T17:27:44.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 msgr2=0x7ff8fc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 0x7ff8fc0a5130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0039c0 tx=0x7ff90c005fb0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 msgr2=0x7ff9101a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff908007ee0 tx=0x7ff90800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 shutdown_connections 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff8fc0a2c20 0x7ff8fc0a5130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff910103b90 0x7ff9101a0ba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9101020c0 0x7ff91006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 --2- 172.21.15.172:0/1672495194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9101031f0 0x7ff91019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.505+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 >> 172.21.15.172:0/1672495194 conn(0x7ff9100fd700 msgr2=0x7ff910106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.506+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 shutdown_connections 2024-05-20T17:27:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:27:44.506+0000 7ff917478700 1 -- 172.21.15.172:0/1672495194 wait complete. 2024-05-20T17:27:45.088 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.5.service 2024-05-20T17:27:45.090 INFO:tasks.cephadm:Deploying osd.6 on smithi135 with /dev/vg_nvme/lv_2... 2024-05-20T17:27:45.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:27:45.338 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:45 smithi135 ceph-mon[32027]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:45 smithi160 ceph-mon[36261]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:45.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:27:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:27:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:45 smithi172 ceph-mon[36511]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:46.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:46 smithi172 ceph-mon[36511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:27:46.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:46 smithi172 ceph-mon[36511]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:27:46.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:46 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:46.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:46 smithi172 ceph-mon[36511]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:46.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:46 smithi172 ceph-mon[36511]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:46.535 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:27:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:27:46.468+0000 7f14ef658700 -1 osd.5 0 waiting for initial osdmap 2024-05-20T17:27:46.535 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:27:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:27:46.478+0000 7f14eb40d700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:27:46.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:46 smithi160 ceph-mon[36261]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:27:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:46 smithi160 ceph-mon[36261]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:27:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:46 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:46 smithi160 ceph-mon[36261]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:46 smithi160 ceph-mon[36261]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:46.829 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:46 smithi135 ceph-mon[32027]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:27:46.829 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:46 smithi135 ceph-mon[32027]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:27:46.829 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:46 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:46.830 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:46 smithi135 ceph-mon[32027]: from='osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:46.830 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:46 smithi135 ceph-mon[32027]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:27:47.434 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:27:47.435 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:27:47.435 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-20T17:27:47.435 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-20T17:27:47.435 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114195 s, 918 MB/s 2024-05-20T17:27:47.435 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] boot 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: osdmap e38: 6 total, 6 up, 6 in 2024-05-20T17:27:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:47 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:27:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:27:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] boot 2024-05-20T17:27:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: osdmap e38: 6 total, 6 up, 6 in 2024-05-20T17:27:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:47 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.832 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: osd.5 [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] boot 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: osdmap e38: 6 total, 6 up, 6 in 2024-05-20T17:27:47.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:47 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:27:48.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-05-20T17:27:48.434 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:27:48.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:27:48.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:27:48.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:48.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:48 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.787 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:27:48.787 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:27:48.787 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:48.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:48 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:27:48.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:48 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:27:49.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:49 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi172 2024-05-20T17:27:49.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:49 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-20T17:27:49.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:49 smithi135 ceph-mon[32027]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:49.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:49 smithi135 ceph-mon[32027]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:27:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:49 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi172 2024-05-20T17:27:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:49 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-20T17:27:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:49 smithi160 ceph-mon[36261]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:49 smithi160 ceph-mon[36261]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:27:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:49 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi172 2024-05-20T17:27:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:49 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-20T17:27:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:49 smithi172 ceph-mon[36511]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:49 smithi172 ceph-mon[36511]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 -- 172.21.15.135:0/4239587165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610103b90 msgr2=0x7fe61010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 --2- 172.21.15.135:0/4239587165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610103b90 0x7fe61010a440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe60800b0a0 tx=0x7fe60800b3b0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 -- 172.21.15.135:0/4239587165 shutdown_connections 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 --2- 172.21.15.135:0/4239587165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe610103b90 0x7fe61010a440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 --2- 172.21.15.135:0/4239587165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6101020c0 0x7fe6101024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 --2- 172.21.15.135:0/4239587165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.073+0000 7fe616256700 1 -- 172.21.15.135:0/4239587165 >> 172.21.15.135:0/4239587165 conn(0x7fe6100fd700 msgr2=0x7fe6100ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:27:50.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.074+0000 7fe616256700 1 -- 172.21.15.135:0/4239587165 shutdown_connections 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.074+0000 7fe616256700 1 -- 172.21.15.135:0/4239587165 wait complete. 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.074+0000 7fe616256700 1 Processor -- start 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.074+0000 7fe616256700 1 -- start start 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610103b90 0x7fe61019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe61010dc90 con 0x7fe6101020c0 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe61010db10 con 0x7fe6101031f0 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe616256700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe61010de10 con 0x7fe610103b90 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:50.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35704/0 (socket says 172.21.15.135:35704) 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 -- 172.21.15.135:0/1538647620 learned_addr learned my addr 172.21.15.135:0/1538647620 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60ffff700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610103b90 0x7fe61019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe606ffd700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 -- 172.21.15.135:0/1538647620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610103b90 msgr2=0x7fe61019fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610103b90 0x7fe61019fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 -- 172.21.15.135:0/1538647620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 msgr2=0x7fe610198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 -- 172.21.15.135:0/1538647620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6101a01c0 con 0x7fe6101020c0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe606ffd700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60f7fe700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe600007b50 tx=0x7fe600007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.075+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e500 con 0x7fe6101020c0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.076+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61006a4f0 con 0x7fe6101020c0 2024-05-20T17:27:50.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.076+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe60000eb80 con 0x7fe6101020c0 2024-05-20T17:27:50.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.076+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60000ac20 con 0x7fe6101020c0 2024-05-20T17:27:50.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.076+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61006aa80 con 0x7fe6101020c0 2024-05-20T17:27:50.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.076+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe610050170 con 0x7fe6101020c0 2024-05-20T17:27:50.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.078+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe60000e6a0 con 0x7fe6101020c0 2024-05-20T17:27:50.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.078+0000 7fe60d7fa700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 0x7fe5fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:27:50.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.079+0000 7fe606ffd700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 0x7fe5fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:27:50.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.079+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4533+0+0 (secure 0 0 0) 0x7fe6000cfac0 con 0x7fe6101020c0 2024-05-20T17:27:50.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.079+0000 7fe606ffd700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 0x7fe5fc0a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8005950 tx=0x7fe5f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:27:50.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.082+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe60009d8e0 con 0x7fe6101020c0 2024-05-20T17:27:50.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:27:50.287+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe61006ada0 con 0x7fe5fc0a2ca0 2024-05-20T17:27:51.180 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:27:51.181 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:51.181 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:51.181 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:51.181 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:51.181 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:50 smithi135 ceph-mon[32027]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:27:51.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:27:51.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:51.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:51.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:51.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:51.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:50 smithi160 ceph-mon[36261]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:27:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:50 smithi172 ceph-mon[36511]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:27:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:51 smithi135 ceph-mon[32027]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:27:52.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:51 smithi160 ceph-mon[36261]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:27:52.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:51 smithi172 ceph-mon[36511]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:27:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:52 smithi160 ceph-mon[36261]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:27:53.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:52 smithi172 ceph-mon[36511]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:27:53.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:52 smithi135 ceph-mon[32027]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:27:54.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:53 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]: dispatch 2024-05-20T17:27:54.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:53 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]': finished 2024-05-20T17:27:54.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:53 smithi160 ceph-mon[36261]: osdmap e43: 7 total, 6 up, 7 in 2024-05-20T17:27:54.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:27:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:53 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3005950491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:54.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:53 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]: dispatch 2024-05-20T17:27:54.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:53 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]': finished 2024-05-20T17:27:54.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:53 smithi172 ceph-mon[36511]: osdmap e43: 7 total, 6 up, 7 in 2024-05-20T17:27:54.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:27:54.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:53 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3005950491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:54.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:53 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]: dispatch 2024-05-20T17:27:54.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:53 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/758040137' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5a64e7c-1cd9-4642-89a7-1912095262e5"}]': finished 2024-05-20T17:27:54.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:53 smithi135 ceph-mon[32027]: osdmap e43: 7 total, 6 up, 7 in 2024-05-20T17:27:54.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:27:54.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:53 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3005950491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:27:55.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:55 smithi160 ceph-mon[36261]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:55.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:55 smithi172 ceph-mon[36511]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:55.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:55 smithi135 ceph-mon[32027]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:27:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:57 smithi160 ceph-mon[36261]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:58.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:57 smithi172 ceph-mon[36511]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:57 smithi135 ceph-mon[32027]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:27:59.978 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:27:59 smithi135 ceph-mon[32027]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:27:59 smithi160 ceph-mon[36261]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:27:59 smithi172 ceph-mon[36511]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:01.906 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:01 smithi135 ceph-mon[32027]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:01.906 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:28:01.906 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:01 smithi160 ceph-mon[36261]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:28:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:02.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:01 smithi172 ceph-mon[36511]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:28:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:02.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:02 smithi135 ceph-mon[32027]: Deploying daemon osd.6 on smithi135 2024-05-20T17:28:03.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:02 smithi160 ceph-mon[36261]: Deploying daemon osd.6 on smithi135 2024-05-20T17:28:03.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:02 smithi172 ceph-mon[36511]: Deploying daemon osd.6 on smithi135 2024-05-20T17:28:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:03 smithi160 ceph-mon[36261]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:04.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:03 smithi172 ceph-mon[36511]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:04.106 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:03 smithi135 ceph-mon[32027]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:05 smithi135 ceph-mon[32027]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:05 smithi160 ceph-mon[36261]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:06.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:05 smithi172 ceph-mon[36511]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:07 smithi135 ceph-mon[32027]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:07 smithi160 ceph-mon[36261]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:07 smithi172 ceph-mon[36511]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:08.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:08 smithi135 ceph-mon[32027]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:08 smithi160 ceph-mon[36261]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:09.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:08 smithi172 ceph-mon[36511]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:11.055 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 6 on host 'smithi135' 2024-05-20T17:28:11.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.053+0000 7fe60d7fa700 1 -- 172.21.15.135:0/1538647620 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe61006ada0 con 0x7fe5fc0a2ca0 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 msgr2=0x7fe5fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 0x7fe5fc0a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8005950 tx=0x7fe5f80058e0 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 msgr2=0x7fe6101986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe600007b50 tx=0x7fe600007e60 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 shutdown_connections 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe5fc0a2ca0 0x7fe5fc0a51b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610103b90 0x7fe61019fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6101020c0 0x7fe6101986f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 --2- 172.21.15.135:0/1538647620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6101031f0 0x7fe610198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:11.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 >> 172.21.15.135:0/1538647620 conn(0x7fe6100fd700 msgr2=0x7fe610106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:28:11.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 shutdown_connections 2024-05-20T17:28:11.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:28:11.055+0000 7fe616256700 1 -- 172.21.15.135:0/1538647620 wait complete. 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:11.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:11.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:11.790 DEBUG:teuthology.orchestra.run.smithi135:osd.6> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.6.service 2024-05-20T17:28:11.792 INFO:tasks.cephadm:Deploying osd.7 on smithi160 with /dev/vg_nvme/lv_2... 2024-05-20T17:28:11.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:28:12.038 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:28:12.405 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:12 smithi160 ceph-mon[36261]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:28:12.405 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:12 smithi160 ceph-mon[36261]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:28:12.405 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:12 smithi160 ceph-mon[36261]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:28:12.406 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:12.442 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:12 smithi135 ceph-mon[32027]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:28:12.443 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:12 smithi135 ceph-mon[32027]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:28:12.443 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:12 smithi135 ceph-mon[32027]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:28:12.443 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:12.443 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:28:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:28:12.144+0000 7f4c70790700 -1 osd.6 0 waiting for initial osdmap 2024-05-20T17:28:12.443 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:28:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:28:12.153+0000 7f4c6c545700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:28:12.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:12 smithi172 ceph-mon[36511]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:28:12.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:12 smithi172 ceph-mon[36511]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:28:12.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:12 smithi172 ceph-mon[36511]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:28:12.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.409 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:13 smithi160 ceph-mon[36261]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:28:13.409 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:13 smithi160 ceph-mon[36261]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:28:13.409 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.409 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:13 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.409 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:13 smithi160 ceph-mon[36261]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:13 smithi135 ceph-mon[32027]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:28:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:13 smithi135 ceph-mon[32027]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:28:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:13 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:13 smithi135 ceph-mon[32027]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:13.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:13 smithi172 ceph-mon[36511]: from='osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:28:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:13 smithi172 ceph-mon[36511]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:28:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:13 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:13 smithi172 ceph-mon[36511]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] boot 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: osdmap e46: 7 total, 7 up, 7 in 2024-05-20T17:28:14.285 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:14.329 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:28:14.329 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:28:14.330 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-20T17:28:14.330 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-20T17:28:14.330 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014944 s, 702 MB/s 2024-05-20T17:28:14.330 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-20T17:28:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:28:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:28:14.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:14.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] boot 2024-05-20T17:28:14.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: osdmap e46: 7 total, 7 up, 7 in 2024-05-20T17:28:14.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:14.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:28:14.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:28:14.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:14.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: osd.6 [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] boot 2024-05-20T17:28:14.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: osdmap e46: 7 total, 7 up, 7 in 2024-05-20T17:28:14.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:28:15.069 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-05-20T17:28:15.318 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:15.441 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:15 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:15.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:15.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:15 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:15.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:15 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:16.339 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:16 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi135 2024-05-20T17:28:16.340 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:16 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 5696M 2024-05-20T17:28:16.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:16 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi135 2024-05-20T17:28:16.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:16 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 5696M 2024-05-20T17:28:16.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:16 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi135 2024-05-20T17:28:16.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:16 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 5696M 2024-05-20T17:28:16.867 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 -- 172.21.15.160:0/1213238642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 msgr2=0x7f5198108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 --2- 172.21.15.160:0/1213238642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198108a50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5188009990 tx=0x7f5188009ca0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 -- 172.21.15.160:0/1213238642 shutdown_connections 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 --2- 172.21.15.160:0/1213238642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198108f90 0x7f519810b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 --2- 172.21.15.160:0/1213238642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198103cd0 0x7f51981060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 --2- 172.21.15.160:0/1213238642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198108a50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 -- 172.21.15.160:0/1213238642 >> 172.21.15.160:0/1213238642 conn(0x7f51980fd710 msgr2=0x7f51980ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 -- 172.21.15.160:0/1213238642 shutdown_connections 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.864+0000 7f519f291700 1 -- 172.21.15.160:0/1213238642 wait complete. 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 Processor -- start 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 -- start start 2024-05-20T17:28:16.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198108f90 0x7f51981a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f519810ed90 con 0x7f5198108f90 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f519810ec10 con 0x7f5198106630 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519f291700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f519810ef10 con 0x7f5198103cd0 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519d02d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519c82c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519d02d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.160:38110/0 (socket says 172.21.15.160:38110) 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519d02d700 1 -- 172.21.15.160:0/927329296 learned_addr learned my addr 172.21.15.160:0/927329296 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519d82e700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198108f90 0x7f51981a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519c82c700 1 -- 172.21.15.160:0/927329296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 msgr2=0x7f51981997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:16.869 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519c82c700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519c82c700 1 -- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198108f90 msgr2=0x7f51981a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.865+0000 7f519c82c700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198108f90 0x7f51981a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f519c82c700 1 -- 172.21.15.160:0/927329296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51981a1350 con 0x7f5198106630 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f519d02d700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f519c82c700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198199d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5188006010 tx=0x7f51880047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188027070 con 0x7f5198106630 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5188004150 con 0x7f5198106630 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51981a15e0 con 0x7f5198106630 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188022e20 con 0x7f5198106630 2024-05-20T17:28:16.870 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.866+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51981a1a30 con 0x7f5198106630 2024-05-20T17:28:16.871 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.867+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5198050170 con 0x7f5198106630 2024-05-20T17:28:16.871 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.868+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f518802a070 con 0x7f5198106630 2024-05-20T17:28:16.871 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.869+0000 7f518e7fc700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 0x7f51840a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:16.871 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.869+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f51880cf5d0 con 0x7f5198106630 2024-05-20T17:28:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.869+0000 7f519d02d700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 0x7f51840a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.870+0000 7f519d02d700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 0x7f51840a5130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51940104e0 tx=0x7f519400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:28:16.875 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:16.873+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5188031020 con 0x7f5198106630 2024-05-20T17:28:17.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:17.074+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5198062a80 con 0x7f51840a2c20 2024-05-20T17:28:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:17 smithi135 ceph-mon[32027]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:17 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:17 smithi160 ceph-mon[36261]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:17 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:17.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:17 smithi172 ceph-mon[36511]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:17 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:18.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:18 smithi160 ceph-mon[36261]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:18.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:18 smithi135 ceph-mon[32027]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:18.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:18 smithi172 ceph-mon[36511]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:19.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:19 smithi160 ceph-mon[36261]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:19 smithi135 ceph-mon[32027]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:19.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:19 smithi172 ceph-mon[36511]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/2985385310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:20 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:20 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]': finished 2024-05-20T17:28:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:20 smithi135 ceph-mon[32027]: osdmap e48: 8 total, 7 up, 8 in 2024-05-20T17:28:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:20 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:20.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:20 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/2985385310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:20 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:20 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]': finished 2024-05-20T17:28:20.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:20 smithi160 ceph-mon[36261]: osdmap e48: 8 total, 7 up, 8 in 2024-05-20T17:28:20.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:20 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:20.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:20 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/2985385310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:20 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]: dispatch 2024-05-20T17:28:20.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:20 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab9e3e44-dbb7-4321-9527-b5973b470ca7"}]': finished 2024-05-20T17:28:20.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:20 smithi172 ceph-mon[36511]: osdmap e48: 8 total, 7 up, 8 in 2024-05-20T17:28:20.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:20 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:21 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/107079232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:21 smithi135 ceph-mon[32027]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:21 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/107079232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:21 smithi160 ceph-mon[36261]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:21.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:21 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/107079232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:21.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:21 smithi172 ceph-mon[36511]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:23.969 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:23 smithi160 ceph-mon[36261]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:24.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:23 smithi172 ceph-mon[36511]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:24.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:23 smithi135 ceph-mon[32027]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:25.991 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:25 smithi160 ceph-mon[36261]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:26.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:25 smithi172 ceph-mon[36511]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:26.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:25 smithi135 ceph-mon[32027]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:28.005 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:27 smithi135 ceph-mon[32027]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:28.006 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:27 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:28:28.006 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:27 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:27 smithi160 ceph-mon[36261]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:27 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:28:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:27 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:27 smithi172 ceph-mon[36511]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:27 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:28:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:27 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:29.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:28 smithi160 ceph-mon[36261]: Deploying daemon osd.7 on smithi160 2024-05-20T17:28:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:28 smithi172 ceph-mon[36511]: Deploying daemon osd.7 on smithi160 2024-05-20T17:28:29.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:28 smithi135 ceph-mon[32027]: Deploying daemon osd.7 on smithi160 2024-05-20T17:28:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:29 smithi160 ceph-mon[36261]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:30.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:29 smithi172 ceph-mon[36511]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:30.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:29 smithi135 ceph-mon[32027]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:31.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:30 smithi160 ceph-mon[36261]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:31.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:30 smithi172 ceph-mon[36511]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:31.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:30 smithi135 ceph-mon[32027]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:33.850 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:33 smithi160 ceph-mon[36261]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:33.850 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:33.850 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:33.850 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:34.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:33 smithi172 ceph-mon[36511]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:34.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:34.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:34.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:33 smithi135 ceph-mon[32027]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:35.957 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:35 smithi160 ceph-mon[36261]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:36.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:35 smithi172 ceph-mon[36511]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:36.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:35 smithi135 ceph-mon[32027]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:36.691 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.690+0000 7f518e7fc700 1 -- 172.21.15.160:0/927329296 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5198062a80 con 0x7f51840a2c20 2024-05-20T17:28:36.692 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 7 on host 'smithi160' 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 msgr2=0x7f51840a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 0x7f51840a5130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51940104e0 tx=0x7f519400b480 comp rx=0 tx=0).stop 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 msgr2=0x7f5198199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198199d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5188006010 tx=0x7f51880047b0 comp rx=0 tx=0).stop 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 shutdown_connections 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f51840a2c20 0x7f51840a5130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:36.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5198108f90 0x7f51981a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:36.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5198103cd0 0x7f51981997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:36.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 --2- 172.21.15.160:0/927329296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5198106630 0x7f5198199d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:36.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 >> 172.21.15.160:0/927329296 conn(0x7f51980fd710 msgr2=0x7f5198104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:28:36.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 shutdown_connections 2024-05-20T17:28:36.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:28:36.692+0000 7f519f291700 1 -- 172.21.15.160:0/927329296 wait complete. 2024-05-20T17:28:37.333 DEBUG:teuthology.orchestra.run.smithi160:osd.7> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.7.service 2024-05-20T17:28:37.336 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-05-20T17:28:37.336 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:28:37.582 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:28:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:37.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:37.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:37.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:28:38.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:38.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:39.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:38 smithi160 ceph-mon[36261]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:28:39.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:38 smithi160 ceph-mon[36261]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:38 smithi160 ceph-mon[36261]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:28:39.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:38 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:39.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:38 smithi160 ceph-mon[36261]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:28:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:28:38.742+0000 7ff2c5607700 -1 osd.7 0 waiting for initial osdmap 2024-05-20T17:28:39.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:28:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:28:38.751+0000 7ff2c13bc700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:28:39.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:38 smithi172 ceph-mon[36511]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:28:39.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:38 smithi172 ceph-mon[36511]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:38 smithi172 ceph-mon[36511]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:28:39.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:38 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:39.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:38 smithi172 ceph-mon[36511]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:38 smithi135 ceph-mon[32027]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:28:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:38 smithi135 ceph-mon[32027]: from='osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:38 smithi135 ceph-mon[32027]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:28:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:38 smithi135 ceph-mon[32027]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145482 s, 721 MB/s 2024-05-20T17:28:39.632 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-20T17:28:39.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:39 smithi172 ceph-mon[36511]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:39.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:39 smithi172 ceph-mon[36511]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:28:39.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:39 smithi172 ceph-mon[36511]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:28:39.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:39.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:39 smithi160 ceph-mon[36261]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:39 smithi160 ceph-mon[36261]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:28:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:39 smithi160 ceph-mon[36261]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:28:40.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:39 smithi135 ceph-mon[32027]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:40.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:39 smithi135 ceph-mon[32027]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:28:40.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:39 smithi135 ceph-mon[32027]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:28:40.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-05-20T17:28:40.490 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] boot 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: osdmap e51: 8 total, 8 up, 8 in 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:40 smithi172 ceph-mon[36511]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] boot 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: osdmap e51: 8 total, 8 up, 8 in 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:40.896 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:40 smithi160 ceph-mon[36261]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: osd.7 [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] boot 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: osdmap e51: 8 total, 8 up, 8 in 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:28:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:40 smithi135 ceph-mon[32027]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi160 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-20T17:28:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:41.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:41 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 -- 172.21.15.172:0/623681458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381031f0 msgr2=0x7f8d38103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:42.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/623681458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381031f0 0x7f8d38103600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009990 tx=0x7f8d20009ca0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 -- 172.21.15.172:0/623681458 shutdown_connections 2024-05-20T17:28:42.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/623681458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381020c0 0x7f8d381024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/623681458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 0x7f8d3810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/623681458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381031f0 0x7f8d38103600 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 -- 172.21.15.172:0/623681458 >> 172.21.15.172:0/623681458 conn(0x7f8d380fd700 msgr2=0x7f8d380ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 -- 172.21.15.172:0/623681458 shutdown_connections 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.099+0000 7f8d3d83c700 1 -- 172.21.15.172:0/623681458 wait complete. 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 Processor -- start 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 -- start start 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381031f0 0x7f8d38198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 0x7f8d3819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:42.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3810dcf0 con 0x7f8d38103b90 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3810db70 con 0x7f8d381031f0 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d3d83c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3810de70 con 0x7f8d381020c0 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43422/0 (socket says 172.21.15.172:43422) 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 -- 172.21.15.172:0/2029613702 learned_addr learned my addr 172.21.15.172:0/2029613702 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d2ffff700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381031f0 0x7f8d38198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 -- 172.21.15.172:0/2029613702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381031f0 msgr2=0x7f8d38198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d377fe700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 0x7f8d3819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381031f0 0x7f8d38198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 -- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 msgr2=0x7f8d3819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 0x7f8d3819fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:28:42.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 -- 172.21.15.172:0/2029613702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d381a0310 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.100+0000 7f8d36ffd700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800d950 tx=0x7f8d2800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.101+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28017070 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.101+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d28009e10 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.101+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800f3c0 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.101+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d381a0600 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.101+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d381a0b40 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.102+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38050170 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.103+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8d2801a070 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.104+0000 7f8d3c83a700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 0x7f8d240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.104+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f8d280cdd10 con 0x7f8d381020c0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.104+0000 7f8d2ffff700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 0x7f8d240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:28:42.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.105+0000 7f8d2ffff700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 0x7f8d240a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d38199860 tx=0x7f8d2001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:28:42.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.108+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8d2809b830 con 0x7f8d381020c0 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi160 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:42.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:41 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:28:42.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi160 2024-05-20T17:28:42.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:28:42.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:41 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:42.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:28:42.313+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8d38062a80 con 0x7f8d240a2ca0 2024-05-20T17:28:43.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:28:43.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:43.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:43.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:43.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:43.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:42 smithi172 ceph-mon[36511]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:42 smithi135 ceph-mon[32027]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:28:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:28:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:28:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:28:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:43.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:42 smithi160 ceph-mon[36261]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:44.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:43 smithi172 ceph-mon[36511]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:28:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:43 smithi135 ceph-mon[32027]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:28:44.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:43 smithi160 ceph-mon[36261]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:28:45.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:44 smithi172 ceph-mon[36511]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:28:45.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:44 smithi172 ceph-mon[36511]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:44 smithi135 ceph-mon[32027]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:28:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:44 smithi135 ceph-mon[32027]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:44 smithi160 ceph-mon[36261]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:28:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:44 smithi160 ceph-mon[36261]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/1996403673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]': finished 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: osdmap e56: 9 total, 8 up, 9 in 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:28:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/1551874462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/1996403673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]': finished 2024-05-20T17:28:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: osdmap e56: 9 total, 8 up, 9 in 2024-05-20T17:28:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:28:46.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/1551874462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/1996403673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]: dispatch 2024-05-20T17:28:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3346f2-6419-4db2-95e0-78374b3cf793"}]': finished 2024-05-20T17:28:46.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: osdmap e56: 9 total, 8 up, 9 in 2024-05-20T17:28:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:28:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/1551874462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:28:47.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:46 smithi172 ceph-mon[36511]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:47.157 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:46 smithi160 ceph-mon[36261]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:46 smithi135 ceph-mon[32027]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:49 smithi160 ceph-mon[36261]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:50.056 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:49 smithi172 ceph-mon[36511]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:50.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:49 smithi135 ceph-mon[32027]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:51 smithi160 ceph-mon[36261]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:52.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:51 smithi172 ceph-mon[36511]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:51 smithi135 ceph-mon[32027]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:53.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:52 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:28:53.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:52 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:53.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:52 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:28:53.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:52 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:53.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:52 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:28:53.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:52 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:28:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:53 smithi160 ceph-mon[36261]: Deploying daemon osd.8 on smithi172 2024-05-20T17:28:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:53 smithi160 ceph-mon[36261]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:53 smithi172 ceph-mon[36511]: Deploying daemon osd.8 on smithi172 2024-05-20T17:28:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:53 smithi172 ceph-mon[36511]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:53 smithi135 ceph-mon[32027]: Deploying daemon osd.8 on smithi172 2024-05-20T17:28:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:53 smithi135 ceph-mon[32027]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:55.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:54 smithi160 ceph-mon[36261]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:54 smithi172 ceph-mon[36511]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:55.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:54 smithi135 ceph-mon[32027]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:57 smithi160 ceph-mon[36261]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:58.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:57 smithi172 ceph-mon[36511]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:57 smithi135 ceph-mon[32027]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:58 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:28:58 smithi135 ceph-mon[32027]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:58 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:28:58 smithi160 ceph-mon[36261]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:28:59.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:28:59.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:58 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:28:59.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:28:58 smithi172 ceph-mon[36511]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.730+0000 7f8d3c83a700 1 -- 172.21.15.172:0/2029613702 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8d38062a80 con 0x7f8d240a2ca0 2024-05-20T17:29:01.732 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 msgr2=0x7f8d240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 0x7f8d240a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d38199860 tx=0x7f8d2001a040 comp rx=0 tx=0).stop 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 msgr2=0x7f8d381987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800d950 tx=0x7f8d2800dc60 comp rx=0 tx=0).stop 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 shutdown_connections 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8d240a2ca0 0x7f8d240a51b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d38103b90 0x7f8d3819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d381020c0 0x7f8d381987b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:01.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 --2- 172.21.15.172:0/2029613702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d381031f0 0x7f8d38198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:01.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 >> 172.21.15.172:0/2029613702 conn(0x7f8d380fd700 msgr2=0x7f8d38106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:29:01.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 shutdown_connections 2024-05-20T17:29:01.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:29:01.733+0000 7f8d3d83c700 1 -- 172.21.15.172:0/2029613702 wait complete. 2024-05-20T17:29:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:01 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:02.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:02.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:02.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:01 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:02.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:01 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:02.412 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.8.service 2024-05-20T17:29:02.414 INFO:tasks.cephadm:Deploying osd.9 on smithi135 with /dev/vg_nvme/lv_1... 2024-05-20T17:29:02.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:29:02.666 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:29:03.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:02 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:03.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:02 smithi160 ceph-mon[36261]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:02 smithi160 ceph-mon[36261]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.022 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:02 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:03.023 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:02 smithi135 ceph-mon[32027]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.023 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:02 smithi135 ceph-mon[32027]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:02 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:03.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:02 smithi172 ceph-mon[36511]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:02 smithi172 ceph-mon[36511]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:29:03.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:03.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:29:03.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:29:03.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:03.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:03.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:03 smithi172 ceph-mon[36511]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:03.923 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:29:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:29:03.724+0000 7fa936611700 -1 osd.8 0 waiting for initial osdmap 2024-05-20T17:29:03.923 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:29:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:29:03.735+0000 7fa9323c6700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:29:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:29:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:29:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:04.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:03 smithi160 ceph-mon[36261]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:04.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:04.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:29:04.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:29:04.026 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:04.026 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: from='osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:04.026 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:03 smithi135 ceph-mon[32027]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:29:04.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:04 smithi135 ceph-mon[32027]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:29:04.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:04 smithi135 ceph-mon[32027]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:29:04.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:04 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:04.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:04 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:04 smithi160 ceph-mon[36261]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:29:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:04 smithi160 ceph-mon[36261]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:29:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:04 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:04 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:29:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:29:05.013 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-20T17:29:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-20T17:29:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114719 s, 914 MB/s 2024-05-20T17:29:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-20T17:29:05.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:04 smithi172 ceph-mon[36511]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:29:05.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:04 smithi172 ceph-mon[36511]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:29:05.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:04 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:04 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-05-20T17:29:05.908 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] boot 2024-05-20T17:29:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: osdmap e59: 9 total, 9 up, 9 in 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:05.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:29:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] boot 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: osdmap e59: 9 total, 9 up, 9 in 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:06.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:06.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: osd.8 [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] boot 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: osdmap e59: 9 total, 9 up, 9 in 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:06.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:06 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi172 2024-05-20T17:29:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:06 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-20T17:29:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:06 smithi160 ceph-mon[36261]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:29:07.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:06 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi172 2024-05-20T17:29:07.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:06 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-20T17:29:07.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:06 smithi172 ceph-mon[36511]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:29:07.093 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:06 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi172 2024-05-20T17:29:07.093 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:06 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-20T17:29:07.093 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:06 smithi135 ceph-mon[32027]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:29:07.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 -- 172.21.15.135:0/2311724123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901020c0 msgr2=0x7fc0901024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 --2- 172.21.15.135:0/2311724123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901020c0 0x7fc0901024d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080009ca0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 -- 172.21.15.135:0/2311724123 shutdown_connections 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 --2- 172.21.15.135:0/2311724123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc090103b90 0x7fc09010a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 --2- 172.21.15.135:0/2311724123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901020c0 0x7fc0901024d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 --2- 172.21.15.135:0/2311724123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0901031f0 0x7fc090103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 -- 172.21.15.135:0/2311724123 >> 172.21.15.135:0/2311724123 conn(0x7fc0900fd700 msgr2=0x7fc0900ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 -- 172.21.15.135:0/2311724123 shutdown_connections 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.648+0000 7fc0953e5700 1 -- 172.21.15.135:0/2311724123 wait complete. 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 Processor -- start 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 -- start start 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0901020c0 0x7fc090198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc090103b90 0x7fc09019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc09010dc60 con 0x7fc0901031f0 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc09010dae0 con 0x7fc0901020c0 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0953e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc09010dde0 con 0x7fc090103b90 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0867fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0867fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58316/0 (socket says 172.21.15.135:58316) 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.649+0000 7fc0867fc700 1 -- 172.21.15.135:0/969300664 learned_addr learned my addr 172.21.15.135:0/969300664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc08f7fe700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc090103b90 0x7fc09019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc08effd700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0901020c0 0x7fc090198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 -- 172.21.15.135:0/969300664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc090103b90 msgr2=0x7fc09019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:07.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc090103b90 0x7fc09019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 -- 172.21.15.135:0/969300664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0901020c0 msgr2=0x7fc090198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0901020c0 0x7fc090198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 -- 172.21.15.135:0/969300664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0901a02d0 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0867fc700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc078009970 tx=0x7fc078009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07801c070 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc07800d260 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09006a4f0 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078017be0 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.650+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09006aa30 con 0x7fc0901031f0 2024-05-20T17:29:07.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.651+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc090050170 con 0x7fc0901031f0 2024-05-20T17:29:07.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.653+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc07801f070 con 0x7fc0901031f0 2024-05-20T17:29:07.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.654+0000 7fc08cff9700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 0x7fc07c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:07.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.654+0000 7fc08effd700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 0x7fc07c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:07.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.654+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5858+0+0 (secure 0 0 0) 0x7fc0780cfae0 con 0x7fc0901031f0 2024-05-20T17:29:07.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.654+0000 7fc08effd700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 0x7fc07c0a5130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc0800039c0 tx=0x7fc08001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:29:07.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.658+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc07809d3d0 con 0x7fc0901031f0 2024-05-20T17:29:07.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:07.866+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc09006ad50 con 0x7fc07c0a2c20 2024-05-20T17:29:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:07 smithi135 ceph-mon[32027]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:07 smithi135 ceph-mon[32027]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:29:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:07 smithi160 ceph-mon[36261]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:07 smithi160 ceph-mon[36261]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:29:08.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:07 smithi172 ceph-mon[36511]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:07 smithi172 ceph-mon[36511]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:29:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:08 smithi160 ceph-mon[36261]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:29:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:08 smithi172 ceph-mon[36511]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:29:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:09.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:09.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:08 smithi135 ceph-mon[32027]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:29:09.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:09.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:09.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:09.755 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:09 smithi135 ceph-mon[32027]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:09.755 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:09 smithi135 ceph-mon[32027]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:09.755 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:09 smithi135 ceph-mon[32027]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:29:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:09 smithi160 ceph-mon[36261]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:09 smithi160 ceph-mon[36261]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:09 smithi160 ceph-mon[36261]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:29:10.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:09 smithi172 ceph-mon[36511]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:10.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:09 smithi172 ceph-mon[36511]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:10.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:09 smithi172 ceph-mon[36511]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:29:11.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:10 smithi160 ceph-mon[36261]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:11.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:10 smithi172 ceph-mon[36511]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:11.183 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:10 smithi135 ceph-mon[32027]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]: dispatch 2024-05-20T17:29:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]': finished 2024-05-20T17:29:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:11 smithi172 ceph-mon[36511]: osdmap e64: 10 total, 9 up, 10 in 2024-05-20T17:29:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1178801427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]: dispatch 2024-05-20T17:29:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]': finished 2024-05-20T17:29:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:11 smithi135 ceph-mon[32027]: osdmap e64: 10 total, 9 up, 10 in 2024-05-20T17:29:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1178801427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]: dispatch 2024-05-20T17:29:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4011242771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a7483eb-245c-4c6c-91f5-8b41e6de11ee"}]': finished 2024-05-20T17:29:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:11 smithi160 ceph-mon[36261]: osdmap e64: 10 total, 9 up, 10 in 2024-05-20T17:29:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1178801427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:12 smithi172 ceph-mon[36511]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-20T17:29:13.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:12 smithi135 ceph-mon[32027]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-20T17:29:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:12 smithi160 ceph-mon[36261]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-20T17:29:16.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:15 smithi160 ceph-mon[36261]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-20T17:29:16.017 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:15 smithi135 ceph-mon[32027]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-20T17:29:16.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:15 smithi172 ceph-mon[36511]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-20T17:29:18.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:17 smithi160 ceph-mon[36261]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:29:18.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:17 smithi172 ceph-mon[36511]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:29:18.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:17 smithi135 ceph-mon[32027]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:29:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:18 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:29:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:18 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:19.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:18 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:29:19.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:18 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:19.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:18 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:29:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:18 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:19 smithi160 ceph-mon[36261]: Deploying daemon osd.9 on smithi135 2024-05-20T17:29:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:19 smithi160 ceph-mon[36261]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:20.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:19 smithi172 ceph-mon[36511]: Deploying daemon osd.9 on smithi135 2024-05-20T17:29:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:19 smithi172 ceph-mon[36511]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:19 smithi135 ceph-mon[32027]: Deploying daemon osd.9 on smithi135 2024-05-20T17:29:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:19 smithi135 ceph-mon[32027]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:20.812 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:20 smithi135 ceph-mon[32027]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:21.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:20 smithi172 ceph-mon[36511]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:20 smithi160 ceph-mon[36261]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:29:24.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:23 smithi160 ceph-mon[36261]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:23 smithi172 ceph-mon[36511]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:24.127 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:23 smithi135 ceph-mon[32027]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:25 smithi135 ceph-mon[32027]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:25 smithi160 ceph-mon[36261]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:25 smithi172 ceph-mon[36511]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:26.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:27.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:27 smithi135 ceph-mon[32027]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:27 smithi160 ceph-mon[36261]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:27 smithi172 ceph-mon[36511]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:28.886 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:29:28.887 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:28 smithi135 ceph-mon[32027]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:28.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.885+0000 7fc08cff9700 1 -- 172.21.15.135:0/969300664 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc09006ad50 con 0x7fc07c0a2c20 2024-05-20T17:29:28.888 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 9 on host 'smithi135' 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.887+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 msgr2=0x7fc07c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.887+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 0x7fc07c0a5130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc0800039c0 tx=0x7fc08001a040 comp rx=0 tx=0).stop 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.887+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 msgr2=0x7fc090198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.887+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc078009970 tx=0x7fc078009d30 comp rx=0 tx=0).stop 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 shutdown_connections 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0901020c0 0x7fc090198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:28.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc07c0a2c20 0x7fc07c0a5130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:28.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc090103b90 0x7fc09019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:28.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 --2- 172.21.15.135:0/969300664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0901031f0 0x7fc090198cb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:28.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 >> 172.21.15.135:0/969300664 conn(0x7fc0900fd700 msgr2=0x7fc090106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:29:28.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 shutdown_connections 2024-05-20T17:29:28.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:29:28.888+0000 7fc0953e5700 1 -- 172.21.15.135:0/969300664 wait complete. 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:29:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:28 smithi172 ceph-mon[36511]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:29.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:29:29.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:28 smithi160 ceph-mon[36261]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:29.675 DEBUG:teuthology.orchestra.run.smithi135:osd.9> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.9.service 2024-05-20T17:29:29.677 INFO:tasks.cephadm:Deploying osd.10 on smithi160 with /dev/vg_nvme/lv_1... 2024-05-20T17:29:29.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:29:29.926 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:29:29.932 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:29:29.932 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:29:29.932 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:29:29.933 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:29.933 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.933 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:29.933 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:29 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:29:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:29:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:29:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:30.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:30.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:29 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:30.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:30.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:29 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:30.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:29:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:29:30.300+0000 7f96b601f700 -1 osd.9 0 waiting for initial osdmap 2024-05-20T17:29:30.455 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:29:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:29:30.316+0000 7f96addcc700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' 2024-05-20T17:29:31.165 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:30 smithi135 ceph-mon[32027]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:31.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:29:31.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:29:31.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' 2024-05-20T17:29:31.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:30 smithi160 ceph-mon[36261]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:31.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-20T17:29:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:29:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: from='osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572]' entity='osd.9' 2024-05-20T17:29:31.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:30 smithi172 ceph-mon[36511]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:29:32.009 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:29:32.047 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:29:32.047 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-20T17:29:32.047 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-20T17:29:32.047 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112949 s, 928 MB/s 2024-05-20T17:29:32.047 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] boot 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: osdmap e67: 10 total, 10 up, 10 in 2024-05-20T17:29:32.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] boot 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: osdmap e67: 10 total, 10 up, 10 in 2024-05-20T17:29:32.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:31 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:29:32.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:29:32.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: osd.9 [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] boot 2024-05-20T17:29:32.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: osdmap e67: 10 total, 10 up, 10 in 2024-05-20T17:29:32.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:31 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:29:32.829 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-05-20T17:29:33.071 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:29:33.454 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:33.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:29:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:33.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:34.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:34 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi135 2024-05-20T17:29:34.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:34 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 4272M 2024-05-20T17:29:34.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:34 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi135 2024-05-20T17:29:34.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:34 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 4272M 2024-05-20T17:29:34.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:34 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi135 2024-05-20T17:29:34.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:34 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 4272M 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 -- 172.21.15.160:0/3767056065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 msgr2=0x7f3214103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 --2- 172.21.15.160:0/3767056065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214103610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3204009990 tx=0x7f3204009ca0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 -- 172.21.15.160:0/3767056065 shutdown_connections 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 --2- 172.21.15.160:0/3767056065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3214103ba0 0x7f321410a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 --2- 172.21.15.160:0/3767056065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32141020d0 0x7f32141024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 --2- 172.21.15.160:0/3767056065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214103610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 -- 172.21.15.160:0/3767056065 >> 172.21.15.160:0/3767056065 conn(0x7f32140fd710 msgr2=0x7f32140ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:29:34.874 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 -- 172.21.15.160:0/3767056065 shutdown_connections 2024-05-20T17:29:34.875 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.872+0000 7f321ba99700 1 -- 172.21.15.160:0/3767056065 wait complete. 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 Processor -- start 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 -- start start 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 0x7f3214199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214103ba0 0x7f32141a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f321410ed80 con 0x7f32141020d0 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f321410ec00 con 0x7f3214103200 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321ba99700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f321410ef00 con 0x7f3214103ba0 2024-05-20T17:29:34.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57884/0 (socket says 172.21.15.160:57884) 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 -- 172.21.15.160:0/831074452 learned_addr learned my addr 172.21.15.160:0/831074452 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f321a036700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214103ba0 0x7f32141a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219835700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 0x7f3214199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 -- 172.21.15.160:0/831074452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214103ba0 msgr2=0x7f32141a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214103ba0 0x7f32141a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 -- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 msgr2=0x7f3214199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 0x7f3214199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219034700 1 -- 172.21.15.160:0/831074452 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32141a13c0 con 0x7f3214103200 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.873+0000 7f3219835700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 0x7f3214199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:29:34.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f3219034700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32040098e0 tx=0x7f32040047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204003c70 con 0x7f3214103200 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3204004830 con 0x7f3214103200 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32141a1650 con 0x7f3214103200 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3204005440 con 0x7f3214103200 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.874+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141a1a40 con 0x7f3214103200 2024-05-20T17:29:34.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.875+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3214050170 con 0x7f3214103200 2024-05-20T17:29:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.876+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3204003e10 con 0x7f3214103200 2024-05-20T17:29:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.877+0000 7f320affd700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 0x7f32000a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:29:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.877+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f32040d0380 con 0x7f3214103200 2024-05-20T17:29:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.877+0000 7f3219835700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 0x7f32000a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:29:34.880 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.878+0000 7f3219835700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 0x7f32000a5130 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3210005950 tx=0x7f32100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:29:34.883 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:34.881+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3204030070 con 0x7f3214103200 2024-05-20T17:29:35.087 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:35.086+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3214062a80 con 0x7f32000a2c20 2024-05-20T17:29:35.697 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:35 smithi160 ceph-mon[36261]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:35.697 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:35.697 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:35.697 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:35 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:35 smithi135 ceph-mon[32027]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:35 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:35.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:35 smithi172 ceph-mon[36511]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:29:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:29:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:35 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:36.699 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:36 smithi160 ceph-mon[36261]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:36.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:36 smithi135 ceph-mon[32027]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:36.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:36 smithi172 ceph-mon[36511]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:29:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:37 smithi135 ceph-mon[32027]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:37 smithi160 ceph-mon[36261]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:37 smithi172 ceph-mon[36511]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:38.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:38 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/4029052937' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:38 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:38 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]': finished 2024-05-20T17:29:38.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:38 smithi160 ceph-mon[36261]: osdmap e69: 11 total, 10 up, 11 in 2024-05-20T17:29:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:38 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:38 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/4029052937' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:38 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:38 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]': finished 2024-05-20T17:29:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:38 smithi135 ceph-mon[32027]: osdmap e69: 11 total, 10 up, 11 in 2024-05-20T17:29:38.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:38 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:38 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/4029052937' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:38 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]: dispatch 2024-05-20T17:29:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:38 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "216e927a-b7f6-447d-86ae-fdad237ebf34"}]': finished 2024-05-20T17:29:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:38 smithi172 ceph-mon[36511]: osdmap e69: 11 total, 10 up, 11 in 2024-05-20T17:29:38.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:38 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:39 smithi135 ceph-mon[32027]: from='client.? 172.21.15.160:0/322049583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:39 smithi135 ceph-mon[32027]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:39 smithi160 ceph-mon[36261]: from='client.? 172.21.15.160:0/322049583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:39 smithi160 ceph-mon[36261]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:39 smithi172 ceph-mon[36511]: from='client.? 172.21.15.160:0/322049583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:29:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:39 smithi172 ceph-mon[36511]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:41.944 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:41 smithi160 ceph-mon[36261]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:41 smithi172 ceph-mon[36511]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:42.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:41 smithi135 ceph-mon[32027]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:43 smithi160 ceph-mon[36261]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:44.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:43 smithi172 ceph-mon[36511]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:44.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:43 smithi135 ceph-mon[32027]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:45 smithi160 ceph-mon[36261]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:29:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:45 smithi172 ceph-mon[36511]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:29:46.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:45 smithi135 ceph-mon[32027]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:29:46.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:46 smithi160 ceph-mon[36261]: Deploying daemon osd.10 on smithi160 2024-05-20T17:29:47.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:46 smithi172 ceph-mon[36511]: Deploying daemon osd.10 on smithi160 2024-05-20T17:29:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:46 smithi135 ceph-mon[32027]: Deploying daemon osd.10 on smithi160 2024-05-20T17:29:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:47 smithi160 ceph-mon[36261]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:48.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:47 smithi172 ceph-mon[36511]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:47 smithi135 ceph-mon[32027]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:48.916 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:48 smithi160 ceph-mon[36261]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:49.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:48 smithi172 ceph-mon[36511]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:49.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:48 smithi135 ceph-mon[32027]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:51 smithi160 ceph-mon[36261]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:52.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:51 smithi172 ceph-mon[36511]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:51 smithi135 ceph-mon[32027]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:52.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:53 smithi160 ceph-mon[36261]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:53 smithi172 ceph-mon[36511]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:54.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:53 smithi135 ceph-mon[32027]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:55.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.455+0000 7f320affd700 1 -- 172.21.15.160:0/831074452 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3214062a80 con 0x7f32000a2c20 2024-05-20T17:29:55.457 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 10 on host 'smithi160' 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 msgr2=0x7f32000a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 0x7f32000a5130 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3210005950 tx=0x7f32100058e0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 msgr2=0x7f3214199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32040098e0 tx=0x7f32040047b0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 shutdown_connections 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32000a2c20 0x7f32000a5130 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214103ba0 0x7f32141a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32141020d0 0x7f3214199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 --2- 172.21.15.160:0/831074452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3214103200 0x7f3214199da0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:29:55.460 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 >> 172.21.15.160:0/831074452 conn(0x7f32140fd710 msgr2=0x7f3214106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:29:55.460 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 shutdown_connections 2024-05-20T17:29:55.460 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-20T17:29:55.457+0000 7f321ba99700 1 -- 172.21.15.160:0/831074452 wait complete. 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:55.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:55 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:55 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:29:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:55 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:29:56.109 DEBUG:teuthology.orchestra.run.smithi160:osd.10> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.10.service 2024-05-20T17:29:56.111 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-05-20T17:29:56.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:29:56.358 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:29:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:56 smithi160 ceph-mon[36261]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:29:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:56 smithi160 ceph-mon[36261]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:29:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:56 smithi160 ceph-mon[36261]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:56 smithi160 ceph-mon[36261]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:56.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:29:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:29:56.516+0000 7fc68868d700 -1 osd.10 0 waiting for initial osdmap 2024-05-20T17:29:56.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:29:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:29:56.532+0000 7fc684442700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:29:56.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:56 smithi172 ceph-mon[36511]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:29:56.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:56 smithi172 ceph-mon[36511]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:29:56.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:56.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:56 smithi172 ceph-mon[36511]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:56.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:56 smithi172 ceph-mon[36511]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:56 smithi135 ceph-mon[32027]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:29:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:56 smithi135 ceph-mon[32027]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:29:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:56 smithi135 ceph-mon[32027]: from='osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:56 smithi135 ceph-mon[32027]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-20T17:29:57.568 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] boot 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: osdmap e72: 11 total, 11 up, 11 in 2024-05-20T17:29:57.569 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:29:57.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] boot 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: osdmap e72: 11 total, 11 up, 11 in 2024-05-20T17:29:57.742 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-20T17:29:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:29:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:29:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: osd.10 [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] boot 2024-05-20T17:29:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: osdmap e72: 11 total, 11 up, 11 in 2024-05-20T17:29:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:29:58.286 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:29:58.286 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:29:58.286 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-20T17:29:58.286 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-20T17:29:58.286 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117665 s, 891 MB/s 2024-05-20T17:29:58.287 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-20T17:29:58.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-05-20T17:29:59.195 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:29:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:59 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:29:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:59 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:29:59.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:59 smithi160 ceph-mon[36261]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:29:59.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:29:59 smithi160 ceph-mon[36261]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:29:59.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:59 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:29:59.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:59 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:29:59.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:59 smithi172 ceph-mon[36511]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:29:59.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:29:59 smithi172 ceph-mon[36511]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:29:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:59 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:29:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:59 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:29:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:59 smithi135 ceph-mon[32027]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:29:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:29:59 smithi135 ceph-mon[32027]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi160 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:00 smithi160 ceph-mon[36261]: overall HEALTH_OK 2024-05-20T17:30:00.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:30:00.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi160 2024-05-20T17:30:00.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:00 smithi172 ceph-mon[36511]: overall HEALTH_OK 2024-05-20T17:30:00.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi160 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:00.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:00.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:00.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:00 smithi135 ceph-mon[32027]: overall HEALTH_OK 2024-05-20T17:30:00.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.924+0000 7f980e836700 1 -- 172.21.15.172:0/3239412981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 msgr2=0x7f980810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:00.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.924+0000 7f980e836700 1 --2- 172.21.15.172:0/3239412981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f980810a450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f980000b0a0 tx=0x7f980000b3b0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 -- 172.21.15.172:0/3239412981 shutdown_connections 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 --2- 172.21.15.172:0/3239412981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 0x7f98081024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 --2- 172.21.15.172:0/3239412981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f980810a450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 --2- 172.21.15.172:0/3239412981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 0x7f9808103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 -- 172.21.15.172:0/3239412981 >> 172.21.15.172:0/3239412981 conn(0x7f98080fd710 msgr2=0x7f98080ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 -- 172.21.15.172:0/3239412981 shutdown_connections 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 -- 172.21.15.172:0/3239412981 wait complete. 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 Processor -- start 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.925+0000 7f980e836700 1 -- start start 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 0x7f98080752f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:00.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 0x7f980819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f980810dd00 con 0x7f9808103200 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f980810db80 con 0x7f98081020d0 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980e836700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f980810de80 con 0x7f9808103ba0 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42872/0 (socket says 172.21.15.172:42872) 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 -- 172.21.15.172:0/352217787 learned_addr learned my addr 172.21.15.172:0/352217787 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f9807fff700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 0x7f98080752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f98077fe700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 0x7f980819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 -- 172.21.15.172:0/352217787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 msgr2=0x7f98080752f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 0x7f98080752f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 -- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 msgr2=0x7f980819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:00.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 0x7f980819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:00.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 -- 172.21.15.172:0/352217787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98081a13c0 con 0x7f9808103ba0 2024-05-20T17:30:00.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.926+0000 7f980cdd3700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9800009fd0 tx=0x7f9800004d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.927+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800021070 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.927+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98081a1650 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.927+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800007c00 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.927+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800005500 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.927+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a1b50 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.928+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9808050170 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.929+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9800024070 con 0x7f9808103ba0 2024-05-20T17:30:00.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.930+0000 7f98057fa700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 0x7f97f00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:00.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.930+0000 7f9807fff700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 0x7f97f00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:00.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.930+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7f980000f020 con 0x7f9808103ba0 2024-05-20T17:30:00.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.930+0000 7f9807fff700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 0x7f97f00a5130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9808103100 tx=0x7f97f800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:00.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:00.934+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f980002b020 con 0x7f9808103ba0 2024-05-20T17:30:01.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:01.142+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9808062a80 con 0x7f97f00a2c20 2024-05-20T17:30:01.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:01 smithi172 ceph-mon[36511]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:30:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:01 smithi172 ceph-mon[36511]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:01 smithi135 ceph-mon[32027]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:30:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:01 smithi135 ceph-mon[32027]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:01 smithi160 ceph-mon[36261]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:30:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:01 smithi160 ceph-mon[36261]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:02.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:02 smithi172 ceph-mon[36511]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:30:02.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:02 smithi172 ceph-mon[36511]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:02.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:02 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:30:02.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:02 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:30:02.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:02 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:02 smithi135 ceph-mon[32027]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:30:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:02 smithi135 ceph-mon[32027]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:02 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:30:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:02 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:30:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:02 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:02.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:02 smithi160 ceph-mon[36261]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:30:02.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:02 smithi160 ceph-mon[36261]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:02.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:02 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:30:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:02 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:30:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:02 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:03.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:03 smithi172 ceph-mon[36511]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:30:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:03 smithi135 ceph-mon[32027]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:30:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:03 smithi160 ceph-mon[36261]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-20T17:30:04.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:04 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/129541476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:04 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:04 smithi172 ceph-mon[36511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]': finished 2024-05-20T17:30:04.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:04 smithi172 ceph-mon[36511]: osdmap e77: 12 total, 11 up, 12 in 2024-05-20T17:30:04.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:04 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:04 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/129541476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:04 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:04 smithi135 ceph-mon[32027]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]': finished 2024-05-20T17:30:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:04 smithi135 ceph-mon[32027]: osdmap e77: 12 total, 11 up, 12 in 2024-05-20T17:30:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:04 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:04 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/129541476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:04 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]: dispatch 2024-05-20T17:30:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:04 smithi160 ceph-mon[36261]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "293fc85d-ffca-4069-9a9c-980c69ba701d"}]': finished 2024-05-20T17:30:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:04 smithi160 ceph-mon[36261]: osdmap e77: 12 total, 11 up, 12 in 2024-05-20T17:30:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:04 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:05.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:05 smithi172 ceph-mon[36511]: from='client.? 172.21.15.172:0/3477814379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:30:05.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:05 smithi172 ceph-mon[36511]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:30:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:05 smithi135 ceph-mon[32027]: from='client.? 172.21.15.172:0/3477814379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:30:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:05 smithi135 ceph-mon[32027]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:30:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:05 smithi160 ceph-mon[36261]: from='client.? 172.21.15.172:0/3477814379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:30:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:05 smithi160 ceph-mon[36261]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-20T17:30:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:07 smithi172 ceph-mon[36511]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-20T17:30:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:07 smithi160 ceph-mon[36261]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-20T17:30:08.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:07 smithi135 ceph-mon[32027]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-20T17:30:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:09 smithi160 ceph-mon[36261]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:30:10.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:09 smithi172 ceph-mon[36511]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:30:10.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:09 smithi135 ceph-mon[32027]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:30:10.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:10 smithi172 ceph-mon[36511]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:11.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:10 smithi135 ceph-mon[32027]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:11.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:10 smithi160 ceph-mon[36261]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:12.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:30:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:11 smithi172 ceph-mon[36511]: Deploying daemon osd.11 on smithi172 2024-05-20T17:30:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:30:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:11 smithi135 ceph-mon[32027]: Deploying daemon osd.11 on smithi172 2024-05-20T17:30:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:30:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:12.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:11 smithi160 ceph-mon[36261]: Deploying daemon osd.11 on smithi172 2024-05-20T17:30:13.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:12 smithi172 ceph-mon[36511]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:13.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:12 smithi135 ceph-mon[32027]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:12 smithi160 ceph-mon[36261]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:16.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:15 smithi160 ceph-mon[36261]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:15 smithi172 ceph-mon[36511]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:15 smithi135 ceph-mon[32027]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:16.974 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:16 smithi172 ceph-mon[36511]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:16 smithi135 ceph-mon[32027]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:16 smithi160 ceph-mon[36261]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:18.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:18 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:18 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:18 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:18.439 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:18 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.439 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:18 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.439 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:18 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:18.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:18 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:18 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:18.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:18 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:19.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:19 smithi172 ceph-mon[36511]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:19.366 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:19 smithi160 ceph-mon[36261]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:19 smithi135 ceph-mon[32027]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:21.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.162+0000 7f98057fa700 1 -- 172.21.15.172:0/352217787 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9808062a80 con 0x7f97f00a2c20 2024-05-20T17:30:21.164 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.164+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 msgr2=0x7f97f00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.164+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 0x7f97f00a5130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9808103100 tx=0x7f97f800b410 comp rx=0 tx=0).stop 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.164+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 msgr2=0x7f98081a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.164+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9800009fd0 tx=0x7f9800004d50 comp rx=0 tx=0).stop 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 shutdown_connections 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98081020d0 0x7f98080752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97f00a2c20 0x7f97f00a5130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9808103ba0 0x7f98081a0b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 --2- 172.21.15.172:0/352217787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9808103200 0x7f980819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 >> 172.21.15.172:0/352217787 conn(0x7f98080fd710 msgr2=0x7f9808106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 shutdown_connections 2024-05-20T17:30:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:21.165+0000 7f980e836700 1 -- 172.21.15.172:0/352217787 wait complete. 2024-05-20T17:30:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:21 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:21.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:21 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:21 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:21.761 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.11.service 2024-05-20T17:30:21.763 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-20T17:30:21.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd stat -f json 2024-05-20T17:30:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:30:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:22 smithi172 ceph-mon[36511]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:30:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:22 smithi172 ceph-mon[36511]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:30:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:22 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:22 smithi172 ceph-mon[36511]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:22 smithi172 ceph-mon[36511]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:22.330 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:30:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:30:22.205+0000 7f6600ef2700 -1 osd.11 0 waiting for initial osdmap 2024-05-20T17:30:22.331 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:30:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:30:22.222+0000 7f65fcca7700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:30:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:22 smithi135 ceph-mon[32027]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:30:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:22 smithi135 ceph-mon[32027]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:30:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:22 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:22 smithi135 ceph-mon[32027]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:22 smithi135 ceph-mon[32027]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:22 smithi160 ceph-mon[36261]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:30:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:22 smithi160 ceph-mon[36261]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:30:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:22 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:22.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:22 smithi160 ceph-mon[36261]: from='osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:22.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:22 smithi160 ceph-mon[36261]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-20T17:30:23.413 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:23 smithi135 ceph-mon[32027]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:30:23.413 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:23 smithi135 ceph-mon[32027]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:30:23.413 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.413 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:23 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.413 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:23 smithi135 ceph-mon[32027]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:23.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:23 smithi160 ceph-mon[36261]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:30:23.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:23 smithi160 ceph-mon[36261]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:30:23.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:23 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:23 smithi160 ceph-mon[36261]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:23 smithi172 ceph-mon[36511]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-20T17:30:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:23 smithi172 ceph-mon[36511]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:30:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:23 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:23.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:23 smithi172 ceph-mon[36511]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:30:23.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 -- 172.21.15.135:0/1591038034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc1020d0 msgr2=0x7f61dc1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:23.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 --2- 172.21.15.135:0/1591038034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc1020d0 0x7f61dc1024e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098f0 tx=0x7f61d4009c00 comp rx=0 tx=0).stop 2024-05-20T17:30:23.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 -- 172.21.15.135:0/1591038034 shutdown_connections 2024-05-20T17:30:23.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 --2- 172.21.15.135:0/1591038034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc103ba0 0x7f61dc10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:23.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 --2- 172.21.15.135:0/1591038034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc1020d0 0x7f61dc1024e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 --2- 172.21.15.135:0/1591038034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103200 0x7f61dc103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 -- 172.21.15.135:0/1591038034 >> 172.21.15.135:0/1591038034 conn(0x7f61dc0fd710 msgr2=0x7f61dc0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 -- 172.21.15.135:0/1591038034 shutdown_connections 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.790+0000 7f61e1271700 1 -- 172.21.15.135:0/1591038034 wait complete. 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 Processor -- start 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 -- start start 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc1020d0 0x7f61dc0752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103ba0 0x7f61dc1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc10dc70 con 0x7f61dc103200 2024-05-20T17:30:23.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc10daf0 con 0x7f61dc103ba0 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61e1271700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc10ddf0 con 0x7f61dc1020d0 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61da7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61da7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42770/0 (socket says 172.21.15.135:42770) 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61da7fc700 1 -- 172.21.15.135:0/1656762804 learned_addr learned my addr 172.21.15.135:0/1656762804 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.791+0000 7f61daffd700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc1020d0 0x7f61dc0752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61db7fe700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103ba0 0x7f61dc1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 -- 172.21.15.135:0/1656762804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc1020d0 msgr2=0x7f61dc0752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:23.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc1020d0 0x7f61dc0752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 -- 172.21.15.135:0/1656762804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103ba0 msgr2=0x7f61dc1a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103ba0 0x7f61dc1a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 -- 172.21.15.135:0/1656762804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc1a1410 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61da7fc700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e9a0 tx=0x7f61c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c400ca10 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c400cbb0 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc1a1700 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4018680 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.792+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1a1c40 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.793+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61dc050170 con 0x7f61dc103200 2024-05-20T17:30:23.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.794+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f61c4010430 con 0x7f61dc103200 2024-05-20T17:30:23.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.795+0000 7f61d3fff700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 0x7f61c80a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:23.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.796+0000 7f61daffd700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 0x7f61c80a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:23.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.796+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f61c40cf290 con 0x7f61dc103200 2024-05-20T17:30:23.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.796+0000 7f61daffd700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 0x7f61c80a5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:23.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.799+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f61c409c690 con 0x7f61dc103200 2024-05-20T17:30:23.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.997+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f61dc02dc60 con 0x7f61dc103200 2024-05-20T17:30:24.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:23.998+0000 7f61d3fff700 1 -- 172.21.15.135:0/1656762804 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7f61c409bf90 con 0x7f61dc103200 2024-05-20T17:30:24.000 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:24.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 msgr2=0x7f61c80a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:24.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 0x7f61c80a5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d4019040 comp rx=0 tx=0).stop 2024-05-20T17:30:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 msgr2=0x7f61dc19e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e9a0 tx=0x7f61c400ecb0 comp rx=0 tx=0).stop 2024-05-20T17:30:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 shutdown_connections 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61dc103ba0 0x7f61dc1a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c80a2c20 0x7f61c80a5130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61dc1020d0 0x7f61dc0752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 --2- 172.21.15.135:0/1656762804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc103200 0x7f61dc19e670 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 >> 172.21.15.135:0/1656762804 conn(0x7f61dc0fd710 msgr2=0x7f61dc106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 shutdown_connections 2024-05-20T17:30:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:24.000+0000 7f61e1271700 1 -- 172.21.15.135:0/1656762804 wait complete. 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: purged_snaps scrub starts 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: purged_snaps scrub ok 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] boot 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: osdmap e80: 12 total, 12 up, 12 in 2024-05-20T17:30:24.295 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.296 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1656762804' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:30:24.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: purged_snaps scrub starts 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: purged_snaps scrub ok 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] boot 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: osdmap e80: 12 total, 12 up, 12 in 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1656762804' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:30:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: purged_snaps scrub starts 2024-05-20T17:30:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: purged_snaps scrub ok 2024-05-20T17:30:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: osd.11 [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] boot 2024-05-20T17:30:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: osdmap e80: 12 total, 12 up, 12 in 2024-05-20T17:30:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:30:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1656762804' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:30:24.734 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1716226223,"num_in_osds":12,"osd_in_since":1716226203,"num_remapped_pgs":0} 2024-05-20T17:30:24.735 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:30:24.986 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:30:25.430 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:30:25.430 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:25.430 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.430 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:25.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:25 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:30:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:25 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:30:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:25 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:26 smithi135 ceph-mon[32027]: Detected new or changed devices on smithi172 2024-05-20T17:30:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:26 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-20T17:30:26.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:26 smithi160 ceph-mon[36261]: Detected new or changed devices on smithi172 2024-05-20T17:30:26.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:26 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-20T17:30:26.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:26 smithi172 ceph-mon[36511]: Detected new or changed devices on smithi172 2024-05-20T17:30:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:26 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-20T17:30:26.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- 172.21.15.135:0/633565011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104340 msgr2=0x7f525c104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:26.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 --2- 172.21.15.135:0/633565011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104340 0x7f525c104750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f524c009990 tx=0x7f524c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- 172.21.15.135:0/633565011 shutdown_connections 2024-05-20T17:30:26.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 --2- 172.21.15.135:0/633565011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 0x7f525c10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 --2- 172.21.15.135:0/633565011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104340 0x7f525c104750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 --2- 172.21.15.135:0/633565011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104c90 0x7f525c10d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- 172.21.15.135:0/633565011 >> 172.21.15.135:0/633565011 conn(0x7f525c0fdc40 msgr2=0x7f525c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:26.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- 172.21.15.135:0/633565011 shutdown_connections 2024-05-20T17:30:26.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- 172.21.15.135:0/633565011 wait complete. 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 Processor -- start 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.677+0000 7f526284f700 1 -- start start 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 0x7f525c102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 0x7f525c102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f525c113490 con 0x7f525c104c90 2024-05-20T17:30:26.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f525c113310 con 0x7f525c104340 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f526284f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f525c113610 con 0x7f525c10d770 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42800/0 (socket says 172.21.15.135:42800) 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 -- 172.21.15.135:0/2054060019 learned_addr learned my addr 172.21.15.135:0/2054060019 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f5260dec700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 0x7f525c102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525bfff700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 0x7f525c102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 -- 172.21.15.135:0/2054060019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 msgr2=0x7f525c102ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 0x7f525c102ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 -- 172.21.15.135:0/2054060019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 msgr2=0x7f525c102030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 0x7f525c102030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 -- 172.21.15.135:0/2054060019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c1a8160 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525bfff700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 0x7f525c102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.678+0000 7f525b7fe700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f524400b530 tx=0x7f524400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.679+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244015020 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.679+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5244011d10 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.679+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244010e50 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.679+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c1a8450 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.679+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1a8990 con 0x7f525c104c90 2024-05-20T17:30:26.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.680+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c050170 con 0x7f525c104c90 2024-05-20T17:30:26.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.682+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5244018020 con 0x7f525c104c90 2024-05-20T17:30:26.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.682+0000 7f52597fa700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 0x7f52480a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:26.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.683+0000 7f525bfff700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 0x7f52480a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:26.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.683+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f52440ce940 con 0x7f525c104c90 2024-05-20T17:30:26.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.683+0000 7f525bfff700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 0x7f52480a52d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f524c006010 tx=0x7f524c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:26.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.686+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f524401f020 con 0x7f525c104c90 2024-05-20T17:30:26.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.884+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f525c103560 con 0x7f525c104c90 2024-05-20T17:30:26.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.885+0000 7f52597fa700 1 -- 172.21.15.135:0/2054060019 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18523 (secure 0 0 0) 0x7f5244097070 con 0x7f525c104c90 2024-05-20T17:30:26.887 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:30:24.211600+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:30:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 msgr2=0x7f52480a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 0x7f52480a52d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f524c006010 tx=0x7f524c01a040 comp rx=0 tx=0).stop 2024-05-20T17:30:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 msgr2=0x7f525c102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f524400b530 tx=0x7f524400b8f0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 shutdown_connections 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c104340 0x7f525c102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f52480a2dc0 0x7f52480a52d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f525c10d770 0x7f525c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 --2- 172.21.15.135:0/2054060019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c104c90 0x7f525c102570 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 >> 172.21.15.135:0/2054060019 conn(0x7f525c0fdc40 msgr2=0x7f525c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 shutdown_connections 2024-05-20T17:30:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:26.888+0000 7f526284f700 1 -- 172.21.15.135:0/2054060019 wait complete. 2024-05-20T17:30:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:27 smithi160 ceph-mon[36261]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:27 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2054060019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:27.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:27 smithi172 ceph-mon[36511]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:27 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2054060019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:27.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:27 smithi135 ceph-mon[32027]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:27.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:27 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2054060019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:27.647 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:30:27.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-20T17:30:27.885 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:30:29.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 -- 172.21.15.135:0/3816374652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0103490 msgr2=0x7f6aa01038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:29.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/3816374652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0103490 0x7f6aa01038a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a940099c0 tx=0x7f6a94009cd0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 -- 172.21.15.135:0/3816374652 shutdown_connections 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/3816374652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0108710 0x7f6aa0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/3816374652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0103490 0x7f6aa01038a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/3816374652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0107dc0 0x7f6aa01081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 -- 172.21.15.135:0/3816374652 >> 172.21.15.135:0/3816374652 conn(0x7f6aa0079df0 msgr2=0x7f6aa007a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 -- 172.21.15.135:0/3816374652 shutdown_connections 2024-05-20T17:30:29.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.691+0000 7f6aa6c52700 1 -- 172.21.15.135:0/3816374652 wait complete. 2024-05-20T17:30:29.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.692+0000 7f6aa6c52700 1 Processor -- start 2024-05-20T17:30:29.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.692+0000 7f6aa6c52700 1 -- start start 2024-05-20T17:30:29.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 0x7f6aa0199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:29.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:29.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 0x7f6aa019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0113580 con 0x7f6aa0107dc0 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0113400 con 0x7f6aa0103490 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0113700 con 0x7f6aa0108710 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48910/0 (socket says 172.21.15.135:48910) 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 -- 172.21.15.135:0/493404265 learned_addr learned my addr 172.21.15.135:0/493404265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa51ef700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 0x7f6aa019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa49ee700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 0x7f6aa0199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:29.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 -- 172.21.15.135:0/493404265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 msgr2=0x7f6aa019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 0x7f6aa019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 -- 172.21.15.135:0/493404265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 msgr2=0x7f6aa0199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 0x7f6aa0199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 -- 172.21.15.135:0/493404265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa019ee20 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa49ee700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 0x7f6aa0199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa51ef700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 0x7f6aa019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9ffff700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00b500 tx=0x7f6a8c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c015020 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa019f110 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a8c011d10 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.693+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00f2e0 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.694+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa01a6a30 con 0x7f6aa0107dc0 2024-05-20T17:30:29.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.695+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa0050170 con 0x7f6aa0107dc0 2024-05-20T17:30:29.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.696+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6a8c018020 con 0x7f6aa0107dc0 2024-05-20T17:30:29.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.697+0000 7f6a9dffb700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 0x7f6a900a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:29.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.697+0000 7f6aa49ee700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 0x7f6a900a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:29.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.697+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6a8c0ce8d0 con 0x7f6aa0107dc0 2024-05-20T17:30:29.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.697+0000 7f6aa49ee700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 0x7f6a900a5130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009750 tx=0x7f6a94005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:29.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.701+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a8c01f020 con 0x7f6aa0107dc0 2024-05-20T17:30:29.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.894+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6aa019b2b0 con 0x7f6aa0107dc0 2024-05-20T17:30:29.896 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:29 smithi135 ceph-mon[32027]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:29.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.895+0000 7f6a9dffb700 1 -- 172.21.15.135:0/493404265 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f6a8c09bc30 con 0x7f6aa0107dc0 2024-05-20T17:30:29.897 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 msgr2=0x7f6a900a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 0x7f6a900a5130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009750 tx=0x7f6a94005e80 comp rx=0 tx=0).stop 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 msgr2=0x7f6aa019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00b500 tx=0x7f6a8c00b8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 shutdown_connections 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.897+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6aa0103490 0x7f6aa0199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6a900a2c20 0x7f6a900a5130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa0108710 0x7f6aa019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 --2- 172.21.15.135:0/493404265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6aa0107dc0 0x7f6aa019a4f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:29.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 >> 172.21.15.135:0/493404265 conn(0x7f6aa0079df0 msgr2=0x7f6aa0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:29.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 shutdown_connections 2024-05-20T17:30:29.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:29.898+0000 7f6aa6c52700 1 -- 172.21.15.135:0/493404265 wait complete. 2024-05-20T17:30:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:29 smithi160 ceph-mon[36261]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:30.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:29 smithi172 ceph-mon[36511]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:30.714 INFO:tasks.cephadm:Adding mds.a on smithi135 2024-05-20T17:30:30.714 INFO:tasks.cephadm:Adding mds.d on smithi135 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.g on smithi135 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.j on smithi135 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.b on smithi160 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.e on smithi160 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.h on smithi160 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.k on smithi160 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-05-20T17:30:30.715 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-05-20T17:30:30.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph orch apply mds all '12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-05-20T17:30:30.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:30 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/493404265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:30.966 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:30:31.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:30 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/493404265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:31.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:30 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/493404265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:32.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:31 smithi172 ceph-mon[36511]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:32.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:31 smithi135 ceph-mon[32027]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:32.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:31 smithi160 ceph-mon[36261]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:32.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 -- 172.21.15.172:0/2713803248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90102de0 msgr2=0x7fbc901031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 --2- 172.21.15.172:0/2713803248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90102de0 0x7fbc901031f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009990 tx=0x7fbc84009ca0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 -- 172.21.15.172:0/2713803248 shutdown_connections 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 --2- 172.21.15.172:0/2713803248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90103860 0x7fbc9010b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 --2- 172.21.15.172:0/2713803248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc90104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 --2- 172.21.15.172:0/2713803248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90102de0 0x7fbc901031f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 -- 172.21.15.172:0/2713803248 >> 172.21.15.172:0/2713803248 conn(0x7fbc900fe850 msgr2=0x7fbc90100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 -- 172.21.15.172:0/2713803248 shutdown_connections 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.596+0000 7fbc96734700 1 -- 172.21.15.172:0/2713803248 wait complete. 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 Processor -- start 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 -- start start 2024-05-20T17:30:32.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90102de0 0x7fbc90199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc901a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9010eec0 con 0x7fbc90104830 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9010ed40 con 0x7fbc90102de0 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc96734700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9010f040 con 0x7fbc90103860 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc8f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc8f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56726/0 (socket says 172.21.15.172:56726) 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc8f7fe700 1 -- 172.21.15.172:0/3128222980 learned_addr learned my addr 172.21.15.172:0/3128222980 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.597+0000 7fbc8ffff700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90102de0 0x7fbc90199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc94cd1700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc901a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 -- 172.21.15.172:0/3128222980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90102de0 msgr2=0x7fbc90199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:32.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90102de0 0x7fbc90199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 -- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 msgr2=0x7fbc901a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc901a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 -- 172.21.15.172:0/3128222980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc901a1440 con 0x7fbc90103860 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc94cd1700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc901a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8f7fe700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc840057c0 tx=0x7fbc840057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84027070 con 0x7fbc90103860 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc84004150 con 0x7fbc90103860 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc901a16d0 con 0x7fbc90103860 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400f460 con 0x7fbc90103860 2024-05-20T17:30:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.598+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc901a1b20 con 0x7fbc90103860 2024-05-20T17:30:32.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.599+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc90050170 con 0x7fbc90103860 2024-05-20T17:30:32.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.600+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fbc8402a070 con 0x7fbc90103860 2024-05-20T17:30:32.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.601+0000 7fbc8d7fa700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 0x7fbc780a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:32.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.601+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbc840cfb70 con 0x7fbc90103860 2024-05-20T17:30:32.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.601+0000 7fbc8ffff700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 0x7fbc780a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:32.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.602+0000 7fbc8ffff700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 0x7fbc780a5130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc90104220 tx=0x7fbc8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:32.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.606+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbc8405e850 con 0x7fbc90103860 2024-05-20T17:30:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.812+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7fbc90062b80 con 0x7fbc780a2c20 2024-05-20T17:30:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.823+0000 7fbc8d7fa700 1 -- 172.21.15.172:0/3128222980 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fbc90062b80 con 0x7fbc780a2c20 2024-05-20T17:30:32.824 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-05-20T17:30:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 msgr2=0x7fbc780a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 0x7fbc780a5130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc90104220 tx=0x7fbc8000b410 comp rx=0 tx=0).stop 2024-05-20T17:30:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 msgr2=0x7fbc90199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc840057c0 tx=0x7fbc840057f0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 shutdown_connections 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90102de0 0x7fbc90199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc780a2c20 0x7fbc780a5130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc90104830 0x7fbc901a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 --2- 172.21.15.172:0/3128222980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc90103860 0x7fbc90199eb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 >> 172.21.15.172:0/3128222980 conn(0x7fbc900fe850 msgr2=0x7fbc90107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 shutdown_connections 2024-05-20T17:30:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-20T17:30:32.825+0000 7fbc96734700 1 -- 172.21.15.172:0/3128222980 wait complete. 2024-05-20T17:30:33.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:32 smithi172 ceph-mon[36511]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:33.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:32 smithi135 ceph-mon[32027]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:32 smithi160 ceph-mon[36261]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:33.504 DEBUG:teuthology.orchestra.run.smithi135:mds.a> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.a.service 2024-05-20T17:30:33.507 DEBUG:teuthology.orchestra.run.smithi135:mds.d> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.d.service 2024-05-20T17:30:33.550 DEBUG:teuthology.orchestra.run.smithi135:mds.g> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.g.service 2024-05-20T17:30:33.594 DEBUG:teuthology.orchestra.run.smithi135:mds.j> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.j.service 2024-05-20T17:30:33.637 DEBUG:teuthology.orchestra.run.smithi160:mds.b> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.b.service 2024-05-20T17:30:33.640 DEBUG:teuthology.orchestra.run.smithi160:mds.e> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.e.service 2024-05-20T17:30:33.682 DEBUG:teuthology.orchestra.run.smithi160:mds.h> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.h.service 2024-05-20T17:30:33.725 DEBUG:teuthology.orchestra.run.smithi160:mds.k> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.k.service 2024-05-20T17:30:33.768 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.c.service 2024-05-20T17:30:33.771 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.f.service 2024-05-20T17:30:33.814 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.i.service 2024-05-20T17:30:33.857 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.l.service 2024-05-20T17:30:33.900 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-20T17:30:33.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:30:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-05-20T17:30:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:33 smithi160 ceph-mon[36261]: Deploying daemon mds.l on smithi172 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 -- 172.21.15.135:0/222528573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe844101f00 msgr2=0x7fe844102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 --2- 172.21.15.135:0/222528573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe844101f00 0x7fe844102310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009900 tx=0x7fe83c02a410 comp rx=0 tx=0).stop 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 -- 172.21.15.135:0/222528573 shutdown_connections 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 --2- 172.21.15.135:0/222528573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844103400 0x7fe844109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 --2- 172.21.15.135:0/222528573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8441028e0 0x7fe844102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 --2- 172.21.15.135:0/222528573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe844101f00 0x7fe844102310 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 -- 172.21.15.135:0/222528573 >> 172.21.15.135:0/222528573 conn(0x7fe8440fc2e0 msgr2=0x7fe8440fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 -- 172.21.15.135:0/222528573 shutdown_connections 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.072+0000 7fe84afb7640 1 -- 172.21.15.135:0/222528573 wait complete. 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 Processor -- start 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 -- start start 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844101f00 0x7fe844199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe844103400 0x7fe8441a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410d5f0 con 0x7fe8441028e0 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410d470 con 0x7fe844103400 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe84afb7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe84410d770 con 0x7fe844101f00 2024-05-20T17:30:34.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe843fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe843fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48930/0 (socket says 172.21.15.135:48930) 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe843fff640 1 -- 172.21.15.135:0/2837339927 learned_addr learned my addr 172.21.15.135:0/2837339927 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.073+0000 7fe848d53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844101f00 0x7fe844199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe849554640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe844103400 0x7fe8441a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 -- 172.21.15.135:0/2837339927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844101f00 msgr2=0x7fe844199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844101f00 0x7fe844199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 -- 172.21.15.135:0/2837339927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe844103400 msgr2=0x7fe8441a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe844103400 0x7fe8441a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 -- 172.21.15.135:0/2837339927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441a0dc0 con 0x7fe8441028e0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe843fff640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9f0 tx=0x7fe82c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cd80 con 0x7fe8441028e0 2024-05-20T17:30:34.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8441a10b0 con 0x7fe8441028e0 2024-05-20T17:30:34.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe82c010910 con 0x7fe8441028e0 2024-05-20T17:30:34.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c018990 con 0x7fe8441028e0 2024-05-20T17:30:34.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.074+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8441a1600 con 0x7fe8441028e0 2024-05-20T17:30:34.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:34.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-05-20T17:30:34.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:34.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:33 smithi172 ceph-mon[36511]: Deploying daemon mds.l on smithi172 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.075+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8441a1860 con 0x7fe8441028e0 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.076+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe82c010ac0 con 0x7fe8441028e0 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.077+0000 7fe841ffb640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 0x7fe8300a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.077+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe82c0cef60 con 0x7fe8441028e0 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.077+0000 7fe848d53640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 0x7fe8300a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.078+0000 7fe848d53640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 0x7fe8300a50a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009230 tx=0x7fe83c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.082+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe82c09c360 con 0x7fe8441028e0 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:30:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:34.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:34.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:34.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:34.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:33 smithi135 ceph-mon[32027]: Deploying daemon mds.l on smithi172 2024-05-20T17:30:34.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.260+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8441a1df0 con 0x7fe8441028e0 2024-05-20T17:30:34.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.261+0000 7fe841ffb640 1 -- 172.21.15.135:0/2837339927 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18523 (secure 0 0 0) 0x7fe82c09bc60 con 0x7fe8441028e0 2024-05-20T17:30:34.264 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:34.264 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:30:24.211600+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 msgr2=0x7fe8300a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 0x7fe8300a50a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009230 tx=0x7fe83c031400 comp rx=0 tx=0).stop 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 msgr2=0x7fe8441997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9f0 tx=0x7fe82c00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 shutdown_connections 2024-05-20T17:30:34.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe8300a2b90 0x7fe8300a50a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe844103400 0x7fe8441a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8441028e0 0x7fe8441997c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 --2- 172.21.15.135:0/2837339927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe844101f00 0x7fe844199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 >> 172.21.15.135:0/2837339927 conn(0x7fe8440fc2e0 msgr2=0x7fe8440fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 shutdown_connections 2024-05-20T17:30:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.264+0000 7fe84afb7640 1 -- 172.21.15.135:0/2837339927 wait complete. 2024-05-20T17:30:34.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:30:34.278 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:30:34.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- 172.21.15.135:0/1752208437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4108720 msgr2=0x7f61d410ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1752208437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4108720 0x7f61d410ac30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009ca0 tx=0x7f61cc02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- 172.21.15.135:0/1752208437 shutdown_connections 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1752208437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4108720 0x7f61d410ac30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1752208437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 0x7f61d4108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1752208437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4100e00 0x7f61d4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- 172.21.15.135:0/1752208437 >> 172.21.15.135:0/1752208437 conn(0x7f61d40fc330 msgr2=0x7f61d40fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- 172.21.15.135:0/1752208437 shutdown_connections 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- 172.21.15.135:0/1752208437 wait complete. 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 Processor -- start 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.390+0000 7f61dc66e640 1 -- start start 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 0x7f61d4199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4108720 0x7f61d41a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410e6e0 con 0x7f61d4100e00 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410e560 con 0x7f61d4108720 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410e860 con 0x7f61d4101300 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48952/0 (socket says 172.21.15.135:48952) 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 -- 172.21.15.135:0/1796660537 learned_addr learned my addr 172.21.15.135:0/1796660537 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61d9c09640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 0x7f61d4199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dac0b640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4108720 0x7f61d41a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 -- 172.21.15.135:0/1796660537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 msgr2=0x7f61d4199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 0x7f61d4199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 -- 172.21.15.135:0/1796660537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4108720 msgr2=0x7f61d41a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4108720 0x7f61d41a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 -- 172.21.15.135:0/1796660537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d41a0d30 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61da40a640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61d000e9f0 tx=0x7f61d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d000cd80 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d0010910 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d41a0fc0 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d00188f0 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.391+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d41a1480 con 0x7f61d4100e00 2024-05-20T17:30:34.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.392+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d40fde50 con 0x7f61d4100e00 2024-05-20T17:30:34.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.394+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f61d0010ac0 con 0x7f61d4100e00 2024-05-20T17:30:34.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.394+0000 7f61cb7fe640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 0x7f61c00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.394+0000 7f61d9c09640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 0x7f61c00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.394+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f61d00cf380 con 0x7f61d4100e00 2024-05-20T17:30:34.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.395+0000 7f61d9c09640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 0x7f61c00a50a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61d419a290 tx=0x7f61c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.398+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f61d009c760 con 0x7f61d4100e00 2024-05-20T17:30:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.575+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61d402d430 con 0x7f61d4100e00 2024-05-20T17:30:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.575+0000 7f61cb7fe640 1 -- 172.21.15.135:0/1796660537 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f61d009c060 con 0x7f61d4100e00 2024-05-20T17:30:34.578 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 msgr2=0x7f61c00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 0x7f61c00a50a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61d419a290 tx=0x7f61c4005f90 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 msgr2=0x7f61d41991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61d000e9f0 tx=0x7f61d000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 shutdown_connections 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f61c00a2b90 0x7f61c00a50a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61d4108720 0x7f61d41a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61d4101300 0x7f61d4199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 --2- 172.21.15.135:0/1796660537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4100e00 0x7f61d41991f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 >> 172.21.15.135:0/1796660537 conn(0x7f61d40fc330 msgr2=0x7f61d4104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 shutdown_connections 2024-05-20T17:30:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.579+0000 7f61dc66e640 1 -- 172.21.15.135:0/1796660537 wait complete. 2024-05-20T17:30:34.594 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:34.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 -- 172.21.15.135:0/1712447555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb581089d0 msgr2=0x7fbb5810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 --2- 172.21.15.135:0/1712447555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb581089d0 0x7fbb5810adf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009ca0 tx=0x7fbb5002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 -- 172.21.15.135:0/1712447555 shutdown_connections 2024-05-20T17:30:34.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 --2- 172.21.15.135:0/1712447555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb581089d0 0x7fbb5810adf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 --2- 172.21.15.135:0/1712447555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 0x7fbb581040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 --2- 172.21.15.135:0/1712447555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb58102a90 0x7fbb58103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 -- 172.21.15.135:0/1712447555 >> 172.21.15.135:0/1712447555 conn(0x7fbb580fdc80 msgr2=0x7fbb58100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 -- 172.21.15.135:0/1712447555 shutdown_connections 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.702+0000 7fbb5d965640 1 -- 172.21.15.135:0/1712447555 wait complete. 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 Processor -- start 2024-05-20T17:30:34.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 -- start start 2024-05-20T17:30:34.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 0x7fbb58199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 0x7fbb581a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5810e6f0 con 0x7fbb58102a90 2024-05-20T17:30:34.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5810e570 con 0x7fbb581089d0 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb5d965640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5810e870 con 0x7fbb58103cd0 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48962/0 (socket says 172.21.15.135:48962) 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.703+0000 7fbb56ffd640 1 -- 172.21.15.135:0/2108439526 learned_addr learned my addr 172.21.15.135:0/2108439526 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb4e7fc640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 0x7fbb58199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb577fe640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 0x7fbb581a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 -- 172.21.15.135:0/2108439526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 msgr2=0x7fbb58199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 0x7fbb58199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 -- 172.21.15.135:0/2108439526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 msgr2=0x7fbb581a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 0x7fbb581a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 -- 172.21.15.135:0/2108439526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb581a0d20 con 0x7fbb58102a90 2024-05-20T17:30:34.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb577fe640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 0x7fbb581a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb56ffd640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800d740 tx=0x7fbb4800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48017070 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb581a0fb0 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb4800de50 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48003e00 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.704+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb581a14c0 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.705+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb58069f50 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.706+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fbb48004020 con 0x7fbb58102a90 2024-05-20T17:30:34.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.707+0000 7fbb5c963640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 0x7fbb440a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:34.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.707+0000 7fbb4e7fc640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 0x7fbb440a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:34.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.707+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbb480ce600 con 0x7fbb58102a90 2024-05-20T17:30:34.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.708+0000 7fbb4e7fc640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 0x7fbb440a50a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb5819a280 tx=0x7fbb4000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:34.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.712+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbb4809ba00 con 0x7fbb58102a90 2024-05-20T17:30:34.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.926+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb5802d2a0 con 0x7fbb58102a90 2024-05-20T17:30:34.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.927+0000 7fbb5c963640 1 -- 172.21.15.135:0/2108439526 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fbb4809b300 con 0x7fbb58102a90 2024-05-20T17:30:34.930 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:34.930 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-20T17:30:34.930 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-05-20T17:30:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 msgr2=0x7fbb440a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 0x7fbb440a50a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb5819a280 tx=0x7fbb4000b410 comp rx=0 tx=0).stop 2024-05-20T17:30:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 msgr2=0x7fbb58199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800d740 tx=0x7fbb4800dc00 comp rx=0 tx=0).stop 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 shutdown_connections 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbb440a2b90 0x7fbb440a50a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb581089d0 0x7fbb581a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb58103cd0 0x7fbb58199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 --2- 172.21.15.135:0/2108439526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb58102a90 0x7fbb58199230 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 >> 172.21.15.135:0/2108439526 conn(0x7fbb580fdc80 msgr2=0x7fbb581049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 shutdown_connections 2024-05-20T17:30:34.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:34.929+0000 7fbb5d965640 1 -- 172.21.15.135:0/2108439526 wait complete. 2024-05-20T17:30:34.942 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:34 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2837339927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:34.942 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:34 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1796660537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:34.942 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:34 smithi135 ceph-mon[32027]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:35.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:34 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2837339927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:35.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:34 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1796660537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:35.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:34 smithi172 ceph-mon[36511]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:35.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:34 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2837339927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:30:35.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:34 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1796660537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:30:35.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:34 smithi160 ceph-mon[36261]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:36.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:35 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2108439526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:36.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:35 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2108439526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:36.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:35 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2108439526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:36.286 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:30:36 smithi172 podman[66891]: 2024-05-20 17:30:36.252516524 +0000 UTC m=+0.355808266 container start 9cac0e586578aab323c81eccc2990c9f4c6a532321f663aca32888f787e6f063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-20T17:30:36.580 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:30:36 smithi172 ceph-mds[66910]: -- 172.21.15.172:0/3327545436 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615696dfa40 con 0x561569757600 2024-05-20T17:30:36.580 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:30:36 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l[66906]: starting mds.l at 2024-05-20T17:30:36.580 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:30:36 smithi172 bash[66891]: 9cac0e586578aab323c81eccc2990c9f4c6a532321f663aca32888f787e6f063 2024-05-20T17:30:36.580 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:30:36 smithi172 systemd[1]: Started Ceph mds.l for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:36.943 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:37.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1869542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481019b0 msgr2=0x7fcc481026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1869542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481019b0 0x7fcc481026b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009900 tx=0x7fcc3802a410 comp rx=0 tx=0).stop 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1869542402 shutdown_connections 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1869542402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc481078f0 0x7fcc48109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1869542402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc48102bf0 0x7fcc48103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1869542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481019b0 0x7fcc481026b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1869542402 >> 172.21.15.135:0/1869542402 conn(0x7fcc480fcba0 msgr2=0x7fcc480ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1869542402 shutdown_connections 2024-05-20T17:30:37.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.067+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1869542402 wait complete. 2024-05-20T17:30:37.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 Processor -- start 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 -- start start 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc481019b0 0x7fcc48198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc48102bf0 0x7fcc481986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4810d600 con 0x7fcc481078f0 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4810d480 con 0x7fcc481019b0 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4ccde640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4810d780 con 0x7fcc48102bf0 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48986/0 (socket says 172.21.15.135:48986) 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 -- 172.21.15.135:0/1045511863 learned_addr learned my addr 172.21.15.135:0/1045511863 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc4659c640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc481019b0 0x7fcc48198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:37.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc3ffff640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc48102bf0 0x7fcc481986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 -- 172.21.15.135:0/1045511863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc48102bf0 msgr2=0x7fcc481986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc48102bf0 0x7fcc481986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 -- 172.21.15.135:0/1045511863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc481019b0 msgr2=0x7fcc48198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc481019b0 0x7fcc48198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.068+0000 7fcc46d9d640 1 -- 172.21.15.135:0/1045511863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4819fcb0 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc46d9d640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000eaa0 tx=0x7fcc4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000cdb0 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc40005020 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400116b0 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4819ffa0 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.069+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc481a0410 con 0x7fcc481078f0 2024-05-20T17:30:37.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.070+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc48106700 con 0x7fcc481078f0 2024-05-20T17:30:37.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.071+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcc40005560 con 0x7fcc481078f0 2024-05-20T17:30:37.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.072+0000 7fcc3f7fe640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 0x7fcc340a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:37.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.072+0000 7fcc4659c640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 0x7fcc340a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:37.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.072+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fcc400ceca0 con 0x7fcc481078f0 2024-05-20T17:30:37.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.072+0000 7fcc4659c640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 0x7fcc340a5120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc38005ab0 tx=0x7fcc38031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:37.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.076+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcc40016030 con 0x7fcc481078f0 2024-05-20T17:30:37.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.290+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc4802d2a0 con 0x7fcc481078f0 2024-05-20T17:30:37.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.290+0000 7fcc3f7fe640 1 -- 172.21.15.135:0/1045511863 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fcc4009ba50 con 0x7fcc481078f0 2024-05-20T17:30:37.292 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:37.292 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:30:37.292 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 msgr2=0x7fcc340a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 0x7fcc340a5120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc38005ab0 tx=0x7fcc38031400 comp rx=0 tx=0).stop 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 msgr2=0x7fcc4819f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000eaa0 tx=0x7fcc4000ef60 comp rx=0 tx=0).stop 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 shutdown_connections 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcc340a2c10 0x7fcc340a5120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc481078f0 0x7fcc4819f640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc48102bf0 0x7fcc481986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 --2- 172.21.15.135:0/1045511863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc481019b0 0x7fcc48198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.292+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 >> 172.21.15.135:0/1045511863 conn(0x7fcc480fcba0 msgr2=0x7fcc481038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.293+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 shutdown_connections 2024-05-20T17:30:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:37.293+0000 7fcc4ccde640 1 -- 172.21.15.135:0/1045511863 wait complete. 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6832/2047222973,v1:172.21.15.172:6833/2047222973] up:boot 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: fsmap 1 up:standby 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.416 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:37.417 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:37.417 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:37.417 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: Deploying daemon mds.k on smithi160 2024-05-20T17:30:37.417 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:37.417 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:37 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1045511863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6832/2047222973,v1:172.21.15.172:6833/2047222973] up:boot 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: fsmap 1 up:standby 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: Deploying daemon mds.k on smithi160 2024-05-20T17:30:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:37 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1045511863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6832/2047222973,v1:172.21.15.172:6833/2047222973] up:boot 2024-05-20T17:30:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: fsmap 1 up:standby 2024-05-20T17:30:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:30:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: Deploying daemon mds.k on smithi160 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:37.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:37 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1045511863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:38.978 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:38 smithi160 systemd[1]: Starting Ceph mds.k for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:39.236 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:38 smithi160 podman[65275]: 2024-05-20 17:30:38.880384781 +0000 UTC m=+0.017052472 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:39.236 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:38 smithi160 podman[65275]: 2024-05-20 17:30:38.989633127 +0000 UTC m=+0.126300818 container create 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-20T17:30:39.236 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 podman[65275]: 2024-05-20 17:30:39.233774117 +0000 UTC m=+0.370441807 container init 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True) 2024-05-20T17:30:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 -- 172.21.15.135:0/1355799151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c102ac0 msgr2=0x7f047c1037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 --2- 172.21.15.135:0/1355799151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c102ac0 0x7f047c1037c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f046c009900 tx=0x7f046c02a410 comp rx=0 tx=0).stop 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 -- 172.21.15.135:0/1355799151 shutdown_connections 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 --2- 172.21.15.135:0/1355799151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c108a00 0x7f047c10ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 --2- 172.21.15.135:0/1355799151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c103d00 0x7f047c104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 --2- 172.21.15.135:0/1355799151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c102ac0 0x7f047c1037c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.433+0000 7f0482977640 1 -- 172.21.15.135:0/1355799151 >> 172.21.15.135:0/1355799151 conn(0x7f047c0fdcf0 msgr2=0x7f047c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:39.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.434+0000 7f0482977640 1 -- 172.21.15.135:0/1355799151 shutdown_connections 2024-05-20T17:30:39.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.434+0000 7f0482977640 1 -- 172.21.15.135:0/1355799151 wait complete. 2024-05-20T17:30:39.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.434+0000 7f0482977640 1 Processor -- start 2024-05-20T17:30:39.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.434+0000 7f0482977640 1 -- start start 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 0x7f047c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c103d00 0x7f047c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10e740 con 0x7f047c108a00 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10e5c0 con 0x7f047c102ac0 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0482977640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10e8c0 con 0x7f047c103d00 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49000/0 (socket says 172.21.15.135:49000) 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 -- 172.21.15.135:0/1743535235 learned_addr learned my addr 172.21.15.135:0/1743535235 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:39.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f047bfff640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 0x7f047c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f047b7fe640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c103d00 0x7f047c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 -- 172.21.15.135:0/1743535235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c103d00 msgr2=0x7f047c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c103d00 0x7f047c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 -- 172.21.15.135:0/1743535235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 msgr2=0x7f047c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 0x7f047c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 -- 172.21.15.135:0/1743535235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c1a0d70 con 0x7f047c108a00 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f047bfff640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 0x7f047c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:30:39.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.435+0000 7f0480f14640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f047400eaa0 tx=0x7f047400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.437+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474004d20 con 0x7f047c108a00 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.437+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0474005020 con 0x7f047c108a00 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.437+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740116d0 con 0x7f047c108a00 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.437+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c1a1060 con 0x7f047c108a00 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.437+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c1a15b0 con 0x7f047c108a00 2024-05-20T17:30:39.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.438+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c107810 con 0x7f047c108a00 2024-05-20T17:30:39.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.439+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f04740051d0 con 0x7f047c108a00 2024-05-20T17:30:39.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.440+0000 7f04797fa640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 0x7f04680a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.441+0000 7f047bfff640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 0x7f04680a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.441+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f04740cecb0 con 0x7f047c108a00 2024-05-20T17:30:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.441+0000 7f047bfff640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 0x7f04680a5120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f046c02aa00 tx=0x7f046c0315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:39.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.446+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0474016030 con 0x7f047c108a00 2024-05-20T17:30:39.506 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 podman[65275]: 2024-05-20 17:30:39.236406057 +0000 UTC m=+0.373073759 container start 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-20T17:30:39.506 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mds[65294]: -- 172.21.15.160:0/3300843379 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629293b5a40 con 0x56292942d180 2024-05-20T17:30:39.507 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k[65290]: starting mds.k at 2024-05-20T17:30:39.507 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 bash[65275]: 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 2024-05-20T17:30:39.507 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:30:39 smithi160 systemd[1]: Started Ceph mds.k for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:39.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.663+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f047c02d2a0 con 0x7f047c108a00 2024-05-20T17:30:39.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.664+0000 7f04797fa640 1 -- 172.21.15.135:0/1743535235 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f047409c0b0 con 0x7f047c108a00 2024-05-20T17:30:39.665 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:39.665 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:30:39.666 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-05-20T17:30:39.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 msgr2=0x7f04680a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 0x7f04680a5120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f046c02aa00 tx=0x7f046c0315b0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 msgr2=0x7f047c1a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f047400eaa0 tx=0x7f047400eea0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 shutdown_connections 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f04680a2c10 0x7f04680a5120 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f047c108a00 0x7f047c1a07b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f047c103d00 0x7f047c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 --2- 172.21.15.135:0/1743535235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f047c102ac0 0x7f047c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 >> 172.21.15.135:0/1743535235 conn(0x7f047c0fdcf0 msgr2=0x7f047c1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 shutdown_connections 2024-05-20T17:30:39.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:39.666+0000 7f0482977640 1 -- 172.21.15.135:0/1743535235 wait complete. 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:39.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:39.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:39 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1743535235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:40.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:39 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1743535235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:40.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:40.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:40.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:39 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1743535235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:41.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:40 smithi160 ceph-mon[36261]: Deploying daemon mds.j on smithi135 2024-05-20T17:30:41.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:40 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6832/3469044918,v1:172.21.15.160:6833/3469044918] up:boot 2024-05-20T17:30:41.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:40 smithi160 ceph-mon[36261]: fsmap 2 up:standby 2024-05-20T17:30:41.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:40 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:30:41.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:40 smithi160 ceph-mon[36261]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:41.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:40 smithi172 ceph-mon[36511]: Deploying daemon mds.j on smithi135 2024-05-20T17:30:41.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:40 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6832/3469044918,v1:172.21.15.160:6833/3469044918] up:boot 2024-05-20T17:30:41.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:40 smithi172 ceph-mon[36511]: fsmap 2 up:standby 2024-05-20T17:30:41.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:40 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:30:41.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:40 smithi172 ceph-mon[36511]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:40 smithi135 ceph-mon[32027]: Deploying daemon mds.j on smithi135 2024-05-20T17:30:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:40 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6832/3469044918,v1:172.21.15.160:6833/3469044918] up:boot 2024-05-20T17:30:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:40 smithi135 ceph-mon[32027]: fsmap 2 up:standby 2024-05-20T17:30:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:40 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:30:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:40 smithi135 ceph-mon[32027]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:41.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:41.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 -- 172.21.15.135:0/3254508706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 msgr2=0x7fa5ac102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:41.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/3254508706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac102680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009900 tx=0x7fa59c02a410 comp rx=0 tx=0).stop 2024-05-20T17:30:41.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 -- 172.21.15.135:0/3254508706 shutdown_connections 2024-05-20T17:30:41.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/3254508706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac1078c0 0x7fa5ac109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:41.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/3254508706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:41.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/3254508706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac102680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:41.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 -- 172.21.15.135:0/3254508706 >> 172.21.15.135:0/3254508706 conn(0x7fa5ac0fcb70 msgr2=0x7fa5ac0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:41.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 -- 172.21.15.135:0/3254508706 shutdown_connections 2024-05-20T17:30:41.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.803+0000 7fa5b0b72640 1 -- 172.21.15.135:0/3254508706 wait complete. 2024-05-20T17:30:41.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 Processor -- start 2024-05-20T17:30:41.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 -- start start 2024-05-20T17:30:41.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:41.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac1078c0 0x7fa5ac19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac10d620 con 0x7fa5ac101980 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac10d4a0 con 0x7fa5ac1078c0 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5b0b72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac10d7a0 con 0x7fa5ac102bc0 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5aa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5aa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58856/0 (socket says 172.21.15.135:58856) 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.804+0000 7fa5aa59c640 1 -- 172.21.15.135:0/1729145581 learned_addr learned my addr 172.21.15.135:0/1729145581 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aad9d640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac1078c0 0x7fa5ac19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5a9d9b640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 -- 172.21.15.135:0/1729145581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 msgr2=0x7fa5ac198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 -- 172.21.15.135:0/1729145581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac1078c0 msgr2=0x7fa5ac19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac1078c0 0x7fa5ac19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 -- 172.21.15.135:0/1729145581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac19fd00 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5a9d9b640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5aa59c640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031440 tx=0x7fa59c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c046070 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa59c032e50 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ac073d80 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c035050 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.805+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ac074270 con 0x7fa5ac101980 2024-05-20T17:30:41.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.806+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ac068cf0 con 0x7fa5ac101980 2024-05-20T17:30:41.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.808+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa59c049070 con 0x7fa5ac101980 2024-05-20T17:30:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.809+0000 7fa59b7fe640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 0x7fa5940a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.810+0000 7fa5a9d9b640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 0x7fa5940a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.810+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa59c0f08c0 con 0x7fa5ac101980 2024-05-20T17:30:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.810+0000 7fa5a9d9b640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 0x7fa5940a50a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac199260 tx=0x7fa5a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:41.812+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa59c050080 con 0x7fa5ac101980 2024-05-20T17:30:42.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.034+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5ac106140 con 0x7fa5ac101980 2024-05-20T17:30:42.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.035+0000 7fa59b7fe640 1 -- 172.21.15.135:0/1729145581 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7fa59c0bdcc0 con 0x7fa5ac101980 2024-05-20T17:30:42.036 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:42.036 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:30:42.037 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 3 2024-05-20T17:30:42.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 msgr2=0x7fa5940a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:42.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 0x7fa5940a50a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac199260 tx=0x7fa5a0005f90 comp rx=0 tx=0).stop 2024-05-20T17:30:42.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 msgr2=0x7fa5ac1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031440 tx=0x7fa59c032c60 comp rx=0 tx=0).stop 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 shutdown_connections 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5940a2b90 0x7fa5940a50a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ac1078c0 0x7fa5ac19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5ac102bc0 0x7fa5ac198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 --2- 172.21.15.135:0/1729145581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac101980 0x7fa5ac1981c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 >> 172.21.15.135:0/1729145581 conn(0x7fa5ac0fcb70 msgr2=0x7fa5ac1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 shutdown_connections 2024-05-20T17:30:42.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:42.037+0000 7fa5b0b72640 1 -- 172.21.15.135:0/1729145581 wait complete. 2024-05-20T17:30:42.149 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1729145581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:42.149 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 podman[69861]: 2024-05-20 17:30:42.145513881 +0000 UTC m=+0.364589402 container init 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-20T17:30:42.149 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 podman[69861]: 2024-05-20 17:30:42.148438995 +0000 UTC m=+0.367514529 container start 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:30:42.454 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 ceph-mds[69901]: -- 172.21.15.135:0/1463545346 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e0c09fa40 con 0x560e0c117600 2024-05-20T17:30:42.454 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j[69895]: starting mds.j at 2024-05-20T17:30:42.454 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 bash[69861]: 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 2024-05-20T17:30:42.454 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:30:42 smithi135 systemd[1]: Started Ceph mds.j for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:42.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1729145581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:42.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1729145581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: Deploying daemon mds.d on smithi135 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.135:6834/185728746,v1:172.21.15.135:6835/185728746] up:boot 2024-05-20T17:30:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: fsmap 3 up:standby 2024-05-20T17:30:43.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:43 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:43.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: Deploying daemon mds.d on smithi135 2024-05-20T17:30:43.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:43.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.135:6834/185728746,v1:172.21.15.135:6835/185728746] up:boot 2024-05-20T17:30:43.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: fsmap 3 up:standby 2024-05-20T17:30:43.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:43 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: Deploying daemon mds.d on smithi135 2024-05-20T17:30:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:43.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.135:6834/185728746,v1:172.21.15.135:6835/185728746] up:boot 2024-05-20T17:30:43.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: fsmap 3 up:standby 2024-05-20T17:30:43.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:43 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:30:44.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:44.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 -- 172.21.15.135:0/3339662066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c101970 msgr2=0x7f593c102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 --2- 172.21.15.135:0/3339662066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c101970 0x7f593c102670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5934009900 tx=0x7f593402a410 comp rx=0 tx=0).stop 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 -- 172.21.15.135:0/3339662066 shutdown_connections 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 --2- 172.21.15.135:0/3339662066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c1078b0 0x7f593c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 --2- 172.21.15.135:0/3339662066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c102bb0 0x7f593c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 --2- 172.21.15.135:0/3339662066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c101970 0x7f593c102670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 -- 172.21.15.135:0/3339662066 >> 172.21.15.135:0/3339662066 conn(0x7f593c0fcb80 msgr2=0x7f593c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 -- 172.21.15.135:0/3339662066 shutdown_connections 2024-05-20T17:30:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.173+0000 7f5943137640 1 -- 172.21.15.135:0/3339662066 wait complete. 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 Processor -- start 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 -- start start 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c101970 0x7f593c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c1078b0 0x7f593c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10d5c0 con 0x7f593c102bb0 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10d440 con 0x7f593c101970 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5943137640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10d740 con 0x7f593c1078b0 2024-05-20T17:30:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58886/0 (socket says 172.21.15.135:58886) 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 -- 172.21.15.135:0/243144699 learned_addr learned my addr 172.21.15.135:0/243144699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f59416d4640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c1078b0 0x7f593c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f5940ed3640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c101970 0x7f593c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 -- 172.21.15.135:0/243144699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c1078b0 msgr2=0x7f593c19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c1078b0 0x7f593c19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 -- 172.21.15.135:0/243144699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c101970 msgr2=0x7f593c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c101970 0x7f593c1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.174+0000 7f593bfff640 1 -- 172.21.15.135:0/243144699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c19fd00 con 0x7f593c102bb0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f593bfff640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f592c00ea80 tx=0x7f592c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00ce40 con 0x7f593c102bb0 2024-05-20T17:30:44.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f592c005020 con 0x7f593c102bb0 2024-05-20T17:30:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c19fff0 con 0x7f593c102bb0 2024-05-20T17:30:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c011760 con 0x7f593c102bb0 2024-05-20T17:30:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.175+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c1a0400 con 0x7f593c102bb0 2024-05-20T17:30:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.176+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c1066c0 con 0x7f593c102bb0 2024-05-20T17:30:44.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.177+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f592c0051d0 con 0x7f593c102bb0 2024-05-20T17:30:44.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.178+0000 7f5939ffb640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 0x7f59280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:44.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.178+0000 7f5940ed3640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 0x7f59280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:44.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.178+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f592c0cf270 con 0x7f593c102bb0 2024-05-20T17:30:44.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.179+0000 7f5940ed3640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 0x7f59280a50a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5934009230 tx=0x7f5934031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:44.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.183+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f592c016030 con 0x7f593c102bb0 2024-05-20T17:30:44.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.413+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f593c02d4c0 con 0x7f593c102bb0 2024-05-20T17:30:44.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.414+0000 7f5939ffb640 1 -- 172.21.15.135:0/243144699 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7f592c09c670 con 0x7f593c102bb0 2024-05-20T17:30:44.415 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:44.415 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:30:44.415 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 4 2024-05-20T17:30:44.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 msgr2=0x7f59280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 0x7f59280a50a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5934009230 tx=0x7f5934031400 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 msgr2=0x7f593c198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f592c00ea80 tx=0x7f592c00ef40 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 shutdown_connections 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f59280a2b90 0x7f59280a50a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593c1078b0 0x7f593c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f593c102bb0 0x7f593c198700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 --2- 172.21.15.135:0/243144699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f593c101970 0x7f593c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 >> 172.21.15.135:0/243144699 conn(0x7f593c0fcb80 msgr2=0x7f593c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 shutdown_connections 2024-05-20T17:30:44.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:44.416+0000 7f5943137640 1 -- 172.21.15.135:0/243144699 wait complete. 2024-05-20T17:30:44.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:44 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/243144699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/243144699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:44.704 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:44 smithi135 systemd[1]: Starting Ceph mds.d for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:44.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:44 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/243144699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:45.120 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:44 smithi135 podman[70228]: 2024-05-20 17:30:44.738287626 +0000 UTC m=+0.017669008 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:45.120 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:44 smithi135 podman[70228]: 2024-05-20 17:30:44.874684913 +0000 UTC m=+0.154066330 container create b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-05-20T17:30:45.120 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 podman[70228]: 2024-05-20 17:30:45.11893353 +0000 UTC m=+0.398314904 container init b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5) 2024-05-20T17:30:45.454 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 podman[70228]: 2024-05-20 17:30:45.12205867 +0000 UTC m=+0.401440045 container start b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-20T17:30:45.454 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mds[70247]: -- 172.21.15.135:0/1268817660 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ac0c93a40 con 0x557ac0d0b180 2024-05-20T17:30:45.454 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d[70243]: starting mds.d at 2024-05-20T17:30:45.454 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 bash[70228]: b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea 2024-05-20T17:30:45.454 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:30:45 smithi135 systemd[1]: Started Ceph mds.d for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:45.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:45 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:45 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:45.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:45 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:46.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:46.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 -- 172.21.15.135:0/3879226168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 msgr2=0x7f7f14109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:46.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 --2- 172.21.15.135:0/3879226168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f14109480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009ca0 tx=0x7f7f0c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 -- 172.21.15.135:0/3879226168 shutdown_connections 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 --2- 172.21.15.135:0/3879226168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f14109480 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 --2- 172.21.15.135:0/3879226168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f14102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 --2- 172.21.15.135:0/3879226168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f14101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 -- 172.21.15.135:0/3879226168 >> 172.21.15.135:0/3879226168 conn(0x7f7f140fc2f0 msgr2=0x7f7f140fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 -- 172.21.15.135:0/3879226168 shutdown_connections 2024-05-20T17:30:46.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.557+0000 7f7f1a261640 1 -- 172.21.15.135:0/3879226168 wait complete. 2024-05-20T17:30:46.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 Processor -- start 2024-05-20T17:30:46.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 -- start start 2024-05-20T17:30:46.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f140fe180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f140fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410cd90 con 0x7f7f14107060 2024-05-20T17:30:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410cc10 con 0x7f7f14101120 2024-05-20T17:30:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f1a261640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410cf10 con 0x7f7f14102360 2024-05-20T17:30:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58924/0 (socket says 172.21.15.135:58924) 2024-05-20T17:30:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f13fff640 1 -- 172.21.15.135:0/2683939751 learned_addr learned my addr 172.21.15.135:0/2683939751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f140fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f12ffd640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f140fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 -- 172.21.15.135:0/2683939751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 msgr2=0x7f7f140fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f140fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 -- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 msgr2=0x7f7f140fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.558+0000 7f7f137fe640 1 -- 172.21.15.135:0/2683939751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f140fd490 con 0x7f7f14101120 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f12ffd640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f140fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f13fff640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f137fe640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f140fe180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f141009f0 tx=0x7f7f0400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400cc40 con 0x7f7f14101120 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f141a32c0 con 0x7f7f14101120 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f0400cde0 con 0x7f7f14101120 2024-05-20T17:30:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04010430 con 0x7f7f14101120 2024-05-20T17:30:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.559+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f141a3780 con 0x7f7f14101120 2024-05-20T17:30:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.560+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f141a3a40 con 0x7f7f14101120 2024-05-20T17:30:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.561+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7f04043ae0 con 0x7f7f14101120 2024-05-20T17:30:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.562+0000 7f7f10ff9640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 0x7f7efc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.562+0000 7f7f12ffd640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 0x7f7efc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.562+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7f040cf120 con 0x7f7f14101120 2024-05-20T17:30:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.562+0000 7f7f12ffd640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 0x7f7efc0a50a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7f08005fd0 tx=0x7f7f08005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.566+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7f0409c480 con 0x7f7f14101120 2024-05-20T17:30:46.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:46 smithi160 ceph-mon[36261]: Deploying daemon mds.e on smithi160 2024-05-20T17:30:46.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:46 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.135:6836/456498361,v1:172.21.15.135:6837/456498361] up:boot 2024-05-20T17:30:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:46 smithi160 ceph-mon[36261]: fsmap 4 up:standby 2024-05-20T17:30:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:46 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:30:46.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.781+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f141a3c10 con 0x7f7f14101120 2024-05-20T17:30:46.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.782+0000 7f7f10ff9640 1 -- 172.21.15.135:0/2683939751 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f7f0409bd80 con 0x7f7f14101120 2024-05-20T17:30:46.784 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:46.784 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:30:46.784 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 5 2024-05-20T17:30:46.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.784+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 msgr2=0x7f7efc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:46.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.784+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 0x7f7efc0a50a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7f08005fd0 tx=0x7f7f08005850 comp rx=0 tx=0).stop 2024-05-20T17:30:46.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.784+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 msgr2=0x7f7f140fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:46.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.784+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f140fe180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f141009f0 tx=0x7f7f0400ee50 comp rx=0 tx=0).stop 2024-05-20T17:30:46.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.784+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 shutdown_connections 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7efc0a2b90 0x7f7efc0a50a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f14107060 0x7f7f140fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14102360 0x7f7f140fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 --2- 172.21.15.135:0/2683939751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f14101120 0x7f7f140fe180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 >> 172.21.15.135:0/2683939751 conn(0x7f7f140fc2f0 msgr2=0x7f7f141084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 shutdown_connections 2024-05-20T17:30:46.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:46.785+0000 7f7f1a261640 1 -- 172.21.15.135:0/2683939751 wait complete. 2024-05-20T17:30:46.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:46 smithi135 ceph-mon[32027]: Deploying daemon mds.e on smithi160 2024-05-20T17:30:46.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:46 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.135:6836/456498361,v1:172.21.15.135:6837/456498361] up:boot 2024-05-20T17:30:46.796 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:46 smithi135 ceph-mon[32027]: fsmap 4 up:standby 2024-05-20T17:30:46.797 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:46 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:30:46.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:46 smithi172 ceph-mon[36511]: Deploying daemon mds.e on smithi160 2024-05-20T17:30:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:46 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.135:6836/456498361,v1:172.21.15.135:6837/456498361] up:boot 2024-05-20T17:30:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:46 smithi172 ceph-mon[36511]: fsmap 4 up:standby 2024-05-20T17:30:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:46 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:30:47.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:47 smithi172 ceph-mon[36511]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:47.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:47 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2683939751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:47 smithi160 ceph-mon[36261]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:47 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2683939751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:47.756 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:47 smithi160 systemd[1]: Starting Ceph mds.e for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:47 smithi135 ceph-mon[32027]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:47 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2683939751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:48.033 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:47 smithi160 podman[65592]: 2024-05-20 17:30:47.660446992 +0000 UTC m=+0.017172605 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:48.033 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:47 smithi160 podman[65592]: 2024-05-20 17:30:47.769210781 +0000 UTC m=+0.125936395 container create 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-20T17:30:48.033 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:47 smithi160 podman[65592]: 2024-05-20 17:30:47.9968081 +0000 UTC m=+0.353533692 container init 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-20T17:30:48.033 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:47 smithi160 podman[65592]: 2024-05-20 17:30:47.999388315 +0000 UTC m=+0.356113915 container start 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-05-20T17:30:48.506 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:48 smithi160 ceph-mds[65611]: -- 172.21.15.160:0/360441006 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f73ef5a40 con 0x561f73f6d600 2024-05-20T17:30:48.506 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: starting mds.e at 2024-05-20T17:30:48.507 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:48 smithi160 bash[65592]: 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd 2024-05-20T17:30:48.507 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:30:48 smithi160 systemd[1]: Started Ceph mds.e for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:48.798 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:48.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 -- 172.21.15.135:0/176302205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 msgr2=0x7fa53c102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 --2- 172.21.15.135:0/176302205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c102670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009ca0 tx=0x7fa52c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 -- 172.21.15.135:0/176302205 shutdown_connections 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 --2- 172.21.15.135:0/176302205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 0x7fa53c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 --2- 172.21.15.135:0/176302205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 0x7fa53c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 --2- 172.21.15.135:0/176302205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c102670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 -- 172.21.15.135:0/176302205 >> 172.21.15.135:0/176302205 conn(0x7fa53c0fcb80 msgr2=0x7fa53c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 -- 172.21.15.135:0/176302205 shutdown_connections 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 -- 172.21.15.135:0/176302205 wait complete. 2024-05-20T17:30:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.921+0000 7fa54138f640 1 Processor -- start 2024-05-20T17:30:48.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 -- start start 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 0x7fa53c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 0x7fa53c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d5a0 con 0x7fa53c101970 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d420 con 0x7fa53c102bb0 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa54138f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d720 con 0x7fa53c1078b0 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58946/0 (socket says 172.21.15.135:58946) 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 -- 172.21.15.135:0/4035310465 learned_addr learned my addr 172.21.15.135:0/4035310465 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53b7fe640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 0x7fa53c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53a7fc640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 0x7fa53c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 -- 172.21.15.135:0/4035310465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 msgr2=0x7fa53c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 0x7fa53c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 -- 172.21.15.135:0/4035310465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 msgr2=0x7fa53c19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 0x7fa53c19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.922+0000 7fa53affd640 1 -- 172.21.15.135:0/4035310465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c1a0d90 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa53affd640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa52c000f80 tx=0x7fa52c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c02faa0 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c1a1020 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa52c02fc40 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c03a7f0 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.923+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c1a15c0 con 0x7fa53c101970 2024-05-20T17:30:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.924+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53c1066c0 con 0x7fa53c101970 2024-05-20T17:30:48.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.925+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa52c030bc0 con 0x7fa53c101970 2024-05-20T17:30:48.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.926+0000 7fa523fff640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 0x7fa5240a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:48.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.926+0000 7fa53a7fc640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 0x7fa5240a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:48.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.926+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa52c0f02a0 con 0x7fa53c101970 2024-05-20T17:30:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.926+0000 7fa53a7fc640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 0x7fa5240a50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa53c069250 tx=0x7fa53000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:48.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:48.930+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa52c0bd730 con 0x7fa53c101970 2024-05-20T17:30:49.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.141+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa53c02d2a0 con 0x7fa53c101970 2024-05-20T17:30:49.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.142+0000 7fa523fff640 1 -- 172.21.15.135:0/4035310465 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7fa52c0bd030 con 0x7fa53c101970 2024-05-20T17:30:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:49.143 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-20T17:30:49.144 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-20T17:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 msgr2=0x7fa5240a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 0x7fa5240a50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa53c069250 tx=0x7fa53000b390 comp rx=0 tx=0).stop 2024-05-20T17:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 msgr2=0x7fa53c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa52c000f80 tx=0x7fa52c031ee0 comp rx=0 tx=0).stop 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 shutdown_connections 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa5240a2b90 0x7fa5240a50a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53c1078b0 0x7fa53c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa53c102bb0 0x7fa53c19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 --2- 172.21.15.135:0/4035310465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53c101970 0x7fa53c0698b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 >> 172.21.15.135:0/4035310465 conn(0x7fa53c0fcb80 msgr2=0x7fa53c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 shutdown_connections 2024-05-20T17:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:49.144+0000 7fa54138f640 1 -- 172.21.15.135:0/4035310465 wait complete. 2024-05-20T17:30:49.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: Deploying daemon mds.f on smithi172 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6834/4160320010,v1:172.21.15.160:6835/4160320010] up:boot 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: fsmap 5 up:standby 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:49.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:49 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4035310465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: Deploying daemon mds.f on smithi172 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6834/4160320010,v1:172.21.15.160:6835/4160320010] up:boot 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: fsmap 5 up:standby 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:30:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:49.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:49 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4035310465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: Deploying daemon mds.f on smithi172 2024-05-20T17:30:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6834/4160320010,v1:172.21.15.160:6835/4160320010] up:boot 2024-05-20T17:30:49.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: fsmap 5 up:standby 2024-05-20T17:30:49.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:30:49.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:49.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:49 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4035310465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:50.330 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 systemd[1]: Starting Ceph mds.f for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:50.625 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 podman[67207]: 2024-05-20 17:30:50.273460369 +0000 UTC m=+0.017218003 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:50.626 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 podman[67207]: 2024-05-20 17:30:50.386070959 +0000 UTC m=+0.129828625 container create 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-20T17:30:50.626 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 podman[67207]: 2024-05-20 17:30:50.588721447 +0000 UTC m=+0.332479068 container init 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-20T17:30:50.626 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 podman[67207]: 2024-05-20 17:30:50.591209628 +0000 UTC m=+0.334967241 container start 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:30:51.080 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 ceph-mds[67226]: -- 172.21.15.172:0/1560791595 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b33bedfa40 con 0x55b33bf57a80 2024-05-20T17:30:51.080 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: starting mds.f at 2024-05-20T17:30:51.080 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 bash[67207]: 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd 2024-05-20T17:30:51.080 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:30:50 smithi172 systemd[1]: Started Ceph mds.f for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:51.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:51.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- 172.21.15.135:0/1538039896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40102bf0 msgr2=0x7fdf40103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:51.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 --2- 172.21.15.135:0/1538039896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40102bf0 0x7fdf40103000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009900 tx=0x7fdf2802a410 comp rx=0 tx=0).stop 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- 172.21.15.135:0/1538039896 shutdown_connections 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 --2- 172.21.15.135:0/1538039896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf401078f0 0x7fdf40109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 --2- 172.21.15.135:0/1538039896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40102bf0 0x7fdf40103000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 --2- 172.21.15.135:0/1538039896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401019b0 0x7fdf401026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- 172.21.15.135:0/1538039896 >> 172.21.15.135:0/1538039896 conn(0x7fdf400fcba0 msgr2=0x7fdf400ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- 172.21.15.135:0/1538039896 shutdown_connections 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- 172.21.15.135:0/1538039896 wait complete. 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 Processor -- start 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.282+0000 7fdf45861640 1 -- start start 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:51.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf40102bf0 0x7fdf40199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401078f0 0x7fdf401a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4010e790 con 0x7fdf401019b0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4010e610 con 0x7fdf40102bf0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4010e910 con 0x7fdf401078f0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41372/0 (socket says 172.21.15.135:41372) 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 -- 172.21.15.135:0/2884126822 learned_addr learned my addr 172.21.15.135:0/2884126822 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3f7fe640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401078f0 0x7fdf401a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf37fff640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf40102bf0 0x7fdf40199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 -- 172.21.15.135:0/2884126822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401078f0 msgr2=0x7fdf401a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401078f0 0x7fdf401a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 -- 172.21.15.135:0/2884126822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf40102bf0 msgr2=0x7fdf40199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf40102bf0 0x7fdf40199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 -- 172.21.15.135:0/2884126822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401a10d0 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf3effd640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e9f0 tx=0x7fdf3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000ccc0 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf300035f0 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000ce60 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401a13c0 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.283+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf401a1910 con 0x7fdf401019b0 2024-05-20T17:30:51.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.284+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf40106700 con 0x7fdf401019b0 2024-05-20T17:30:51.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.286+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdf300037a0 con 0x7fdf401019b0 2024-05-20T17:30:51.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.286+0000 7fdf4485f640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 0x7fdf2c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:51.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.287+0000 7fdf37fff640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 0x7fdf2c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:51.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.287+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fdf300cf240 con 0x7fdf401019b0 2024-05-20T17:30:51.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.287+0000 7fdf37fff640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 0x7fdf2c0a5120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006010 tx=0x7fdf28031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:51.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.290+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdf3009c640 con 0x7fdf401019b0 2024-05-20T17:30:51.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.503+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf40068b20 con 0x7fdf401019b0 2024-05-20T17:30:51.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.504+0000 7fdf4485f640 1 -- 172.21.15.135:0/2884126822 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7fdf3009bf40 con 0x7fdf401019b0 2024-05-20T17:30:51.506 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-20T17:30:51.506 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 msgr2=0x7fdf2c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 0x7fdf2c0a5120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006010 tx=0x7fdf28031400 comp rx=0 tx=0).stop 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 msgr2=0x7fdf40199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e9f0 tx=0x7fdf3000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 shutdown_connections 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fdf2c0a2c10 0x7fdf2c0a5120 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf401078f0 0x7fdf401a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf40102bf0 0x7fdf40199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 --2- 172.21.15.135:0/2884126822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf401019b0 0x7fdf40199590 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:51.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 >> 172.21.15.135:0/2884126822 conn(0x7fdf400fcba0 msgr2=0x7fdf401038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:51.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 shutdown_connections 2024-05-20T17:30:51.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:51.506+0000 7fdf45861640 1 -- 172.21.15.135:0/2884126822 wait complete. 2024-05-20T17:30:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6834/3094095088,v1:172.21.15.172:6835/3094095088] up:boot 2024-05-20T17:30:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: fsmap 6 up:standby 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:51 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2884126822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6834/3094095088,v1:172.21.15.172:6835/3094095088] up:boot 2024-05-20T17:30:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: fsmap 6 up:standby 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:51 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2884126822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6834/3094095088,v1:172.21.15.172:6835/3094095088] up:boot 2024-05-20T17:30:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: fsmap 6 up:standby 2024-05-20T17:30:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:30:52.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:52.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:51 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2884126822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:52.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:52 smithi135 ceph-mon[32027]: Deploying daemon mds.c on smithi172 2024-05-20T17:30:53.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:52 smithi160 ceph-mon[36261]: Deploying daemon mds.c on smithi172 2024-05-20T17:30:53.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:52 smithi172 ceph-mon[36511]: Deploying daemon mds.c on smithi172 2024-05-20T17:30:53.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:52 smithi172 systemd[1]: Starting Ceph mds.c for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:53.397 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 podman[67510]: 2024-05-20 17:30:52.993295167 +0000 UTC m=+0.017019965 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:53.397 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 podman[67510]: 2024-05-20 17:30:53.126533785 +0000 UTC m=+0.150258561 container create e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:30:53.397 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 podman[67510]: 2024-05-20 17:30:53.396428853 +0000 UTC m=+0.420153636 container init e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-20T17:30:53.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:53.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 -- 172.21.15.135:0/4140860412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84201078d0 msgr2=0x7f8420109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:53.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 --2- 172.21.15.135:0/4140860412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84201078d0 0x7f8420109cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8418009ca0 tx=0x7f841802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 -- 172.21.15.135:0/4140860412 shutdown_connections 2024-05-20T17:30:53.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 --2- 172.21.15.135:0/4140860412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84201078d0 0x7f8420109cf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 --2- 172.21.15.135:0/4140860412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f8420102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 --2- 172.21.15.135:0/4140860412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8420101990 0x7f8420102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 -- 172.21.15.135:0/4140860412 >> 172.21.15.135:0/4140860412 conn(0x7f84200fcba0 msgr2=0x7f84200ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.645+0000 7f842554b640 1 -- 172.21.15.135:0/4140860412 shutdown_connections 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.646+0000 7f842554b640 1 -- 172.21.15.135:0/4140860412 wait complete. 2024-05-20T17:30:53.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.646+0000 7f842554b640 1 Processor -- start 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.646+0000 7f842554b640 1 -- start start 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f842019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 0x7f84201a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f842010d610 con 0x7f8420101990 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f842010d490 con 0x7f84201078d0 2024-05-20T17:30:53.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f842010d790 con 0x7f8420102bd0 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41404/0 (socket says 172.21.15.135:41404) 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 -- 172.21.15.135:0/3713161280 learned_addr learned my addr 172.21.15.135:0/3713161280 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841e7fc640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f842019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841f7fe640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 0x7f84201a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 -- 172.21.15.135:0/3713161280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 msgr2=0x7f842019e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f842019e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 -- 172.21.15.135:0/3713161280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 msgr2=0x7f84201a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 0x7f84201a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 -- 172.21.15.135:0/3713161280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201a0df0 con 0x7f8420101990 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841e7fc640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f842019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841f7fe640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 0x7f84201a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:30:53.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f841effd640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9f0 tx=0x7f841000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000ccc0 con 0x7f8420101990 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84201a10e0 con 0x7f8420101990 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84100035f0 con 0x7f8420101990 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000ce60 con 0x7f8420101990 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.647+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a1680 con 0x7f8420101990 2024-05-20T17:30:53.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.649+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84201066e0 con 0x7f8420101990 2024-05-20T17:30:53.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.650+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8410004020 con 0x7f8420101990 2024-05-20T17:30:53.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.650+0000 7f8407fff640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 0x7f84080a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:53.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.651+0000 7f841e7fc640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 0x7f84080a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:53.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.651+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f84100cef50 con 0x7f8420101990 2024-05-20T17:30:53.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.651+0000 7f841e7fc640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 0x7f84080a50a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8420074190 tx=0x7f8414005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:53.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.656+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f841009c350 con 0x7f8420101990 2024-05-20T17:30:53.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 podman[67510]: 2024-05-20 17:30:53.39943582 +0000 UTC m=+0.423160610 container start e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:30:53.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mds[67529]: -- 172.21.15.172:0/1999486541 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b595c8da40 con 0x55b595d05180 2024-05-20T17:30:53.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: starting mds.c at 2024-05-20T17:30:53.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 bash[67510]: e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 2024-05-20T17:30:53.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:30:53 smithi172 systemd[1]: Started Ceph mds.c for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:53.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.869+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8420062750 con 0x7f8420101990 2024-05-20T17:30:53.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.870+0000 7f8407fff640 1 -- 172.21.15.135:0/3713161280 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7f841009bc50 con 0x7f8420101990 2024-05-20T17:30:53.871 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:53.871 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-20T17:30:53.871 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 8 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 msgr2=0x7f84080a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 0x7f84080a50a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8420074190 tx=0x7f8414005f90 comp rx=0 tx=0).stop 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 msgr2=0x7f8420074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9f0 tx=0x7f841000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 shutdown_connections 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f84080a2b90 0x7f84080a50a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84201078d0 0x7f84201a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8420102bd0 0x7f842019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 --2- 172.21.15.135:0/3713161280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8420101990 0x7f8420074780 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:53.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.871+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 >> 172.21.15.135:0/3713161280 conn(0x7f84200fcba0 msgr2=0x7f84201038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:53.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.872+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 shutdown_connections 2024-05-20T17:30:53.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:53.872+0000 7f842554b640 1 -- 172.21.15.135:0/3713161280 wait complete. 2024-05-20T17:30:53.883 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:53.884 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:53 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:54.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:53 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:54.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:53 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:54.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:54 smithi160 ceph-mon[36261]: Deploying daemon mds.h on smithi160 2024-05-20T17:30:54.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:54 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6836/3276473516,v1:172.21.15.172:6837/3276473516] up:boot 2024-05-20T17:30:54.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:54 smithi160 ceph-mon[36261]: fsmap 7 up:standby 2024-05-20T17:30:54.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:54 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:30:54.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:54 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3713161280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:54.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:54 smithi135 ceph-mon[32027]: Deploying daemon mds.h on smithi160 2024-05-20T17:30:54.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:54 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6836/3276473516,v1:172.21.15.172:6837/3276473516] up:boot 2024-05-20T17:30:54.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:54 smithi135 ceph-mon[32027]: fsmap 7 up:standby 2024-05-20T17:30:54.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:54 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:30:54.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:54 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3713161280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:55.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:54 smithi172 ceph-mon[36511]: Deploying daemon mds.h on smithi160 2024-05-20T17:30:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:54 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6836/3276473516,v1:172.21.15.172:6837/3276473516] up:boot 2024-05-20T17:30:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:54 smithi172 ceph-mon[36511]: fsmap 7 up:standby 2024-05-20T17:30:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:54 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:30:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:54 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3713161280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:55.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:55 smithi135 ceph-mon[32027]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:56.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:55 smithi160 ceph-mon[36261]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:56.007 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:55 smithi160 systemd[1]: Starting Ceph mds.h for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 -- 172.21.15.135:0/1204793458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1041078b0 msgr2=0x7fc104109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 --2- 172.21.15.135:0/1204793458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1041078b0 0x7fc104109cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009900 tx=0x7fc0fc02a410 comp rx=0 tx=0).stop 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 -- 172.21.15.135:0/1204793458 shutdown_connections 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 --2- 172.21.15.135:0/1204793458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1041078b0 0x7fc104109cd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 --2- 172.21.15.135:0/1204793458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102bb0 0x7fc104102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 --2- 172.21.15.135:0/1204793458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104101970 0x7fc104102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 -- 172.21.15.135:0/1204793458 >> 172.21.15.135:0/1204793458 conn(0x7fc1040fcb80 msgr2=0x7fc1040ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 -- 172.21.15.135:0/1204793458 shutdown_connections 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.009+0000 7fc10a157640 1 -- 172.21.15.135:0/1204793458 wait complete. 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 Processor -- start 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 -- start start 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104102bb0 0x7fc10419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 0x7fc1041a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc10410d5d0 con 0x7fc104101970 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc10410d450 con 0x7fc104102bb0 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc10a157640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc10410d750 con 0x7fc1041078b0 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41434/0 (socket says 172.21.15.135:41434) 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc1037fe640 1 -- 172.21.15.135:0/3648359306 learned_addr learned my addr 172.21.15.135:0/3648359306 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc103fff640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 0x7fc1041a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.010+0000 7fc102ffd640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104102bb0 0x7fc10419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 -- 172.21.15.135:0/3648359306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 msgr2=0x7fc1041a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 0x7fc1041a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 -- 172.21.15.135:0/3648359306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104102bb0 msgr2=0x7fc10419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104102bb0 0x7fc10419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 -- 172.21.15.135:0/3648359306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1041a0d20 con 0x7fc104101970 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc103fff640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 0x7fc1041a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc1037fe640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400eb90 tx=0x7fc0f400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4003b70 con 0x7fc104101970 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f400ee90 con 0x7fc104101970 2024-05-20T17:30:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1041a0fb0 con 0x7fc104101970 2024-05-20T17:30:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4019820 con 0x7fc104101970 2024-05-20T17:30:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.011+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1041a1470 con 0x7fc104101970 2024-05-20T17:30:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.012+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1041066c0 con 0x7fc104101970 2024-05-20T17:30:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.014+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc0f40199c0 con 0x7fc104101970 2024-05-20T17:30:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.015+0000 7fc100ff9640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 0x7fc0ec0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.015+0000 7fc102ffd640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 0x7fc0ec0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.015+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc0f40cf600 con 0x7fc104101970 2024-05-20T17:30:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.015+0000 7fc102ffd640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 0x7fc0ec0a50a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc104069270 tx=0x7fc0f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:56.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.018+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc0f409ca90 con 0x7fc104101970 2024-05-20T17:30:56.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:55 smithi172 ceph-mon[36511]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:56.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.231+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc10402d2a0 con 0x7fc104101970 2024-05-20T17:30:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.232+0000 7fc100ff9640 1 -- 172.21.15.135:0/3648359306 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7fc0f4003d10 con 0x7fc104101970 2024-05-20T17:30:56.233 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:56.233 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-20T17:30:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 8 2024-05-20T17:30:56.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 msgr2=0x7fc0ec0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:56.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 0x7fc0ec0a50a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc104069270 tx=0x7fc0f8005f90 comp rx=0 tx=0).stop 2024-05-20T17:30:56.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 msgr2=0x7fc104069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:56.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400eb90 tx=0x7fc0f400c6a0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 shutdown_connections 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc0ec0a2b90 0x7fc0ec0a50a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1041078b0 0x7fc1041a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc104102bb0 0x7fc10419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 --2- 172.21.15.135:0/3648359306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc104101970 0x7fc104069860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 >> 172.21.15.135:0/3648359306 conn(0x7fc1040fcb80 msgr2=0x7fc104103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 shutdown_connections 2024-05-20T17:30:56.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:56.234+0000 7fc10a157640 1 -- 172.21.15.135:0/3648359306 wait complete. 2024-05-20T17:30:56.344 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 podman[65893]: 2024-05-20 17:30:55.993857758 +0000 UTC m=+0.017422819 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:56.344 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 podman[65893]: 2024-05-20 17:30:56.124279448 +0000 UTC m=+0.147844517 container create d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-20T17:30:56.344 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 podman[65893]: 2024-05-20 17:30:56.343157539 +0000 UTC m=+0.366722586 container init d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:30:56.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 podman[65893]: 2024-05-20 17:30:56.346143429 +0000 UTC m=+0.369708480 container start d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:30:56.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mds[65913]: -- 172.21.15.160:0/2094726182 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c874483a40 con 0x55c8744fba80 2024-05-20T17:30:56.708 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: starting mds.h at 2024-05-20T17:30:56.708 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 bash[65893]: d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 2024-05-20T17:30:56.708 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:30:56 smithi160 systemd[1]: Started Ceph mds.h for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:30:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3648359306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:56 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:57.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3648359306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:56 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3648359306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:30:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:30:57.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:30:57.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:56 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:30:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:57 smithi160 ceph-mon[36261]: Deploying daemon mds.i on smithi172 2024-05-20T17:30:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:57 smithi160 ceph-mon[36261]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:57 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:boot 2024-05-20T17:30:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:57 smithi160 ceph-mon[36261]: fsmap 8 up:standby 2024-05-20T17:30:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:57 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:30:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:57 smithi172 ceph-mon[36511]: Deploying daemon mds.i on smithi172 2024-05-20T17:30:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:57 smithi172 ceph-mon[36511]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:57 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:boot 2024-05-20T17:30:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:57 smithi172 ceph-mon[36511]: fsmap 8 up:standby 2024-05-20T17:30:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:57 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:30:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:57 smithi135 ceph-mon[32027]: Deploying daemon mds.i on smithi172 2024-05-20T17:30:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:57 smithi135 ceph-mon[32027]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:30:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:57 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:boot 2024-05-20T17:30:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:57 smithi135 ceph-mon[32027]: fsmap 8 up:standby 2024-05-20T17:30:58.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:57 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:30:58.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:30:58.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 -- 172.21.15.135:0/1328735415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c1078b0 msgr2=0x7f7b5c109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:58.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 --2- 172.21.15.135:0/1328735415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c109cd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009ca0 tx=0x7f7b5402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 -- 172.21.15.135:0/1328735415 shutdown_connections 2024-05-20T17:30:58.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 --2- 172.21.15.135:0/1328735415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c109cd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 --2- 172.21.15.135:0/1328735415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 --2- 172.21.15.135:0/1328735415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c101970 0x7f7b5c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 -- 172.21.15.135:0/1328735415 >> 172.21.15.135:0/1328735415 conn(0x7f7b5c0fcb80 msgr2=0x7f7b5c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 -- 172.21.15.135:0/1328735415 shutdown_connections 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 -- 172.21.15.135:0/1328735415 wait complete. 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.371+0000 7f7b61909640 1 Processor -- start 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 -- start start 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c101970 0x7f7b5c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c10d5f0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c10d470 con 0x7f7b5c101970 2024-05-20T17:30:58.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b61909640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c10d770 con 0x7f7b5c1078b0 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41448/0 (socket says 172.21.15.135:41448) 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 -- 172.21.15.135:0/506221427 learned_addr learned my addr 172.21.15.135:0/506221427 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5affd640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c101970 0x7f7b5c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5b7fe640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 -- 172.21.15.135:0/506221427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c1078b0 msgr2=0x7f7b5c19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 -- 172.21.15.135:0/506221427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c101970 msgr2=0x7f7b5c198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:58.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c101970 0x7f7b5c198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 -- 172.21.15.135:0/506221427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c19fbd0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.372+0000 7f7b5a7fc640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c920 tx=0x7f7b4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.373+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c007c70 con 0x7f7b5c102bb0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.373+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c19fec0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.373+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b4c007e10 con 0x7f7b5c102bb0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.373+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c018890 con 0x7f7b5c102bb0 2024-05-20T17:30:58.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.373+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1a0380 con 0x7f7b5c102bb0 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.374+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5c1066c0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.375+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7b4c018a50 con 0x7f7b5c102bb0 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.376+0000 7f7b60907640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 0x7f7b480a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.376+0000 7f7b5affd640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 0x7f7b480a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.376+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7b4c0ceed0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.376+0000 7f7b5affd640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 0x7f7b480a50a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c102570 tx=0x7f7b44005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:30:58.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.380+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b4c014030 con 0x7f7b5c102bb0 2024-05-20T17:30:58.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.591+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b5c02d2a0 con 0x7f7b5c102bb0 2024-05-20T17:30:58.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.592+0000 7f7b60907640 1 -- 172.21.15.135:0/506221427 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7183 (secure 0 0 0) 0x7f7b4c09c360 con 0x7f7b5c102bb0 2024-05-20T17:30:58.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:30:58.593 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-20T17:30:58.593 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 9 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.593+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 msgr2=0x7f7b480a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 0x7f7b480a50a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c102570 tx=0x7f7b44005f90 comp rx=0 tx=0).stop 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 msgr2=0x7f7b5c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c920 tx=0x7f7b4c00cde0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 shutdown_connections 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f7b480a2b90 0x7f7b480a50a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5c1078b0 0x7f7b5c19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5c102bb0 0x7f7b5c198680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 --2- 172.21.15.135:0/506221427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5c101970 0x7f7b5c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:30:58.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 >> 172.21.15.135:0/506221427 conn(0x7f7b5c0fcb80 msgr2=0x7f7b5c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:30:58.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 shutdown_connections 2024-05-20T17:30:58.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:30:58.594+0000 7f7b61909640 1 -- 172.21.15.135:0/506221427 wait complete. 2024-05-20T17:30:58.722 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:58 smithi172 systemd[1]: Starting Ceph mds.i for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:30:58.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:58 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/506221427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:58.991 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:58 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/506221427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:58.991 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:58 smithi172 podman[67810]: 2024-05-20 17:30:58.757658281 +0000 UTC m=+0.017438391 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:30:58.991 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:58 smithi172 podman[67810]: 2024-05-20 17:30:58.866053482 +0000 UTC m=+0.125833630 container create e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-20T17:30:59.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:58 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/506221427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 podman[67810]: 2024-05-20 17:30:59.093656035 +0000 UTC m=+0.353436138 container init e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0) 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 podman[67810]: 2024-05-20 17:30:59.096495388 +0000 UTC m=+0.356275498 container start e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mds[67829]: -- 172.21.15.172:0/254212677 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f0c8299a40 con 0x55f0c8311180 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: starting mds.i at 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 bash[67810]: e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 2024-05-20T17:30:59.330 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:30:59 smithi172 systemd[1]: Started Ceph mds.i for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:31:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:30:59 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:00.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:00.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:30:59 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:30:59 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:00.608 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 -- 172.21.15.135:0/2404633261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 msgr2=0x7fd2f0103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 --2- 172.21.15.135:0/2404633261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f0103770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009900 tx=0x7fd2ec02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 -- 172.21.15.135:0/2404633261 shutdown_connections 2024-05-20T17:31:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 --2- 172.21.15.135:0/2404633261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 0x7fd2f0106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 --2- 172.21.15.135:0/2404633261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 0x7fd2f01060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 --2- 172.21.15.135:0/2404633261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f0103770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.723+0000 7fd2f7892640 1 -- 172.21.15.135:0/2404633261 >> 172.21.15.135:0/2404633261 conn(0x7fd2f00fcb80 msgr2=0x7fd2f00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 -- 172.21.15.135:0/2404633261 shutdown_connections 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 -- 172.21.15.135:0/2404633261 wait complete. 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 Processor -- start 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 -- start start 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.724+0000 7fd2f7892640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 0x7fd2f019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 0x7fd2f01a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0114ce0 con 0x7fd2f0101350 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0114b60 con 0x7fd2f0106610 2024-05-20T17:31:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0114e60 con 0x7fd2f0103cb0 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43432/0 (socket says 172.21.15.135:43432) 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 -- 172.21.15.135:0/3017572074 learned_addr learned my addr 172.21.15.135:0/3017572074 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f4e2d640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 0x7fd2f019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f5e2f640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 0x7fd2f01a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 -- 172.21.15.135:0/3017572074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 msgr2=0x7fd2f019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 0x7fd2f019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 -- 172.21.15.135:0/3017572074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 msgr2=0x7fd2f01a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 0x7fd2f01a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 -- 172.21.15.135:0/3017572074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f01a7400 con 0x7fd2f0101350 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f562e640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005ab0 tx=0x7fd2ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec03f030 con 0x7fd2f0101350 2024-05-20T17:31:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2ec003ad0 con 0x7fd2f0101350 2024-05-20T17:31:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f01a7690 con 0x7fd2f0101350 2024-05-20T17:31:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec035070 con 0x7fd2f0101350 2024-05-20T17:31:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.725+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f01a7b80 con 0x7fd2f0101350 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.726+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f00fe6a0 con 0x7fd2f0101350 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.728+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd2ec042030 con 0x7fd2f0101350 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.729+0000 7fd2e67fc640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.729+0000 7fd2f4e2d640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.729+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd2ec0ef440 con 0x7fd2f0101350 2024-05-20T17:31:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.729+0000 7fd2f4e2d640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2f01a0960 tx=0x7fd2e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.732+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd2ec0bc1f0 con 0x7fd2f0101350 2024-05-20T17:31:00.900 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:00 smithi135 ceph-mon[32027]: Deploying daemon mds.g on smithi135 2024-05-20T17:31:00.900 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:00 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:boot 2024-05-20T17:31:00.900 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:00 smithi135 ceph-mon[32027]: fsmap 9 up:standby 2024-05-20T17:31:00.900 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:00 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:31:00.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.955+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2f002d2a0 con 0x7fd2f0101350 2024-05-20T17:31:00.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.956+0000 7fd2e67fc640 1 -- 172.21.15.135:0/3017572074 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8010 (secure 0 0 0) 0x7fd2ec0c04f0 con 0x7fd2f0101350 2024-05-20T17:31:00.957 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:00.957 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:31:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-20T17:31:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 msgr2=0x7fd2dc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2f01a0960 tx=0x7fd2e0005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 msgr2=0x7fd2f019f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005ab0 tx=0x7fd2ec004270 comp rx=0 tx=0).stop 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 shutdown_connections 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f0106610 0x7fd2f01a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0103cb0 0x7fd2f019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 --2- 172.21.15.135:0/3017572074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f0101350 0x7fd2f019f8c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 >> 172.21.15.135:0/3017572074 conn(0x7fd2f00fcb80 msgr2=0x7fd2f0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 shutdown_connections 2024-05-20T17:31:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:00.958+0000 7fd2f7892640 1 -- 172.21.15.135:0/3017572074 wait complete. 2024-05-20T17:31:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:00 smithi160 ceph-mon[36261]: Deploying daemon mds.g on smithi135 2024-05-20T17:31:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:00 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:boot 2024-05-20T17:31:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:00 smithi160 ceph-mon[36261]: fsmap 9 up:standby 2024-05-20T17:31:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:00 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:31:01.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:00 smithi172 ceph-mon[36511]: Deploying daemon mds.g on smithi135 2024-05-20T17:31:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:00 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:boot 2024-05-20T17:31:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:00 smithi172 ceph-mon[36511]: fsmap 9 up:standby 2024-05-20T17:31:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:00 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:31:01.698 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:01 smithi135 systemd[1]: Starting Ceph mds.g for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:31:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:01 smithi135 ceph-mon[32027]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:01 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3017572074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:01.955 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:01 smithi135 podman[70832]: 2024-05-20 17:31:01.600254706 +0000 UTC m=+0.017466977 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:31:01.955 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:01 smithi135 podman[70832]: 2024-05-20 17:31:01.722714337 +0000 UTC m=+0.139926626 container create 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-20T17:31:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:01 smithi160 ceph-mon[36261]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:01 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3017572074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:02.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:01 smithi172 ceph-mon[36511]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:01 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3017572074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:02.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:01 smithi135 podman[70832]: 2024-05-20 17:31:01.994111983 +0000 UTC m=+0.411324262 container init 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS) 2024-05-20T17:31:02.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:01 smithi135 podman[70832]: 2024-05-20 17:31:01.997038895 +0000 UTC m=+0.414251165 container start 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-20T17:31:02.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:02 smithi135 ceph-mds[70851]: -- 172.21.15.135:0/497524655 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56311d553a40 con 0x56311d5cb600 2024-05-20T17:31:02.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g[70847]: starting mds.g at 2024-05-20T17:31:02.455 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:02 smithi135 bash[70832]: 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 2024-05-20T17:31:02.455 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:31:02 smithi135 systemd[1]: Started Ceph mds.g for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:31:02.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:03.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 -- 172.21.15.135:0/3716516382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0101f60 msgr2=0x7f73b0102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 --2- 172.21.15.135:0/3716516382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0101f60 0x7f73b0102370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009ca0 tx=0x7f73a002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 -- 172.21.15.135:0/3716516382 shutdown_connections 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 --2- 172.21.15.135:0/3716516382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0103620 0x7f73b0109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 --2- 172.21.15.135:0/3716516382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b0102ac0 0x7f73b0102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 --2- 172.21.15.135:0/3716516382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0101f60 0x7f73b0102370 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 -- 172.21.15.135:0/3716516382 >> 172.21.15.135:0/3716516382 conn(0x7f73b00fc2e0 msgr2=0x7f73b00fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 -- 172.21.15.135:0/3716516382 shutdown_connections 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 -- 172.21.15.135:0/3716516382 wait complete. 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.090+0000 7f73b6226640 1 Processor -- start 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 -- start start 2024-05-20T17:31:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0101f60 0x7f73b0199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 0x7f73b01a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010e940 con 0x7f73b0102ac0 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010e7c0 con 0x7f73b0101f60 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73b6226640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010eac0 con 0x7f73b019e540 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43486/0 (socket says 172.21.15.135:43486) 2024-05-20T17:31:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 -- 172.21.15.135:0/2093779245 learned_addr learned my addr 172.21.15.135:0/2093779245 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73af7fe640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0101f60 0x7f73b0199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73affff640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 0x7f73b01a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 -- 172.21.15.135:0/2093779245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 msgr2=0x7f73b01a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 0x7f73b01a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 -- 172.21.15.135:0/2093779245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0101f60 msgr2=0x7f73b0199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0101f60 0x7f73b0199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73aeffd640 1 -- 172.21.15.135:0/2093779245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b01a0f20 con 0x7f73b0102ac0 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.091+0000 7f73affff640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 0x7f73b01a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73aeffd640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c920 tx=0x7f73a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:03.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4007c70 con 0x7f73b0102ac0 2024-05-20T17:31:03.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b01a1210 con 0x7f73b0102ac0 2024-05-20T17:31:03.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a4007e10 con 0x7f73b0102ac0 2024-05-20T17:31:03.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4018890 con 0x7f73b0102ac0 2024-05-20T17:31:03.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.092+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b01a17b0 con 0x7f73b0102ac0 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.093+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b0068c20 con 0x7f73b0102ac0 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.094+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f73a4018a50 con 0x7f73b0102ac0 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.095+0000 7f73acff9640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 0x7f73980a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.095+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f73a40cef80 con 0x7f73b0102ac0 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.095+0000 7f73af7fe640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 0x7f73980a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:03.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.096+0000 7f73af7fe640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 0x7f73980a50a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73a0031c10 tx=0x7f73a0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:03.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.100+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f73a4014030 con 0x7f73b0102ac0 2024-05-20T17:31:03.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.318+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73b0106370 con 0x7f73b0102ac0 2024-05-20T17:31:03.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.318+0000 7f73acff9640 1 -- 172.21.15.135:0/2093779245 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8839 (secure 0 0 0) 0x7f73a409c410 con 0x7f73b0102ac0 2024-05-20T17:31:03.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:03.320 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:31:03.320 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 11 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 msgr2=0x7f73980a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 0x7f73980a50a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73a0031c10 tx=0x7f73a0005fd0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 msgr2=0x7f73b01995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c920 tx=0x7f73a400cde0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 shutdown_connections 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f73980a2b90 0x7f73980a50a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b019e540 0x7f73b01a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b0102ac0 0x7f73b01995c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 --2- 172.21.15.135:0/2093779245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73b0101f60 0x7f73b0199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:03.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 >> 172.21.15.135:0/2093779245 conn(0x7f73b00fc2e0 msgr2=0x7f73b00fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:03.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.320+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 shutdown_connections 2024-05-20T17:31:03.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:03.321+0000 7f73b6226640 1 -- 172.21.15.135:0/2093779245 wait complete. 2024-05-20T17:31:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: Deploying daemon mds.a on smithi135 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.135:6838/2845322204,v1:172.21.15.135:6839/2845322204] up:boot 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: fsmap 10 up:standby 2024-05-20T17:31:03.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:03 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:31:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: Deploying daemon mds.a on smithi135 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.135:6838/2845322204,v1:172.21.15.135:6839/2845322204] up:boot 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: fsmap 10 up:standby 2024-05-20T17:31:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:03 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: Deploying daemon mds.a on smithi135 2024-05-20T17:31:03.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:03.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.135:6838/2845322204,v1:172.21.15.135:6839/2845322204] up:boot 2024-05-20T17:31:03.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: fsmap 10 up:standby 2024-05-20T17:31:03.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:03 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:31:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:04 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2093779245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:04.455 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 systemd[1]: Starting Ceph mds.a for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:31:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:04 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2093779245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:04.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:04 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2093779245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:04.794 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 podman[71174]: 2024-05-20 17:31:04.433878078 +0000 UTC m=+0.017244542 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:31:04.794 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 podman[71174]: 2024-05-20 17:31:04.554294781 +0000 UTC m=+0.137661217 container create 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:31:04.794 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 podman[71174]: 2024-05-20 17:31:04.757089273 +0000 UTC m=+0.340455719 container init 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-20T17:31:04.794 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 podman[71174]: 2024-05-20 17:31:04.759934265 +0000 UTC m=+0.343300719 container start 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, io.buildah.version=1.33.5) 2024-05-20T17:31:05.204 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 ceph-mds[71193]: -- 172.21.15.135:0/1758046556 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c20affa40 con 0x563c20b77600 2024-05-20T17:31:05.205 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a[71189]: starting mds.a at 2024-05-20T17:31:05.205 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 bash[71174]: 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c 2024-05-20T17:31:05.205 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:31:04 smithi135 systemd[1]: Started Ceph mds.a for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:31:05.334 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 -- 172.21.15.135:0/3868679216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0181078b0 msgr2=0x7fb018109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 --2- 172.21.15.135:0/3868679216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0181078b0 0x7fb018109cd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb010009900 tx=0x7fb01002a410 comp rx=0 tx=0).stop 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 -- 172.21.15.135:0/3868679216 shutdown_connections 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 --2- 172.21.15.135:0/3868679216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0181078b0 0x7fb018109cd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 --2- 172.21.15.135:0/3868679216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 0x7fb018102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 --2- 172.21.15.135:0/3868679216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb018101970 0x7fb018102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 -- 172.21.15.135:0/3868679216 >> 172.21.15.135:0/3868679216 conn(0x7fb0180fcb80 msgr2=0x7fb0180ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 -- 172.21.15.135:0/3868679216 shutdown_connections 2024-05-20T17:31:05.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.449+0000 7fb01d85a640 1 -- 172.21.15.135:0/3868679216 wait complete. 2024-05-20T17:31:05.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 Processor -- start 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 -- start start 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 0x7fb01819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181078b0 0x7fb0181a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810d5f0 con 0x7fb018101970 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810d470 con 0x7fb018102bb0 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb01d85a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810d770 con 0x7fb0181078b0 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb016ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43518/0 (socket says 172.21.15.135:43518) 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb016ffd640 1 -- 172.21.15.135:0/707018991 learned_addr learned my addr 172.21.15.135:0/707018991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:05.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.450+0000 7fb0167fc640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 0x7fb01819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb0177fe640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181078b0 0x7fb0181a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 -- 172.21.15.135:0/707018991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181078b0 msgr2=0x7fb0181a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181078b0 0x7fb0181a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 -- 172.21.15.135:0/707018991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 msgr2=0x7fb01819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 0x7fb01819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 -- 172.21.15.135:0/707018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0181a0d60 con 0x7fb018101970 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb016ffd640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb00800ead0 tx=0x7fb00800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00800cde0 con 0x7fb018101970 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0181a0ff0 con 0x7fb018101970 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb008003e50 con 0x7fb018101970 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080116b0 con 0x7fb018101970 2024-05-20T17:31:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.451+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181a14b0 con 0x7fb018101970 2024-05-20T17:31:05.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.452+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0181066c0 con 0x7fb018101970 2024-05-20T17:31:05.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.453+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb008003970 con 0x7fb018101970 2024-05-20T17:31:05.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.454+0000 7fb01c858640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 0x7fb0040a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:05.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.454+0000 7fb0167fc640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 0x7fb0040a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:05.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.454+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb0080cf1c0 con 0x7fb018101970 2024-05-20T17:31:05.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.454+0000 7fb0167fc640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 0x7fb0040a50a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb018069250 tx=0x7fb000005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:05.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.458+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb008015030 con 0x7fb018101970 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:05 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:05 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:05.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.670+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01802d2a0 con 0x7fb018101970 2024-05-20T17:31:05.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.670+0000 7fb01c858640 1 -- 172.21.15.135:0/707018991 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7fb00809c650 con 0x7fb018101970 2024-05-20T17:31:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:31:05.672 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 12 2024-05-20T17:31:05.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 msgr2=0x7fb0040a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:05.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 0x7fb0040a50a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb018069250 tx=0x7fb000005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:05.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 msgr2=0x7fb0180698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:05.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb00800ead0 tx=0x7fb00800ef90 comp rx=0 tx=0).stop 2024-05-20T17:31:05.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 shutdown_connections 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb0040a2b90 0x7fb0040a50a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181078b0 0x7fb0181a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb018102bb0 0x7fb01819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 --2- 172.21.15.135:0/707018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb018101970 0x7fb0180698b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 >> 172.21.15.135:0/707018991 conn(0x7fb0180fcb80 msgr2=0x7fb018103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 shutdown_connections 2024-05-20T17:31:05.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:05.673+0000 7fb01d85a640 1 -- 172.21.15.135:0/707018991 wait complete. 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:31:05.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:05 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:06.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:06 smithi160 ceph-mon[36261]: Deploying daemon mds.b on smithi160 2024-05-20T17:31:06.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:06 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.135:6840/2294779524,v1:172.21.15.135:6841/2294779524] up:boot 2024-05-20T17:31:06.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:06 smithi160 ceph-mon[36261]: fsmap 11 up:standby 2024-05-20T17:31:06.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:31:06.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:06 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/707018991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:06 smithi172 ceph-mon[36511]: Deploying daemon mds.b on smithi160 2024-05-20T17:31:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:06 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.135:6840/2294779524,v1:172.21.15.135:6841/2294779524] up:boot 2024-05-20T17:31:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:06 smithi172 ceph-mon[36511]: fsmap 11 up:standby 2024-05-20T17:31:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:31:06.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:06 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/707018991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:06 smithi135 ceph-mon[32027]: Deploying daemon mds.b on smithi160 2024-05-20T17:31:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:06 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.135:6840/2294779524,v1:172.21.15.135:6841/2294779524] up:boot 2024-05-20T17:31:06.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:06 smithi135 ceph-mon[32027]: fsmap 11 up:standby 2024-05-20T17:31:06.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:31:06.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:06 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/707018991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:07.503 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:07 smithi160 ceph-mon[36261]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:07.504 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 podman[66202]: 2024-05-20 17:31:07.377930228 +0000 UTC m=+0.017315975 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:31:07.504 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 podman[66202]: 2024-05-20 17:31:07.503352443 +0000 UTC m=+0.142738158 container create e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-20T17:31:07.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:07 smithi172 ceph-mon[36511]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:07.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:07 smithi135 ceph-mon[32027]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:07.756 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 podman[66202]: 2024-05-20 17:31:07.739338292 +0000 UTC m=+0.378724018 container init e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:31:07.756 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 podman[66202]: 2024-05-20 17:31:07.742247311 +0000 UTC m=+0.381633050 container start e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-20T17:31:07.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 -- 172.21.15.135:0/3486607350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c102bb0 msgr2=0x7fab0c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:07.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 --2- 172.21.15.135:0/3486607350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c102bb0 0x7fab0c102fc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faafc009900 tx=0x7faafc02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:07.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 -- 172.21.15.135:0/3486607350 shutdown_connections 2024-05-20T17:31:07.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 --2- 172.21.15.135:0/3486607350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c1078b0 0x7fab0c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:07.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 --2- 172.21.15.135:0/3486607350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c102bb0 0x7fab0c102fc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 --2- 172.21.15.135:0/3486607350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c101970 0x7fab0c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 -- 172.21.15.135:0/3486607350 >> 172.21.15.135:0/3486607350 conn(0x7fab0c0fcb80 msgr2=0x7fab0c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 -- 172.21.15.135:0/3486607350 shutdown_connections 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.814+0000 7fab1474b640 1 -- 172.21.15.135:0/3486607350 wait complete. 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 Processor -- start 2024-05-20T17:31:07.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 -- start start 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c101970 0x7fab0c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c102bb0 0x7fab0c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10d630 con 0x7fab0c1078b0 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10d4b0 con 0x7fab0c101970 2024-05-20T17:31:07.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab1474b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10d7b0 con 0x7fab0c102bb0 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab12ce8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.815+0000 7fab12ce8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43536/0 (socket says 172.21.15.135:43536) 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 -- 172.21.15.135:0/2189313207 learned_addr learned my addr 172.21.15.135:0/2189313207 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab124e7640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c101970 0x7fab0c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab11ce6640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c102bb0 0x7fab0c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 -- 172.21.15.135:0/2189313207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c102bb0 msgr2=0x7fab0c198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c102bb0 0x7fab0c198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 -- 172.21.15.135:0/2189313207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c101970 msgr2=0x7fab0c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:07.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c101970 0x7fab0c1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 -- 172.21.15.135:0/2189313207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c19fd10 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab12ce8640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab04009fd0 tx=0x7fab0400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04017070 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c19ffa0 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04003e50 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040106c0 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.816+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c1a04b0 con 0x7fab0c1078b0 2024-05-20T17:31:07.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.817+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0c1066c0 con 0x7fab0c1078b0 2024-05-20T17:31:07.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.818+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fab04003970 con 0x7fab0c1078b0 2024-05-20T17:31:07.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.819+0000 7fab037fe640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 0x7faaf80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:07.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.819+0000 7fab124e7640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 0x7faaf80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:07.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.819+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fab040cec60 con 0x7fab0c1078b0 2024-05-20T17:31:07.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.819+0000 7fab124e7640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 0x7faaf80a50a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab0c102570 tx=0x7fab08005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:07.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:07.823+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fab0409c060 con 0x7fab0c1078b0 2024-05-20T17:31:08.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.044+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab0c02d2a0 con 0x7fab0c1078b0 2024-05-20T17:31:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.045+0000 7fab037fe640 1 -- 172.21.15.135:0/2189313207 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7fab0409b960 con 0x7fab0c1078b0 2024-05-20T17:31:08.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:08.046 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:31:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 12 2024-05-20T17:31:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 msgr2=0x7faaf80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 0x7faaf80a50a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab0c102570 tx=0x7fab08005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 msgr2=0x7fab0c19f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab04009fd0 tx=0x7fab0400b260 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 shutdown_connections 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faaf80a2b90 0x7faaf80a50a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab0c1078b0 0x7fab0c19f6a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab0c102bb0 0x7fab0c198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 --2- 172.21.15.135:0/2189313207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab0c101970 0x7fab0c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 >> 172.21.15.135:0/2189313207 conn(0x7fab0c0fcb80 msgr2=0x7fab0c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 shutdown_connections 2024-05-20T17:31:08.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:08.047+0000 7fab1474b640 1 -- 172.21.15.135:0/2189313207 wait complete. 2024-05-20T17:31:08.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 ceph-mds[66221]: -- 172.21.15.160:0/813285250 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a3ce49a40 con 0x558a3cec1a80 2024-05-20T17:31:08.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: starting mds.b at 2024-05-20T17:31:08.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 bash[66202]: e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd 2024-05-20T17:31:08.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:07 smithi160 systemd[1]: Started Ceph mds.b for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.195 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2189313207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:boot 2024-05-20T17:31:09.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: fsmap 12 up:standby 2024-05-20T17:31:09.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:31:09.196 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:08 smithi135 ceph-mon[32027]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:09.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2189313207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:boot 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: fsmap 12 up:standby 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:31:09.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:08 smithi160 ceph-mon[36261]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2189313207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:boot 2024-05-20T17:31:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: fsmap 12 up:standby 2024-05-20T17:31:09.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:31:09.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:08 smithi172 ceph-mon[36511]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:10.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:10.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 -- 172.21.15.135:0/2984523975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 msgr2=0x7f20f0108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/2984523975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0108090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009900 tx=0x7f20dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 -- 172.21.15.135:0/2984523975 shutdown_connections 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/2984523975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0108720 0x7f20f010ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/2984523975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0108090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/2984523975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0100dd0 0x7f20f01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 -- 172.21.15.135:0/2984523975 >> 172.21.15.135:0/2984523975 conn(0x7f20f00fc2e0 msgr2=0x7f20f00fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 -- 172.21.15.135:0/2984523975 shutdown_connections 2024-05-20T17:31:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.174+0000 7f20f6ad7640 1 -- 172.21.15.135:0/2984523975 wait complete. 2024-05-20T17:31:10.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 Processor -- start 2024-05-20T17:31:10.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 -- start start 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0100dd0 0x7f20f0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 0x7f20f01a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20f010e6e0 con 0x7f20f0105bb0 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f20f010e560 con 0x7f20f0108720 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f6ad7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20f010e860 con 0x7f20f0100dd0 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49944/0 (socket says 172.21.15.135:49944) 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20effff640 1 -- 172.21.15.135:0/3091171799 learned_addr learned my addr 172.21.15.135:0/3091171799 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f4873640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0100dd0 0x7f20f0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.175+0000 7f20f5074640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 0x7f20f01a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 -- 172.21.15.135:0/3091171799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0100dd0 msgr2=0x7f20f0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0100dd0 0x7f20f0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 -- 172.21.15.135:0/3091171799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 msgr2=0x7f20f01a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 0x7f20f01a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 -- 172.21.15.135:0/3091171799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f01a0d90 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20f5074640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 0x7f20f01a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20effff640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc03f030 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20dc003ad0 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc035070 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f01a1020 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.176+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f01a1510 con 0x7f20f0105bb0 2024-05-20T17:31:10.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.177+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f00fde00 con 0x7f20f0105bb0 2024-05-20T17:31:10.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.179+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20dc042030 con 0x7f20f0105bb0 2024-05-20T17:31:10.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.179+0000 7f20edffb640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 0x7f20e00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.179+0000 7f20f4873640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 0x7f20e00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.179+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f20dc0ef700 con 0x7f20f0105bb0 2024-05-20T17:31:10.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.180+0000 7f20f4873640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 0x7f20e00a50a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20f0103aa0 tx=0x7f20e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.187+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f20dc0bc4b0 con 0x7f20f0105bb0 2024-05-20T17:31:10.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.407+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f002d2a0 con 0x7f20f0105bb0 2024-05-20T17:31:10.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.408+0000 7f20edffb640 1 -- 172.21.15.135:0/3091171799 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7f20dc0c07b0 con 0x7f20f0105bb0 2024-05-20T17:31:10.410 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:10.410 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-20T17:31:10.410 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 13 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 msgr2=0x7f20e00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 0x7f20e00a50a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20f0103aa0 tx=0x7f20e4005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 msgr2=0x7f20f0199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc031b60 comp rx=0 tx=0).stop 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 shutdown_connections 2024-05-20T17:31:10.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f20e00a2b90 0x7f20e00a50a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f0108720 0x7f20f01a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f0105bb0 0x7f20f0199790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 --2- 172.21.15.135:0/3091171799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20f0100dd0 0x7f20f0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 >> 172.21.15.135:0/3091171799 conn(0x7f20f00fc2e0 msgr2=0x7f20f0106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 shutdown_connections 2024-05-20T17:31:10.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.411+0000 7f20f6ad7640 1 -- 172.21.15.135:0/3091171799 wait complete. 2024-05-20T17:31:10.424 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 -- 172.21.15.135:0/1825971909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 msgr2=0x7fa840102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 --2- 172.21.15.135:0/1825971909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa840102670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa830009900 tx=0x7fa83002a410 comp rx=0 tx=0).stop 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 -- 172.21.15.135:0/1825971909 shutdown_connections 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 --2- 172.21.15.135:0/1825971909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 0x7fa840109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 --2- 172.21.15.135:0/1825971909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa840102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 --2- 172.21.15.135:0/1825971909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa840102670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 -- 172.21.15.135:0/1825971909 >> 172.21.15.135:0/1825971909 conn(0x7fa8400fcb80 msgr2=0x7fa8400ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 -- 172.21.15.135:0/1825971909 shutdown_connections 2024-05-20T17:31:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.543+0000 7fa846244640 1 -- 172.21.15.135:0/1825971909 wait complete. 2024-05-20T17:31:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.544+0000 7fa846244640 1 Processor -- start 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.544+0000 7fa846244640 1 -- start start 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa8401986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 0x7fa84019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa84010d5c0 con 0x7fa840101970 2024-05-20T17:31:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa84010d440 con 0x7fa840102bb0 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa846244640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa84010d740 con 0x7fa8401078b0 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49952/0 (socket says 172.21.15.135:49952) 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa8401986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 -- 172.21.15.135:0/1762620631 learned_addr learned my addr 172.21.15.135:0/1762620631 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83ffff640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 0x7fa84019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 -- 172.21.15.135:0/1762620631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 msgr2=0x7fa84019f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 0x7fa84019f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 -- 172.21.15.135:0/1762620631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 msgr2=0x7fa8401986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa8401986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 -- 172.21.15.135:0/1762620631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84019fce0 con 0x7fa840101970 2024-05-20T17:31:10.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83effd640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa8401986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.545+0000 7fa83f7fe640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa830005ab0 tx=0x7fa830004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.546+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83003f030 con 0x7fa840101970 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.546+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84019ff70 con 0x7fa840101970 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.546+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa830003ad0 con 0x7fa840101970 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.546+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830035070 con 0x7fa840101970 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.546+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8401a0370 con 0x7fa840101970 2024-05-20T17:31:10.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.547+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8401066c0 con 0x7fa840101970 2024-05-20T17:31:10.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.549+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa830042030 con 0x7fa840101970 2024-05-20T17:31:10.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.549+0000 7fa83cff9640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 0x7fa8280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.549+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa8300ef300 con 0x7fa840101970 2024-05-20T17:31:10.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.549+0000 7fa83effd640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 0x7fa8280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.550+0000 7fa83effd640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 0x7fa8280a50a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa840199240 tx=0x7fa834005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.557+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa8300bc0b0 con 0x7fa840101970 2024-05-20T17:31:10.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.740+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa84002d470 con 0x7fa840101970 2024-05-20T17:31:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.741+0000 7fa83cff9640 1 -- 172.21.15.135:0/1762620631 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18523 (secure 0 0 0) 0x7fa8300c03b0 con 0x7fa840101970 2024-05-20T17:31:10.743 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:10.743 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:30:24.211600+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 msgr2=0x7fa8280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 0x7fa8280a50a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa840199240 tx=0x7fa834005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 msgr2=0x7fa8401981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa830005ab0 tx=0x7fa830004270 comp rx=0 tx=0).stop 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 shutdown_connections 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa8280a2b90 0x7fa8280a50a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8401078b0 0x7fa84019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa840102bb0 0x7fa8401986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 --2- 172.21.15.135:0/1762620631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa840101970 0x7fa8401981a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.743+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 >> 172.21.15.135:0/1762620631 conn(0x7fa8400fcb80 msgr2=0x7fa840103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:10.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.744+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 shutdown_connections 2024-05-20T17:31:10.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.744+0000 7fa846244640 1 -- 172.21.15.135:0/1762620631 wait complete. 2024-05-20T17:31:10.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:31:10.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:31:10.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 -- 172.21.15.135:0/2225608960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 msgr2=0x7f2f1c10ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 --2- 172.21.15.135:0/2225608960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c10ae10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009ca0 tx=0x7f2f1402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 -- 172.21.15.135:0/2225608960 shutdown_connections 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 --2- 172.21.15.135:0/2225608960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c10ae10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 --2- 172.21.15.135:0/2225608960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 --2- 172.21.15.135:0/2225608960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.872+0000 7f2f22b10640 1 -- 172.21.15.135:0/2225608960 >> 172.21.15.135:0/2225608960 conn(0x7f2f1c0fdca0 msgr2=0x7f2f1c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.873+0000 7f2f22b10640 1 -- 172.21.15.135:0/2225608960 shutdown_connections 2024-05-20T17:31:10.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.873+0000 7f2f22b10640 1 -- 172.21.15.135:0/2225608960 wait complete. 2024-05-20T17:31:10.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.873+0000 7f2f22b10640 1 Processor -- start 2024-05-20T17:31:10.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 -- start start 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c10e730 con 0x7f2f1c1089f0 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c10e5b0 con 0x7f2f1c102ab0 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f22b10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c10e8b0 con 0x7f2f1c103cf0 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f208ac640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f210ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f208ac640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:45116/0 (socket says 172.21.15.135:45116) 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f208ac640 1 -- 172.21.15.135:0/1599659703 learned_addr learned my addr 172.21.15.135:0/1599659703 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 -- 172.21.15.135:0/1599659703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 msgr2=0x7f2f1c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 -- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 msgr2=0x7f2f1c1a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c1a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.874+0000 7f2f1bfff640 1 -- 172.21.15.135:0/1599659703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c1a0de0 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f1bfff640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c1997e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d6d0 tx=0x7f2f0800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08009820 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08004d00 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c1a10d0 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.875+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c1a1670 con 0x7f2f1c103cf0 2024-05-20T17:31:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.876+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c107800 con 0x7f2f1c103cf0 2024-05-20T17:31:10.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.877+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2f080099d0 con 0x7f2f1c103cf0 2024-05-20T17:31:10.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.878+0000 7f2f19ffb640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 0x7f2f0c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:10.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.878+0000 7f2f208ac640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 0x7f2f0c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.878+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2f080ce6c0 con 0x7f2f1c103cf0 2024-05-20T17:31:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.879+0000 7f2f208ac640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 0x7f2f0c0a5120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009c30 tx=0x7f2f10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:10.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:10.883+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2f0809b3d0 con 0x7f2f1c103cf0 2024-05-20T17:31:11.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3091171799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.067+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f1c062750 con 0x7f2f1c103cf0 2024-05-20T17:31:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.068+0000 7f2f19ffb640 1 -- 172.21.15.135:0/1599659703 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f2f0809f6d0 con 0x7f2f1c103cf0 2024-05-20T17:31:11.069 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 msgr2=0x7f2f0c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 0x7f2f0c0a5120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009c30 tx=0x7f2f10005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 msgr2=0x7f2f1c1997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c1997e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d6d0 tx=0x7f2f0800db90 comp rx=0 tx=0).stop 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 shutdown_connections 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2f0c0a2c10 0x7f2f0c0a5120 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f1c1089f0 0x7f2f1c1a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f1c103cf0 0x7f2f1c1997e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 --2- 172.21.15.135:0/1599659703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f1c102ab0 0x7f2f1c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 >> 172.21.15.135:0/1599659703 conn(0x7f2f1c0fdca0 msgr2=0x7f2f1c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.070+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 shutdown_connections 2024-05-20T17:31:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.071+0000 7f2f22b10640 1 -- 172.21.15.135:0/1599659703 wait complete. 2024-05-20T17:31:11.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3091171799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:11.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:11.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:11.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3091171799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:11.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:31:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 -- 172.21.15.135:0/2181244066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c101990 msgr2=0x7f123c102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 --2- 172.21.15.135:0/2181244066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c101990 0x7f123c102690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1234009900 tx=0x7f123402a410 comp rx=0 tx=0).stop 2024-05-20T17:31:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 -- 172.21.15.135:0/2181244066 shutdown_connections 2024-05-20T17:31:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 --2- 172.21.15.135:0/2181244066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 0x7f123c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 --2- 172.21.15.135:0/2181244066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c102bd0 0x7f123c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 --2- 172.21.15.135:0/2181244066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c101990 0x7f123c102690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 -- 172.21.15.135:0/2181244066 >> 172.21.15.135:0/2181244066 conn(0x7f123c0fcba0 msgr2=0x7f123c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 -- 172.21.15.135:0/2181244066 shutdown_connections 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.193+0000 7f12419d5640 1 -- 172.21.15.135:0/2181244066 wait complete. 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 Processor -- start 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 -- start start 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c101990 0x7f123c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 0x7f123c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e700 con 0x7f123c102bd0 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e580 con 0x7f123c1078d0 2024-05-20T17:31:11.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.194+0000 7f12419d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e880 con 0x7f123c101990 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49988/0 (socket says 172.21.15.135:49988) 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 -- 172.21.15.135:0/19581520 learned_addr learned my addr 172.21.15.135:0/19581520 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123affd640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c101990 0x7f123c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123b7fe640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 0x7f123c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 -- 172.21.15.135:0/19581520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c101990 msgr2=0x7f123c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c101990 0x7f123c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 -- 172.21.15.135:0/19581520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 msgr2=0x7f123c1a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 0x7f123c1a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 -- 172.21.15.135:0/19581520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c1a0e40 con 0x7f123c102bd0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f123a7fc640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f122400d770 tx=0x7f122400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224017070 con 0x7f123c102bd0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c1a1130 con 0x7f123c102bd0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1224005500 con 0x7f123c102bd0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224004e00 con 0x7f123c102bd0 2024-05-20T17:31:11.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.195+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c1a1630 con 0x7f123c102bd0 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.196+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c1066e0 con 0x7f123c102bd0 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.198+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1224004fa0 con 0x7f123c102bd0 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.198+0000 7f12409d3640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 0x7f12280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.199+0000 7f123affd640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 0x7f12280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.199+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f12240ce950 con 0x7f123c102bd0 2024-05-20T17:31:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.199+0000 7f123affd640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 0x7f12280a50a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1234005ab0 tx=0x7f12340315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.202+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f122409b700 con 0x7f123c102bd0 2024-05-20T17:31:11.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.402+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f123c02d470 con 0x7f123c102bd0 2024-05-20T17:31:11.404 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:11.404 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-20T17:31:11.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.403+0000 7f12409d3640 1 -- 172.21.15.135:0/19581520 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f122409fa00 con 0x7f123c102bd0 2024-05-20T17:31:11.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 msgr2=0x7f12280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 0x7f12280a50a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1234005ab0 tx=0x7f12340315b0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 msgr2=0x7f123c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f122400d770 tx=0x7f122400dc30 comp rx=0 tx=0).stop 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 shutdown_connections 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f12280a2b90 0x7f12280a50a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f123c1078d0 0x7f123c1a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f123c102bd0 0x7f123c1998b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 --2- 172.21.15.135:0/19581520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f123c101990 0x7f123c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 >> 172.21.15.135:0/19581520 conn(0x7f123c0fcba0 msgr2=0x7f123c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:11.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 shutdown_connections 2024-05-20T17:31:11.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.405+0000 7f12419d5640 1 -- 172.21.15.135:0/19581520 wait complete. 2024-05-20T17:31:11.419 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:31:11.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 -- 172.21.15.135:0/112521988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 msgr2=0x7f35dc102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 --2- 172.21.15.135:0/112521988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc102d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009900 tx=0x7f35cc02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 -- 172.21.15.135:0/112521988 shutdown_connections 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 --2- 172.21.15.135:0/112521988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 0x7f35dc109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 --2- 172.21.15.135:0/112521988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc102d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 --2- 172.21.15.135:0/112521988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 0x7f35dc102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 -- 172.21.15.135:0/112521988 >> 172.21.15.135:0/112521988 conn(0x7f35dc0fc2f0 msgr2=0x7f35dc0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 -- 172.21.15.135:0/112521988 shutdown_connections 2024-05-20T17:31:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.547+0000 7f35e4606640 1 -- 172.21.15.135:0/112521988 wait complete. 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 Processor -- start 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 -- start start 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 0x7f35dc198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 0x7f35dc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10d630 con 0x7f35dc1028f0 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10d4b0 con 0x7f35dc101f10 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e4606640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10d7b0 con 0x7f35dc103410 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e1ba1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e1ba1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50004/0 (socket says 172.21.15.135:50004) 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e1ba1640 1 -- 172.21.15.135:0/3798707817 learned_addr learned my addr 172.21.15.135:0/3798707817 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e23a2640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 0x7f35dc198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.548+0000 7f35e2ba3640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 0x7f35dc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 -- 172.21.15.135:0/3798707817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 msgr2=0x7f35dc19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 0x7f35dc19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 -- 172.21.15.135:0/3798707817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 msgr2=0x7f35dc198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 0x7f35dc198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 -- 172.21.15.135:0/3798707817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc19fcb0 con 0x7f35dc1028f0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e1ba1640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc03f030 con 0x7f35dc1028f0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35cc003ce0 con 0x7f35dc1028f0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc19ff40 con 0x7f35dc1028f0 2024-05-20T17:31:11.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc035070 con 0x7f35dc1028f0 2024-05-20T17:31:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.549+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1a0350 con 0x7f35dc1028f0 2024-05-20T17:31:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.550+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc1068b0 con 0x7f35dc1028f0 2024-05-20T17:31:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.552+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f35cc042030 con 0x7f35dc1028f0 2024-05-20T17:31:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.553+0000 7f35d37fe640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 0x7f35c80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.553+0000 7f35e23a2640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 0x7f35c80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.553+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f35cc0ef560 con 0x7f35dc1028f0 2024-05-20T17:31:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.554+0000 7f35e23a2640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 0x7f35c80a50a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35d80095f0 tx=0x7f35d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.557+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f35cc0bc310 con 0x7f35dc1028f0 2024-05-20T17:31:11.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:11.756+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f35dc02d2a0 con 0x7f35dc1028f0 2024-05-20T17:31:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1762620631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1599659703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:31:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/19581520' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:31:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:11 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1762620631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1599659703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/19581520' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:11 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:12.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1762620631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1599659703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/19581520' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:11 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:12.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.763+0000 7f35d37fe640 1 -- 172.21.15.135:0/3798707817 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f35cc0c0610 con 0x7f35dc1028f0 2024-05-20T17:31:12.764 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 msgr2=0x7f35c80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 0x7f35c80a50a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35d80095f0 tx=0x7f35d8005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 msgr2=0x7f35dc1986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006010 tx=0x7f35cc0042f0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 shutdown_connections 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35c80a2b90 0x7f35c80a50a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc103410 0x7f35dc19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35dc1028f0 0x7f35dc1986b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 --2- 172.21.15.135:0/3798707817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35dc101f10 0x7f35dc198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 >> 172.21.15.135:0/3798707817 conn(0x7f35dc0fc2f0 msgr2=0x7f35dc103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 shutdown_connections 2024-05-20T17:31:12.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.766+0000 7f35e4606640 1 -- 172.21.15.135:0/3798707817 wait complete. 2024-05-20T17:31:12.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 -- 172.21.15.135:0/1637775340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc103400 msgr2=0x7f62cc109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 --2- 172.21.15.135:0/1637775340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc103400 0x7f62cc109b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009ca0 tx=0x7f62c402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 -- 172.21.15.135:0/1637775340 shutdown_connections 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 --2- 172.21.15.135:0/1637775340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc103400 0x7f62cc109b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 --2- 172.21.15.135:0/1637775340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc1028e0 0x7f62cc102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 --2- 172.21.15.135:0/1637775340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc101f00 0x7f62cc102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 -- 172.21.15.135:0/1637775340 >> 172.21.15.135:0/1637775340 conn(0x7f62cc0fc2e0 msgr2=0x7f62cc0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 -- 172.21.15.135:0/1637775340 shutdown_connections 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.907+0000 7f62d0a21640 1 -- 172.21.15.135:0/1637775340 wait complete. 2024-05-20T17:31:12.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 Processor -- start 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 -- start start 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc1028e0 0x7f62cc19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc103400 0x7f62cc1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc10d620 con 0x7f62cc101f00 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc10d4a0 con 0x7f62cc1028e0 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62d0a21640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc10d7a0 con 0x7f62cc103400 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50028/0 (socket says 172.21.15.135:50028) 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 -- 172.21.15.135:0/2522311532 learned_addr learned my addr 172.21.15.135:0/2522311532 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62c3fff640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc1028e0 0x7f62cc19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62cad9d640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc103400 0x7f62cc1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:12.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 -- 172.21.15.135:0/2522311532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc103400 msgr2=0x7f62cc1a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc103400 0x7f62cc1a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 -- 172.21.15.135:0/2522311532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc1028e0 msgr2=0x7f62cc19df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc1028e0 0x7f62cc19df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 -- 172.21.15.135:0/2522311532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc1a0d00 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.908+0000 7f62ca59c640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d770 tx=0x7f62bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.909+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc017070 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.909+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc1a0ff0 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.909+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62bc009c30 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.909+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00f620 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.909+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc1a1450 con 0x7f62cc101f00 2024-05-20T17:31:12.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.910+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc0682c0 con 0x7f62cc101f00 2024-05-20T17:31:12.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.912+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f62bc01a070 con 0x7f62cc101f00 2024-05-20T17:31:12.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.913+0000 7f62c37fe640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 0x7f62b80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:12.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.913+0000 7f62c3fff640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 0x7f62b80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:12.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.913+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f62bc0ce7c0 con 0x7f62cc101f00 2024-05-20T17:31:12.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.913+0000 7f62c3fff640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 0x7f62b80a50a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f62cc100b60 tx=0x7f62b400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:12.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:12.917+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f62bc009de0 con 0x7f62cc101f00 2024-05-20T17:31:13.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:31:13.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:13.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:13.054 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:13.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.100+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f62cc108900 con 0x7f62cc101f00 2024-05-20T17:31:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:31:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:31:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:31:13.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:31:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.769+0000 7f62c37fe640 1 -- 172.21.15.135:0/2522311532 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f62cc108900 con 0x7f62cc101f00 2024-05-20T17:31:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-05-20T17:31:13.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 msgr2=0x7f62b80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:13.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 0x7f62b80a50a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f62cc100b60 tx=0x7f62b400b390 comp rx=0 tx=0).stop 2024-05-20T17:31:13.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 msgr2=0x7f62cc1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:13.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d770 tx=0x7f62bc00dc30 comp rx=0 tx=0).stop 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 shutdown_connections 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f62b80a2b90 0x7f62b80a50a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62cc103400 0x7f62cc1a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62cc1028e0 0x7f62cc19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 --2- 172.21.15.135:0/2522311532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62cc101f00 0x7f62cc1011c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 >> 172.21.15.135:0/2522311532 conn(0x7f62cc0fc2e0 msgr2=0x7f62cc105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 shutdown_connections 2024-05-20T17:31:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.771+0000 7f62d0a21640 1 -- 172.21.15.135:0/2522311532 wait complete. 2024-05-20T17:31:13.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 -- 172.21.15.135:0/2626300855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c101990 msgr2=0x7f307c102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 --2- 172.21.15.135:0/2626300855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c101990 0x7f307c102690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f306c009900 tx=0x7f306c02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 -- 172.21.15.135:0/2626300855 shutdown_connections 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 --2- 172.21.15.135:0/2626300855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c1078d0 0x7f307c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 --2- 172.21.15.135:0/2626300855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c102bd0 0x7f307c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 --2- 172.21.15.135:0/2626300855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c101990 0x7f307c102690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 -- 172.21.15.135:0/2626300855 >> 172.21.15.135:0/2626300855 conn(0x7f307c0fcb80 msgr2=0x7f307c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 -- 172.21.15.135:0/2626300855 shutdown_connections 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.907+0000 7f3080f77640 1 -- 172.21.15.135:0/2626300855 wait complete. 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 Processor -- start 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 -- start start 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c101990 0x7f307c0698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c102bd0 0x7f307c19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10d5e0 con 0x7f307c1078d0 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10d460 con 0x7f307c102bd0 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3080f77640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10d760 con 0x7f307c101990 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f307ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:13.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f307ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50046/0 (socket says 172.21.15.135:50046) 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f307ad9d640 1 -- 172.21.15.135:0/2506785627 learned_addr learned my addr 172.21.15.135:0/2506785627 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f3073fff640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c102bd0 0x7f307c19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.908+0000 7f307a59c640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c101990 0x7f307c0698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 -- 172.21.15.135:0/2506785627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c101990 msgr2=0x7f307c0698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c101990 0x7f307c0698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 -- 172.21.15.135:0/2506785627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c102bd0 msgr2=0x7f307c19e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c102bd0 0x7f307c19e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 -- 172.21.15.135:0/2506785627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c1a1130 con 0x7f307c1078d0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f307ad9d640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f307400cad0 tx=0x7f307400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307400ae20 con 0x7f307c1078d0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3074005020 con 0x7f307c1078d0 2024-05-20T17:31:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c1a1420 con 0x7f307c1078d0 2024-05-20T17:31:13.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307400f6f0 con 0x7f307c1078d0 2024-05-20T17:31:13.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.909+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1a1920 con 0x7f307c1078d0 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.910+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c1066e0 con 0x7f307c1078d0 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.911+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f30740051d0 con 0x7f307c1078d0 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.912+0000 7f30737fe640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 0x7f30680a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.912+0000 7f307a59c640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 0x7f30680a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.912+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f30740cf210 con 0x7f307c1078d0 2024-05-20T17:31:13.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.912+0000 7f307a59c640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 0x7f30680a50a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f306c005ab0 tx=0x7f306c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:13.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:13.916+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3074014030 con 0x7f307c1078d0 2024-05-20T17:31:14.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:13 smithi172 ceph-mon[36511]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:13 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:31:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:13 smithi172 ceph-mon[36511]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:31:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:13 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:31:14.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.130+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f307c06b250 con 0x7f307c1078d0 2024-05-20T17:31:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:13 smithi135 ceph-mon[32027]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:13 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:31:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:13 smithi135 ceph-mon[32027]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:31:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:13 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:31:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:13 smithi160 ceph-mon[36261]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:13 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3798707817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:31:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:13 smithi160 ceph-mon[36261]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:31:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:13 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:31:14.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.780+0000 7f30737fe640 1 -- 172.21.15.135:0/2506785627 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f307409bcb0 con 0x7f307c1078d0 2024-05-20T17:31:14.782 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 2 and data pool 3 2024-05-20T17:31:14.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.784+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 msgr2=0x7f30680a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:14.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.784+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 0x7f30680a50a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f306c005ab0 tx=0x7f306c031400 comp rx=0 tx=0).stop 2024-05-20T17:31:14.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.784+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 msgr2=0x7f307c1a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:14.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.784+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f307400cad0 tx=0x7f307400cf90 comp rx=0 tx=0).stop 2024-05-20T17:31:14.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 shutdown_connections 2024-05-20T17:31:14.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f30680a2b90 0x7f30680a50a0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f306c005ab0 tx=0x7f306c031400 comp rx=0 tx=0).stop 2024-05-20T17:31:14.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307c1078d0 0x7f307c1a0910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f307c102bd0 0x7f307c19e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 --2- 172.21.15.135:0/2506785627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c101990 0x7f307c0698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 >> 172.21.15.135:0/2506785627 conn(0x7f307c0fcb80 msgr2=0x7f307c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:14.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.785+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 shutdown_connections 2024-05-20T17:31:14.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.786+0000 7f3080f77640 1 -- 172.21.15.135:0/2506785627 wait complete. 2024-05-20T17:31:14.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:31:14.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 -- 172.21.15.135:0/3364257531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840105f10 msgr2=0x7f9840108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:14.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 --2- 172.21.15.135:0/3364257531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840105f10 0x7f9840108330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f983c009900 tx=0x7f983c02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 -- 172.21.15.135:0/3364257531 shutdown_connections 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 --2- 172.21.15.135:0/3364257531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840108870 0x7f984010ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 --2- 172.21.15.135:0/3364257531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840105f10 0x7f9840108330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 --2- 172.21.15.135:0/3364257531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 0x7f98401059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 -- 172.21.15.135:0/3364257531 >> 172.21.15.135:0/3364257531 conn(0x7f98400fcbb0 msgr2=0x7f98400ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 -- 172.21.15.135:0/3364257531 shutdown_connections 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.922+0000 7f984872c640 1 -- 172.21.15.135:0/3364257531 wait complete. 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 Processor -- start 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 -- start start 2024-05-20T17:31:14.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 0x7f9840199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840105f10 0x7f9840199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f984010e720 con 0x7f9840108870 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f984010e5a0 con 0x7f98401035b0 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f984872c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f984010e8a0 con 0x7f9840105f10 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50062/0 (socket says 172.21.15.135:50062) 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 -- 172.21.15.135:0/2367104146 learned_addr learned my addr 172.21.15.135:0/2367104146 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f98464c8640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 0x7f9840199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9845cc7640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840105f10 0x7f9840199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 -- 172.21.15.135:0/2367104146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840105f10 msgr2=0x7f9840199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:14.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840105f10 0x7f9840199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 -- 172.21.15.135:0/2367104146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 msgr2=0x7f9840199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 0x7f9840199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 -- 172.21.15.135:0/2367104146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98401a0db0 con 0x7f9840108870 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f9846cc9640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f983000c970 tx=0x7f983000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.923+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830004230 con 0x7f9840108870 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.924+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98300043d0 con 0x7f9840108870 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.924+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000f450 con 0x7f9840108870 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.924+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98401a10a0 con 0x7f9840108870 2024-05-20T17:31:14.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.924+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98401a15a0 con 0x7f9840108870 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.925+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98400fe6d0 con 0x7f9840108870 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.926+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f98300079b0 con 0x7f9840108870 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.927+0000 7f98377fe640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 0x7f98280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.927+0000 7f98464c8640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 0x7f98280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.927+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f98300cf0b0 con 0x7f9840108870 2024-05-20T17:31:14.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.927+0000 7f98464c8640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 0x7f98280a50a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f984006ac00 tx=0x7f9838009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:14.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:14.931+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9830014070 con 0x7f9840108870 2024-05-20T17:31:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:14 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:31:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:14 smithi172 ceph-mon[36511]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:31:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:14 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:31:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:14 smithi172 ceph-mon[36511]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:31:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:14 smithi172 ceph-mon[36511]: pgmap v287: 97 pgs: 35 creating+peering, 5 active+clean, 57 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:15.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.106+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9840062750 con 0x7f9840108870 2024-05-20T17:31:15.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.108+0000 7f98377fe640 1 -- 172.21.15.135:0/2367104146 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22299 (secure 0 0 0) 0x7f983009c140 con 0x7f9840108870 2024-05-20T17:31:15.109 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":84,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:31:14.132265+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:15.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 msgr2=0x7f98280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 0x7f98280a50a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f984006ac00 tx=0x7f9838009680 comp rx=0 tx=0).stop 2024-05-20T17:31:15.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 msgr2=0x7f98401a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f983000c970 tx=0x7f983000ce30 comp rx=0 tx=0).stop 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 shutdown_connections 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f98280a2b90 0x7f98280a50a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9840108870 0x7f98401a07f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9840105f10 0x7f9840199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 --2- 172.21.15.135:0/2367104146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401035b0 0x7f9840199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 >> 172.21.15.135:0/2367104146 conn(0x7f98400fcbb0 msgr2=0x7f9840104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 shutdown_connections 2024-05-20T17:31:15.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.110+0000 7f984872c640 1 -- 172.21.15.135:0/2367104146 wait complete. 2024-05-20T17:31:15.121 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:14 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:31:15.122 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:14 smithi135 ceph-mon[32027]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:31:15.122 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:14 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:31:15.122 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:14 smithi135 ceph-mon[32027]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:31:15.122 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:14 smithi135 ceph-mon[32027]: pgmap v287: 97 pgs: 35 creating+peering, 5 active+clean, 57 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:15.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3994915713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac1078b0 msgr2=0x7fc7ac109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3994915713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac109cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009ca0 tx=0x7fc7a402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3994915713 shutdown_connections 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3994915713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac109cd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3994915713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3994915713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac101970 0x7fc7ac102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3994915713 >> 172.21.15.135:0/3994915713 conn(0x7fc7ac0fcb80 msgr2=0x7fc7ac0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3994915713 shutdown_connections 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.235+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3994915713 wait complete. 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 Processor -- start 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 -- start start 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d5d0 con 0x7fc7ac101970 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d450 con 0x7fc7ac102bb0 2024-05-20T17:31:15.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7b0bb7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d750 con 0x7fc7ac1078b0 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50072/0 (socket says 172.21.15.135:50072) 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 -- 172.21.15.135:0/3046255627 learned_addr learned my addr 172.21.15.135:0/3046255627 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7a9d9b640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 -- 172.21.15.135:0/3046255627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac1078b0 msgr2=0x7fc7ac1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aad9d640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac1a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 -- 172.21.15.135:0/3046255627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 msgr2=0x7fc7ac1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7aa59c640 1 -- 172.21.15.135:0/3046255627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac1a0cf0 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.236+0000 7fc7a9d9b640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc7aa59c640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c970 tx=0x7fc79c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c007c70 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc79c007e10 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac1a0fe0 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0188c0 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.237+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac1a14a0 con 0x7fc7ac101970 2024-05-20T17:31:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.238+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac1a1760 con 0x7fc7ac101970 2024-05-20T17:31:15.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.240+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc79c00f450 con 0x7fc7ac101970 2024-05-20T17:31:15.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.241+0000 7fc79b7fe640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 0x7fc7940a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.241+0000 7fc7a9d9b640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 0x7fc7940a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.241+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fc79c0cf130 con 0x7fc7ac101970 2024-05-20T17:31:15.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.241+0000 7fc7a9d9b640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 0x7fc7940a5120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00058c0 tx=0x7fc7a0005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.244+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc79c014030 con 0x7fc7ac101970 2024-05-20T17:31:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:14 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2522311532' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:31:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:14 smithi160 ceph-mon[36261]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:31:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:14 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:31:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:14 smithi160 ceph-mon[36261]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:31:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:14 smithi160 ceph-mon[36261]: pgmap v287: 97 pgs: 35 creating+peering, 5 active+clean, 57 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:31:15.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.424+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7ac1a19f0 con 0x7fc7ac101970 2024-05-20T17:31:15.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.425+0000 7fc79b7fe640 1 -- 172.21.15.135:0/3046255627 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22299 (secure 0 0 0) 0x7fc79c09c260 con 0x7fc7ac101970 2024-05-20T17:31:15.427 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:15.427 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":84,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:31:14.132265+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 msgr2=0x7fc7940a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 0x7fc7940a5120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00058c0 tx=0x7fc7a0005d50 comp rx=0 tx=0).stop 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 msgr2=0x7fc7ac199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c970 tx=0x7fc79c00ce30 comp rx=0 tx=0).stop 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 shutdown_connections 2024-05-20T17:31:15.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7940a2c10 0x7fc7940a5120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7ac1078b0 0x7fc7ac1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac102bb0 0x7fc7ac1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 --2- 172.21.15.135:0/3046255627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7ac101970 0x7fc7ac199260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 >> 172.21.15.135:0/3046255627 conn(0x7fc7ac0fcb80 msgr2=0x7fc7ac108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 shutdown_connections 2024-05-20T17:31:15.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.428+0000 7fc7b0bb7640 1 -- 172.21.15.135:0/3046255627 wait complete. 2024-05-20T17:31:15.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:31:15.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 -- 172.21.15.135:0/4021370398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc1019b0 msgr2=0x7f21fc1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 --2- 172.21.15.135:0/4021370398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc1019b0 0x7f21fc1026b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009900 tx=0x7f21f802a410 comp rx=0 tx=0).stop 2024-05-20T17:31:15.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 -- 172.21.15.135:0/4021370398 shutdown_connections 2024-05-20T17:31:15.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 --2- 172.21.15.135:0/4021370398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 --2- 172.21.15.135:0/4021370398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc102bf0 0x7f21fc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 --2- 172.21.15.135:0/4021370398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc1019b0 0x7f21fc1026b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 -- 172.21.15.135:0/4021370398 >> 172.21.15.135:0/4021370398 conn(0x7f21fc0fcba0 msgr2=0x7f21fc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 -- 172.21.15.135:0/4021370398 shutdown_connections 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.554+0000 7f220438f640 1 -- 172.21.15.135:0/4021370398 wait complete. 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 Processor -- start 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 -- start start 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 0x7f21fc198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc10d5e0 con 0x7f21fc102bf0 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc10d460 con 0x7f21fc1078f0 2024-05-20T17:31:15.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220438f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc10d760 con 0x7f21fc1019b0 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50086/0 (socket says 172.21.15.135:50086) 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 -- 172.21.15.135:0/432753229 learned_addr learned my addr 172.21.15.135:0/432753229 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220212b640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 0x7f21fc198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220292c640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 -- 172.21.15.135:0/432753229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 msgr2=0x7f21fc198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 0x7f21fc198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 -- 172.21.15.135:0/432753229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 msgr2=0x7f21fc19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 -- 172.21.15.135:0/432753229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc19fca0 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220212b640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 0x7f21fc198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220292c640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.555+0000 7f220192a640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c920 tx=0x7f21ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.556+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec007c70 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.556+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc073d80 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.556+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21ec007e10 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.556+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec018890 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.556+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc074320 con 0x7f21fc102bf0 2024-05-20T17:31:15.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.557+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc069110 con 0x7f21fc102bf0 2024-05-20T17:31:15.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.558+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f21ec018b10 con 0x7f21fc102bf0 2024-05-20T17:31:15.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.558+0000 7f21f37fe640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 0x7f21e80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.559+0000 7f220212b640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 0x7f21e80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.559+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f21ec0cf3e0 con 0x7f21fc102bf0 2024-05-20T17:31:15.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.559+0000 7f220212b640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 0x7f21e80a50a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009230 tx=0x7f21f8009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.562+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f21ec014030 con 0x7f21fc102bf0 2024-05-20T17:31:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.776+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f21fc106170 con 0x7f21fc102bf0 2024-05-20T17:31:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.781+0000 7f21f37fe640 1 -- 172.21.15.135:0/432753229 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f21ec09c520 con 0x7f21fc102bf0 2024-05-20T17:31:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 msgr2=0x7f21e80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 0x7f21e80a50a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009230 tx=0x7f21f8009560 comp rx=0 tx=0).stop 2024-05-20T17:31:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 msgr2=0x7f21fc198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c920 tx=0x7f21ec00cde0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 shutdown_connections 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f21e80a2b90 0x7f21e80a50a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21fc1078f0 0x7f21fc19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21fc102bf0 0x7f21fc198750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 --2- 172.21.15.135:0/432753229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21fc1019b0 0x7f21fc198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 >> 172.21.15.135:0/432753229 conn(0x7f21fc0fcba0 msgr2=0x7f21fc1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 shutdown_connections 2024-05-20T17:31:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.783+0000 7f220438f640 1 -- 172.21.15.135:0/432753229 wait complete. 2024-05-20T17:31:15.797 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-20T17:31:15.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 -- 172.21.15.135:0/3491281322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 msgr2=0x7f67d4102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/3491281322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4102690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009900 tx=0x7f67c402a410 comp rx=0 tx=0).stop 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 -- 172.21.15.135:0/3491281322 shutdown_connections 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/3491281322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 0x7f67d4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/3491281322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 0x7f67d4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.908+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/3491281322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4102690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.909+0000 7f67d9e7a640 1 -- 172.21.15.135:0/3491281322 >> 172.21.15.135:0/3491281322 conn(0x7f67d40fcb80 msgr2=0x7f67d40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.909+0000 7f67d9e7a640 1 -- 172.21.15.135:0/3491281322 shutdown_connections 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.909+0000 7f67d9e7a640 1 -- 172.21.15.135:0/3491281322 wait complete. 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.909+0000 7f67d9e7a640 1 Processor -- start 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.909+0000 7f67d9e7a640 1 -- start start 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 0x7f67d4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 0x7f67d419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410d6b0 con 0x7f67d4101990 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410d530 con 0x7f67d41078d0 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410d830 con 0x7f67d4102bd0 2024-05-20T17:31:15.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50096/0 (socket says 172.21.15.135:50096) 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 -- 172.21.15.135:0/4115642922 learned_addr learned my addr 172.21.15.135:0/4115642922 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d2ffd640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 0x7f67d4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d3fff640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 0x7f67d419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 -- 172.21.15.135:0/4115642922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 msgr2=0x7f67d4198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 0x7f67d4198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 -- 172.21.15.135:0/4115642922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 msgr2=0x7f67d419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 0x7f67d419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 -- 172.21.15.135:0/4115642922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d419fde0 con 0x7f67d4101990 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d37fe640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f67c4031610 tx=0x7f67c4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4046070 con 0x7f67d4101990 2024-05-20T17:31:15.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c4003ad0 con 0x7f67d4101990 2024-05-20T17:31:15.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d4073d80 con 0x7f67d4101990 2024-05-20T17:31:15.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4035050 con 0x7f67d4101990 2024-05-20T17:31:15.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.910+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d40742f0 con 0x7f67d4101990 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.912+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d4106150 con 0x7f67d4101990 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.913+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f67c4049070 con 0x7f67d4101990 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.913+0000 7f67d0ff9640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 0x7f67bc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.913+0000 7f67d2ffd640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 0x7f67bc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.913+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f67c40f0ad0 con 0x7f67d4101990 2024-05-20T17:31:15.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.914+0000 7f67d2ffd640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 0x7f67bc0a50a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67d41993b0 tx=0x7f67c80094a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:15.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:15.918+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f67c40bdb80 con 0x7f67d4101990 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2367104146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3046255627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:15 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:31:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.130+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f67d419ffb0 con 0x7f67d4101990 2024-05-20T17:31:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:31:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:31:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:31:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:31:16.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:31:16.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2367104146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3046255627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:15 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:31:16.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:31:16.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:31:16.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2506785627' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:31:16.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:31:16.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:31:16.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2367104146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3046255627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:16.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:15 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:31:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.792+0000 7f67d0ff9640 1 -- 172.21.15.135:0/4115642922 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7f67c40bd480 con 0x7f67d4101990 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 msgr2=0x7f67bc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 0x7f67bc0a50a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67d41993b0 tx=0x7f67c80094a0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 msgr2=0x7f67d4198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f67c4031610 tx=0x7f67c4032c60 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 shutdown_connections 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f67bc0a2b90 0x7f67bc0a50a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d41078d0 0x7f67d419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d4102bd0 0x7f67d4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 --2- 172.21.15.135:0/4115642922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d4101990 0x7f67d4198310 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.794+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 >> 172.21.15.135:0/4115642922 conn(0x7f67d40fcb80 msgr2=0x7f67d41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.795+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 shutdown_connections 2024-05-20T17:31:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.795+0000 7f67d9e7a640 1 -- 172.21.15.135:0/4115642922 wait complete. 2024-05-20T17:31:16.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 -- 172.21.15.135:0/1707379810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b881078f0 msgr2=0x7f5b88109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 --2- 172.21.15.135:0/1707379810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b881078f0 0x7f5b88109d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009ca0 tx=0x7f5b8002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 -- 172.21.15.135:0/1707379810 shutdown_connections 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 --2- 172.21.15.135:0/1707379810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b881078f0 0x7f5b88109d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 --2- 172.21.15.135:0/1707379810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b88102bf0 0x7f5b88103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 --2- 172.21.15.135:0/1707379810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b881019b0 0x7f5b881026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 -- 172.21.15.135:0/1707379810 >> 172.21.15.135:0/1707379810 conn(0x7f5b880fcba0 msgr2=0x7f5b880ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 -- 172.21.15.135:0/1707379810 shutdown_connections 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.925+0000 7f5b9027a640 1 -- 172.21.15.135:0/1707379810 wait complete. 2024-05-20T17:31:16.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 Processor -- start 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 -- start start 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b881019b0 0x7f5b881981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b881078f0 0x7f5b8819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8810d680 con 0x7f5b88102bf0 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8810d500 con 0x7f5b881019b0 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b9027a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8810d800 con 0x7f5b881078f0 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50102/0 (socket says 172.21.15.135:50102) 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 -- 172.21.15.135:0/2003889951 learned_addr learned my addr 172.21.15.135:0/2003889951 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 -- 172.21.15.135:0/2003889951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b881078f0 msgr2=0x7f5b8819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:16.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b881078f0 0x7f5b8819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 -- 172.21.15.135:0/2003889951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b881019b0 msgr2=0x7f5b881981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b881019b0 0x7f5b881981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.926+0000 7f5b8d815640 1 -- 172.21.15.135:0/2003889951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8819fd30 con 0x7f5b88102bf0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b8d815640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400d990 tx=0x7f5b8400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8401b070 con 0x7f5b88102bf0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8400edf0 con 0x7f5b88102bf0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b88073de0 con 0x7f5b88102bf0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84014870 con 0x7f5b88102bf0 2024-05-20T17:31:16.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.927+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b88074360 con 0x7f5b88102bf0 2024-05-20T17:31:16.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.928+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b88106170 con 0x7f5b88102bf0 2024-05-20T17:31:16.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.929+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5b8401e070 con 0x7f5b88102bf0 2024-05-20T17:31:16.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.930+0000 7f5b7b7fe640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 0x7f5b740a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:16.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.930+0000 7f5b8e016640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 0x7f5b740a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:16.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.931+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f5b840d0b60 con 0x7f5b88102bf0 2024-05-20T17:31:16.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.931+0000 7f5b8e016640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 0x7f5b740a50a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c005fd0 tx=0x7f5b7c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:16.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:16.934+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b8409dc10 con 0x7f5b88102bf0 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:active 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-20T17:31:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:16 smithi172 ceph-mon[36511]: pgmap v290: 97 pgs: 35 creating+peering, 26 active+clean, 36 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-20T17:31:17.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.148+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5b88106390 con 0x7f5b88102bf0 2024-05-20T17:31:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:31:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:active 2024-05-20T17:31:17.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:17.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:31:17.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-20T17:31:17.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:16 smithi135 ceph-mon[32027]: pgmap v290: 97 pgs: 35 creating+peering, 26 active+clean, 36 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-20T17:31:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/432753229' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:31:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] up:active 2024-05-20T17:31:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:31:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-20T17:31:17.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:16 smithi160 ceph-mon[36261]: pgmap v290: 97 pgs: 35 creating+peering, 26 active+clean, 36 unknown; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-20T17:31:17.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.800+0000 7f5b7b7fe640 1 -- 172.21.15.135:0/2003889951 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f5b8409d510 con 0x7f5b88102bf0 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 msgr2=0x7f5b740a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 0x7f5b740a50a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c005fd0 tx=0x7f5b7c00b410 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 msgr2=0x7f5b88198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400d990 tx=0x7f5b8400de50 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 shutdown_connections 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b740a2b90 0x7f5b740a50a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b881078f0 0x7f5b8819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b88102bf0 0x7f5b88198730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 --2- 172.21.15.135:0/2003889951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b881019b0 0x7f5b881981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 >> 172.21.15.135:0/2003889951 conn(0x7f5b880fcba0 msgr2=0x7f5b881038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:17.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 shutdown_connections 2024-05-20T17:31:17.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.803+0000 7f5b9027a640 1 -- 172.21.15.135:0/2003889951 wait complete. 2024-05-20T17:31:17.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-20T17:31:17.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 -- 172.21.15.135:0/3840739460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4103cd0 msgr2=0x7fd2f41040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/3840739460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4103cd0 0x7fd2f41040e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009900 tx=0x7fd2dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 -- 172.21.15.135:0/3840739460 shutdown_connections 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/3840739460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 0x7fd2f410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/3840739460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4103cd0 0x7fd2f41040e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/3840739460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4102a90 0x7fd2f4103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 -- 172.21.15.135:0/3840739460 >> 172.21.15.135:0/3840739460 conn(0x7fd2f40fdc80 msgr2=0x7fd2f4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 -- 172.21.15.135:0/3840739460 shutdown_connections 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.940+0000 7fd2f95d5640 1 -- 172.21.15.135:0/3840739460 wait complete. 2024-05-20T17:31:17.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 Processor -- start 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 -- start start 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4103cd0 0x7fd2f4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 0x7fd2f41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e710 con 0x7fd2f4102a90 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e590 con 0x7fd2f4103cd0 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f95d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e890 con 0x7fd2f41089d0 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50120/0 (socket says 172.21.15.135:50120) 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2f2ffd640 1 -- 172.21.15.135:0/2256560307 learned_addr learned my addr 172.21.15.135:0/2256560307 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:17.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.941+0000 7fd2ea7fc640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4103cd0 0x7fd2f4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f37fe640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 0x7fd2f41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 -- 172.21.15.135:0/2256560307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 msgr2=0x7fd2f41a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 0x7fd2f41a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 -- 172.21.15.135:0/2256560307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4103cd0 msgr2=0x7fd2f4199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4103cd0 0x7fd2f4199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 -- 172.21.15.135:0/2256560307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f41a0e60 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f2ffd640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e980 tx=0x7fd2e400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400cd80 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f41a1150 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e4010910 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40189c0 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.942+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f41a16a0 con 0x7fd2f4102a90 2024-05-20T17:31:17.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.943+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f41077e0 con 0x7fd2f4102a90 2024-05-20T17:31:17.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.945+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd2e401f020 con 0x7fd2f4102a90 2024-05-20T17:31:17.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.946+0000 7fd2f0ff9640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 0x7fd2e00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:17.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.946+0000 7fd2ea7fc640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 0x7fd2e00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:17.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.946+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fd2e40cf530 con 0x7fd2f4102a90 2024-05-20T17:31:17.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.946+0000 7fd2ea7fc640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 0x7fd2e00a50a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009230 tx=0x7fd2dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:17.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:17.949+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd2e409c5e0 con 0x7fd2f4102a90 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: Cluster is now healthy 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:31:18.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:31:18.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:17 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:31:18.157 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: Cluster is now healthy 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:31:18.158 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:17 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:31:18.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:18.164+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd2f402d2a0 con 0x7fd2f4102a90 2024-05-20T17:31:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:31:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: Cluster is now healthy 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4115642922' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:31:18.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:17 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:31:18.506 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: 2024-05-20T17:31:18.254+0000 7fb2ca869700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:31:18.506 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: 2024-05-20T17:31:18.254+0000 7fb2ca869700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-20T17:31:18.506 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: 2024-05-20T17:31:18.254+0000 7fb2ca869700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-20T17:31:19.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.023+0000 7fd2f0ff9640 1 -- 172.21.15.135:0/2256560307 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fd2e409bee0 con 0x7fd2f4102a90 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 msgr2=0x7fd2e00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 0x7fd2e00a50a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009230 tx=0x7fd2dc031400 comp rx=0 tx=0).stop 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 msgr2=0x7fd2f4199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e980 tx=0x7fd2e400ee40 comp rx=0 tx=0).stop 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 shutdown_connections 2024-05-20T17:31:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd2e00a2b90 0x7fd2e00a50a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f41089d0 0x7fd2f41a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4103cd0 0x7fd2f4199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 --2- 172.21.15.135:0/2256560307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4102a90 0x7fd2f4199320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 >> 172.21.15.135:0/2256560307 conn(0x7fd2f40fdc80 msgr2=0x7fd2f41049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 shutdown_connections 2024-05-20T17:31:19.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.026+0000 7fd2f95d5640 1 -- 172.21.15.135:0/2256560307 wait complete. 2024-05-20T17:31:19.042 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-05-20T17:31:19.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-20T17:31:19.066 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: Cluster is now healthy 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-20T17:31:19.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-20T17:31:19.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-20T17:31:19.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:31:19.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:19.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:31:19.068 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:18 smithi135 ceph-mon[32027]: pgmap v291: 97 pgs: 30 creating+peering, 65 active+clean, 2 unknown; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 344 B/s rd, 3.4 KiB/s wr, 11 op/s 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: Cluster is now healthy 2024-05-20T17:31:19.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:31:19.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:18 smithi172 ceph-mon[36511]: pgmap v291: 97 pgs: 30 creating+peering, 65 active+clean, 2 unknown; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 344 B/s rd, 3.4 KiB/s wr, 11 op/s 2024-05-20T17:31:19.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 -- 172.21.15.135:0/1294192190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe841078d0 msgr2=0x7fbe84109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 --2- 172.21.15.135:0/1294192190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe841078d0 0x7fbe84109cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009ca0 tx=0x7fbe7c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 -- 172.21.15.135:0/1294192190 shutdown_connections 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 --2- 172.21.15.135:0/1294192190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe841078d0 0x7fbe84109cf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 --2- 172.21.15.135:0/1294192190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe84102bd0 0x7fbe84102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 --2- 172.21.15.135:0/1294192190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 -- 172.21.15.135:0/1294192190 >> 172.21.15.135:0/1294192190 conn(0x7fbe840fcb80 msgr2=0x7fbe840ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 -- 172.21.15.135:0/1294192190 shutdown_connections 2024-05-20T17:31:19.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.161+0000 7fbe8b977640 1 -- 172.21.15.135:0/1294192190 wait complete. 2024-05-20T17:31:19.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 Processor -- start 2024-05-20T17:31:19.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 -- start start 2024-05-20T17:31:19.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe841078d0 0x7fbe841a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8410e710 con 0x7fbe84102bd0 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8410e590 con 0x7fbe841078d0 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe8b977640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8410e890 con 0x7fbe84101990 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50130/0 (socket says 172.21.15.135:50130) 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 -- 172.21.15.135:0/276533938 learned_addr learned my addr 172.21.15.135:0/276533938 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe89713640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe89f14640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe841078d0 0x7fbe841a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 -- 172.21.15.135:0/276533938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 msgr2=0x7fbe84199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 -- 172.21.15.135:0/276533938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe841078d0 msgr2=0x7fbe841a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe841078d0 0x7fbe841a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 -- 172.21.15.135:0/276533938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe841a10c0 con 0x7fbe84102bd0 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe89713640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.162+0000 7fbe88f12640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9f0 tx=0x7fbe7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.163+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400cd80 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.163+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe841a13b0 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.163+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe74010910 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.163+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe740188f0 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.163+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841a1950 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.164+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe841066e0 con 0x7fbe84102bd0 2024-05-20T17:31:19.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.165+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fbe74010ac0 con 0x7fbe84102bd0 2024-05-20T17:31:19.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.166+0000 7fbe7a7fc640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 0x7fbe700a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.166+0000 7fbe89713640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 0x7fbe700a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.166+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fbe740cf6b0 con 0x7fbe84102bd0 2024-05-20T17:31:19.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.166+0000 7fbe89713640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 0x7fbe700a50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe84102590 tx=0x7fbe80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.169+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbe7409c110 con 0x7fbe84102bd0 2024-05-20T17:31:19.177 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2003889951' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: Cluster is now healthy 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:19.178 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:31:19.179 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:18 smithi160 ceph-mon[36261]: pgmap v291: 97 pgs: 30 creating+peering, 65 active+clean, 2 unknown; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 344 B/s rd, 3.4 KiB/s wr, 11 op/s 2024-05-20T17:31:19.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.370+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbe8402d3e0 con 0x7fbe700a2b90 2024-05-20T17:31:19.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.399+0000 7fbe7a7fc640 1 -- 172.21.15.135:0/276533938 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbe8402d3e0 con 0x7fbe700a2b90 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 msgr2=0x7fbe700a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 0x7fbe700a50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe84102590 tx=0x7fbe80005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 msgr2=0x7fbe84199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9f0 tx=0x7fbe7400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 shutdown_connections 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbe700a2b90 0x7fbe700a50a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe841078d0 0x7fbe841a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe84102bd0 0x7fbe84199ac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 --2- 172.21.15.135:0/276533938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe84101990 0x7fbe84199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 >> 172.21.15.135:0/276533938 conn(0x7fbe840fcb80 msgr2=0x7fbe841038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 shutdown_connections 2024-05-20T17:31:19.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.401+0000 7fbe8b977640 1 -- 172.21.15.135:0/276533938 wait complete. 2024-05-20T17:31:19.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2991550344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b81078d0 msgr2=0x7ff2b8109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2991550344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b81078d0 0x7ff2b8109cf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009ca0 tx=0x7ff2b002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2991550344 shutdown_connections 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2991550344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b81078d0 0x7ff2b8109cf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2991550344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 0x7ff2b8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2991550344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b8101990 0x7ff2b8102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2991550344 >> 172.21.15.135:0/2991550344 conn(0x7ff2b80fcb80 msgr2=0x7ff2b80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2991550344 shutdown_connections 2024-05-20T17:31:19.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.569+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2991550344 wait complete. 2024-05-20T17:31:19.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 Processor -- start 2024-05-20T17:31:19.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 -- start start 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 0x7ff2b819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 0x7ff2b81a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b810d640 con 0x7ff2b8101990 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b810d4c0 con 0x7ff2b8102bd0 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2bd9f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b810d7c0 con 0x7ff2b81078d0 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33694/0 (socket says 172.21.15.135:33694) 2024-05-20T17:31:19.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2b6ffd640 1 -- 172.21.15.135:0/2162839356 learned_addr learned my addr 172.21.15.135:0/2162839356 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2b67fc640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 0x7ff2b819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.570+0000 7ff2b77fe640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 0x7ff2b81a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 -- 172.21.15.135:0/2162839356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 msgr2=0x7ff2b81a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 0x7ff2b81a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 -- 172.21.15.135:0/2162839356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 msgr2=0x7ff2b819e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 0x7ff2b819e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 -- 172.21.15.135:0/2162839356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b81a0dd0 con 0x7ff2b8101990 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b77fe640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 0x7ff2b81a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2b6ffd640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c970 tx=0x7ff2a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004220 con 0x7ff2b8101990 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b81a10c0 con 0x7ff2b8101990 2024-05-20T17:31:19.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a80043c0 con 0x7ff2b8101990 2024-05-20T17:31:19.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800f450 con 0x7ff2b8101990 2024-05-20T17:31:19.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.571+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b81a1660 con 0x7ff2b8101990 2024-05-20T17:31:19.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.572+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b81066e0 con 0x7ff2b8101990 2024-05-20T17:31:19.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.573+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff2a80079b0 con 0x7ff2b8101990 2024-05-20T17:31:19.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.574+0000 7ff2bc9f3640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 0x7ff2a00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.574+0000 7ff2b67fc640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 0x7ff2a00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.574+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ff2a80cef90 con 0x7ff2b8101990 2024-05-20T17:31:19.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.574+0000 7ff2b67fc640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 0x7ff2a00a50a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8074190 tx=0x7ff2ac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.577+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2a8014030 con 0x7ff2b8101990 2024-05-20T17:31:19.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:31:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:31:19.375+0000 7f5817f8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:31:19.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:31:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:31:19.375+0000 7f5817f8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:31:19.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:31:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:31:19.375+0000 7f5817f8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:31:19.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:31:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:31:19.375+0000 7f5817f8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:31:19.705 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:31:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:31:19.375+0000 7f5817f8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:31:19.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.780+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff2b8061f90 con 0x7ff2a00a2b90 2024-05-20T17:31:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.806+0000 7ff2bc9f3640 1 -- 172.21.15.135:0/2162839356 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff2b8061f90 con 0x7ff2a00a2b90 2024-05-20T17:31:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 msgr2=0x7ff2a00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 0x7ff2a00a50a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8074190 tx=0x7ff2ac00b390 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 msgr2=0x7ff2b80747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c970 tx=0x7ff2a800ce30 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 shutdown_connections 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff2a00a2b90 0x7ff2a00a50a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b81078d0 0x7ff2b81a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b8102bd0 0x7ff2b819e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 --2- 172.21.15.135:0/2162839356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b8101990 0x7ff2b80747f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 >> 172.21.15.135:0/2162839356 conn(0x7ff2b80fcb80 msgr2=0x7ff2b81038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 shutdown_connections 2024-05-20T17:31:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.809+0000 7ff2bd9f5640 1 -- 172.21.15.135:0/2162839356 wait complete. 2024-05-20T17:31:19.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-20T17:31:19.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2825563460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c1019a0 msgr2=0x7f0b9c1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2825563460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1026a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009900 tx=0x7f0b8c02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:19.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2825563460 shutdown_connections 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2825563460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1078e0 0x7f0b9c109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2825563460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c102be0 0x7f0b9c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2825563460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1026a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2825563460 >> 172.21.15.135:0/2825563460 conn(0x7f0b9c0fcb70 msgr2=0x7f0b9c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2825563460 shutdown_connections 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.937+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2825563460 wait complete. 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 Processor -- start 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 -- start start 2024-05-20T17:31:19.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c1078e0 0x7f0b9c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10d5f0 con 0x7f0b9c102be0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10d470 con 0x7f0b9c1078e0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba27e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10d770 con 0x7f0b9c1019a0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33710/0 (socket says 172.21.15.135:33710) 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 -- 172.21.15.135:0/2238066555 learned_addr learned my addr 172.21.15.135:0/2238066555 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0ba0d7d640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c1078e0 0x7f0b9c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b9bfff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 -- 172.21.15.135:0/2238066555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1019a0 msgr2=0x7f0b9c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 -- 172.21.15.135:0/2238066555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c1078e0 msgr2=0x7f0b9c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c1078e0 0x7f0b9c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.938+0000 7f0b93fff640 1 -- 172.21.15.135:0/2238066555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c19fd30 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0b93fff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400cd80 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b84010910 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c19ffc0 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840188f0 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.939+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c1a0480 con 0x7f0b9c102be0 2024-05-20T17:31:19.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.940+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9c1066f0 con 0x7f0b9c102be0 2024-05-20T17:31:19.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.941+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0b84010ac0 con 0x7f0b9c102be0 2024-05-20T17:31:19.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.942+0000 7f0b99ffb640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 0x7f0b880a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:19.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.942+0000 7f0b9bfff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 0x7f0b880a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:19.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.942+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f0b840cf6e0 con 0x7f0b9c102be0 2024-05-20T17:31:19.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.942+0000 7f0b9bfff640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 0x7f0b880a50a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009230 tx=0x7f0b8c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:19.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:19.945+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b8409c790 con 0x7f0b9c102be0 2024-05-20T17:31:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.148+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0b9c062020 con 0x7f0b880a2b90 2024-05-20T17:31:20.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.153+0000 7f0b99ffb640 1 -- 172.21.15.135:0/2238066555 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0b9c062020 con 0x7f0b880a2b90 2024-05-20T17:31:20.156 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_0/c94bb977-a9f2-4af4-9121-3ed5bc8acab2 2024-05-20T17:31:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 msgr2=0x7f0b880a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 0x7f0b880a50a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009230 tx=0x7f0b8c031400 comp rx=0 tx=0).stop 2024-05-20T17:31:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 msgr2=0x7f0b9c198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 shutdown_connections 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0b880a2b90 0x7f0b880a50a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b9c1078e0 0x7f0b9c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b9c102be0 0x7f0b9c198730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 --2- 172.21.15.135:0/2238066555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b9c1019a0 0x7f0b9c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 >> 172.21.15.135:0/2238066555 conn(0x7f0b9c0fcb70 msgr2=0x7f0b9c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 shutdown_connections 2024-05-20T17:31:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.156+0000 7f0ba27e0640 1 -- 172.21.15.135:0/2238066555 wait complete. 2024-05-20T17:31:20.168 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:31:20.168 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:20 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:20.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:20 smithi135 ceph-mon[32027]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:20.170 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-20T17:31:20.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2485892401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681029f0 msgr2=0x7f6e68102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2485892401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681029f0 0x7f6e68102e00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009900 tx=0x7f6e5c02a410 comp rx=0 tx=0).stop 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2485892401 shutdown_connections 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2485892401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681076f0 0x7f6e68109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2485892401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681029f0 0x7f6e68102e00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2485892401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681017b0 0x7f6e681024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2485892401 >> 172.21.15.135:0/2485892401 conn(0x7f6e680fc9a0 msgr2=0x7f6e680fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2485892401 shutdown_connections 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2485892401 wait complete. 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 Processor -- start 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.283+0000 7f6e6d99d640 1 -- start start 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681017b0 0x7f6e68199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681029f0 0x7f6e68199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810e530 con 0x7f6e681076f0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810e3b0 con 0x7f6e681029f0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810e6b0 con 0x7f6e681017b0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33730/0 (socket says 172.21.15.135:33730) 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 -- 172.21.15.135:0/2766240692 learned_addr learned my addr 172.21.15.135:0/2766240692 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e67fff640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681029f0 0x7f6e68199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6c99b640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681017b0 0x7f6e68199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 -- 172.21.15.135:0/2766240692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681017b0 msgr2=0x7f6e68199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681017b0 0x7f6e68199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 -- 172.21.15.135:0/2766240692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681029f0 msgr2=0x7f6e68199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681029f0 0x7f6e68199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 -- 172.21.15.135:0/2766240692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e681a0b50 con 0x7f6e681076f0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d19c640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000cce0 tx=0x7f6e6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000f450 con 0x7f6e681076f0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e6000fad0 con 0x7f6e681076f0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e681a0e40 con 0x7f6e681076f0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.284+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60018c10 con 0x7f6e681076f0 2024-05-20T17:31:20.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.285+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e681a12a0 con 0x7f6e681076f0 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.285+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e68106500 con 0x7f6e681076f0 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.287+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6e6000f5f0 con 0x7f6e681076f0 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.287+0000 7f6e65ffb640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 0x7f6e500a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.287+0000 7f6e6c99b640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 0x7f6e500a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.287+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f6e600cf530 con 0x7f6e681076f0 2024-05-20T17:31:20.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.288+0000 7f6e6c99b640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 0x7f6e500a5090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e681023b0 tx=0x7f6e58005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:20.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.292+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e60014030 con 0x7f6e681076f0 2024-05-20T17:31:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:20 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:31:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:20 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:20 smithi172 ceph-mon[36511]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:20.376 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:20 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2256560307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:31:20.376 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:20 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:31:20.376 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:20 smithi160 ceph-mon[36261]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:20.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.494+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6e68061f90 con 0x7f6e500a2b80 2024-05-20T17:31:20.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.519+0000 7f6e65ffb640 1 -- 172.21.15.135:0/2766240692 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e68061f90 con 0x7f6e500a2b80 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 msgr2=0x7f6e500a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 0x7f6e500a5090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e681023b0 tx=0x7f6e58005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 msgr2=0x7f6e681a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000cce0 tx=0x7f6e6000a620 comp rx=0 tx=0).stop 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 shutdown_connections 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6e500a2b80 0x7f6e500a5090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e681076f0 0x7f6e681a0590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e681029f0 0x7f6e68199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 --2- 172.21.15.135:0/2766240692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e681017b0 0x7f6e68199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.521+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 >> 172.21.15.135:0/2766240692 conn(0x7f6e680fc9a0 msgr2=0x7f6e681036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.522+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 shutdown_connections 2024-05-20T17:31:20.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.522+0000 7f6e6d99d640 1 -- 172.21.15.135:0/2766240692 wait complete. 2024-05-20T17:31:20.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-20T17:31:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 -- 172.21.15.135:0/1929738928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 msgr2=0x7fa800102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 --2- 172.21.15.135:0/1929738928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800102fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009900 tx=0x7fa7f002a410 comp rx=0 tx=0).stop 2024-05-20T17:31:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 -- 172.21.15.135:0/1929738928 shutdown_connections 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 --2- 172.21.15.135:0/1929738928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8001078d0 0x7fa800109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 --2- 172.21.15.135:0/1929738928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800102fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 --2- 172.21.15.135:0/1929738928 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa800101990 0x7fa800102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 -- 172.21.15.135:0/1929738928 >> 172.21.15.135:0/1929738928 conn(0x7fa8000fcb80 msgr2=0x7fa8000ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 -- 172.21.15.135:0/1929738928 shutdown_connections 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.648+0000 7fa807ca0640 1 -- 172.21.15.135:0/1929738928 wait complete. 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 Processor -- start 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 -- start start 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800101990 0x7fa8001995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8001078d0 0x7fa8001a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa80010e710 con 0x7fa800102bd0 2024-05-20T17:31:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa80010e590 con 0x7fa8001078d0 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa807ca0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa80010e890 con 0x7fa800101990 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33752/0 (socket says 172.21.15.135:33752) 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 -- 172.21.15.135:0/4053772252 learned_addr learned my addr 172.21.15.135:0/4053772252 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80623d640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8001078d0 0x7fa8001a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa805a3c640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800101990 0x7fa8001995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 -- 172.21.15.135:0/4053772252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800101990 msgr2=0x7fa8001995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800101990 0x7fa8001995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 -- 172.21.15.135:0/4053772252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8001078d0 msgr2=0x7fa8001a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8001078d0 0x7fa8001a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 -- 172.21.15.135:0/4053772252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8001a1110 con 0x7fa800102bd0 2024-05-20T17:31:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.649+0000 7fa80523b640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0006010 tx=0x7fa7f0031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.650+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f003f030 con 0x7fa800102bd0 2024-05-20T17:31:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.650+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f0003ad0 con 0x7fa800102bd0 2024-05-20T17:31:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.650+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8001a13a0 con 0x7fa800102bd0 2024-05-20T17:31:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.650+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0035070 con 0x7fa800102bd0 2024-05-20T17:31:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.650+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8001a1890 con 0x7fa800102bd0 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.651+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8001066e0 con 0x7fa800102bd0 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.652+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa7f0042030 con 0x7fa800102bd0 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.653+0000 7fa7f6ffd640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 0x7fa7ec0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.653+0000 7fa805a3c640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 0x7fa7ec0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.653+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fa7f00efb00 con 0x7fa800102bd0 2024-05-20T17:31:20.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.653+0000 7fa805a3c640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 0x7fa7ec0a50a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa800102590 tx=0x7fa7fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.656+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa7f00bcbb0 con 0x7fa800102bd0 2024-05-20T17:31:20.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.860+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa80002d4d0 con 0x7fa7ec0a2b90 2024-05-20T17:31:20.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.865+0000 7fa7f6ffd640 1 -- 172.21.15.135:0/4053772252 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa80002d4d0 con 0x7fa7ec0a2b90 2024-05-20T17:31:20.868 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a 2024-05-20T17:31:20.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 msgr2=0x7fa7ec0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 0x7fa7ec0a50a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa800102590 tx=0x7fa7fc005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:20.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 msgr2=0x7fa800199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0006010 tx=0x7fa7f0031b60 comp rx=0 tx=0).stop 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 shutdown_connections 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7ec0a2b90 0x7fa7ec0a50a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8001078d0 0x7fa8001a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa800102bd0 0x7fa800199b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 --2- 172.21.15.135:0/4053772252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800101990 0x7fa8001995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 >> 172.21.15.135:0/4053772252 conn(0x7fa8000fcb80 msgr2=0x7fa8001038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 shutdown_connections 2024-05-20T17:31:20.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.868+0000 7fa807ca0640 1 -- 172.21.15.135:0/4053772252 wait complete. 2024-05-20T17:31:20.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 -- 172.21.15.135:0/914191265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c1078b0 msgr2=0x7f4d4c109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 --2- 172.21.15.135:0/914191265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c109cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009ca0 tx=0x7f4d3c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 -- 172.21.15.135:0/914191265 shutdown_connections 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 --2- 172.21.15.135:0/914191265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c109cd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 --2- 172.21.15.135:0/914191265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 --2- 172.21.15.135:0/914191265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 -- 172.21.15.135:0/914191265 >> 172.21.15.135:0/914191265 conn(0x7f4d4c0fcb80 msgr2=0x7f4d4c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:20.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 -- 172.21.15.135:0/914191265 shutdown_connections 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.989+0000 7f4d54372640 1 -- 172.21.15.135:0/914191265 wait complete. 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 Processor -- start 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 -- start start 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c10d5f0 con 0x7f4d4c102bb0 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c10d470 con 0x7f4d4c101970 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d54372640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c10d770 con 0x7f4d4c1078b0 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33764/0 (socket says 172.21.15.135:33764) 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 -- 172.21.15.135:0/1251134025 learned_addr learned my addr 172.21.15.135:0/1251134025 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5210e640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 -- 172.21.15.135:0/1251134025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 msgr2=0x7f4d4c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5290f640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 -- 172.21.15.135:0/1251134025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 msgr2=0x7f4d4c198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 -- 172.21.15.135:0/1251134025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c19fc60 con 0x7f4d4c102bb0 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5210e640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5290f640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.990+0000 7f4d5190d640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000d770 tx=0x7f4d4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.991+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40017070 con 0x7f4d4c102bb0 2024-05-20T17:31:20.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.991+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d40005500 con 0x7f4d4c102bb0 2024-05-20T17:31:20.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.991+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c19ff50 con 0x7f4d4c102bb0 2024-05-20T17:31:20.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.991+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004e00 con 0x7f4d4c102bb0 2024-05-20T17:31:20.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.991+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c1a03c0 con 0x7f4d4c102bb0 2024-05-20T17:31:20.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.992+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c1066c0 con 0x7f4d4c102bb0 2024-05-20T17:31:20.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.994+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4d40004fa0 con 0x7f4d4c102bb0 2024-05-20T17:31:20.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.994+0000 7f4d4b7fe640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 0x7f4d340a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:20.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.995+0000 7f4d5210e640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 0x7f4d340a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:20.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.995+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f4d400cede0 con 0x7f4d4c102bb0 2024-05-20T17:31:20.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.995+0000 7f4d5210e640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 0x7f4d340a5120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c102570 tx=0x7f4d44005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:21.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:20.998+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4d4009bf10 con 0x7f4d4c102bb0 2024-05-20T17:31:21.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.037+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4d40097e80 con 0x7f4d4c102bb0 2024-05-20T17:31:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:21 smithi135 ceph-mon[32027]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:21 smithi135 ceph-mon[32027]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:21 smithi135 ceph-mon[32027]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:21 smithi135 ceph-mon[32027]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-20T17:31:21.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.219+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d4c02d2a0 con 0x7f4d4c102bb0 2024-05-20T17:31:21.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.220+0000 7f4d4b7fe640 1 -- 172.21.15.135:0/1251134025 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f4d400c6d30 con 0x7f4d4c102bb0 2024-05-20T17:31:21.223 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:21.223 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:31:21.223 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 msgr2=0x7f4d340a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 0x7f4d340a5120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c102570 tx=0x7f4d44005f90 comp rx=0 tx=0).stop 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 msgr2=0x7f4d4c1986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000d770 tx=0x7f4d4000dc30 comp rx=0 tx=0).stop 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 shutdown_connections 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f4d340a2c10 0x7f4d340a5120 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d4c1078b0 0x7f4d4c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d4c102bb0 0x7f4d4c1986d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 --2- 172.21.15.135:0/1251134025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d4c101970 0x7f4d4c198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.222+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 >> 172.21.15.135:0/1251134025 conn(0x7f4d4c0fcb80 msgr2=0x7f4d4c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:21.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.223+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 shutdown_connections 2024-05-20T17:31:21.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.223+0000 7f4d54372640 1 -- 172.21.15.135:0/1251134025 wait complete. 2024-05-20T17:31:21.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:31:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:21 smithi172 ceph-mon[36511]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:21 smithi172 ceph-mon[36511]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:21 smithi172 ceph-mon[36511]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:21 smithi172 ceph-mon[36511]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-20T17:31:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 -- 172.21.15.135:0/2430815900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0102bb0 msgr2=0x7fc9e0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 --2- 172.21.15.135:0/2430815900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0102bb0 0x7fc9e0102fc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009900 tx=0x7fc9c802a410 comp rx=0 tx=0).stop 2024-05-20T17:31:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 -- 172.21.15.135:0/2430815900 shutdown_connections 2024-05-20T17:31:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 --2- 172.21.15.135:0/2430815900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e01078b0 0x7fc9e0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 --2- 172.21.15.135:0/2430815900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e0102bb0 0x7fc9e0102fc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 --2- 172.21.15.135:0/2430815900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e0102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 -- 172.21.15.135:0/2430815900 >> 172.21.15.135:0/2430815900 conn(0x7fc9e00fcb80 msgr2=0x7fc9e00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 -- 172.21.15.135:0/2430815900 shutdown_connections 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.346+0000 7fc9e5945640 1 -- 172.21.15.135:0/2430815900 wait complete. 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 Processor -- start 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 -- start start 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e00698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e0102bb0 0x7fc9e019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e010d630 con 0x7fc9e01078b0 2024-05-20T17:31:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e010d4b0 con 0x7fc9e0102bb0 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9e5945640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e010d7b0 con 0x7fc9e0101970 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9df7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9df7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33780/0 (socket says 172.21.15.135:33780) 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9df7fe640 1 -- 172.21.15.135:0/3229756075 learned_addr learned my addr 172.21.15.135:0/3229756075 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9deffd640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e00698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.347+0000 7fc9de7fc640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e0102bb0 0x7fc9e019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 -- 172.21.15.135:0/3229756075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 msgr2=0x7fc9e00698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e00698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 -- 172.21.15.135:0/3229756075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e0102bb0 msgr2=0x7fc9e019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e0102bb0 0x7fc9e019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 -- 172.21.15.135:0/3229756075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e01a0d60 con 0x7fc9e01078b0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9deffd640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e00698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9df7fe640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c970 tx=0x7fc9d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0007bb0 con 0x7fc9e01078b0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d0007d50 con 0x7fc9e01078b0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e01a0ff0 con 0x7fc9e01078b0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0018800 con 0x7fc9e01078b0 2024-05-20T17:31:21.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.348+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e01a1460 con 0x7fc9e01078b0 2024-05-20T17:31:21.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.349+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e01066c0 con 0x7fc9e01078b0 2024-05-20T17:31:21.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.350+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc9d000fa50 con 0x7fc9e01078b0 2024-05-20T17:31:21.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.351+0000 7fc9e4943640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 0x7fc9cc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.351+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc9d00cf100 con 0x7fc9e01078b0 2024-05-20T17:31:21.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.351+0000 7fc9deffd640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 0x7fc9cc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.351+0000 7fc9deffd640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 0x7fc9cc0a5130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0102570 tx=0x7fc9d8009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:21.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.355+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc9d0014030 con 0x7fc9e01078b0 2024-05-20T17:31:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:21 smithi160 ceph-mon[36261]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:21 smithi160 ceph-mon[36261]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:21 smithi160 ceph-mon[36261]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:21.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:21 smithi160 ceph-mon[36261]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-20T17:31:21.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.533+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9e002d4c0 con 0x7fc9e01078b0 2024-05-20T17:31:21.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.534+0000 7fc9e4943640 1 -- 172.21.15.135:0/3229756075 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22286 (secure 0 0 0) 0x7fc9d009c0b0 con 0x7fc9e01078b0 2024-05-20T17:31:21.537 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:21.537 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:31:15.781120+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 msgr2=0x7fc9cc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 0x7fc9cc0a5130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0102570 tx=0x7fc9d8009520 comp rx=0 tx=0).stop 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 msgr2=0x7fc9e01a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c970 tx=0x7fc9d000ce30 comp rx=0 tx=0).stop 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 shutdown_connections 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc9cc0a2c20 0x7fc9cc0a5130 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9e01078b0 0x7fc9e01a05d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e0102bb0 0x7fc9e019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 --2- 172.21.15.135:0/3229756075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e0101970 0x7fc9e00698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 >> 172.21.15.135:0/3229756075 conn(0x7fc9e00fcb80 msgr2=0x7fc9e0103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:21.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 shutdown_connections 2024-05-20T17:31:21.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.536+0000 7fc9e5945640 1 -- 172.21.15.135:0/3229756075 wait complete. 2024-05-20T17:31:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:31:21.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 -- 172.21.15.135:0/811439047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c1089c0 msgr2=0x7f2d3c10ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 --2- 172.21.15.135:0/811439047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c10ade0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009ca0 tx=0x7f2d3402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 -- 172.21.15.135:0/811439047 shutdown_connections 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 --2- 172.21.15.135:0/811439047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c10ade0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 --2- 172.21.15.135:0/811439047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c103cc0 0x7f2d3c1040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 --2- 172.21.15.135:0/811439047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c102a80 0x7f2d3c103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 -- 172.21.15.135:0/811439047 >> 172.21.15.135:0/811439047 conn(0x7f2d3c0fdc90 msgr2=0x7f2d3c100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 -- 172.21.15.135:0/811439047 shutdown_connections 2024-05-20T17:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.659+0000 7f2d40baa640 1 -- 172.21.15.135:0/811439047 wait complete. 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 Processor -- start 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 -- start start 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c103cc0 0x7f2d3c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10e700 con 0x7f2d3c102a80 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10e580 con 0x7f2d3c103cc0 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d40baa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c10e880 con 0x7f2d3c1089c0 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d3a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d3a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33806/0 (socket says 172.21.15.135:33806) 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d3a59c640 1 -- 172.21.15.135:0/4233959866 learned_addr learned my addr 172.21.15.135:0/4233959866 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.660+0000 7f2d33fff640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c103cc0 0x7f2d3c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3ad9d640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 -- 172.21.15.135:0/4233959866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c1089c0 msgr2=0x7f2d3c1a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c1a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 -- 172.21.15.135:0/4233959866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c103cc0 msgr2=0x7f2d3c199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c103cc0 0x7f2d3c199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 -- 172.21.15.135:0/4233959866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c1a0d50 con 0x7f2d3c102a80 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d3a59c640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c970 tx=0x7f2d2c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004220 con 0x7f2d3c102a80 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d2c0043c0 con 0x7f2d3c102a80 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c1a0fe0 con 0x7f2d3c102a80 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00f450 con 0x7f2d3c102a80 2024-05-20T17:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.661+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c1a14a0 con 0x7f2d3c102a80 2024-05-20T17:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.662+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c1077d0 con 0x7f2d3c102a80 2024-05-20T17:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.663+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2d2c0079b0 con 0x7f2d3c102a80 2024-05-20T17:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.664+0000 7f2d337fe640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 0x7f2d280a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.664+0000 7f2d33fff640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 0x7f2d280a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.664+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f2d2c0cf0d0 con 0x7f2d3c102a80 2024-05-20T17:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.664+0000 7f2d33fff640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 0x7f2d280a5130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c19a2b0 tx=0x7f2d2400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.667+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d2c014030 con 0x7f2d3c102a80 2024-05-20T17:31:21.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.843+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d3c061f90 con 0x7f2d280a2c20 2024-05-20T17:31:21.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.851+0000 7f2d337fe640 1 -- 172.21.15.135:0/4233959866 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258909 (secure 0 0 0) 0x7f2d3c061f90 con 0x7f2d280a2c20 2024-05-20T17:31:21.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:21.859 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 msgr2=0x7f2d280a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 0x7f2d280a5130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c19a2b0 tx=0x7f2d2400b390 comp rx=0 tx=0).stop 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 msgr2=0x7f2d3c199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c970 tx=0x7f2d2c00ce30 comp rx=0 tx=0).stop 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 shutdown_connections 2024-05-20T17:31:21.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f2d280a2c20 0x7f2d280a5130 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d3c1089c0 0x7f2d3c1a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c103cc0 0x7f2d3c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 --2- 172.21.15.135:0/4233959866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3c102a80 0x7f2d3c199210 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 >> 172.21.15.135:0/4233959866 conn(0x7f2d3c0fdc90 msgr2=0x7f2d3c1049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 shutdown_connections 2024-05-20T17:31:21.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:21.854+0000 7f2d40baa640 1 -- 172.21.15.135:0/4233959866 wait complete. 2024-05-20T17:31:21.868 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-05-20T17:31:20.710051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595456,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":273,"num_write_kb":2967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347712,"kb_used_data":10964,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124594112,"statfs":{"total":1151940427776,"available":1151584370688,"internally_reserved":0,"allocated":11227136,"data_stored":7018360,"data_compressed":107100,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5088,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":92,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.937497"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610510+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:31:16.610510+0000","last_peered":"2024-05-20T17:31:16.610510+0000","last_clean":"2024-05-20T17:31:16.610510+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:31:16.610510+0000","last_undegraded":"2024-05-20T17:31:16.610510+0000","last_fullsized":"2024-05-20T17:31:16.610510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182393+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:31:16.182393+0000","last_peered":"2024-05-20T17:31:16.182393+0000","last_clean":"2024-05-20T17:31:16.182393+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:31:16.182393+0000","last_undegraded":"2024-05-20T17:31:16.182393+0000","last_fullsized":"2024-05-20T17:31:16.182393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182298+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:31:16.182298+0000","last_peered":"2024-05-20T17:31:16.182298+0000","last_clean":"2024-05-20T17:31:16.182298+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:31:16.182298+0000","last_undegraded":"2024-05-20T17:31:16.182298+0000","last_fullsized":"2024-05-20T17:31:16.182298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799415+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:31:16.799415+0000","last_peered":"2024-05-20T17:31:16.799415+0000","last_clean":"2024-05-20T17:31:16.799415+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:31:16.799415+0000","last_undegraded":"2024-05-20T17:31:16.799415+0000","last_fullsized":"2024-05-20T17:31:16.799415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.795273+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:31:14.795273+0000","last_peered":"2024-05-20T17:31:14.795273+0000","last_clean":"2024-05-20T17:31:14.795273+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:31:14.795273+0000","last_undegraded":"2024-05-20T17:31:14.795273+0000","last_fullsized":"2024-05-20T17:31:14.795273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:54.518993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789925+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:31:15.789925+0000","last_peered":"2024-05-20T17:31:15.789925+0000","last_clean":"2024-05-20T17:31:15.789925+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:31:15.789925+0000","last_undegraded":"2024-05-20T17:31:15.789925+0000","last_fullsized":"2024-05-20T17:31:15.789925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.799659+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:31:14.799659+0000","last_peered":"2024-05-20T17:31:14.799659+0000","last_clean":"2024-05-20T17:31:14.799659+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:31:14.799659+0000","last_undegraded":"2024-05-20T17:31:14.799659+0000","last_fullsized":"2024-05-20T17:31:14.799659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:56:46.712189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798538+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:31:15.798538+0000","last_peered":"2024-05-20T17:31:15.798538+0000","last_clean":"2024-05-20T17:31:15.798538+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:31:15.798538+0000","last_undegraded":"2024-05-20T17:31:15.798538+0000","last_fullsized":"2024-05-20T17:31:15.798538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620249+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:31:16.620249+0000","last_peered":"2024-05-20T17:31:16.620249+0000","last_clean":"2024-05-20T17:31:16.620249+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:31:16.620249+0000","last_undegraded":"2024-05-20T17:31:16.620249+0000","last_fullsized":"2024-05-20T17:31:16.620249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789970+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:31:15.789970+0000","last_peered":"2024-05-20T17:31:15.789970+0000","last_clean":"2024-05-20T17:31:15.789970+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:31:15.789970+0000","last_undegraded":"2024-05-20T17:31:15.789970+0000","last_fullsized":"2024-05-20T17:31:15.789970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.800076+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:31:14.800076+0000","last_peered":"2024-05-20T17:31:14.800076+0000","last_clean":"2024-05-20T17:31:14.800076+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:31:14.800076+0000","last_undegraded":"2024-05-20T17:31:14.800076+0000","last_fullsized":"2024-05-20T17:31:14.800076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:37.010520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799629+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:31:16.799629+0000","last_peered":"2024-05-20T17:31:16.799629+0000","last_clean":"2024-05-20T17:31:16.799629+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:31:16.799629+0000","last_undegraded":"2024-05-20T17:31:16.799629+0000","last_fullsized":"2024-05-20T17:31:16.799629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789396+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:31:15.789396+0000","last_peered":"2024-05-20T17:31:15.789396+0000","last_clean":"2024-05-20T17:31:15.789396+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:31:15.789396+0000","last_undegraded":"2024-05-20T17:31:15.789396+0000","last_fullsized":"2024-05-20T17:31:15.789396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182061+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:31:16.182061+0000","last_peered":"2024-05-20T17:31:16.182061+0000","last_clean":"2024-05-20T17:31:16.182061+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:31:16.182061+0000","last_undegraded":"2024-05-20T17:31:16.182061+0000","last_fullsized":"2024-05-20T17:31:16.182061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182028+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:31:16.182028+0000","last_peered":"2024-05-20T17:31:16.182028+0000","last_clean":"2024-05-20T17:31:16.182028+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:31:16.182028+0000","last_undegraded":"2024-05-20T17:31:16.182028+0000","last_fullsized":"2024-05-20T17:31:16.182028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619696+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:31:16.619696+0000","last_peered":"2024-05-20T17:31:16.619696+0000","last_clean":"2024-05-20T17:31:16.619696+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:31:16.619696+0000","last_undegraded":"2024-05-20T17:31:16.619696+0000","last_fullsized":"2024-05-20T17:31:16.619696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610662+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:31:16.610662+0000","last_peered":"2024-05-20T17:31:16.610662+0000","last_clean":"2024-05-20T17:31:16.610662+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:31:16.610662+0000","last_undegraded":"2024-05-20T17:31:16.610662+0000","last_fullsized":"2024-05-20T17:31:16.610662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.797058+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:31:15.797058+0000","last_peered":"2024-05-20T17:31:15.797058+0000","last_clean":"2024-05-20T17:31:15.797058+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:31:15.797058+0000","last_undegraded":"2024-05-20T17:31:15.797058+0000","last_fullsized":"2024-05-20T17:31:15.797058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790132+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:31:15.790132+0000","last_peered":"2024-05-20T17:31:15.790132+0000","last_clean":"2024-05-20T17:31:15.790132+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:31:15.790132+0000","last_undegraded":"2024-05-20T17:31:15.790132+0000","last_fullsized":"2024-05-20T17:31:15.790132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.797065+0000","last_change":"2024-05-20T17:31:13.793561+0000","last_active":"2024-05-20T17:31:15.797065+0000","last_peered":"2024-05-20T17:31:15.797065+0000","last_clean":"2024-05-20T17:31:15.797065+0000","last_became_active":"2024-05-20T17:31:13.793186+0000","last_became_peered":"2024-05-20T17:31:13.793186+0000","last_unstale":"2024-05-20T17:31:15.797065+0000","last_undegraded":"2024-05-20T17:31:15.797065+0000","last_fullsized":"2024-05-20T17:31:15.797065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:59.299639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798952+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:31:15.798952+0000","last_peered":"2024-05-20T17:31:15.798952+0000","last_clean":"2024-05-20T17:31:15.798952+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:31:15.798952+0000","last_undegraded":"2024-05-20T17:31:15.798952+0000","last_fullsized":"2024-05-20T17:31:15.798952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.799072+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:31:15.799072+0000","last_peered":"2024-05-20T17:31:15.799072+0000","last_clean":"2024-05-20T17:31:15.799072+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:31:15.799072+0000","last_undegraded":"2024-05-20T17:31:15.799072+0000","last_fullsized":"2024-05-20T17:31:15.799072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182514+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:31:16.182514+0000","last_peered":"2024-05-20T17:31:16.182514+0000","last_clean":"2024-05-20T17:31:16.182514+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:31:16.182514+0000","last_undegraded":"2024-05-20T17:31:16.182514+0000","last_fullsized":"2024-05-20T17:31:16.182514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.813019+0000","last_change":"2024-05-20T17:31:13.793000+0000","last_active":"2024-05-20T17:31:14.813019+0000","last_peered":"2024-05-20T17:31:14.813019+0000","last_clean":"2024-05-20T17:31:14.813019+0000","last_became_active":"2024-05-20T17:31:13.792614+0000","last_became_peered":"2024-05-20T17:31:13.792614+0000","last_unstale":"2024-05-20T17:31:14.813019+0000","last_undegraded":"2024-05-20T17:31:14.813019+0000","last_fullsized":"2024-05-20T17:31:14.813019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:57.792916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619865+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:31:16.619865+0000","last_peered":"2024-05-20T17:31:16.619865+0000","last_clean":"2024-05-20T17:31:16.619865+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:31:16.619865+0000","last_undegraded":"2024-05-20T17:31:16.619865+0000","last_fullsized":"2024-05-20T17:31:16.619865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814521+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:31:14.814521+0000","last_peered":"2024-05-20T17:31:14.814521+0000","last_clean":"2024-05-20T17:31:14.814521+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:31:14.814521+0000","last_undegraded":"2024-05-20T17:31:14.814521+0000","last_fullsized":"2024-05-20T17:31:14.814521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799448+0000","last_change":"2024-05-20T17:31:14.793859+0000","last_active":"2024-05-20T17:31:16.799448+0000","last_peered":"2024-05-20T17:31:16.799448+0000","last_clean":"2024-05-20T17:31:16.799448+0000","last_became_active":"2024-05-20T17:31:14.793400+0000","last_became_peered":"2024-05-20T17:31:14.793400+0000","last_unstale":"2024-05-20T17:31:16.799448+0000","last_undegraded":"2024-05-20T17:31:16.799448+0000","last_fullsized":"2024-05-20T17:31:16.799448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:43.997668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.814703+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:31:16.814703+0000","last_peered":"2024-05-20T17:31:16.814703+0000","last_clean":"2024-05-20T17:31:16.814703+0000","last_became_active":"2024-05-20T17:31:13.792882+0000","last_became_peered":"2024-05-20T17:31:13.792882+0000","last_unstale":"2024-05-20T17:31:16.814703+0000","last_undegraded":"2024-05-20T17:31:16.814703+0000","last_fullsized":"2024-05-20T17:31:16.814703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:32.236130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.798810+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:31:14.798810+0000","last_peered":"2024-05-20T17:31:14.798810+0000","last_clean":"2024-05-20T17:31:14.798810+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:31:14.798810+0000","last_undegraded":"2024-05-20T17:31:14.798810+0000","last_fullsized":"2024-05-20T17:31:14.798810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:24:17.972207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789640+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:31:15.789640+0000","last_peered":"2024-05-20T17:31:15.789640+0000","last_clean":"2024-05-20T17:31:15.789640+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:31:15.789640+0000","last_undegraded":"2024-05-20T17:31:15.789640+0000","last_fullsized":"2024-05-20T17:31:15.789640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799119+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:31:16.799119+0000","last_peered":"2024-05-20T17:31:16.799119+0000","last_clean":"2024-05-20T17:31:16.799119+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:31:16.799119+0000","last_undegraded":"2024-05-20T17:31:16.799119+0000","last_fullsized":"2024-05-20T17:31:16.799119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.818576+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:31:17.818576+0000","last_peered":"2024-05-20T17:31:17.818576+0000","last_clean":"2024-05-20T17:31:17.818576+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:31:17.818576+0000","last_undegraded":"2024-05-20T17:31:17.818576+0000","last_fullsized":"2024-05-20T17:31:17.818576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798508+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:31:15.798508+0000","last_peered":"2024-05-20T17:31:15.798508+0000","last_clean":"2024-05-20T17:31:15.798508+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:31:15.798508+0000","last_undegraded":"2024-05-20T17:31:15.798508+0000","last_fullsized":"2024-05-20T17:31:15.798508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811535+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:31:16.811535+0000","last_peered":"2024-05-20T17:31:16.811535+0000","last_clean":"2024-05-20T17:31:16.811535+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:31:16.811535+0000","last_undegraded":"2024-05-20T17:31:16.811535+0000","last_fullsized":"2024-05-20T17:31:16.811535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.796907+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:31:15.796907+0000","last_peered":"2024-05-20T17:31:15.796907+0000","last_clean":"2024-05-20T17:31:15.796907+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:31:15.796907+0000","last_undegraded":"2024-05-20T17:31:15.796907+0000","last_fullsized":"2024-05-20T17:31:15.796907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.812677+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:31:16.812677+0000","last_peered":"2024-05-20T17:31:16.812677+0000","last_clean":"2024-05-20T17:31:16.812677+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:31:16.812677+0000","last_undegraded":"2024-05-20T17:31:16.812677+0000","last_fullsized":"2024-05-20T17:31:16.812677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620244+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:31:16.620244+0000","last_peered":"2024-05-20T17:31:16.620244+0000","last_clean":"2024-05-20T17:31:16.620244+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:31:16.620244+0000","last_undegraded":"2024-05-20T17:31:16.620244+0000","last_fullsized":"2024-05-20T17:31:16.620244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.780028+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:31:14.780028+0000","last_peered":"2024-05-20T17:31:14.780028+0000","last_clean":"2024-05-20T17:31:14.780028+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:31:14.780028+0000","last_undegraded":"2024-05-20T17:31:14.780028+0000","last_fullsized":"2024-05-20T17:31:14.780028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182482+0000","last_change":"2024-05-20T17:31:14.804732+0000","last_active":"2024-05-20T17:31:16.182482+0000","last_peered":"2024-05-20T17:31:16.182482+0000","last_clean":"2024-05-20T17:31:16.182482+0000","last_became_active":"2024-05-20T17:31:14.801272+0000","last_became_peered":"2024-05-20T17:31:14.801272+0000","last_unstale":"2024-05-20T17:31:16.182482+0000","last_undegraded":"2024-05-20T17:31:16.182482+0000","last_fullsized":"2024-05-20T17:31:16.182482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:42:29.879887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811795+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:31:16.811795+0000","last_peered":"2024-05-20T17:31:16.811795+0000","last_clean":"2024-05-20T17:31:16.811795+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:31:16.811795+0000","last_undegraded":"2024-05-20T17:31:16.811795+0000","last_fullsized":"2024-05-20T17:31:16.811795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620085+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:31:16.620085+0000","last_peered":"2024-05-20T17:31:16.620085+0000","last_clean":"2024-05-20T17:31:16.620085+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:31:16.620085+0000","last_undegraded":"2024-05-20T17:31:16.620085+0000","last_fullsized":"2024-05-20T17:31:16.620085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811941+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:31:16.811941+0000","last_peered":"2024-05-20T17:31:16.811941+0000","last_clean":"2024-05-20T17:31:16.811941+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:31:16.811941+0000","last_undegraded":"2024-05-20T17:31:16.811941+0000","last_fullsized":"2024-05-20T17:31:16.811941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.801975+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:31:14.801975+0000","last_peered":"2024-05-20T17:31:14.801975+0000","last_clean":"2024-05-20T17:31:14.801975+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:31:14.801975+0000","last_undegraded":"2024-05-20T17:31:14.801975+0000","last_fullsized":"2024-05-20T17:31:14.801975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:01.474764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.819550+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:31:17.819550+0000","last_peered":"2024-05-20T17:31:17.819550+0000","last_clean":"2024-05-20T17:31:17.819550+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:31:17.819550+0000","last_undegraded":"2024-05-20T17:31:17.819550+0000","last_fullsized":"2024-05-20T17:31:17.819550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789148+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:31:15.789148+0000","last_peered":"2024-05-20T17:31:15.789148+0000","last_clean":"2024-05-20T17:31:15.789148+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:31:15.789148+0000","last_undegraded":"2024-05-20T17:31:15.789148+0000","last_fullsized":"2024-05-20T17:31:15.789148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811806+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:31:16.811806+0000","last_peered":"2024-05-20T17:31:16.811806+0000","last_clean":"2024-05-20T17:31:16.811806+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:31:16.811806+0000","last_undegraded":"2024-05-20T17:31:16.811806+0000","last_fullsized":"2024-05-20T17:31:16.811806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803995+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:31:14.803995+0000","last_peered":"2024-05-20T17:31:14.803995+0000","last_clean":"2024-05-20T17:31:14.803995+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:31:14.803995+0000","last_undegraded":"2024-05-20T17:31:14.803995+0000","last_fullsized":"2024-05-20T17:31:14.803995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:14.044557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.026109+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:31:18.026109+0000","last_peered":"2024-05-20T17:31:18.026109+0000","last_clean":"2024-05-20T17:31:18.026109+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:31:18.026109+0000","last_undegraded":"2024-05-20T17:31:18.026109+0000","last_fullsized":"2024-05-20T17:31:18.026109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803805+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:31:14.803805+0000","last_peered":"2024-05-20T17:31:14.803805+0000","last_clean":"2024-05-20T17:31:14.803805+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:31:14.803805+0000","last_undegraded":"2024-05-20T17:31:14.803805+0000","last_fullsized":"2024-05-20T17:31:14.803805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:08:05.365011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814320+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:31:14.814320+0000","last_peered":"2024-05-20T17:31:14.814320+0000","last_clean":"2024-05-20T17:31:14.814320+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:31:14.814320+0000","last_undegraded":"2024-05-20T17:31:14.814320+0000","last_fullsized":"2024-05-20T17:31:14.814320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.798880+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:31:16.798880+0000","last_peered":"2024-05-20T17:31:16.798880+0000","last_clean":"2024-05-20T17:31:16.798880+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:31:16.798880+0000","last_undegraded":"2024-05-20T17:31:16.798880+0000","last_fullsized":"2024-05-20T17:31:16.798880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814315+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:31:14.814315+0000","last_peered":"2024-05-20T17:31:14.814315+0000","last_clean":"2024-05-20T17:31:14.814315+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:31:14.814315+0000","last_undegraded":"2024-05-20T17:31:14.814315+0000","last_fullsized":"2024-05-20T17:31:14.814315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610463+0000","last_change":"2024-05-20T17:31:14.804254+0000","last_active":"2024-05-20T17:31:16.610463+0000","last_peered":"2024-05-20T17:31:16.610463+0000","last_clean":"2024-05-20T17:31:16.610463+0000","last_became_active":"2024-05-20T17:31:14.803518+0000","last_became_peered":"2024-05-20T17:31:14.803518+0000","last_unstale":"2024-05-20T17:31:16.610463+0000","last_undegraded":"2024-05-20T17:31:16.610463+0000","last_fullsized":"2024-05-20T17:31:16.610463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:16:26.326857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.796993+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:31:15.796993+0000","last_peered":"2024-05-20T17:31:15.796993+0000","last_clean":"2024-05-20T17:31:15.796993+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:31:15.796993+0000","last_undegraded":"2024-05-20T17:31:15.796993+0000","last_fullsized":"2024-05-20T17:31:15.796993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790011+0000","last_change":"2024-05-20T17:31:14.806370+0000","last_active":"2024-05-20T17:31:15.790011+0000","last_peered":"2024-05-20T17:31:15.790011+0000","last_clean":"2024-05-20T17:31:15.790011+0000","last_became_active":"2024-05-20T17:31:14.806013+0000","last_became_peered":"2024-05-20T17:31:14.806013+0000","last_unstale":"2024-05-20T17:31:15.790011+0000","last_undegraded":"2024-05-20T17:31:15.790011+0000","last_fullsized":"2024-05-20T17:31:15.790011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:50:13.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.789192+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:31:14.789192+0000","last_peered":"2024-05-20T17:31:14.789192+0000","last_clean":"2024-05-20T17:31:14.789192+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:31:14.789192+0000","last_undegraded":"2024-05-20T17:31:14.789192+0000","last_fullsized":"2024-05-20T17:31:14.789192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789679+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:31:15.789679+0000","last_peered":"2024-05-20T17:31:15.789679+0000","last_clean":"2024-05-20T17:31:15.789679+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:31:15.789679+0000","last_undegraded":"2024-05-20T17:31:15.789679+0000","last_fullsized":"2024-05-20T17:31:15.789679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799081+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:31:16.799081+0000","last_peered":"2024-05-20T17:31:16.799081+0000","last_clean":"2024-05-20T17:31:16.799081+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:31:16.799081+0000","last_undegraded":"2024-05-20T17:31:16.799081+0000","last_fullsized":"2024-05-20T17:31:16.799081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.025664+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:31:18.025664+0000","last_peered":"2024-05-20T17:31:18.025664+0000","last_clean":"2024-05-20T17:31:18.025664+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:31:18.025664+0000","last_undegraded":"2024-05-20T17:31:18.025664+0000","last_fullsized":"2024-05-20T17:31:18.025664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798875+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:31:15.798875+0000","last_peered":"2024-05-20T17:31:15.798875+0000","last_clean":"2024-05-20T17:31:15.798875+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:31:15.798875+0000","last_undegraded":"2024-05-20T17:31:15.798875+0000","last_fullsized":"2024-05-20T17:31:15.798875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.022211+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:31:18.022211+0000","last_peered":"2024-05-20T17:31:18.022211+0000","last_clean":"2024-05-20T17:31:18.022211+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:31:18.022211+0000","last_undegraded":"2024-05-20T17:31:18.022211+0000","last_fullsized":"2024-05-20T17:31:18.022211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.780107+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:31:14.780107+0000","last_peered":"2024-05-20T17:31:14.780107+0000","last_clean":"2024-05-20T17:31:14.780107+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:31:14.780107+0000","last_undegraded":"2024-05-20T17:31:14.780107+0000","last_fullsized":"2024-05-20T17:31:14.780107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.788958+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:31:15.788958+0000","last_peered":"2024-05-20T17:31:15.788958+0000","last_clean":"2024-05-20T17:31:15.788958+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:31:15.788958+0000","last_undegraded":"2024-05-20T17:31:15.788958+0000","last_fullsized":"2024-05-20T17:31:15.788958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.781517+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:31:14.781517+0000","last_peered":"2024-05-20T17:31:14.781517+0000","last_clean":"2024-05-20T17:31:14.781517+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:31:14.781517+0000","last_undegraded":"2024-05-20T17:31:14.781517+0000","last_fullsized":"2024-05-20T17:31:14.781517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.786412+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:31:14.786412+0000","last_peered":"2024-05-20T17:31:14.786412+0000","last_clean":"2024-05-20T17:31:14.786412+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:31:14.786412+0000","last_undegraded":"2024-05-20T17:31:14.786412+0000","last_fullsized":"2024-05-20T17:31:14.786412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789201+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:31:15.789201+0000","last_peered":"2024-05-20T17:31:15.789201+0000","last_clean":"2024-05-20T17:31:15.789201+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:31:15.789201+0000","last_undegraded":"2024-05-20T17:31:15.789201+0000","last_fullsized":"2024-05-20T17:31:15.789201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798656+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:31:15.798656+0000","last_peered":"2024-05-20T17:31:15.798656+0000","last_clean":"2024-05-20T17:31:15.798656+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:31:15.798656+0000","last_undegraded":"2024-05-20T17:31:15.798656+0000","last_fullsized":"2024-05-20T17:31:15.798656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.799047+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:31:15.799047+0000","last_peered":"2024-05-20T17:31:15.799047+0000","last_clean":"2024-05-20T17:31:15.799047+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:31:15.799047+0000","last_undegraded":"2024-05-20T17:31:15.799047+0000","last_fullsized":"2024-05-20T17:31:15.799047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810098+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:31:16.810098+0000","last_peered":"2024-05-20T17:31:16.810098+0000","last_clean":"2024-05-20T17:31:16.810098+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:31:16.810098+0000","last_undegraded":"2024-05-20T17:31:16.810098+0000","last_fullsized":"2024-05-20T17:31:16.810098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182439+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:31:16.182439+0000","last_peered":"2024-05-20T17:31:16.182439+0000","last_clean":"2024-05-20T17:31:16.182439+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:31:16.182439+0000","last_undegraded":"2024-05-20T17:31:16.182439+0000","last_fullsized":"2024-05-20T17:31:16.182439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810959+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:31:16.810959+0000","last_peered":"2024-05-20T17:31:16.810959+0000","last_clean":"2024-05-20T17:31:16.810959+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:31:16.810959+0000","last_undegraded":"2024-05-20T17:31:16.810959+0000","last_fullsized":"2024-05-20T17:31:16.810959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.798772+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:31:14.798772+0000","last_peered":"2024-05-20T17:31:14.798772+0000","last_clean":"2024-05-20T17:31:14.798772+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:31:14.798772+0000","last_undegraded":"2024-05-20T17:31:14.798772+0000","last_fullsized":"2024-05-20T17:31:14.798772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:39.234238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810850+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:31:16.810850+0000","last_peered":"2024-05-20T17:31:16.810850+0000","last_clean":"2024-05-20T17:31:16.810850+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:31:16.810850+0000","last_undegraded":"2024-05-20T17:31:16.810850+0000","last_fullsized":"2024-05-20T17:31:16.810850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610247+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:31:16.610247+0000","last_peered":"2024-05-20T17:31:16.610247+0000","last_clean":"2024-05-20T17:31:16.610247+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:31:16.610247+0000","last_undegraded":"2024-05-20T17:31:16.610247+0000","last_fullsized":"2024-05-20T17:31:16.610247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789777+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:31:15.789777+0000","last_peered":"2024-05-20T17:31:15.789777+0000","last_clean":"2024-05-20T17:31:15.789777+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:31:15.789777+0000","last_undegraded":"2024-05-20T17:31:15.789777+0000","last_fullsized":"2024-05-20T17:31:15.789777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798833+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:31:15.798833+0000","last_peered":"2024-05-20T17:31:15.798833+0000","last_clean":"2024-05-20T17:31:15.798833+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:31:15.798833+0000","last_undegraded":"2024-05-20T17:31:15.798833+0000","last_fullsized":"2024-05-20T17:31:15.798833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.813437+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:31:14.813437+0000","last_peered":"2024-05-20T17:31:14.813437+0000","last_clean":"2024-05-20T17:31:14.813437+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:31:14.813437+0000","last_undegraded":"2024-05-20T17:31:14.813437+0000","last_fullsized":"2024-05-20T17:31:14.813437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.804533+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:31:14.804533+0000","last_peered":"2024-05-20T17:31:14.804533+0000","last_clean":"2024-05-20T17:31:14.804533+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:31:14.804533+0000","last_undegraded":"2024-05-20T17:31:14.804533+0000","last_fullsized":"2024-05-20T17:31:14.804533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:01.945936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.817815+0000","last_change":"2024-05-20T17:31:13.794222+0000","last_active":"2024-05-20T17:31:17.817815+0000","last_peered":"2024-05-20T17:31:17.817815+0000","last_clean":"2024-05-20T17:31:17.817815+0000","last_became_active":"2024-05-20T17:31:13.793828+0000","last_became_peered":"2024-05-20T17:31:13.793828+0000","last_unstale":"2024-05-20T17:31:17.817815+0000","last_undegraded":"2024-05-20T17:31:17.817815+0000","last_fullsized":"2024-05-20T17:31:17.817815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:46:50.859413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803952+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:31:14.803952+0000","last_peered":"2024-05-20T17:31:14.803952+0000","last_clean":"2024-05-20T17:31:14.803952+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:31:14.803952+0000","last_undegraded":"2024-05-20T17:31:14.803952+0000","last_fullsized":"2024-05-20T17:31:14.803952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:55.001348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799354+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:31:16.799354+0000","last_peered":"2024-05-20T17:31:16.799354+0000","last_clean":"2024-05-20T17:31:16.799354+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:31:16.799354+0000","last_undegraded":"2024-05-20T17:31:16.799354+0000","last_fullsized":"2024-05-20T17:31:16.799354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.799693+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:31:14.799693+0000","last_peered":"2024-05-20T17:31:14.799693+0000","last_clean":"2024-05-20T17:31:14.799693+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:31:14.799693+0000","last_undegraded":"2024-05-20T17:31:14.799693+0000","last_fullsized":"2024-05-20T17:31:14.799693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:26:59.457907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789219+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:31:15.789219+0000","last_peered":"2024-05-20T17:31:15.789219+0000","last_clean":"2024-05-20T17:31:15.789219+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:31:15.789219+0000","last_undegraded":"2024-05-20T17:31:15.789219+0000","last_fullsized":"2024-05-20T17:31:15.789219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.800038+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:31:14.800038+0000","last_peered":"2024-05-20T17:31:14.800038+0000","last_clean":"2024-05-20T17:31:14.800038+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:31:14.800038+0000","last_undegraded":"2024-05-20T17:31:14.800038+0000","last_fullsized":"2024-05-20T17:31:14.800038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:14:22.703056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610310+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:31:16.610310+0000","last_peered":"2024-05-20T17:31:16.610310+0000","last_clean":"2024-05-20T17:31:16.610310+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:31:16.610310+0000","last_undegraded":"2024-05-20T17:31:16.610310+0000","last_fullsized":"2024-05-20T17:31:16.610310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789909+0000","last_change":"2024-05-20T17:31:14.805064+0000","last_active":"2024-05-20T17:31:15.789909+0000","last_peered":"2024-05-20T17:31:15.789909+0000","last_clean":"2024-05-20T17:31:15.789909+0000","last_became_active":"2024-05-20T17:31:14.804714+0000","last_became_peered":"2024-05-20T17:31:14.804714+0000","last_unstale":"2024-05-20T17:31:15.789909+0000","last_undegraded":"2024-05-20T17:31:15.789909+0000","last_fullsized":"2024-05-20T17:31:15.789909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:41:06.791965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789804+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:31:15.789804+0000","last_peered":"2024-05-20T17:31:15.789804+0000","last_clean":"2024-05-20T17:31:15.789804+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:31:15.789804+0000","last_undegraded":"2024-05-20T17:31:15.789804+0000","last_fullsized":"2024-05-20T17:31:15.789804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182257+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:31:16.182257+0000","last_peered":"2024-05-20T17:31:16.182257+0000","last_clean":"2024-05-20T17:31:16.182257+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:31:16.182257+0000","last_undegraded":"2024-05-20T17:31:16.182257+0000","last_fullsized":"2024-05-20T17:31:16.182257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789151+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:31:15.789151+0000","last_peered":"2024-05-20T17:31:15.789151+0000","last_clean":"2024-05-20T17:31:15.789151+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:31:15.789151+0000","last_undegraded":"2024-05-20T17:31:15.789151+0000","last_fullsized":"2024-05-20T17:31:15.789151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610373+0000","last_change":"2024-05-20T17:31:14.795150+0000","last_active":"2024-05-20T17:31:16.610373+0000","last_peered":"2024-05-20T17:31:16.610373+0000","last_clean":"2024-05-20T17:31:16.610373+0000","last_became_active":"2024-05-20T17:31:14.794755+0000","last_became_peered":"2024-05-20T17:31:14.794755+0000","last_unstale":"2024-05-20T17:31:16.610373+0000","last_undegraded":"2024-05-20T17:31:16.610373+0000","last_fullsized":"2024-05-20T17:31:16.610373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:39.423408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790205+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:31:15.790205+0000","last_peered":"2024-05-20T17:31:15.790205+0000","last_clean":"2024-05-20T17:31:15.790205+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:31:15.790205+0000","last_undegraded":"2024-05-20T17:31:15.790205+0000","last_fullsized":"2024-05-20T17:31:15.790205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798991+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:31:15.798991+0000","last_peered":"2024-05-20T17:31:15.798991+0000","last_clean":"2024-05-20T17:31:15.798991+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:31:15.798991+0000","last_undegraded":"2024-05-20T17:31:15.798991+0000","last_fullsized":"2024-05-20T17:31:15.798991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.798932+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:31:16.798932+0000","last_peered":"2024-05-20T17:31:16.798932+0000","last_clean":"2024-05-20T17:31:16.798932+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:31:16.798932+0000","last_undegraded":"2024-05-20T17:31:16.798932+0000","last_fullsized":"2024-05-20T17:31:16.798932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798567+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:31:15.798567+0000","last_peered":"2024-05-20T17:31:15.798567+0000","last_clean":"2024-05-20T17:31:15.798567+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:31:15.798567+0000","last_undegraded":"2024-05-20T17:31:15.798567+0000","last_fullsized":"2024-05-20T17:31:15.798567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619920+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:31:16.619920+0000","last_peered":"2024-05-20T17:31:16.619920+0000","last_clean":"2024-05-20T17:31:16.619920+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:31:16.619920+0000","last_undegraded":"2024-05-20T17:31:16.619920+0000","last_fullsized":"2024-05-20T17:31:16.619920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789418+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:31:15.789418+0000","last_peered":"2024-05-20T17:31:15.789418+0000","last_clean":"2024-05-20T17:31:15.789418+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:31:15.789418+0000","last_undegraded":"2024-05-20T17:31:15.789418+0000","last_fullsized":"2024-05-20T17:31:15.789418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610285+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:31:16.610285+0000","last_peered":"2024-05-20T17:31:16.610285+0000","last_clean":"2024-05-20T17:31:16.610285+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:31:16.610285+0000","last_undegraded":"2024-05-20T17:31:16.610285+0000","last_fullsized":"2024-05-20T17:31:16.610285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246618,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5088,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":92,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":13666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":439103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645330,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":1030695,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":439103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":1020901,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":438611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":440133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":440789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1020501,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:31:21.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:31:22.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.015+0000 7fa04491a640 1 -- 172.21.15.135:0/2593793372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 msgr2=0x7fa04010ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 --2- 172.21.15.135:0/2593793372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa04010ac40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa038009ca0 tx=0x7fa03802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 -- 172.21.15.135:0/2593793372 shutdown_connections 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 --2- 172.21.15.135:0/2593793372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa04010ac40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 --2- 172.21.15.135:0/2593793372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 --2- 172.21.15.135:0/2593793372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 0x7fa040104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 -- 172.21.15.135:0/2593793372 >> 172.21.15.135:0/2593793372 conn(0x7fa0400fc2e0 msgr2=0x7fa0400fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 -- 172.21.15.135:0/2593793372 shutdown_connections 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 -- 172.21.15.135:0/2593793372 wait complete. 2024-05-20T17:31:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.016+0000 7fa04491a640 1 Processor -- start 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 -- start start 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 0x7fa0401a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa04010e710 con 0x7fa0401011e0 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa04010e590 con 0x7fa0401006e0 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa04491a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa04010e890 con 0x7fa040104030 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:22.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33818/0 (socket says 172.21.15.135:33818) 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 -- 172.21.15.135:0/768789150 learned_addr learned my addr 172.21.15.135:0/768789150 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa03ed9d640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 0x7fa0401a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa03e59c640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 -- 172.21.15.135:0/768789150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 msgr2=0x7fa0401a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 0x7fa0401a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 -- 172.21.15.135:0/768789150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 msgr2=0x7fa040199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 -- 172.21.15.135:0/768789150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0401a0cc0 con 0x7fa0401011e0 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa03e59c640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.017+0000 7fa035d9b640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa02800c920 tx=0x7fa02800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:22.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.018+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028007c70 con 0x7fa0401011e0 2024-05-20T17:31:22.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.018+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0401a0fb0 con 0x7fa0401011e0 2024-05-20T17:31:22.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.018+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa028007e10 con 0x7fa0401011e0 2024-05-20T17:31:22.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.018+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028018890 con 0x7fa0401011e0 2024-05-20T17:31:22.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.018+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0401a1470 con 0x7fa0401011e0 2024-05-20T17:31:22.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.019+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0401099d0 con 0x7fa0401011e0 2024-05-20T17:31:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.020+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa028018a50 con 0x7fa0401011e0 2024-05-20T17:31:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.021+0000 7fa037fff640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 0x7fa02c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.021+0000 7fa03e59c640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 0x7fa02c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.021+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fa0280cf400 con 0x7fa0401011e0 2024-05-20T17:31:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.021+0000 7fa03e59c640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 0x7fa02c0a5130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa0300058c0 tx=0x7fa030005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:22.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.024+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa028014030 con 0x7fa0401011e0 2024-05-20T17:31:22.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.199+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa040061f90 con 0x7fa02c0a2c20 2024-05-20T17:31:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:22 smithi135 ceph-mon[32027]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:22 smithi135 ceph-mon[32027]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:31:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:22 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1251134025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:22 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3229756075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.206+0000 7fa037fff640 1 -- 172.21.15.135:0/768789150 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258909 (secure 0 0 0) 0x7fa040061f90 con 0x7fa02c0a2c20 2024-05-20T17:31:22.213 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:22.215 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 msgr2=0x7fa02c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 0x7fa02c0a5130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa0300058c0 tx=0x7fa030005850 comp rx=0 tx=0).stop 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 msgr2=0x7fa040199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa02800c920 tx=0x7fa02800cde0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 shutdown_connections 2024-05-20T17:31:22.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa02c0a2c20 0x7fa02c0a5130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104030 0x7fa0401a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0401011e0 0x7fa040199770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 --2- 172.21.15.135:0/768789150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0401006e0 0x7fa040199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.209+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 >> 172.21.15.135:0/768789150 conn(0x7fa0400fc2e0 msgr2=0x7fa040106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.210+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 shutdown_connections 2024-05-20T17:31:22.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:22.210+0000 7fa04491a640 1 -- 172.21.15.135:0/768789150 wait complete. 2024-05-20T17:31:22.223 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-05-20T17:31:20.710051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595456,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":273,"num_write_kb":2967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347712,"kb_used_data":10964,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124594112,"statfs":{"total":1151940427776,"available":1151584370688,"internally_reserved":0,"allocated":11227136,"data_stored":7018360,"data_compressed":107100,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5088,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":92,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.937497"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610510+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:31:16.610510+0000","last_peered":"2024-05-20T17:31:16.610510+0000","last_clean":"2024-05-20T17:31:16.610510+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:31:16.610510+0000","last_undegraded":"2024-05-20T17:31:16.610510+0000","last_fullsized":"2024-05-20T17:31:16.610510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182393+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:31:16.182393+0000","last_peered":"2024-05-20T17:31:16.182393+0000","last_clean":"2024-05-20T17:31:16.182393+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:31:16.182393+0000","last_undegraded":"2024-05-20T17:31:16.182393+0000","last_fullsized":"2024-05-20T17:31:16.182393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182298+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:31:16.182298+0000","last_peered":"2024-05-20T17:31:16.182298+0000","last_clean":"2024-05-20T17:31:16.182298+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:31:16.182298+0000","last_undegraded":"2024-05-20T17:31:16.182298+0000","last_fullsized":"2024-05-20T17:31:16.182298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799415+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:31:16.799415+0000","last_peered":"2024-05-20T17:31:16.799415+0000","last_clean":"2024-05-20T17:31:16.799415+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:31:16.799415+0000","last_undegraded":"2024-05-20T17:31:16.799415+0000","last_fullsized":"2024-05-20T17:31:16.799415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.795273+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:31:14.795273+0000","last_peered":"2024-05-20T17:31:14.795273+0000","last_clean":"2024-05-20T17:31:14.795273+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:31:14.795273+0000","last_undegraded":"2024-05-20T17:31:14.795273+0000","last_fullsized":"2024-05-20T17:31:14.795273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:54.518993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789925+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:31:15.789925+0000","last_peered":"2024-05-20T17:31:15.789925+0000","last_clean":"2024-05-20T17:31:15.789925+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:31:15.789925+0000","last_undegraded":"2024-05-20T17:31:15.789925+0000","last_fullsized":"2024-05-20T17:31:15.789925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.799659+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:31:14.799659+0000","last_peered":"2024-05-20T17:31:14.799659+0000","last_clean":"2024-05-20T17:31:14.799659+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:31:14.799659+0000","last_undegraded":"2024-05-20T17:31:14.799659+0000","last_fullsized":"2024-05-20T17:31:14.799659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:56:46.712189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798538+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:31:15.798538+0000","last_peered":"2024-05-20T17:31:15.798538+0000","last_clean":"2024-05-20T17:31:15.798538+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:31:15.798538+0000","last_undegraded":"2024-05-20T17:31:15.798538+0000","last_fullsized":"2024-05-20T17:31:15.798538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620249+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:31:16.620249+0000","last_peered":"2024-05-20T17:31:16.620249+0000","last_clean":"2024-05-20T17:31:16.620249+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:31:16.620249+0000","last_undegraded":"2024-05-20T17:31:16.620249+0000","last_fullsized":"2024-05-20T17:31:16.620249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789970+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:31:15.789970+0000","last_peered":"2024-05-20T17:31:15.789970+0000","last_clean":"2024-05-20T17:31:15.789970+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:31:15.789970+0000","last_undegraded":"2024-05-20T17:31:15.789970+0000","last_fullsized":"2024-05-20T17:31:15.789970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.800076+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:31:14.800076+0000","last_peered":"2024-05-20T17:31:14.800076+0000","last_clean":"2024-05-20T17:31:14.800076+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:31:14.800076+0000","last_undegraded":"2024-05-20T17:31:14.800076+0000","last_fullsized":"2024-05-20T17:31:14.800076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:37.010520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799629+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:31:16.799629+0000","last_peered":"2024-05-20T17:31:16.799629+0000","last_clean":"2024-05-20T17:31:16.799629+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:31:16.799629+0000","last_undegraded":"2024-05-20T17:31:16.799629+0000","last_fullsized":"2024-05-20T17:31:16.799629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789396+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:31:15.789396+0000","last_peered":"2024-05-20T17:31:15.789396+0000","last_clean":"2024-05-20T17:31:15.789396+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:31:15.789396+0000","last_undegraded":"2024-05-20T17:31:15.789396+0000","last_fullsized":"2024-05-20T17:31:15.789396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182061+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:31:16.182061+0000","last_peered":"2024-05-20T17:31:16.182061+0000","last_clean":"2024-05-20T17:31:16.182061+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:31:16.182061+0000","last_undegraded":"2024-05-20T17:31:16.182061+0000","last_fullsized":"2024-05-20T17:31:16.182061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182028+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:31:16.182028+0000","last_peered":"2024-05-20T17:31:16.182028+0000","last_clean":"2024-05-20T17:31:16.182028+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:31:16.182028+0000","last_undegraded":"2024-05-20T17:31:16.182028+0000","last_fullsized":"2024-05-20T17:31:16.182028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619696+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:31:16.619696+0000","last_peered":"2024-05-20T17:31:16.619696+0000","last_clean":"2024-05-20T17:31:16.619696+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:31:16.619696+0000","last_undegraded":"2024-05-20T17:31:16.619696+0000","last_fullsized":"2024-05-20T17:31:16.619696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610662+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:31:16.610662+0000","last_peered":"2024-05-20T17:31:16.610662+0000","last_clean":"2024-05-20T17:31:16.610662+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:31:16.610662+0000","last_undegraded":"2024-05-20T17:31:16.610662+0000","last_fullsized":"2024-05-20T17:31:16.610662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.797058+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:31:15.797058+0000","last_peered":"2024-05-20T17:31:15.797058+0000","last_clean":"2024-05-20T17:31:15.797058+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:31:15.797058+0000","last_undegraded":"2024-05-20T17:31:15.797058+0000","last_fullsized":"2024-05-20T17:31:15.797058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790132+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:31:15.790132+0000","last_peered":"2024-05-20T17:31:15.790132+0000","last_clean":"2024-05-20T17:31:15.790132+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:31:15.790132+0000","last_undegraded":"2024-05-20T17:31:15.790132+0000","last_fullsized":"2024-05-20T17:31:15.790132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.797065+0000","last_change":"2024-05-20T17:31:13.793561+0000","last_active":"2024-05-20T17:31:15.797065+0000","last_peered":"2024-05-20T17:31:15.797065+0000","last_clean":"2024-05-20T17:31:15.797065+0000","last_became_active":"2024-05-20T17:31:13.793186+0000","last_became_peered":"2024-05-20T17:31:13.793186+0000","last_unstale":"2024-05-20T17:31:15.797065+0000","last_undegraded":"2024-05-20T17:31:15.797065+0000","last_fullsized":"2024-05-20T17:31:15.797065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:59.299639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798952+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:31:15.798952+0000","last_peered":"2024-05-20T17:31:15.798952+0000","last_clean":"2024-05-20T17:31:15.798952+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:31:15.798952+0000","last_undegraded":"2024-05-20T17:31:15.798952+0000","last_fullsized":"2024-05-20T17:31:15.798952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.799072+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:31:15.799072+0000","last_peered":"2024-05-20T17:31:15.799072+0000","last_clean":"2024-05-20T17:31:15.799072+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:31:15.799072+0000","last_undegraded":"2024-05-20T17:31:15.799072+0000","last_fullsized":"2024-05-20T17:31:15.799072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182514+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:31:16.182514+0000","last_peered":"2024-05-20T17:31:16.182514+0000","last_clean":"2024-05-20T17:31:16.182514+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:31:16.182514+0000","last_undegraded":"2024-05-20T17:31:16.182514+0000","last_fullsized":"2024-05-20T17:31:16.182514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.813019+0000","last_change":"2024-05-20T17:31:13.793000+0000","last_active":"2024-05-20T17:31:14.813019+0000","last_peered":"2024-05-20T17:31:14.813019+0000","last_clean":"2024-05-20T17:31:14.813019+0000","last_became_active":"2024-05-20T17:31:13.792614+0000","last_became_peered":"2024-05-20T17:31:13.792614+0000","last_unstale":"2024-05-20T17:31:14.813019+0000","last_undegraded":"2024-05-20T17:31:14.813019+0000","last_fullsized":"2024-05-20T17:31:14.813019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:34:57.792916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619865+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:31:16.619865+0000","last_peered":"2024-05-20T17:31:16.619865+0000","last_clean":"2024-05-20T17:31:16.619865+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:31:16.619865+0000","last_undegraded":"2024-05-20T17:31:16.619865+0000","last_fullsized":"2024-05-20T17:31:16.619865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814521+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:31:14.814521+0000","last_peered":"2024-05-20T17:31:14.814521+0000","last_clean":"2024-05-20T17:31:14.814521+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:31:14.814521+0000","last_undegraded":"2024-05-20T17:31:14.814521+0000","last_fullsized":"2024-05-20T17:31:14.814521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799448+0000","last_change":"2024-05-20T17:31:14.793859+0000","last_active":"2024-05-20T17:31:16.799448+0000","last_peered":"2024-05-20T17:31:16.799448+0000","last_clean":"2024-05-20T17:31:16.799448+0000","last_became_active":"2024-05-20T17:31:14.793400+0000","last_became_peered":"2024-05-20T17:31:14.793400+0000","last_unstale":"2024-05-20T17:31:16.799448+0000","last_undegraded":"2024-05-20T17:31:16.799448+0000","last_fullsized":"2024-05-20T17:31:16.799448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:43.997668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.814703+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:31:16.814703+0000","last_peered":"2024-05-20T17:31:16.814703+0000","last_clean":"2024-05-20T17:31:16.814703+0000","last_became_active":"2024-05-20T17:31:13.792882+0000","last_became_peered":"2024-05-20T17:31:13.792882+0000","last_unstale":"2024-05-20T17:31:16.814703+0000","last_undegraded":"2024-05-20T17:31:16.814703+0000","last_fullsized":"2024-05-20T17:31:16.814703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:32.236130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.798810+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:31:14.798810+0000","last_peered":"2024-05-20T17:31:14.798810+0000","last_clean":"2024-05-20T17:31:14.798810+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:31:14.798810+0000","last_undegraded":"2024-05-20T17:31:14.798810+0000","last_fullsized":"2024-05-20T17:31:14.798810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:24:17.972207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789640+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:31:15.789640+0000","last_peered":"2024-05-20T17:31:15.789640+0000","last_clean":"2024-05-20T17:31:15.789640+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:31:15.789640+0000","last_undegraded":"2024-05-20T17:31:15.789640+0000","last_fullsized":"2024-05-20T17:31:15.789640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799119+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:31:16.799119+0000","last_peered":"2024-05-20T17:31:16.799119+0000","last_clean":"2024-05-20T17:31:16.799119+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:31:16.799119+0000","last_undegraded":"2024-05-20T17:31:16.799119+0000","last_fullsized":"2024-05-20T17:31:16.799119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.818576+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:31:17.818576+0000","last_peered":"2024-05-20T17:31:17.818576+0000","last_clean":"2024-05-20T17:31:17.818576+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:31:17.818576+0000","last_undegraded":"2024-05-20T17:31:17.818576+0000","last_fullsized":"2024-05-20T17:31:17.818576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798508+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:31:15.798508+0000","last_peered":"2024-05-20T17:31:15.798508+0000","last_clean":"2024-05-20T17:31:15.798508+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:31:15.798508+0000","last_undegraded":"2024-05-20T17:31:15.798508+0000","last_fullsized":"2024-05-20T17:31:15.798508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811535+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:31:16.811535+0000","last_peered":"2024-05-20T17:31:16.811535+0000","last_clean":"2024-05-20T17:31:16.811535+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:31:16.811535+0000","last_undegraded":"2024-05-20T17:31:16.811535+0000","last_fullsized":"2024-05-20T17:31:16.811535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.796907+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:31:15.796907+0000","last_peered":"2024-05-20T17:31:15.796907+0000","last_clean":"2024-05-20T17:31:15.796907+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:31:15.796907+0000","last_undegraded":"2024-05-20T17:31:15.796907+0000","last_fullsized":"2024-05-20T17:31:15.796907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.812677+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:31:16.812677+0000","last_peered":"2024-05-20T17:31:16.812677+0000","last_clean":"2024-05-20T17:31:16.812677+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:31:16.812677+0000","last_undegraded":"2024-05-20T17:31:16.812677+0000","last_fullsized":"2024-05-20T17:31:16.812677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620244+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:31:16.620244+0000","last_peered":"2024-05-20T17:31:16.620244+0000","last_clean":"2024-05-20T17:31:16.620244+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:31:16.620244+0000","last_undegraded":"2024-05-20T17:31:16.620244+0000","last_fullsized":"2024-05-20T17:31:16.620244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.780028+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:31:14.780028+0000","last_peered":"2024-05-20T17:31:14.780028+0000","last_clean":"2024-05-20T17:31:14.780028+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:31:14.780028+0000","last_undegraded":"2024-05-20T17:31:14.780028+0000","last_fullsized":"2024-05-20T17:31:14.780028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182482+0000","last_change":"2024-05-20T17:31:14.804732+0000","last_active":"2024-05-20T17:31:16.182482+0000","last_peered":"2024-05-20T17:31:16.182482+0000","last_clean":"2024-05-20T17:31:16.182482+0000","last_became_active":"2024-05-20T17:31:14.801272+0000","last_became_peered":"2024-05-20T17:31:14.801272+0000","last_unstale":"2024-05-20T17:31:16.182482+0000","last_undegraded":"2024-05-20T17:31:16.182482+0000","last_fullsized":"2024-05-20T17:31:16.182482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:42:29.879887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811795+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:31:16.811795+0000","last_peered":"2024-05-20T17:31:16.811795+0000","last_clean":"2024-05-20T17:31:16.811795+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:31:16.811795+0000","last_undegraded":"2024-05-20T17:31:16.811795+0000","last_fullsized":"2024-05-20T17:31:16.811795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.620085+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:31:16.620085+0000","last_peered":"2024-05-20T17:31:16.620085+0000","last_clean":"2024-05-20T17:31:16.620085+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:31:16.620085+0000","last_undegraded":"2024-05-20T17:31:16.620085+0000","last_fullsized":"2024-05-20T17:31:16.620085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811941+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:31:16.811941+0000","last_peered":"2024-05-20T17:31:16.811941+0000","last_clean":"2024-05-20T17:31:16.811941+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:31:16.811941+0000","last_undegraded":"2024-05-20T17:31:16.811941+0000","last_fullsized":"2024-05-20T17:31:16.811941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.801975+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:31:14.801975+0000","last_peered":"2024-05-20T17:31:14.801975+0000","last_clean":"2024-05-20T17:31:14.801975+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:31:14.801975+0000","last_undegraded":"2024-05-20T17:31:14.801975+0000","last_fullsized":"2024-05-20T17:31:14.801975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:01.474764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.819550+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:31:17.819550+0000","last_peered":"2024-05-20T17:31:17.819550+0000","last_clean":"2024-05-20T17:31:17.819550+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:31:17.819550+0000","last_undegraded":"2024-05-20T17:31:17.819550+0000","last_fullsized":"2024-05-20T17:31:17.819550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789148+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:31:15.789148+0000","last_peered":"2024-05-20T17:31:15.789148+0000","last_clean":"2024-05-20T17:31:15.789148+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:31:15.789148+0000","last_undegraded":"2024-05-20T17:31:15.789148+0000","last_fullsized":"2024-05-20T17:31:15.789148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.811806+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:31:16.811806+0000","last_peered":"2024-05-20T17:31:16.811806+0000","last_clean":"2024-05-20T17:31:16.811806+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:31:16.811806+0000","last_undegraded":"2024-05-20T17:31:16.811806+0000","last_fullsized":"2024-05-20T17:31:16.811806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803995+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:31:14.803995+0000","last_peered":"2024-05-20T17:31:14.803995+0000","last_clean":"2024-05-20T17:31:14.803995+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:31:14.803995+0000","last_undegraded":"2024-05-20T17:31:14.803995+0000","last_fullsized":"2024-05-20T17:31:14.803995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:14.044557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.026109+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:31:18.026109+0000","last_peered":"2024-05-20T17:31:18.026109+0000","last_clean":"2024-05-20T17:31:18.026109+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:31:18.026109+0000","last_undegraded":"2024-05-20T17:31:18.026109+0000","last_fullsized":"2024-05-20T17:31:18.026109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803805+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:31:14.803805+0000","last_peered":"2024-05-20T17:31:14.803805+0000","last_clean":"2024-05-20T17:31:14.803805+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:31:14.803805+0000","last_undegraded":"2024-05-20T17:31:14.803805+0000","last_fullsized":"2024-05-20T17:31:14.803805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:08:05.365011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814320+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:31:14.814320+0000","last_peered":"2024-05-20T17:31:14.814320+0000","last_clean":"2024-05-20T17:31:14.814320+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:31:14.814320+0000","last_undegraded":"2024-05-20T17:31:14.814320+0000","last_fullsized":"2024-05-20T17:31:14.814320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.798880+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:31:16.798880+0000","last_peered":"2024-05-20T17:31:16.798880+0000","last_clean":"2024-05-20T17:31:16.798880+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:31:16.798880+0000","last_undegraded":"2024-05-20T17:31:16.798880+0000","last_fullsized":"2024-05-20T17:31:16.798880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.814315+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:31:14.814315+0000","last_peered":"2024-05-20T17:31:14.814315+0000","last_clean":"2024-05-20T17:31:14.814315+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:31:14.814315+0000","last_undegraded":"2024-05-20T17:31:14.814315+0000","last_fullsized":"2024-05-20T17:31:14.814315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610463+0000","last_change":"2024-05-20T17:31:14.804254+0000","last_active":"2024-05-20T17:31:16.610463+0000","last_peered":"2024-05-20T17:31:16.610463+0000","last_clean":"2024-05-20T17:31:16.610463+0000","last_became_active":"2024-05-20T17:31:14.803518+0000","last_became_peered":"2024-05-20T17:31:14.803518+0000","last_unstale":"2024-05-20T17:31:16.610463+0000","last_undegraded":"2024-05-20T17:31:16.610463+0000","last_fullsized":"2024-05-20T17:31:16.610463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:16:26.326857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.796993+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:31:15.796993+0000","last_peered":"2024-05-20T17:31:15.796993+0000","last_clean":"2024-05-20T17:31:15.796993+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:31:15.796993+0000","last_undegraded":"2024-05-20T17:31:15.796993+0000","last_fullsized":"2024-05-20T17:31:15.796993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790011+0000","last_change":"2024-05-20T17:31:14.806370+0000","last_active":"2024-05-20T17:31:15.790011+0000","last_peered":"2024-05-20T17:31:15.790011+0000","last_clean":"2024-05-20T17:31:15.790011+0000","last_became_active":"2024-05-20T17:31:14.806013+0000","last_became_peered":"2024-05-20T17:31:14.806013+0000","last_unstale":"2024-05-20T17:31:15.790011+0000","last_undegraded":"2024-05-20T17:31:15.790011+0000","last_fullsized":"2024-05-20T17:31:15.790011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:50:13.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.789192+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:31:14.789192+0000","last_peered":"2024-05-20T17:31:14.789192+0000","last_clean":"2024-05-20T17:31:14.789192+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:31:14.789192+0000","last_undegraded":"2024-05-20T17:31:14.789192+0000","last_fullsized":"2024-05-20T17:31:14.789192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789679+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:31:15.789679+0000","last_peered":"2024-05-20T17:31:15.789679+0000","last_clean":"2024-05-20T17:31:15.789679+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:31:15.789679+0000","last_undegraded":"2024-05-20T17:31:15.789679+0000","last_fullsized":"2024-05-20T17:31:15.789679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799081+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:31:16.799081+0000","last_peered":"2024-05-20T17:31:16.799081+0000","last_clean":"2024-05-20T17:31:16.799081+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:31:16.799081+0000","last_undegraded":"2024-05-20T17:31:16.799081+0000","last_fullsized":"2024-05-20T17:31:16.799081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.025664+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:31:18.025664+0000","last_peered":"2024-05-20T17:31:18.025664+0000","last_clean":"2024-05-20T17:31:18.025664+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:31:18.025664+0000","last_undegraded":"2024-05-20T17:31:18.025664+0000","last_fullsized":"2024-05-20T17:31:18.025664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798875+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:31:15.798875+0000","last_peered":"2024-05-20T17:31:15.798875+0000","last_clean":"2024-05-20T17:31:15.798875+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:31:15.798875+0000","last_undegraded":"2024-05-20T17:31:15.798875+0000","last_fullsized":"2024-05-20T17:31:15.798875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:18.022211+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:31:18.022211+0000","last_peered":"2024-05-20T17:31:18.022211+0000","last_clean":"2024-05-20T17:31:18.022211+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:31:18.022211+0000","last_undegraded":"2024-05-20T17:31:18.022211+0000","last_fullsized":"2024-05-20T17:31:18.022211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.780107+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:31:14.780107+0000","last_peered":"2024-05-20T17:31:14.780107+0000","last_clean":"2024-05-20T17:31:14.780107+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:31:14.780107+0000","last_undegraded":"2024-05-20T17:31:14.780107+0000","last_fullsized":"2024-05-20T17:31:14.780107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.788958+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:31:15.788958+0000","last_peered":"2024-05-20T17:31:15.788958+0000","last_clean":"2024-05-20T17:31:15.788958+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:31:15.788958+0000","last_undegraded":"2024-05-20T17:31:15.788958+0000","last_fullsized":"2024-05-20T17:31:15.788958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.781517+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:31:14.781517+0000","last_peered":"2024-05-20T17:31:14.781517+0000","last_clean":"2024-05-20T17:31:14.781517+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:31:14.781517+0000","last_undegraded":"2024-05-20T17:31:14.781517+0000","last_fullsized":"2024-05-20T17:31:14.781517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.786412+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:31:14.786412+0000","last_peered":"2024-05-20T17:31:14.786412+0000","last_clean":"2024-05-20T17:31:14.786412+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:31:14.786412+0000","last_undegraded":"2024-05-20T17:31:14.786412+0000","last_fullsized":"2024-05-20T17:31:14.786412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789201+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:31:15.789201+0000","last_peered":"2024-05-20T17:31:15.789201+0000","last_clean":"2024-05-20T17:31:15.789201+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:31:15.789201+0000","last_undegraded":"2024-05-20T17:31:15.789201+0000","last_fullsized":"2024-05-20T17:31:15.789201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798656+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:31:15.798656+0000","last_peered":"2024-05-20T17:31:15.798656+0000","last_clean":"2024-05-20T17:31:15.798656+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:31:15.798656+0000","last_undegraded":"2024-05-20T17:31:15.798656+0000","last_fullsized":"2024-05-20T17:31:15.798656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.799047+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:31:15.799047+0000","last_peered":"2024-05-20T17:31:15.799047+0000","last_clean":"2024-05-20T17:31:15.799047+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:31:15.799047+0000","last_undegraded":"2024-05-20T17:31:15.799047+0000","last_fullsized":"2024-05-20T17:31:15.799047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810098+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:31:16.810098+0000","last_peered":"2024-05-20T17:31:16.810098+0000","last_clean":"2024-05-20T17:31:16.810098+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:31:16.810098+0000","last_undegraded":"2024-05-20T17:31:16.810098+0000","last_fullsized":"2024-05-20T17:31:16.810098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182439+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:31:16.182439+0000","last_peered":"2024-05-20T17:31:16.182439+0000","last_clean":"2024-05-20T17:31:16.182439+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:31:16.182439+0000","last_undegraded":"2024-05-20T17:31:16.182439+0000","last_fullsized":"2024-05-20T17:31:16.182439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810959+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:31:16.810959+0000","last_peered":"2024-05-20T17:31:16.810959+0000","last_clean":"2024-05-20T17:31:16.810959+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:31:16.810959+0000","last_undegraded":"2024-05-20T17:31:16.810959+0000","last_fullsized":"2024-05-20T17:31:16.810959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.798772+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:31:14.798772+0000","last_peered":"2024-05-20T17:31:14.798772+0000","last_clean":"2024-05-20T17:31:14.798772+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:31:14.798772+0000","last_undegraded":"2024-05-20T17:31:14.798772+0000","last_fullsized":"2024-05-20T17:31:14.798772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:39.234238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.810850+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:31:16.810850+0000","last_peered":"2024-05-20T17:31:16.810850+0000","last_clean":"2024-05-20T17:31:16.810850+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:31:16.810850+0000","last_undegraded":"2024-05-20T17:31:16.810850+0000","last_fullsized":"2024-05-20T17:31:16.810850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610247+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:31:16.610247+0000","last_peered":"2024-05-20T17:31:16.610247+0000","last_clean":"2024-05-20T17:31:16.610247+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:31:16.610247+0000","last_undegraded":"2024-05-20T17:31:16.610247+0000","last_fullsized":"2024-05-20T17:31:16.610247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789777+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:31:15.789777+0000","last_peered":"2024-05-20T17:31:15.789777+0000","last_clean":"2024-05-20T17:31:15.789777+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:31:15.789777+0000","last_undegraded":"2024-05-20T17:31:15.789777+0000","last_fullsized":"2024-05-20T17:31:15.789777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798833+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:31:15.798833+0000","last_peered":"2024-05-20T17:31:15.798833+0000","last_clean":"2024-05-20T17:31:15.798833+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:31:15.798833+0000","last_undegraded":"2024-05-20T17:31:15.798833+0000","last_fullsized":"2024-05-20T17:31:15.798833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.813437+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:31:14.813437+0000","last_peered":"2024-05-20T17:31:14.813437+0000","last_clean":"2024-05-20T17:31:14.813437+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:31:14.813437+0000","last_undegraded":"2024-05-20T17:31:14.813437+0000","last_fullsized":"2024-05-20T17:31:14.813437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.804533+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:31:14.804533+0000","last_peered":"2024-05-20T17:31:14.804533+0000","last_clean":"2024-05-20T17:31:14.804533+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:31:14.804533+0000","last_undegraded":"2024-05-20T17:31:14.804533+0000","last_fullsized":"2024-05-20T17:31:14.804533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:01.945936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:17.817815+0000","last_change":"2024-05-20T17:31:13.794222+0000","last_active":"2024-05-20T17:31:17.817815+0000","last_peered":"2024-05-20T17:31:17.817815+0000","last_clean":"2024-05-20T17:31:17.817815+0000","last_became_active":"2024-05-20T17:31:13.793828+0000","last_became_peered":"2024-05-20T17:31:13.793828+0000","last_unstale":"2024-05-20T17:31:17.817815+0000","last_undegraded":"2024-05-20T17:31:17.817815+0000","last_fullsized":"2024-05-20T17:31:17.817815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:46:50.859413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.803952+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:31:14.803952+0000","last_peered":"2024-05-20T17:31:14.803952+0000","last_clean":"2024-05-20T17:31:14.803952+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:31:14.803952+0000","last_undegraded":"2024-05-20T17:31:14.803952+0000","last_fullsized":"2024-05-20T17:31:14.803952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:55.001348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.799354+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:31:16.799354+0000","last_peered":"2024-05-20T17:31:16.799354+0000","last_clean":"2024-05-20T17:31:16.799354+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:31:16.799354+0000","last_undegraded":"2024-05-20T17:31:16.799354+0000","last_fullsized":"2024-05-20T17:31:16.799354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.799693+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:31:14.799693+0000","last_peered":"2024-05-20T17:31:14.799693+0000","last_clean":"2024-05-20T17:31:14.799693+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:31:14.799693+0000","last_undegraded":"2024-05-20T17:31:14.799693+0000","last_fullsized":"2024-05-20T17:31:14.799693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:26:59.457907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789219+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:31:15.789219+0000","last_peered":"2024-05-20T17:31:15.789219+0000","last_clean":"2024-05-20T17:31:15.789219+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:31:15.789219+0000","last_undegraded":"2024-05-20T17:31:15.789219+0000","last_fullsized":"2024-05-20T17:31:15.789219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-20T17:31:14.800038+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:31:14.800038+0000","last_peered":"2024-05-20T17:31:14.800038+0000","last_clean":"2024-05-20T17:31:14.800038+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:31:14.800038+0000","last_undegraded":"2024-05-20T17:31:14.800038+0000","last_fullsized":"2024-05-20T17:31:14.800038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:14:22.703056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610310+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:31:16.610310+0000","last_peered":"2024-05-20T17:31:16.610310+0000","last_clean":"2024-05-20T17:31:16.610310+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:31:16.610310+0000","last_undegraded":"2024-05-20T17:31:16.610310+0000","last_fullsized":"2024-05-20T17:31:16.610310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789909+0000","last_change":"2024-05-20T17:31:14.805064+0000","last_active":"2024-05-20T17:31:15.789909+0000","last_peered":"2024-05-20T17:31:15.789909+0000","last_clean":"2024-05-20T17:31:15.789909+0000","last_became_active":"2024-05-20T17:31:14.804714+0000","last_became_peered":"2024-05-20T17:31:14.804714+0000","last_unstale":"2024-05-20T17:31:15.789909+0000","last_undegraded":"2024-05-20T17:31:15.789909+0000","last_fullsized":"2024-05-20T17:31:15.789909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:41:06.791965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789804+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:31:15.789804+0000","last_peered":"2024-05-20T17:31:15.789804+0000","last_clean":"2024-05-20T17:31:15.789804+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:31:15.789804+0000","last_undegraded":"2024-05-20T17:31:15.789804+0000","last_fullsized":"2024-05-20T17:31:15.789804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.182257+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:31:16.182257+0000","last_peered":"2024-05-20T17:31:16.182257+0000","last_clean":"2024-05-20T17:31:16.182257+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:31:16.182257+0000","last_undegraded":"2024-05-20T17:31:16.182257+0000","last_fullsized":"2024-05-20T17:31:16.182257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789151+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:31:15.789151+0000","last_peered":"2024-05-20T17:31:15.789151+0000","last_clean":"2024-05-20T17:31:15.789151+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:31:15.789151+0000","last_undegraded":"2024-05-20T17:31:15.789151+0000","last_fullsized":"2024-05-20T17:31:15.789151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610373+0000","last_change":"2024-05-20T17:31:14.795150+0000","last_active":"2024-05-20T17:31:16.610373+0000","last_peered":"2024-05-20T17:31:16.610373+0000","last_clean":"2024-05-20T17:31:16.610373+0000","last_became_active":"2024-05-20T17:31:14.794755+0000","last_became_peered":"2024-05-20T17:31:14.794755+0000","last_unstale":"2024-05-20T17:31:16.610373+0000","last_undegraded":"2024-05-20T17:31:16.610373+0000","last_fullsized":"2024-05-20T17:31:16.610373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:39.423408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.790205+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:31:15.790205+0000","last_peered":"2024-05-20T17:31:15.790205+0000","last_clean":"2024-05-20T17:31:15.790205+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:31:15.790205+0000","last_undegraded":"2024-05-20T17:31:15.790205+0000","last_fullsized":"2024-05-20T17:31:15.790205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798991+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:31:15.798991+0000","last_peered":"2024-05-20T17:31:15.798991+0000","last_clean":"2024-05-20T17:31:15.798991+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:31:15.798991+0000","last_undegraded":"2024-05-20T17:31:15.798991+0000","last_fullsized":"2024-05-20T17:31:15.798991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.798932+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:31:16.798932+0000","last_peered":"2024-05-20T17:31:16.798932+0000","last_clean":"2024-05-20T17:31:16.798932+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:31:16.798932+0000","last_undegraded":"2024-05-20T17:31:16.798932+0000","last_fullsized":"2024-05-20T17:31:16.798932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.798567+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:31:15.798567+0000","last_peered":"2024-05-20T17:31:15.798567+0000","last_clean":"2024-05-20T17:31:15.798567+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:31:15.798567+0000","last_undegraded":"2024-05-20T17:31:15.798567+0000","last_fullsized":"2024-05-20T17:31:15.798567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.619920+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:31:16.619920+0000","last_peered":"2024-05-20T17:31:16.619920+0000","last_clean":"2024-05-20T17:31:16.619920+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:31:16.619920+0000","last_undegraded":"2024-05-20T17:31:16.619920+0000","last_fullsized":"2024-05-20T17:31:16.619920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:15.789418+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:31:15.789418+0000","last_peered":"2024-05-20T17:31:15.789418+0000","last_clean":"2024-05-20T17:31:15.789418+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:31:15.789418+0000","last_undegraded":"2024-05-20T17:31:15.789418+0000","last_fullsized":"2024-05-20T17:31:15.789418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-20T17:31:16.610285+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:31:16.610285+0000","last_peered":"2024-05-20T17:31:16.610285+0000","last_clean":"2024-05-20T17:31:16.610285+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:31:16.610285+0000","last_undegraded":"2024-05-20T17:31:16.610285+0000","last_fullsized":"2024-05-20T17:31:16.610285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246618,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5088,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":92,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":13666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":439103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645330,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":1030695,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":439103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":1020901,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":438611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":440133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":440789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1020501,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:31:22.229 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:31:22.230 INFO:tasks.cephadm:Setting up client nodes... 2024-05-20T17:31:22.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-20T17:31:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:22 smithi172 ceph-mon[36511]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:22 smithi172 ceph-mon[36511]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:31:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:22 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1251134025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:22 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3229756075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:22.503 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:22 smithi160 ceph-mon[36261]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:31:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:22 smithi160 ceph-mon[36261]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:31:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:22 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1251134025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:31:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:22 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3229756075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:23 smithi135 ceph-mon[32027]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:23 smithi135 ceph-mon[32027]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:23 smithi135 ceph-mon[32027]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-20T17:31:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:23 smithi172 ceph-mon[36511]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:23 smithi172 ceph-mon[36511]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:23 smithi172 ceph-mon[36511]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-20T17:31:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:23 smithi160 ceph-mon[36261]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:23 smithi160 ceph-mon[36261]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:31:23.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:23 smithi160 ceph-mon[36261]: pgmap v293: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-20T17:31:24.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 -- 172.21.15.135:0/2138889776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c541020d0 msgr2=0x7f1c541024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/2138889776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c541020d0 0x7f1c541024e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009990 tx=0x7f1c50009ca0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 -- 172.21.15.135:0/2138889776 shutdown_connections 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/2138889776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c5410a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/2138889776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c541020d0 0x7f1c541024e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/2138889776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c54103200 0x7f1c54103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 -- 172.21.15.135:0/2138889776 >> 172.21.15.135:0/2138889776 conn(0x7f1c540fd710 msgr2=0x7f1c540ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 -- 172.21.15.135:0/2138889776 shutdown_connections 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.234+0000 7f1c5bc28700 1 -- 172.21.15.135:0/2138889776 wait complete. 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 Processor -- start 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 -- start start 2024-05-20T17:31:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c541020d0 0x7f1c540752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c541a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5410dcb0 con 0x7f1c54103200 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5410db30 con 0x7f1c541020d0 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5bc28700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5410de30 con 0x7f1c54103ba0 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33834/0 (socket says 172.21.15.135:33834) 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 -- 172.21.15.135:0/3818417542 learned_addr learned my addr 172.21.15.135:0/3818417542 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c599c4700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c541020d0 0x7f1c540752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c5a1c5700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c541a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 -- 172.21.15.135:0/3818417542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 msgr2=0x7f1c541a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c541a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 -- 172.21.15.135:0/3818417542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c541020d0 msgr2=0x7f1c540752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.235+0000 7f1c591c3700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c541020d0 0x7f1c540752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c591c3700 1 -- 172.21.15.135:0/3818417542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c541a13f0 con 0x7f1c54103200 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c5a1c5700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c541a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c591c3700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c920 tx=0x7f1c4400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44007b00 con 0x7f1c54103200 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c44004d10 con 0x7f1c54103200 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44005630 con 0x7f1c54103200 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c541a16e0 con 0x7f1c54103200 2024-05-20T17:31:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.236+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c541a1bd0 con 0x7f1c54103200 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.237+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c54050170 con 0x7f1c54103200 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.238+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1c44004750 con 0x7f1c54103200 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.239+0000 7f1c4affd700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 0x7f1c400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.240+0000 7f1c599c4700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 0x7f1c400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.240+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f1c440cf020 con 0x7f1c54103200 2024-05-20T17:31:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.240+0000 7f1c599c4700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 0x7f1c400a51c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c500039c0 tx=0x7f1c5001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:24.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.243+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c44014030 con 0x7f1c54103200 2024-05-20T17:31:24.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.519+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1c5402dc60 con 0x7f1c54103200 2024-05-20T17:31:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.522+0000 7f1c4affd700 1 -- 172.21.15.135:0/3818417542 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f1c4409bf50 con 0x7f1c54103200 2024-05-20T17:31:24.523 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-05-20T17:31:24.523 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDsiEtmhkcLHxAAzN6kOBKASBoW18Wxn/8+Vg== 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 msgr2=0x7f1c400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 0x7f1c400a51c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c500039c0 tx=0x7f1c5001a040 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 msgr2=0x7f1c5419e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c920 tx=0x7f1c4400cc30 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 shutdown_connections 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c541020d0 0x7f1c540752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c400a2cb0 0x7f1c400a51c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54103ba0 0x7f1c541a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 --2- 172.21.15.135:0/3818417542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c54103200 0x7f1c5419e650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.524+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 >> 172.21.15.135:0/3818417542 conn(0x7f1c540fd710 msgr2=0x7f1c54106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.525+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 shutdown_connections 2024-05-20T17:31:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:24.525+0000 7f1c5bc28700 1 -- 172.21.15.135:0/3818417542 wait complete. 2024-05-20T17:31:24.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:31:24.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:31:24.901 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:31:24.901 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:31:25.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:31:25.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3818417542' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:31:25.299 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:31:25.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-20T17:31:25.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-20T17:31:25.338 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-20T17:31:25.339 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-20T17:31:25.339 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph mgr dump --format=json 2024-05-20T17:31:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:25.886 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:25 smithi135 ceph-mon[32027]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 KiB/s wr, 20 op/s 2024-05-20T17:31:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:25 smithi160 ceph-mon[36261]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 KiB/s wr, 20 op/s 2024-05-20T17:31:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:25 smithi172 ceph-mon[36511]: pgmap v294: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.2 KiB/s wr, 20 op/s 2024-05-20T17:31:27.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:26 smithi172 ceph-mon[36511]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-05-20T17:31:27.088 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:26 smithi135 ceph-mon[32027]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-05-20T17:31:27.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:26 smithi160 ceph-mon[36261]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 -- 172.21.15.135:0/199428207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 msgr2=0x7f2a0010d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 --2- 172.21.15.135:0/199428207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0010d180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009990 tx=0x7f29f0009ca0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 -- 172.21.15.135:0/199428207 shutdown_connections 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 --2- 172.21.15.135:0/199428207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a001042e0 0x7f2a001046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 --2- 172.21.15.135:0/199428207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0010d750 0x7f2a0010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 --2- 172.21.15.135:0/199428207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0010d180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 -- 172.21.15.135:0/199428207 >> 172.21.15.135:0/199428207 conn(0x7f2a000fdc70 msgr2=0x7f2a00100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:27.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 -- 172.21.15.135:0/199428207 shutdown_connections 2024-05-20T17:31:27.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.349+0000 7f2a087cb700 1 -- 172.21.15.135:0/199428207 wait complete. 2024-05-20T17:31:27.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 Processor -- start 2024-05-20T17:31:27.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 -- start start 2024-05-20T17:31:27.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a001042e0 0x7f2a00199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:27.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a0010d750 0x7f2a0019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00113430 con 0x7f2a00104c30 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001132b0 con 0x7f2a0010d750 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.350+0000 7f2a087cb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001135b0 con 0x7f2a001042e0 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33850/0 (socket says 172.21.15.135:33850) 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 -- 172.21.15.135:0/3827124237 learned_addr learned my addr 172.21.15.135:0/3827124237 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a06567700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a001042e0 0x7f2a00199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 -- 172.21.15.135:0/3827124237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a001042e0 msgr2=0x7f2a00199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a001042e0 0x7f2a00199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 -- 172.21.15.135:0/3827124237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a0010d750 msgr2=0x7f2a0019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:27.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a0010d750 0x7f2a0019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 -- 172.21.15.135:0/3827124237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0019ec30 con 0x7f2a00104c30 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a05d66700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29f0000c00 tx=0x7f29f00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0027070 con 0x7f2a00104c30 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f0003780 con 0x7f2a00104c30 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0019eec0 con 0x7f2a00104c30 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0022db0 con 0x7f2a00104c30 2024-05-20T17:31:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.351+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0019f3a0 con 0x7f2a00104c30 2024-05-20T17:31:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.352+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a00050170 con 0x7f2a00104c30 2024-05-20T17:31:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.354+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f29f002a070 con 0x7f2a00104c30 2024-05-20T17:31:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.354+0000 7f29f77fe700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 0x7f29ec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.355+0000 7f2a06567700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 0x7f29ec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.355+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f29f00d00f0 con 0x7f2a00104c30 2024-05-20T17:31:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.355+0000 7f2a06567700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 0x7f29ec0a51c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a0006bfd0 tx=0x7f29fc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:27.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.358+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f29f0013070 con 0x7f2a00104c30 2024-05-20T17:31:27.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.607+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2a0002dc60 con 0x7f2a00104c30 2024-05-20T17:31:27.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.612+0000 7f29f77fe700 1 -- 172.21.15.135:0/3827124237 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263209 (secure 0 0 0) 0x7f29f009d130 con 0x7f2a00104c30 2024-05-20T17:31:27.617 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:27.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.615+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 msgr2=0x7f29ec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:27.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.615+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 0x7f29ec0a51c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a0006bfd0 tx=0x7f29fc007400 comp rx=0 tx=0).stop 2024-05-20T17:31:27.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.615+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 msgr2=0x7f2a0019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.615+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29f0000c00 tx=0x7f29f00047b0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 shutdown_connections 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a0010d750 0x7f2a0019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f29ec0a2cb0 0x7f29ec0a51c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a001042e0 0x7f2a00199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 --2- 172.21.15.135:0/3827124237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a00104c30 0x7f2a0019a300 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 >> 172.21.15.135:0/3827124237 conn(0x7f2a000fdc70 msgr2=0x7f2a000ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 shutdown_connections 2024-05-20T17:31:27.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:27.616+0000 7f2a087cb700 1 -- 172.21.15.135:0/3827124237 wait complete. 2024-05-20T17:31:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:27 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3827124237' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:31:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:27 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3827124237' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:31:28.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:27 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3827124237' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:31:28.314 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3106262554},{"type":"v1","addr":"172.21.15.135:6801","nonce":3106262554}]},"active_addr":"172.21.15.135:6801/3106262554","active_change":"2024-05-20T17:24:06.618781+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14223,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24118,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.135:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2340719003}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3892403253}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2366951991}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3665782068}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":672773430}]}]} 2024-05-20T17:31:28.321 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-20T17:31:28.321 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-20T17:31:28.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:31:28.561 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:28.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:28 smithi135 ceph-mon[32027]: pgmap v296: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2024-05-20T17:31:29.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:28 smithi172 ceph-mon[36511]: pgmap v296: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2024-05-20T17:31:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:28 smithi160 ceph-mon[36261]: pgmap v296: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2024-05-20T17:31:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.280+0000 7fd85e7b0700 1 -- 172.21.15.135:0/3392955512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 msgr2=0x7fd858105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.280+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/3392955512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd858105a70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd8480099c0 tx=0x7fd848009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 -- 172.21.15.135:0/3392955512 shutdown_connections 2024-05-20T17:31:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/3392955512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 0x7fd858112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/3392955512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd858105a70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/3392955512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85810a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 -- 172.21.15.135:0/3392955512 >> 172.21.15.135:0/3392955512 conn(0x7fd858100ed0 msgr2=0x7fd858103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 -- 172.21.15.135:0/3392955512 shutdown_connections 2024-05-20T17:31:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 -- 172.21.15.135:0/3392955512 wait complete. 2024-05-20T17:31:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 Processor -- start 2024-05-20T17:31:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.281+0000 7fd85e7b0700 1 -- start start 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 0x7fd8581a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd858115660 con 0x7fd858105660 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581154e0 con 0x7fd85810a8e0 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85e7b0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581157e0 con 0x7fd858109f90 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52762/0 (socket says 172.21.15.135:52762) 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 -- 172.21.15.135:0/605849611 learned_addr learned my addr 172.21.15.135:0/605849611 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd85cd4d700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 0x7fd8581a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:30.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd84ffff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 -- 172.21.15.135:0/605849611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 msgr2=0x7fd85819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 -- 172.21.15.135:0/605849611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 msgr2=0x7fd8581a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 0x7fd8581a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 -- 172.21.15.135:0/605849611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8581a0d50 con 0x7fd858105660 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd84ffff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.282+0000 7fd857fff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8480059d0 tx=0x7fd8480038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.283+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848027070 con 0x7fd858105660 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.283+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8581a0fe0 con 0x7fd858105660 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.283+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd848004050 con 0x7fd858105660 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.283+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848022db0 con 0x7fd858105660 2024-05-20T17:31:30.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.283+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581a1510 con 0x7fd858105660 2024-05-20T17:31:30.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.284+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd858050170 con 0x7fd858105660 2024-05-20T17:31:30.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.285+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd84802a070 con 0x7fd858105660 2024-05-20T17:31:30.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.286+0000 7fd855ffb700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 0x7fd8440a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:30.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.286+0000 7fd84ffff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 0x7fd8440a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:30.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.286+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fd8480cfdb0 con 0x7fd858105660 2024-05-20T17:31:30.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.286+0000 7fd84ffff700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 0x7fd8440a51c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd840005fd0 tx=0x7fd840005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.291+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd84805e850 con 0x7fd858105660 2024-05-20T17:31:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.497+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd85819d290 con 0x7fd858105660 2024-05-20T17:31:30.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.498+0000 7fd855ffb700 1 -- 172.21.15.135:0/605849611 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22286 (secure 0 0 0) 0x7fd848013070 con 0x7fd858105660 2024-05-20T17:31:30.500 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:30.500 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:31:15.781120+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 msgr2=0x7fd8440a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 0x7fd8440a51c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd840005fd0 tx=0x7fd840005e20 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 msgr2=0x7fd85819bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8480059d0 tx=0x7fd8480038b0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 shutdown_connections 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85810a8e0 0x7fd8581a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd8440a2cb0 0x7fd8440a51c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd858105660 0x7fd85819bf30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 --2- 172.21.15.135:0/605849611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd858109f90 0x7fd85819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 >> 172.21.15.135:0/605849611 conn(0x7fd858100ed0 msgr2=0x7fd858102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 shutdown_connections 2024-05-20T17:31:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:30.501+0000 7fd85e7b0700 1 -- 172.21.15.135:0/605849611 wait complete. 2024-05-20T17:31:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:30 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/605849611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:30.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:30 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/605849611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:30.878 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:30 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/605849611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:31.315 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-20T17:31:31.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:31:31.558 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:31 smithi172 ceph-mon[36511]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-05-20T17:31:31.833 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:31 smithi135 ceph-mon[32027]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-05-20T17:31:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:31 smithi160 ceph-mon[36261]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-05-20T17:31:33.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:32 smithi135 ceph-mon[32027]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-05-20T17:31:33.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:32 smithi172 ceph-mon[36511]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-05-20T17:31:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:32 smithi160 ceph-mon[36261]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 -- 172.21.15.135:0/529448857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3860102340 msgr2=0x7f3860102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 --2- 172.21.15.135:0/529448857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3860102340 0x7f3860102750 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38500099c0 tx=0x7f3850009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 -- 172.21.15.135:0/529448857 shutdown_connections 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 --2- 172.21.15.135:0/529448857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38601075c0 0x7f386010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 --2- 172.21.15.135:0/529448857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3860102340 0x7f3860102750 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 --2- 172.21.15.135:0/529448857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860106c70 0x7f3860107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 -- 172.21.15.135:0/529448857 >> 172.21.15.135:0/529448857 conn(0x7f38600fdc40 msgr2=0x7f3860100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:33.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 -- 172.21.15.135:0/529448857 shutdown_connections 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 -- 172.21.15.135:0/529448857 wait complete. 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.314+0000 7f386664a700 1 Processor -- start 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 -- start start 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860102340 0x7f386019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3860106c70 0x7f386019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3860112340 con 0x7f38601075c0 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38601121c0 con 0x7f3860102340 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f386664a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38601124c0 con 0x7f3860106c70 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52780/0 (socket says 172.21.15.135:52780) 2024-05-20T17:31:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 -- 172.21.15.135:0/1386512393 learned_addr learned my addr 172.21.15.135:0/1386512393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f385ffff700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860102340 0x7f386019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3857fff700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3860106c70 0x7f386019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 -- 172.21.15.135:0/1386512393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3860106c70 msgr2=0x7f386019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3860106c70 0x7f386019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 -- 172.21.15.135:0/1386512393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860102340 msgr2=0x7f386019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860102340 0x7f386019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 -- 172.21.15.135:0/1386512393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3860199130 con 0x7f38601075c0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.315+0000 7f3864be7700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3858007ee0 tx=0x7f385800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.316+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858004bb0 con 0x7f38601075c0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.316+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3860199420 con 0x7f38601075c0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.316+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3858004d50 con 0x7f38601075c0 2024-05-20T17:31:33.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.316+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858005960 con 0x7f38601075c0 2024-05-20T17:31:33.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.316+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38601a56f0 con 0x7f38601075c0 2024-05-20T17:31:33.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.317+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3860050170 con 0x7f38601075c0 2024-05-20T17:31:33.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.318+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f385801a020 con 0x7f38601075c0 2024-05-20T17:31:33.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.319+0000 7f385dffb700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 0x7f384c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:33.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.319+0000 7f385ffff700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 0x7f384c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:33.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.319+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f38580ce6e0 con 0x7f38601075c0 2024-05-20T17:31:33.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.320+0000 7f385ffff700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 0x7f384c0a51c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3850000c00 tx=0x7f385001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:33.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.324+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3858010070 con 0x7f38601075c0 2024-05-20T17:31:33.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.528+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f386002dc60 con 0x7f38601075c0 2024-05-20T17:31:33.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.530+0000 7f385dffb700 1 -- 172.21.15.135:0/1386512393 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22286 (secure 0 0 0) 0x7f385809b690 con 0x7f38601075c0 2024-05-20T17:31:33.531 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:31:33.532 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:31:15.781120+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:31:33.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 msgr2=0x7f384c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:33.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 0x7f384c0a51c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3850000c00 tx=0x7f385001a040 comp rx=0 tx=0).stop 2024-05-20T17:31:33.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 msgr2=0x7f3860198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3858007ee0 tx=0x7f385800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 shutdown_connections 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3860102340 0x7f386019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f384c0a2cb0 0x7f384c0a51c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38601075c0 0x7f3860198a80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 --2- 172.21.15.135:0/1386512393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3860106c70 0x7f386019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 >> 172.21.15.135:0/1386512393 conn(0x7f38600fdc40 msgr2=0x7f3860108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 shutdown_connections 2024-05-20T17:31:33.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:33.532+0000 7f386664a700 1 -- 172.21.15.135:0/1386512393 wait complete. 2024-05-20T17:31:34.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:33 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1386512393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:33 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1386512393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:34.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:33 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1386512393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:31:34.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-20T17:31:34.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-20T17:31:34.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-20T17:31:34.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-20T17:31:34.569 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-20T17:31:34.569 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-20T17:31:34.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-20T17:31:34.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-20T17:31:34.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-20T17:31:34.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-20T17:31:34.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-20T17:31:34.572 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-20T17:31:34.831 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:34 smithi135 ceph-mon[32027]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-20T17:31:35.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:34 smithi172 ceph-mon[36511]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-20T17:31:35.247 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.247 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.248 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.253 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:34 smithi160 ceph-mon[36261]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-20T17:31:35.257 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.259 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.259 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.339 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.579 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.580 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.580 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:35.581 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:31:37.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:36 smithi135 ceph-mon[32027]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-20T17:31:37.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:36 smithi172 ceph-mon[36511]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-20T17:31:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:36 smithi160 ceph-mon[36261]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-20T17:31:39.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:38 smithi172 ceph-mon[36511]: pgmap v301: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-20T17:31:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:38 smithi135 ceph-mon[32027]: pgmap v301: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-20T17:31:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:38 smithi160 ceph-mon[36261]: pgmap v301: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-20T17:31:41.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 -- 172.21.15.135:0/3043455743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23541086d0 msgr2=0x7f2354110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 --2- 172.21.15.135:0/3043455743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23541086d0 0x7f2354110030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f234c00b0d0 tx=0x7f234c00b3e0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 -- 172.21.15.135:0/3043455743 shutdown_connections 2024-05-20T17:31:41.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 --2- 172.21.15.135:0/3043455743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2354103450 0x7f2354103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 --2- 172.21.15.135:0/3043455743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23541086d0 0x7f2354110030 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 --2- 172.21.15.135:0/3043455743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2354107d80 0x7f2354108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 -- 172.21.15.135:0/3043455743 >> 172.21.15.135:0/3043455743 conn(0x7f23540fed20 msgr2=0x7f2354101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 -- 172.21.15.135:0/3043455743 shutdown_connections 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.034+0000 7f235b447700 1 -- 172.21.15.135:0/3043455743 wait complete. 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 Processor -- start 2024-05-20T17:31:41.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 -- start start 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2354103450 0x7f235419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 0x7f235419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23541086d0 0x7f23541a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2354115640 con 0x7f2354107d80 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f23541154c0 con 0x7f2354103450 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f235b447700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23541157c0 con 0x7f23541086d0 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f23589e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 0x7f235419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f23589e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 0x7f235419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48510/0 (socket says 172.21.15.135:48510) 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.035+0000 7f23589e2700 1 -- 172.21.15.135:0/2547246509 learned_addr learned my addr 172.21.15.135:0/2547246509 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23599e4700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23541086d0 0x7f23541a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:41.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23591e3700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2354103450 0x7f235419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 -- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23541086d0 msgr2=0x7f23541a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23541086d0 0x7f23541a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 -- 172.21.15.135:0/2547246509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2354103450 msgr2=0x7f235419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2354103450 0x7f235419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23541a0d80 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23589e2700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 0x7f235419c450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f234800d980 tx=0x7f234800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348017070 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23541a1070 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2348009b40 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234800f620 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.036+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23541a8990 con 0x7f2354107d80 2024-05-20T17:31:41.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.037+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2354062dd0 con 0x7f2354107d80 2024-05-20T17:31:41.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.038+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2348009cf0 con 0x7f2354107d80 2024-05-20T17:31:41.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23467fc700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f23400a2cb0 0x7f23400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:41.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23591e3700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f23400a2cb0 0x7f23400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f23480cef00 con 0x7f2354107d80 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23467fc700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] conn(0x7f23400ac4e0 0x7f23400ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2348020e70 con 0x7f23400ac4e0 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.039+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f23480cf3e0 con 0x7f2354107d80 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.040+0000 7f23591e3700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f23400a2cb0 0x7f23400a51c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2350005950 tx=0x7f23500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.040+0000 7f23599e4700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] conn(0x7f23400ac4e0 0x7f23400ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.040+0000 7f23599e4700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] conn(0x7f23400ac4e0 0x7f23400ae930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:41.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.041+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== osd.2 v2:172.21.15.172:6800/1279158957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2348020e70 con 0x7f23400ac4e0 2024-05-20T17:31:41.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.057+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 --> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2354063250 con 0x7f23400ac4e0 2024-05-20T17:31:41.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f23467fc700 1 -- 172.21.15.135:0/2547246509 <== osd.2 v2:172.21.15.172:6800/1279158957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2354063250 con 0x7f23400ac4e0 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] conn(0x7f23400ac4e0 msgr2=0x7f23400ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] conn(0x7f23400ac4e0 0x7f23400ae930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f23400a2cb0 msgr2=0x7f23400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f23400a2cb0 0x7f23400a51c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2350005950 tx=0x7f23500058e0 comp rx=0 tx=0).stop 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 msgr2=0x7f235419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 --2- 172.21.15.135:0/2547246509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2354107d80 0x7f235419c450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f234800d980 tx=0x7f234800dd40 comp rx=0 tx=0).stop 2024-05-20T17:31:41.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f23599e4700 1 -- 172.21.15.135:0/2547246509 reap_dead start 2024-05-20T17:31:41.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 shutdown_connections 2024-05-20T17:31:41.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 >> 172.21.15.135:0/2547246509 conn(0x7f23540fed20 msgr2=0x7f2354107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:41.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 shutdown_connections 2024-05-20T17:31:41.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:41.058+0000 7f235b447700 1 -- 172.21.15.135:0/2547246509 wait complete. 2024-05-20T17:31:41.070 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:40 smithi135 ceph-mon[32027]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:31:41.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:40 smithi172 ceph-mon[36511]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:31:41.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:40 smithi160 ceph-mon[36261]: pgmap v302: 97 pgs: 97 active+clean; 636 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:31:41.938 INFO:teuthology.orchestra.run.smithi135.stdout:77309411393 2024-05-20T17:31:41.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-20T17:31:43.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:42 smithi172 ceph-mon[36511]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-20T17:31:43.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:42 smithi135 ceph-mon[32027]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-20T17:31:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:42 smithi160 ceph-mon[36261]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 -- 172.21.15.135:0/1008390823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 msgr2=0x7fb1f8108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 --2- 172.21.15.135:0/1008390823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f8108190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40099c0 tx=0x7fb1e4009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 -- 172.21.15.135:0/1008390823 shutdown_connections 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 --2- 172.21.15.135:0/1008390823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f81086d0 0x7fb1f8110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 --2- 172.21.15.135:0/1008390823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f8103450 0x7fb1f8103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 --2- 172.21.15.135:0/1008390823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f8108190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 -- 172.21.15.135:0/1008390823 >> 172.21.15.135:0/1008390823 conn(0x7fb1f80fed20 msgr2=0x7fb1f8101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 -- 172.21.15.135:0/1008390823 shutdown_connections 2024-05-20T17:31:44.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.630+0000 7fb1febc3700 1 -- 172.21.15.135:0/1008390823 wait complete. 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 Processor -- start 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 -- start start 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f8103450 0x7fb1f8199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f81086d0 0x7fb1f819e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8113430 con 0x7fb1f8107d80 2024-05-20T17:31:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f81132b0 con 0x7fb1f81086d0 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1febc3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f81135b0 con 0x7fb1f8103450 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48524/0 (socket says 172.21.15.135:48524) 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.631+0000 7fb1f7fff700 1 -- 172.21.15.135:0/2433002796 learned_addr learned my addr 172.21.15.135:0/2433002796 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1fd160700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f81086d0 0x7fb1f819e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1fc95f700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f8103450 0x7fb1f8199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 -- 172.21.15.135:0/2433002796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f8103450 msgr2=0x7fb1f8199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f8103450 0x7fb1f8199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 -- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f81086d0 msgr2=0x7fb1f819e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f81086d0 0x7fb1f819e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f819ec70 con 0x7fb1f8107d80 2024-05-20T17:31:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f7fff700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f819a340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400fa00 tx=0x7fb1e400fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4027070 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f819ef00 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e4003680 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.632+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40173f0 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.633+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f81a6880 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.633+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1f8062d90 con 0x7fb1f8107d80 2024-05-20T17:31:44.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.635+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb1e402a070 con 0x7fb1f8107d80 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1f5ffb700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1e80a2d30 0x7fb1e80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1fc95f700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1e80a2d30 0x7fb1e80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb1e40d0650 con 0x7fb1f8107d80 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1f5ffb700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] conn(0x7fb1e80ac560 0x7fb1e80ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1e80af080 con 0x7fb1e80ac560 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.636+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fb1e40d0b30 con 0x7fb1f8107d80 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.637+0000 7fb1fc95f700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1e80a2d30 0x7fb1e80a5240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009bf0 tx=0x7fb1ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:44.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.637+0000 7fb1fd160700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] conn(0x7fb1e80ac560 0x7fb1e80ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:44.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.637+0000 7fb1fd160700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] conn(0x7fb1e80ac560 0x7fb1e80ae9b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:44.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.638+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== osd.10 v2:172.21.15.160:6824/1618218869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1e80af080 con 0x7fb1e80ac560 2024-05-20T17:31:44.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.654+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 --> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1f8062fd0 con 0x7fb1e80ac560 2024-05-20T17:31:44.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1f5ffb700 1 -- 172.21.15.135:0/2433002796 <== osd.10 v2:172.21.15.160:6824/1618218869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb1f8062fd0 con 0x7fb1e80ac560 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] conn(0x7fb1e80ac560 msgr2=0x7fb1e80ae9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] conn(0x7fb1e80ac560 0x7fb1e80ae9b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1e80a2d30 msgr2=0x7fb1e80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1e80a2d30 0x7fb1e80a5240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009bf0 tx=0x7fb1ec009260 comp rx=0 tx=0).stop 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 msgr2=0x7fb1f819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 --2- 172.21.15.135:0/2433002796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1f8107d80 0x7fb1f819a340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400fa00 tx=0x7fb1e400fa30 comp rx=0 tx=0).stop 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1fd160700 1 -- 172.21.15.135:0/2433002796 reap_dead start 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 shutdown_connections 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 >> 172.21.15.135:0/2433002796 conn(0x7fb1f80fed20 msgr2=0x7fb1f8107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 shutdown_connections 2024-05-20T17:31:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:44.655+0000 7fb1febc3700 1 -- 172.21.15.135:0/2433002796 wait complete. 2024-05-20T17:31:45.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:44 smithi172 ceph-mon[36511]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:45.180 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:44 smithi135 ceph-mon[32027]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:44 smithi160 ceph-mon[36261]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:46.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:46 smithi135 ceph-mon[32027]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-20T17:31:47.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:46 smithi172 ceph-mon[36511]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-20T17:31:47.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:46 smithi160 ceph-mon[36261]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-20T17:31:47.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 -- 172.21.15.135:0/2161285295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7441075c0 msgr2=0x7fc74410ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 --2- 172.21.15.135:0/2161285295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7441075c0 0x7fc74410ef20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00b0d0 tx=0x7fc73c00b3e0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 -- 172.21.15.135:0/2161285295 shutdown_connections 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 --2- 172.21.15.135:0/2161285295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7441075c0 0x7fc74410ef20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 --2- 172.21.15.135:0/2161285295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc744102340 0x7fc744102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 --2- 172.21.15.135:0/2161285295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc744106c70 0x7fc744107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 -- 172.21.15.135:0/2161285295 >> 172.21.15.135:0/2161285295 conn(0x7fc7440fdc40 msgr2=0x7fc744100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 -- 172.21.15.135:0/2161285295 shutdown_connections 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.461+0000 7fc748b21700 1 -- 172.21.15.135:0/2161285295 wait complete. 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 Processor -- start 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 -- start start 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc744102340 0x7fc744199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 0x7fc74419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7441075c0 0x7fc74419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7441134b0 con 0x7fc744106c70 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc744113330 con 0x7fc744102340 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.462+0000 7fc748b21700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc744113630 con 0x7fc7441075c0 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 0x7fc74419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 0x7fc74419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48536/0 (socket says 172.21.15.135:48536) 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 -- 172.21.15.135:0/2745329104 learned_addr learned my addr 172.21.15.135:0/2745329104 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc74259c700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc744102340 0x7fc744199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc742d9d700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7441075c0 0x7fc74419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 -- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7441075c0 msgr2=0x7fc74419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7441075c0 0x7fc74419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 -- 172.21.15.135:0/2745329104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc744102340 msgr2=0x7fc744199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc744102340 0x7fc744199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74419ec10 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73bfff700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 0x7fc74419a2e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d980 tx=0x7fc72c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c017070 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc72c00fd70 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74419ef00 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00e3b0 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.463+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7441a6820 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.464+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc744062dd0 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.466+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc72c00f890 con 0x7fc744106c70 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.466+0000 7fc73b7fe700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7300a2cb0 0x7fc7300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.466+0000 7fc74259c700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7300a2cb0 0x7fc7300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:47.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.466+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc72c0cefd0 con 0x7fc744106c70 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc73b7fe700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] conn(0x7fc7300ac4e0 0x7fc7300ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc72c026e50 con 0x7fc7300ac4e0 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc72c0cf4b0 con 0x7fc744106c70 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc74259c700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7300a2cb0 0x7fc7300a51c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc734009a10 tx=0x7fc734009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc742d9d700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] conn(0x7fc7300ac4e0 0x7fc7300ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.467+0000 7fc742d9d700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] conn(0x7fc7300ac4e0 0x7fc7300ae930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:47.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.468+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== osd.5 v2:172.21.15.172:6808/1955442624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc72c026e50 con 0x7fc7300ac4e0 2024-05-20T17:31:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.485+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 --> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7440631d0 con 0x7fc7300ac4e0 2024-05-20T17:31:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.485+0000 7fc73b7fe700 1 -- 172.21.15.135:0/2745329104 <== osd.5 v2:172.21.15.172:6808/1955442624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc7440631d0 con 0x7fc7300ac4e0 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] conn(0x7fc7300ac4e0 msgr2=0x7fc7300ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] conn(0x7fc7300ac4e0 0x7fc7300ae930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7300a2cb0 msgr2=0x7fc7300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc7300a2cb0 0x7fc7300a51c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc734009a10 tx=0x7fc734009190 comp rx=0 tx=0).stop 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 msgr2=0x7fc74419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 --2- 172.21.15.135:0/2745329104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc744106c70 0x7fc74419a2e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d980 tx=0x7fc72c00dc90 comp rx=0 tx=0).stop 2024-05-20T17:31:47.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc742d9d700 1 -- 172.21.15.135:0/2745329104 reap_dead start 2024-05-20T17:31:47.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 shutdown_connections 2024-05-20T17:31:47.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 >> 172.21.15.135:0/2745329104 conn(0x7fc7440fdc40 msgr2=0x7fc744106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:47.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 shutdown_connections 2024-05-20T17:31:47.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:47.486+0000 7fc748b21700 1 -- 172.21.15.135:0/2745329104 wait complete. 2024-05-20T17:31:48.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:48 smithi135 ceph-mon[32027]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:49.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:48 smithi172 ceph-mon[36511]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:49.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:48 smithi160 ceph-mon[36261]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:49.992 INFO:teuthology.orchestra.run.smithi135.stdout:309237645336 2024-05-20T17:31:49.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-20T17:31:51.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:50 smithi172 ceph-mon[36511]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:51.101 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:50 smithi135 ceph-mon[32027]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:51.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:50 smithi160 ceph-mon[36261]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-20T17:31:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:163208757298 2024-05-20T17:31:52.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-20T17:31:53.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:52 smithi172 ceph-mon[36511]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:31:53.123 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:52 smithi135 ceph-mon[32027]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:31:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:52 smithi160 ceph-mon[36261]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:31:53.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 -- 172.21.15.135:0/2177484802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97481075c0 msgr2=0x7f974810ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2177484802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97481075c0 0x7f974810ef20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f974000b0d0 tx=0x7f974000b3e0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 -- 172.21.15.135:0/2177484802 shutdown_connections 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2177484802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9748102340 0x7f9748102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2177484802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97481075c0 0x7f974810ef20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2177484802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9748106c70 0x7f9748107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 -- 172.21.15.135:0/2177484802 >> 172.21.15.135:0/2177484802 conn(0x7f97480fdc40 msgr2=0x7f9748100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 -- 172.21.15.135:0/2177484802 shutdown_connections 2024-05-20T17:31:53.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.744+0000 7f974d5bc700 1 -- 172.21.15.135:0/2177484802 wait complete. 2024-05-20T17:31:53.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 Processor -- start 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 -- start start 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9748102340 0x7f974819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 0x7f974819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97481075c0 0x7f9748198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9748112340 con 0x7f9748106c70 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97481121c0 con 0x7f9748102340 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.745+0000 7f974d5bc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97481124c0 con 0x7f97481075c0 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 0x7f974819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 0x7f974819ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57924/0 (socket says 172.21.15.135:57924) 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 -- 172.21.15.135:0/2500404737 learned_addr learned my addr 172.21.15.135:0/2500404737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:53.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f9746ffd700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9748102340 0x7f974819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97477fe700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97481075c0 0x7f9748198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 -- 172.21.15.135:0/2500404737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97481075c0 msgr2=0x7f9748198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97481075c0 0x7f9748198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 -- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9748102340 msgr2=0x7f974819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9748102340 0x7f974819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748199100 con 0x7f9748106c70 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f97467fc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 0x7f974819ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f973c007b50 tx=0x7f973c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c00e500 con 0x7f9748106c70 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97481993f0 con 0x7f9748106c70 2024-05-20T17:31:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f973c00eb80 con 0x7f9748106c70 2024-05-20T17:31:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c00abf0 con 0x7f9748106c70 2024-05-20T17:31:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.746+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974806a490 con 0x7f9748106c70 2024-05-20T17:31:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.747+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f974806a9c0 con 0x7f9748106c70 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.749+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f973c00e6a0 con 0x7f9748106c70 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.749+0000 7f972ffff700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97300a2cb0 0x7f97300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.749+0000 7f9746ffd700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97300a2cb0 0x7f97300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f973c0d0f60 con 0x7f9748106c70 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f972ffff700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] conn(0x7f97300ac4e0 0x7f97300ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f973c023e80 con 0x7f97300ac4e0 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f973c0d1440 con 0x7f9748106c70 2024-05-20T17:31:53.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f9746ffd700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97300a2cb0 0x7f97300a51c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9748199c00 tx=0x7f973800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.750+0000 7f97477fe700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] conn(0x7f97300ac4e0 0x7f97300ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.751+0000 7f97477fe700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] conn(0x7f97300ac4e0 0x7f97300ae930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.751+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== osd.1 v2:172.21.15.160:6800/2448318206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f973c023e80 con 0x7f97300ac4e0 2024-05-20T17:31:53.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.767+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 --> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f974806adc0 con 0x7f97300ac4e0 2024-05-20T17:31:53.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f972ffff700 1 -- 172.21.15.135:0/2500404737 <== osd.1 v2:172.21.15.160:6800/2448318206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f974806adc0 con 0x7f97300ac4e0 2024-05-20T17:31:53.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] conn(0x7f97300ac4e0 msgr2=0x7f97300ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] conn(0x7f97300ac4e0 0x7f97300ae930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97300a2cb0 msgr2=0x7f97300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f97300a2cb0 0x7f97300a51c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9748199c00 tx=0x7f973800b410 comp rx=0 tx=0).stop 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 msgr2=0x7f974819ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f974d5bc700 1 --2- 172.21.15.135:0/2500404737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9748106c70 0x7f974819ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f973c007b50 tx=0x7f973c007e60 comp rx=0 tx=0).stop 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.768+0000 7f97477fe700 1 -- 172.21.15.135:0/2500404737 reap_dead start 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.769+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 shutdown_connections 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.769+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 >> 172.21.15.135:0/2500404737 conn(0x7f97480fdc40 msgr2=0x7f97481063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.769+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 shutdown_connections 2024-05-20T17:31:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.769+0000 7f974d5bc700 1 -- 172.21.15.135:0/2500404737 wait complete. 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 -- 172.21.15.135:0/1002260547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f01075c0 msgr2=0x7ff6f010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 --2- 172.21.15.135:0/1002260547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f01075c0 0x7ff6f010ef20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800b0d0 tx=0x7ff6e800b3e0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 -- 172.21.15.135:0/1002260547 shutdown_connections 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 --2- 172.21.15.135:0/1002260547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f01075c0 0x7ff6f010ef20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 --2- 172.21.15.135:0/1002260547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6f0102340 0x7ff6f0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 --2- 172.21.15.135:0/1002260547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f0106c70 0x7ff6f0107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 -- 172.21.15.135:0/1002260547 >> 172.21.15.135:0/1002260547 conn(0x7ff6f00fdc40 msgr2=0x7ff6f0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 -- 172.21.15.135:0/1002260547 shutdown_connections 2024-05-20T17:31:54.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.485+0000 7ff6f8041700 1 -- 172.21.15.135:0/1002260547 wait complete. 2024-05-20T17:31:54.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 Processor -- start 2024-05-20T17:31:54.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 -- start start 2024-05-20T17:31:54.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f0102340 0x7ff6f019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:54.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 0x7ff6f019fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:54.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6f01075c0 0x7ff6f0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0112340 con 0x7ff6f0106c70 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f01121c0 con 0x7ff6f0102340 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f8041700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f01124c0 con 0x7ff6f01075c0 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f55dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 0x7ff6f019fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f55dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 0x7ff6f019fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57940/0 (socket says 172.21.15.135:57940) 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.486+0000 7ff6f55dc700 1 -- 172.21.15.135:0/4259001299 learned_addr learned my addr 172.21.15.135:0/4259001299 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f5ddd700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f0102340 0x7ff6f019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f65de700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6f01075c0 0x7ff6f0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 -- 172.21.15.135:0/4259001299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6f01075c0 msgr2=0x7ff6f0199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6f01075c0 0x7ff6f0199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 -- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f0102340 msgr2=0x7ff6f019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f0102340 0x7ff6f019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f019a1d0 con 0x7ff6f0106c70 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f55dc700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 0x7ff6f019fee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c9e0 tx=0x7ff6e000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0007aa0 con 0x7ff6f0106c70 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e0007c40 con 0x7ff6f0106c70 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f019a4c0 con 0x7ff6f0106c70 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.487+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0018660 con 0x7ff6f0106c70 2024-05-20T17:31:54.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.488+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f00fe050 con 0x7ff6f0106c70 2024-05-20T17:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.488+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6f0062dd0 con 0x7ff6f0106c70 2024-05-20T17:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.490+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff6e000f450 con 0x7ff6f0106c70 2024-05-20T17:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.490+0000 7ff6e6ffd700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff6dc0a2d30 0x7ff6dc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6f5ddd700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff6dc0a2d30 0x7ff6dc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ff6e00cf470 con 0x7ff6f0106c70 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6e6ffd700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] conn(0x7ff6dc0ac560 0x7ff6dc0ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc0af080 con 0x7ff6dc0ac560 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7ff6e00cf950 con 0x7ff6f0106c70 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6f5ddd700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff6dc0a2d30 0x7ff6dc0a5240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005950 tx=0x7ff6ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6f65de700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] conn(0x7ff6dc0ac560 0x7ff6dc0ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.491+0000 7ff6f65de700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] conn(0x7ff6dc0ac560 0x7ff6dc0ae9b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.492+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== osd.7 v2:172.21.15.160:6816/350268889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc0af080 con 0x7ff6dc0ac560 2024-05-20T17:31:54.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.508+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 --> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6f00631d0 con 0x7ff6dc0ac560 2024-05-20T17:31:54.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6e6ffd700 1 -- 172.21.15.135:0/4259001299 <== osd.7 v2:172.21.15.160:6816/350268889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6f00631d0 con 0x7ff6dc0ac560 2024-05-20T17:31:54.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] conn(0x7ff6dc0ac560 msgr2=0x7ff6dc0ae9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] conn(0x7ff6dc0ac560 0x7ff6dc0ae9b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff6dc0a2d30 msgr2=0x7ff6dc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff6dc0a2d30 0x7ff6dc0a5240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005950 tx=0x7ff6ec00b410 comp rx=0 tx=0).stop 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 msgr2=0x7ff6f019fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 --2- 172.21.15.135:0/4259001299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f0106c70 0x7ff6f019fee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c9e0 tx=0x7ff6e000ccf0 comp rx=0 tx=0).stop 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f65de700 1 -- 172.21.15.135:0/4259001299 reap_dead start 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 shutdown_connections 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.509+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 >> 172.21.15.135:0/4259001299 conn(0x7ff6f00fdc40 msgr2=0x7ff6f006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.510+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 shutdown_connections 2024-05-20T17:31:54.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.510+0000 7ff6f8041700 1 -- 172.21.15.135:0/4259001299 wait complete. 2024-05-20T17:31:55.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:54 smithi172 ceph-mon[36511]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:31:55.110 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:54 smithi135 ceph-mon[32027]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:31:55.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 -- 172.21.15.135:0/3871790749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 msgr2=0x7f3554102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 --2- 172.21.15.135:0/3871790749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f3554102750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f35440099c0 tx=0x7f3544009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 -- 172.21.15.135:0/3871790749 shutdown_connections 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 --2- 172.21.15.135:0/3871790749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35541075c0 0x7f355410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 --2- 172.21.15.135:0/3871790749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f3554102750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 --2- 172.21.15.135:0/3871790749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3554106c70 0x7f3554107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 -- 172.21.15.135:0/3871790749 >> 172.21.15.135:0/3871790749 conn(0x7f35540fdc70 msgr2=0x7f3554100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 -- 172.21.15.135:0/3871790749 shutdown_connections 2024-05-20T17:31:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.221+0000 7f355a74f700 1 -- 172.21.15.135:0/3871790749 wait complete. 2024-05-20T17:31:55.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 Processor -- start 2024-05-20T17:31:55.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 -- start start 2024-05-20T17:31:55.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f355419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:55.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3554106c70 0x7f355419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35541075c0 0x7f3554198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3554112340 con 0x7f3554102340 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f35541121c0 con 0x7f3554106c70 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f355a74f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35541124c0 con 0x7f35541075c0 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f3553fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f355419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f3553fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f355419e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57978/0 (socket says 172.21.15.135:57978) 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f3553fff700 1 -- 172.21.15.135:0/2368842094 learned_addr learned my addr 172.21.15.135:0/2368842094 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.222+0000 7f35537fe700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3554106c70 0x7f355419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:55.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3558cec700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35541075c0 0x7f3554198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:55.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 -- 172.21.15.135:0/2368842094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35541075c0 msgr2=0x7f3554198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35541075c0 0x7f3554198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 -- 172.21.15.135:0/2368842094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3554106c70 msgr2=0x7f355419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3554106c70 0x7f355419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3554199170 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f35537fe700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3554106c70 0x7f355419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f3553fff700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f355419e8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3544006010 tx=0x7f3544009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544027070 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3554199400 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3544004050 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544022e10 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.223+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35541998e0 con 0x7f3554102340 2024-05-20T17:31:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.224+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3554062dd0 con 0x7f3554102340 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.225+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f354402a070 con 0x7f3554102340 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35517fa700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f353c0a2cb0 0x7f353c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35537fe700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f353c0a2cb0 0x7f353c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f35440d0b00 con 0x7f3554102340 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35517fa700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] conn(0x7f353c0ac4e0 0x7f353c0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35440043d0 con 0x7f353c0ac4e0 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f35440d0fe0 con 0x7f3554102340 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f3558cec700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] conn(0x7f353c0ac4e0 0x7f353c0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.226+0000 7f35537fe700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f353c0a2cb0 0x7f353c0a51c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3548005950 tx=0x7f35480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.227+0000 7f3558cec700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] conn(0x7f353c0ac4e0 0x7f353c0ae930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:55.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.227+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== osd.0 v2:172.21.15.135:6802/2987635953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35440043d0 con 0x7f353c0ac4e0 2024-05-20T17:31:55.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.243+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 --> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3554063250 con 0x7f353c0ac4e0 2024-05-20T17:31:55.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.243+0000 7f35517fa700 1 -- 172.21.15.135:0/2368842094 <== osd.0 v2:172.21.15.135:6802/2987635953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3554063250 con 0x7f353c0ac4e0 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] conn(0x7f353c0ac4e0 msgr2=0x7f353c0ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] conn(0x7f353c0ac4e0 0x7f353c0ae930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f353c0a2cb0 msgr2=0x7f353c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f353c0a2cb0 0x7f353c0a51c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3548005950 tx=0x7f35480058e0 comp rx=0 tx=0).stop 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 msgr2=0x7f355419e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 --2- 172.21.15.135:0/2368842094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3554102340 0x7f355419e8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3544006010 tx=0x7f3544009f80 comp rx=0 tx=0).stop 2024-05-20T17:31:55.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f3558cec700 1 -- 172.21.15.135:0/2368842094 reap_dead start 2024-05-20T17:31:55.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 shutdown_connections 2024-05-20T17:31:55.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 >> 172.21.15.135:0/2368842094 conn(0x7f35540fdc70 msgr2=0x7f3554108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:55.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 shutdown_connections 2024-05-20T17:31:55.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:55.244+0000 7f355a74f700 1 -- 172.21.15.135:0/2368842094 wait complete. 2024-05-20T17:31:55.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:54 smithi160 ceph-mon[36261]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:31:56.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 -- 172.21.15.135:0/2750464781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 msgr2=0x7ff914102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 --2- 172.21.15.135:0/2750464781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914102750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff9100099c0 tx=0x7ff910009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 -- 172.21.15.135:0/2750464781 shutdown_connections 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 --2- 172.21.15.135:0/2750464781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9141075c0 0x7ff91410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 --2- 172.21.15.135:0/2750464781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914102750 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 --2- 172.21.15.135:0/2750464781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff914106c70 0x7ff914107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 -- 172.21.15.135:0/2750464781 >> 172.21.15.135:0/2750464781 conn(0x7ff9140fdc40 msgr2=0x7ff914100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 -- 172.21.15.135:0/2750464781 shutdown_connections 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 -- 172.21.15.135:0/2750464781 wait complete. 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.685+0000 7ff91bf88700 1 Processor -- start 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 -- start start 2024-05-20T17:31:56.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff914106c70 0x7ff91419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9141075c0 0x7ff91419e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141123c0 con 0x7ff914102340 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff914112240 con 0x7ff9141075c0 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91bf88700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff914112540 con 0x7ff914106c70 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57964/0 (socket says 172.21.15.135:57964) 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 -- 172.21.15.135:0/1104012114 learned_addr learned my addr 172.21.15.135:0/1104012114 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919523700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff914106c70 0x7ff91419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:56.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91a525700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9141075c0 0x7ff91419e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 -- 172.21.15.135:0/1104012114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff914106c70 msgr2=0x7ff91419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff914106c70 0x7ff91419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 -- 172.21.15.135:0/1104012114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9141075c0 msgr2=0x7ff91419e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9141075c0 0x7ff91419e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91419ebc0 con 0x7ff914102340 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff91a525700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9141075c0 0x7ff91419e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.686+0000 7ff919d24700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914199da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff910009fd0 tx=0x7ff910003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:56.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.687+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910027070 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.687+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9100040d0 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.687+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91419ee50 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.687+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91000f460 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.687+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91419f300 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.688+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff914062d50 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.689+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff91002a070 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff90affd700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9000a2cb0 0x7ff9000a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff919523700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9000a2cb0 0x7ff9000a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ff9100d09e0 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff90affd700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] conn(0x7ff9000ac4e0 0x7ff9000ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9100056b0 con 0x7ff9000ac4e0 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7ff9100d0ec0 con 0x7ff914102340 2024-05-20T17:31:56.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff91a525700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] conn(0x7ff9000ac4e0 0x7ff9000ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff919523700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9000a2cb0 0x7ff9000a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff914108780 tx=0x7ff90400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.690+0000 7ff91a525700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] conn(0x7ff9000ac4e0 0x7ff9000ae930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.691+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== osd.9 v2:172.21.15.135:6826/1712068572 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9100056b0 con 0x7ff9000ac4e0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.707+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 --> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff914063150 con 0x7ff9000ac4e0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.707+0000 7ff90affd700 1 -- 172.21.15.135:0/1104012114 <== osd.9 v2:172.21.15.135:6826/1712068572 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff914063150 con 0x7ff9000ac4e0 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.707+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] conn(0x7ff9000ac4e0 msgr2=0x7ff9000ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.707+0000 7ff91bf88700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] conn(0x7ff9000ac4e0 0x7ff9000ae930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9000a2cb0 msgr2=0x7ff9000a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9000a2cb0 0x7ff9000a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff914108780 tx=0x7ff90400a380 comp rx=0 tx=0).stop 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 msgr2=0x7ff914199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 --2- 172.21.15.135:0/1104012114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff914102340 0x7ff914199da0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff910009fd0 tx=0x7ff910003680 comp rx=0 tx=0).stop 2024-05-20T17:31:56.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91a525700 1 -- 172.21.15.135:0/1104012114 reap_dead start 2024-05-20T17:31:56.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 shutdown_connections 2024-05-20T17:31:56.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 >> 172.21.15.135:0/1104012114 conn(0x7ff9140fdc40 msgr2=0x7ff91406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:56.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 shutdown_connections 2024-05-20T17:31:56.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:54.708+0000 7ff91bf88700 1 -- 172.21.15.135:0/1104012114 wait complete. 2024-05-20T17:31:56.916 INFO:teuthology.orchestra.run.smithi135.stdout:34359738445 2024-05-20T17:31:56.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-20T17:31:57.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- 172.21.15.135:0/3844908190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 msgr2=0x7f3d78101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 --2- 172.21.15.135:0/3844908190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d78101c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009990 tx=0x7f3d60009ca0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- 172.21.15.135:0/3844908190 shutdown_connections 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 --2- 172.21.15.135:0/3844908190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d78107870 0x7f3d78107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 --2- 172.21.15.135:0/3844908190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d78102190 0x7f3d7810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 --2- 172.21.15.135:0/3844908190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d78101c50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- 172.21.15.135:0/3844908190 >> 172.21.15.135:0/3844908190 conn(0x7f3d780fd570 msgr2=0x7f3d780ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- 172.21.15.135:0/3844908190 shutdown_connections 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- 172.21.15.135:0/3844908190 wait complete. 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 Processor -- start 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.276+0000 7f3d7e043700 1 -- start start 2024-05-20T17:31:57.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d780fda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d78102190 0x7f3d780fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d78107870 0x7f3d780fe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781123c0 con 0x7f3d78101840 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112240 con 0x7f3d78107870 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d7e043700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112540 con 0x7f3d78102190 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d780fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d780fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57904/0 (socket says 172.21.15.135:57904) 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 -- 172.21.15.135:0/1439736300 learned_addr learned my addr 172.21.15.135:0/1439736300 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:57.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d77fff700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d78107870 0x7f3d780fe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d6effd700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d78102190 0x7f3d780fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 -- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d78102190 msgr2=0x7f3d780fdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d78102190 0x7f3d780fdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 -- 172.21.15.135:0/1439736300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d78107870 msgr2=0x7f3d780fe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d78107870 0x7f3d780fe4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a81b0 con 0x7f3d78101840 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.277+0000 7f3d777fe700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d780fda50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c9e0 tx=0x7f3d6800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007aa0 con 0x7f3d78101840 2024-05-20T17:31:57.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d68007c40 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a84a0 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68018660 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a89b0 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.278+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d78062d50 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.280+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3d6800f450 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d757fa700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3d640a2cb0 0x7f3d640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d6effd700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3d640a2cb0 0x7f3d640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f3d680cf3f0 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d757fa700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] conn(0x7f3d640ac4e0 0x7f3d640ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d640af000 con 0x7f3d640ac4e0 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3d680cf8d0 con 0x7f3d78101840 2024-05-20T17:31:57.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d6effd700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3d640a2cb0 0x7f3d640a51c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006010 tx=0x7f3d6001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.281+0000 7f3d77fff700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] conn(0x7f3d640ac4e0 0x7f3d640ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.282+0000 7f3d77fff700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] conn(0x7f3d640ac4e0 0x7f3d640ae930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.282+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== osd.8 v2:172.21.15.172:6816/695820543 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d640af000 con 0x7f3d640ac4e0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 --> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d78063150 con 0x7f3d640ac4e0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d757fa700 1 -- 172.21.15.135:0/1439736300 <== osd.8 v2:172.21.15.172:6816/695820543 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3d78063150 con 0x7f3d640ac4e0 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] conn(0x7f3d640ac4e0 msgr2=0x7f3d640ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] conn(0x7f3d640ac4e0 0x7f3d640ae930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3d640a2cb0 msgr2=0x7f3d640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3d640a2cb0 0x7f3d640a51c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006010 tx=0x7f3d6001a040 comp rx=0 tx=0).stop 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 msgr2=0x7f3d780fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d7e043700 1 --2- 172.21.15.135:0/1439736300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78101840 0x7f3d780fda50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c9e0 tx=0x7f3d6800ccf0 comp rx=0 tx=0).stop 2024-05-20T17:31:57.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.299+0000 7f3d77fff700 1 -- 172.21.15.135:0/1439736300 reap_dead start 2024-05-20T17:31:57.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.300+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 shutdown_connections 2024-05-20T17:31:57.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.300+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 >> 172.21.15.135:0/1439736300 conn(0x7f3d780fd570 msgr2=0x7f3d78110ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:57.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.300+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 shutdown_connections 2024-05-20T17:31:57.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:53.300+0000 7f3d7e043700 1 -- 172.21.15.135:0/1439736300 wait complete. 2024-05-20T17:31:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:56 smithi172 ceph-mon[36511]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-05-20T17:31:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:56 smithi135 ceph-mon[32027]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-05-20T17:31:57.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:56 smithi160 ceph-mon[36261]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-05-20T17:31:57.809 INFO:teuthology.orchestra.run.smithi135.stdout:253403070501 2024-05-20T17:31:57.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-20T17:31:58.362 INFO:teuthology.orchestra.run.smithi135.stdout:55834574920 2024-05-20T17:31:58.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-20T17:31:58.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.578+0000 7fb5f1ffb700 1 -- 172.21.15.135:0/653798997 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003c20 con 0x7fb5f4102aa0 2024-05-20T17:31:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 -- 172.21.15.135:0/653798997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f4102aa0 msgr2=0x7fb5f4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 --2- 172.21.15.135:0/653798997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f4102aa0 0x7fb5f4102eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40099c0 tx=0x7fb5e4009cd0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 -- 172.21.15.135:0/653798997 shutdown_connections 2024-05-20T17:31:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 --2- 172.21.15.135:0/653798997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f41075f0 0x7fb5f410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 --2- 172.21.15.135:0/653798997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f4102aa0 0x7fb5f4102eb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 --2- 172.21.15.135:0/653798997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f4106ca0 0x7fb5f41070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 -- 172.21.15.135:0/653798997 >> 172.21.15.135:0/653798997 conn(0x7fb5f40fd570 msgr2=0x7fb5f40ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:58.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 -- 172.21.15.135:0/653798997 shutdown_connections 2024-05-20T17:31:58.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.579+0000 7fb5f955f700 1 -- 172.21.15.135:0/653798997 wait complete. 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 Processor -- start 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 -- start start 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102aa0 0x7fb5f419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f4106ca0 0x7fb5f419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f41075f0 0x7fb5f419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4112390 con 0x7fb5f41075f0 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4112210 con 0x7fb5f4106ca0 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f955f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4112510 con 0x7fb5f4102aa0 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.580+0000 7fb5f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f41075f0 0x7fb5f419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f41075f0 0x7fb5f419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58008/0 (socket says 172.21.15.135:58008) 2024-05-20T17:31:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f37fe700 1 -- 172.21.15.135:0/2722502286 learned_addr learned my addr 172.21.15.135:0/2722502286 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102aa0 0x7fb5f419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f27fc700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f4106ca0 0x7fb5f419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 -- 172.21.15.135:0/2722502286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f4106ca0 msgr2=0x7fb5f419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f4106ca0 0x7fb5f419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 -- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f41075f0 msgr2=0x7fb5f419b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f41075f0 0x7fb5f419b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f41a5f60 con 0x7fb5f4102aa0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f2ffd700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102aa0 0x7fb5f419abf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40098e0 tx=0x7fb5e400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4027070 con 0x7fb5f4102aa0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f41a61f0 con 0x7fb5f4102aa0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f41a66a0 con 0x7fb5f4102aa0 2024-05-20T17:31:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e4003680 con 0x7fb5f4102aa0 2024-05-20T17:31:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.581+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40173f0 con 0x7fb5f4102aa0 2024-05-20T17:31:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.582+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5e0001030 con 0x7fb5f4102aa0 2024-05-20T17:31:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.584+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb5e402a070 con 0x7fb5f4102aa0 2024-05-20T17:31:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5dbfff700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5dc0a2cb0 0x7fb5dc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb5e40d0140 con 0x7fb5f4102aa0 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5dbfff700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] conn(0x7fb5dc0ac4e0 0x7fb5dc0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5dc0af000 con 0x7fb5dc0ac4e0 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5f27fc700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5dc0a2cb0 0x7fb5dc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fb5e40d0620 con 0x7fb5f4102aa0 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.585+0000 7fb5f37fe700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] conn(0x7fb5dc0ac4e0 0x7fb5dc0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.586+0000 7fb5f27fc700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5dc0a2cb0 0x7fb5dc0a51c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4105570 tx=0x7fb5e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.586+0000 7fb5f37fe700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] conn(0x7fb5dc0ac4e0 0x7fb5dc0ae930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.587+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== osd.11 v2:172.21.15.172:6824/3648204338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5dc0af000 con 0x7fb5dc0ac4e0 2024-05-20T17:31:58.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.603+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 --> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5e0002e60 con 0x7fb5dc0ac4e0 2024-05-20T17:31:58.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5dbfff700 1 -- 172.21.15.135:0/2722502286 <== osd.11 v2:172.21.15.172:6824/3648204338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb5e0002e60 con 0x7fb5dc0ac4e0 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] conn(0x7fb5dc0ac4e0 msgr2=0x7fb5dc0ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] conn(0x7fb5dc0ac4e0 0x7fb5dc0ae930 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5dc0a2cb0 msgr2=0x7fb5dc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5dc0a2cb0 0x7fb5dc0a51c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4105570 tx=0x7fb5e8009260 comp rx=0 tx=0).stop 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102aa0 msgr2=0x7fb5f419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 --2- 172.21.15.135:0/2722502286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f4102aa0 0x7fb5f419abf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40098e0 tx=0x7fb5e400fa00 comp rx=0 tx=0).stop 2024-05-20T17:31:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f37fe700 1 -- 172.21.15.135:0/2722502286 reap_dead start 2024-05-20T17:31:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 shutdown_connections 2024-05-20T17:31:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 >> 172.21.15.135:0/2722502286 conn(0x7fb5f40fd570 msgr2=0x7fb5f4106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 shutdown_connections 2024-05-20T17:31:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.604+0000 7fb5f955f700 1 -- 172.21.15.135:0/2722502286 wait complete. 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 -- 172.21.15.135:0/259203436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c102190 msgr2=0x7f409c10e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/259203436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c102190 0x7f409c10e710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4094009e80 tx=0x7f409400c440 comp rx=0 tx=0).stop 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 -- 172.21.15.135:0/259203436 shutdown_connections 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/259203436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c102190 0x7f409c10e710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/259203436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409c107870 0x7f409c107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/259203436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c101840 0x7f409c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 -- 172.21.15.135:0/259203436 >> 172.21.15.135:0/259203436 conn(0x7f409c0fd570 msgr2=0x7f409c0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 -- 172.21.15.135:0/259203436 shutdown_connections 2024-05-20T17:31:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.778+0000 7f40a2ce6700 1 -- 172.21.15.135:0/259203436 wait complete. 2024-05-20T17:31:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 Processor -- start 2024-05-20T17:31:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 -- start start 2024-05-20T17:31:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409c101840 0x7f409c199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 0x7f409c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c107870 0x7f409c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f409c111330 con 0x7f409c102190 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1111b0 con 0x7f409c107870 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f40a2ce6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1114b0 con 0x7f409c101840 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.779+0000 7f409bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 0x7f409c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 0x7f409c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58032/0 (socket says 172.21.15.135:58032) 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 -- 172.21.15.135:0/2136344797 learned_addr learned my addr 172.21.15.135:0/2136344797 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f40a0a82700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409c101840 0x7f409c199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f40a1283700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c107870 0x7f409c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 -- 172.21.15.135:0/2136344797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409c101840 msgr2=0x7f409c199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409c101840 0x7f409c199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 -- 172.21.15.135:0/2136344797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c107870 msgr2=0x7f409c19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f409c107870 0x7f409c19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c19ede0 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f409bfff700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 0x7f409c19a4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f408800b500 tx=0x7f408800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088015020 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4088011d10 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088010de0 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c19f0d0 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.780+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c1a69f0 con 0x7f409c102190 2024-05-20T17:31:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.781+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f409c062d50 con 0x7f409c102190 2024-05-20T17:31:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4088018020 con 0x7f409c102190 2024-05-20T17:31:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f4099ffb700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f408c0a2d30 0x7f408c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f40a0a82700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f408c0a2d30 0x7f408c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f40880ce520 con 0x7f409c102190 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f4099ffb700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] conn(0x7f408c0ac560 0x7f408c0ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.783+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f408c0af080 con 0x7f408c0ac560 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.784+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f40880d5050 con 0x7f409c102190 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.784+0000 7f40a1283700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] conn(0x7f408c0ac560 0x7f408c0ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.784+0000 7f40a0a82700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f408c0a2d30 0x7f408c0a5240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4090009750 tx=0x7f4090009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.784+0000 7f40a1283700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] conn(0x7f408c0ac560 0x7f408c0ae9b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:31:58.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.785+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== osd.3 v2:172.21.15.135:6810/3128080158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f408c0af080 con 0x7f408c0ac560 2024-05-20T17:31:58.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.801+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 --> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f409c063180 con 0x7f408c0ac560 2024-05-20T17:31:58.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.801+0000 7f4099ffb700 1 -- 172.21.15.135:0/2136344797 <== osd.3 v2:172.21.15.135:6810/3128080158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f409c063180 con 0x7f408c0ac560 2024-05-20T17:31:58.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.801+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] conn(0x7f408c0ac560 msgr2=0x7f408c0ae9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.801+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] conn(0x7f408c0ac560 0x7f408c0ae9b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:31:58.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f408c0a2d30 msgr2=0x7f408c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f408c0a2d30 0x7f408c0a5240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4090009750 tx=0x7f4090009310 comp rx=0 tx=0).stop 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 msgr2=0x7f409c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 --2- 172.21.15.135:0/2136344797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409c102190 0x7f409c19a4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f408800b500 tx=0x7f408800b810 comp rx=0 tx=0).stop 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a1283700 1 -- 172.21.15.135:0/2136344797 reap_dead start 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 shutdown_connections 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 >> 172.21.15.135:0/2136344797 conn(0x7f409c0fd570 msgr2=0x7f409c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 shutdown_connections 2024-05-20T17:31:58.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.802+0000 7f40a2ce6700 1 -- 172.21.15.135:0/2136344797 wait complete. 2024-05-20T17:31:59.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:31:58 smithi172 ceph-mon[36511]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:31:59.126 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:31:58 smithi135 ceph-mon[32027]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:31:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:31:58 smithi160 ceph-mon[36261]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:31:59.474 INFO:teuthology.orchestra.run.smithi135.stdout:343597383702 2024-05-20T17:31:59.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.142+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3576100117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 msgr2=0x7fbaa41070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.142+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3576100117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa41070c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fba940099c0 tx=0x7fba94009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3576100117 shutdown_connections 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3576100117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa41023d0 0x7fbaa41027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3576100117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4107600 0x7fbaa410ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3576100117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa41070c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3576100117 >> 172.21.15.135:0/3576100117 conn(0x7fbaa4077c80 msgr2=0x7fbaa40780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:00.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3576100117 shutdown_connections 2024-05-20T17:32:00.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3576100117 wait complete. 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 Processor -- start 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.143+0000 7fbaac7a5700 1 -- start start 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa41023d0 0x7fbaa419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa4107600 0x7fbaa419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4112380 con 0x7fbaa4106cb0 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4112200 con 0x7fbaa4107600 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4112500 con 0x7fbaa41023d0 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50884/0 (socket says 172.21.15.135:50884) 2024-05-20T17:32:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 -- 172.21.15.135:0/3808350066 learned_addr learned my addr 172.21.15.135:0/3808350066 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaaa541700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa41023d0 0x7fbaa419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaaad42700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa4107600 0x7fbaa419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 -- 172.21.15.135:0/3808350066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa41023d0 msgr2=0x7fbaa419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa41023d0 0x7fbaa419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 -- 172.21.15.135:0/3808350066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa4107600 msgr2=0x7fbaa419b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa4107600 0x7fbaa419b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41a5f50 con 0x7fbaa4106cb0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaaad42700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaa4107600 0x7fbaa419b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaa9d40700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa419b120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba940059d0 tx=0x7fba940038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94027070 con 0x7fbaa4106cb0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba94004050 con 0x7fbaa4106cb0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa41a61e0 con 0x7fbaa4106cb0 2024-05-20T17:32:00.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.144+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94022d20 con 0x7fbaa4106cb0 2024-05-20T17:32:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.145+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa41a6630 con 0x7fbaa4106cb0 2024-05-20T17:32:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.145+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbaa4062d10 con 0x7fbaa4106cb0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.147+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fba9402a070 con 0x7fbaa4106cb0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fba9b7fe700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fba900a2cb0 0x7fba900a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fbaaa541700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fba900a2cb0 0x7fba900a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fba940d0910 con 0x7fbaa4106cb0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fba9b7fe700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] conn(0x7fba900ac4e0 0x7fba900ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba900af000 con 0x7fba900ac4e0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fba940d0df0 con 0x7fbaa4106cb0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.148+0000 7fbaaad42700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] conn(0x7fba900ac4e0 0x7fba900ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.149+0000 7fbaaa541700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fba900a2cb0 0x7fba900a51c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00060b0 tx=0x7fbaa000c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.149+0000 7fbaaad42700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] conn(0x7fba900ac4e0 0x7fba900ae930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:00.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.150+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== osd.6 v2:172.21.15.135:6818/4265227752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba900af000 con 0x7fba900ac4e0 2024-05-20T17:32:00.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 --> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbaa4063190 con 0x7fba900ac4e0 2024-05-20T17:32:00.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fba9b7fe700 1 -- 172.21.15.135:0/3808350066 <== osd.6 v2:172.21.15.135:6818/4265227752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbaa4063190 con 0x7fba900ac4e0 2024-05-20T17:32:00.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] conn(0x7fba900ac4e0 msgr2=0x7fba900ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] conn(0x7fba900ac4e0 0x7fba900ae930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fba900a2cb0 msgr2=0x7fba900a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fba900a2cb0 0x7fba900a51c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00060b0 tx=0x7fbaa000c040 comp rx=0 tx=0).stop 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 msgr2=0x7fbaa419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 --2- 172.21.15.135:0/3808350066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbaa4106cb0 0x7fbaa419b120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba940059d0 tx=0x7fba940038b0 comp rx=0 tx=0).stop 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaaad42700 1 -- 172.21.15.135:0/3808350066 reap_dead start 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 shutdown_connections 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 >> 172.21.15.135:0/3808350066 conn(0x7fbaa4077c80 msgr2=0x7fbaa40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.166+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 shutdown_connections 2024-05-20T17:32:00.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:00.167+0000 7fbaac7a5700 1 -- 172.21.15.135:0/3808350066 wait complete. 2024-05-20T17:32:00.966 INFO:teuthology.orchestra.run.smithi135.stdout:287762808864 2024-05-20T17:32:00.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2150328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc106c70 msgr2=0x7ff0dc107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2150328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc106c70 0x7ff0dc107080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00099c0 tx=0x7ff0d0009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2150328892 shutdown_connections 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2150328892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0dc102340 0x7ff0dc102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2150328892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2150328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc106c70 0x7ff0dc107080 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2150328892 >> 172.21.15.135:0/2150328892 conn(0x7ff0dc0fdc70 msgr2=0x7ff0dc100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2150328892 shutdown_connections 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2150328892 wait complete. 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 Processor -- start 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.331+0000 7ff0e35c8700 1 -- start start 2024-05-20T17:32:01.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0dc102340 0x7ff0dc19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc106c70 0x7ff0dc19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc112320 con 0x7ff0dc1075c0 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1121a0 con 0x7ff0dc102340 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e35c8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1124a0 con 0x7ff0dc106c70 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58000/0 (socket says 172.21.15.135:58000) 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 -- 172.21.15.135:0/2127594544 learned_addr learned my addr 172.21.15.135:0/2127594544 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1364700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0dc102340 0x7ff0dc19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:01.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e0b63700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc106c70 0x7ff0dc19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 -- 172.21.15.135:0/2127594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc106c70 msgr2=0x7ff0dc19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc106c70 0x7ff0dc19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 -- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0dc102340 msgr2=0x7ff0dc19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0dc102340 0x7ff0dc19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc199100 con 0x7ff0dc1075c0 2024-05-20T17:32:01.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0e1b65700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc198ac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d980 tx=0x7ff0d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.332+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4017070 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.333+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1993f0 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.333+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0d4005020 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.333+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400fbf0 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.333+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1998b0 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.333+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0dc062d90 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.335+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff0d40051d0 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0da7fc700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0c40a2cb0 0x7ff0c40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ff0d40cf390 con 0x7ff0dc1075c0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0e1364700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0c40a2cb0 0x7ff0c40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:01.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0da7fc700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] conn(0x7ff0c40ac4e0 0x7ff0c40ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0d4022e50 con 0x7ff0c40ac4e0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7ff0d40cf870 con 0x7ff0dc1075c0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0e1364700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0c40a2cb0 0x7ff0c40a51c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc199c00 tx=0x7ff0cc0079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.336+0000 7ff0e0b63700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] conn(0x7ff0c40ac4e0 0x7ff0c40ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.337+0000 7ff0e0b63700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] conn(0x7ff0c40ac4e0 0x7ff0c40ae930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.338+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== osd.4 v2:172.21.15.160:6808/3098243466 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0d4022e50 con 0x7ff0c40ac4e0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.354+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 --> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0dc063240 con 0x7ff0c40ac4e0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0da7fc700 1 -- 172.21.15.135:0/2127594544 <== osd.4 v2:172.21.15.160:6808/3098243466 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0dc063240 con 0x7ff0c40ac4e0 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] conn(0x7ff0c40ac4e0 msgr2=0x7ff0c40ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] conn(0x7ff0c40ac4e0 0x7ff0c40ae930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0c40a2cb0 msgr2=0x7ff0c40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0c40a2cb0 0x7ff0c40a51c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc199c00 tx=0x7ff0cc0079e0 comp rx=0 tx=0).stop 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 msgr2=0x7ff0dc198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 --2- 172.21.15.135:0/2127594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0dc1075c0 0x7ff0dc198ac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d980 tx=0x7ff0d400dc90 comp rx=0 tx=0).stop 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e1b65700 1 -- 172.21.15.135:0/2127594544 reap_dead start 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 shutdown_connections 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.355+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 >> 172.21.15.135:0/2127594544 conn(0x7ff0dc0fdc70 msgr2=0x7ff0dc108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.356+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 shutdown_connections 2024-05-20T17:32:01.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:31:58.356+0000 7ff0e35c8700 1 -- 172.21.15.135:0/2127594544 wait complete. 2024-05-20T17:32:01.060 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:00 smithi135 ceph-mon[32027]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:01.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:00 smithi172 ceph-mon[36511]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:01.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:00 smithi160 ceph-mon[36261]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:01.728 INFO:teuthology.orchestra.run.smithi135.stdout:141733920826 2024-05-20T17:32:01.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-20T17:32:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:219043332138 2024-05-20T17:32:02.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-20T17:32:02.821 INFO:teuthology.orchestra.run.smithi135.stdout:197568495665 2024-05-20T17:32:02.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-20T17:32:02.913 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:02.915 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:03.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:02 smithi172 ceph-mon[36511]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:02 smithi135 ceph-mon[32027]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:02 smithi160 ceph-mon[36261]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-20T17:32:03.338 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:03.375 INFO:teuthology.orchestra.run.smithi135.stdout:107374182464 2024-05-20T17:32:03.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-20T17:32:03.441 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:03.441 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:05.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:04 smithi172 ceph-mon[36511]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:05.193 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:04 smithi135 ceph-mon[32027]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:05.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:04 smithi160 ceph-mon[36261]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:06.151 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:06.151 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:06.880 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:06.880 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-20T17:32:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-20T17:32:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-20T17:32:06.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:06 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-20T17:32:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-20T17:32:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-20T17:32:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-20T17:32:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:06 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-20T17:32:07.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-05-20T17:32:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-05-20T17:32:07.115 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-05-20T17:32:07.115 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:06 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-20T17:32:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:32:07.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:07 smithi135 ceph-mon[32027]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-20T17:32:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-20T17:32:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-20T17:32:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:32:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:07 smithi160 ceph-mon[36261]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-20T17:32:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-20T17:32:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-20T17:32:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-05-20T17:32:08.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:32:08.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:07 smithi172 ceph-mon[36511]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 -- 172.21.15.135:0/2808143088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b0103450 msgr2=0x7fc8b0103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2808143088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b0103450 0x7fc8b0103860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00099c0 tx=0x7fc8a0009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 -- 172.21.15.135:0/2808143088 shutdown_connections 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2808143088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b01086d0 0x7fc8b0110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2808143088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b0103450 0x7fc8b0103860 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2808143088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0107d80 0x7fc8b0108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 -- 172.21.15.135:0/2808143088 >> 172.21.15.135:0/2808143088 conn(0x7fc8b00fed20 msgr2=0x7fc8b0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 -- 172.21.15.135:0/2808143088 shutdown_connections 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.957+0000 7fc8b6271700 1 -- 172.21.15.135:0/2808143088 wait complete. 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.958+0000 7fc8b6271700 1 Processor -- start 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.958+0000 7fc8b6271700 1 -- start start 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.958+0000 7fc8b6271700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0103450 0x7fc8b0199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.958+0000 7fc8b6271700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b0107d80 0x7fc8b019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0113470 con 0x7fc8b01086d0 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01132f0 con 0x7fc8b0103450 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01135f0 con 0x7fc8b0107d80 2024-05-20T17:32:08.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50894/0 (socket says 172.21.15.135:50894) 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 -- 172.21.15.135:0/2624101163 learned_addr learned my addr 172.21.15.135:0/2624101163 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8af7fe700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b0107d80 0x7fc8b019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8affff700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0103450 0x7fc8b0199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 -- 172.21.15.135:0/2624101163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b0107d80 msgr2=0x7fc8b019a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b0107d80 0x7fc8b019a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 -- 172.21.15.135:0/2624101163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0103450 msgr2=0x7fc8b0199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0103450 0x7fc8b0199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 -- 172.21.15.135:0/2624101163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b019ebf0 con 0x7fc8b01086d0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b480e700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8007ee0 tx=0x7fc8a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004bb0 con 0x7fc8b01086d0 2024-05-20T17:32:08.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a8004d50 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b019eee0 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8005960 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.959+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b01a6800 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.960+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b0050170 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.962+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc8a801a020 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.962+0000 7fc8ad7fa700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 0x7fc8980a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.963+0000 7fc8affff700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 0x7fc8980a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.963+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc8a80ceed0 con 0x7fc8b01086d0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.963+0000 7fc8affff700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 0x7fc8980a51c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:08.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:08.966+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc8a8010070 con 0x7fc8b01086d0 2024-05-20T17:32:09.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:08 smithi160 ceph-mon[36261]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:32:09.072 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:08 smithi135 ceph-mon[32027]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:32:09.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:08 smithi172 ceph-mon[36511]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:32:09.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.170+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc8b002dc60 con 0x7fc8b01086d0 2024-05-20T17:32:09.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.170+0000 7fc8ad7fa700 1 -- 172.21.15.135:0/2624101163 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8a809bcb0 con 0x7fc8b01086d0 2024-05-20T17:32:09.173 INFO:teuthology.orchestra.run.smithi135.stdout:34359738447 2024-05-20T17:32:09.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 msgr2=0x7fc8980a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:09.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 0x7fc8980a51c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a001a040 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 msgr2=0x7fc8b019e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8007ee0 tx=0x7fc8a800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 shutdown_connections 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8b0103450 0x7fc8b0199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8980a2cb0 0x7fc8980a51c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b01086d0 0x7fc8b019e550 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 --2- 172.21.15.135:0/2624101163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b0107d80 0x7fc8b019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 >> 172.21.15.135:0/2624101163 conn(0x7fc8b00fed20 msgr2=0x7fc8b01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 shutdown_connections 2024-05-20T17:32:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:09.173+0000 7fc8b6271700 1 -- 172.21.15.135:0/2624101163 wait complete. 2024-05-20T17:32:09.896 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:09 smithi135 ceph-mon[32027]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:09.896 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:09 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2624101163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:32:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:09 smithi160 ceph-mon[36261]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:09 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2624101163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:32:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:09 smithi172 ceph-mon[36511]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:32:10.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:09 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2624101163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:32:10.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- 172.21.15.135:0/1239139381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c10d770 msgr2=0x7fcf8c10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:10.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 --2- 172.21.15.135:0/1239139381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c10d770 0x7fcf8c10fc50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009990 tx=0x7fcf7c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- 172.21.15.135:0/1239139381 shutdown_connections 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 --2- 172.21.15.135:0/1239139381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c104300 0x7fcf8c104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 --2- 172.21.15.135:0/1239139381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c10d770 0x7fcf8c10fc50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 --2- 172.21.15.135:0/1239139381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104c50 0x7fcf8c10d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- 172.21.15.135:0/1239139381 >> 172.21.15.135:0/1239139381 conn(0x7fcf8c0fddb0 msgr2=0x7fcf8c1001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- 172.21.15.135:0/1239139381 shutdown_connections 2024-05-20T17:32:10.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- 172.21.15.135:0/1239139381 wait complete. 2024-05-20T17:32:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 Processor -- start 2024-05-20T17:32:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.244+0000 7fcf937dc700 1 -- start start 2024-05-20T17:32:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104300 0x7fcf8c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c10d770 0x7fcf8c199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c113450 con 0x7fcf8c104c50 2024-05-20T17:32:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c1132d0 con 0x7fcf8c10d770 2024-05-20T17:32:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf937dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c1135d0 con 0x7fcf8c104300 2024-05-20T17:32:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf91578700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104300 0x7fcf8c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60962/0 (socket says 172.21.15.135:60962) 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 -- 172.21.15.135:0/4271538845 learned_addr learned my addr 172.21.15.135:0/4271538845 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf91d79700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c10d770 0x7fcf8c199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 -- 172.21.15.135:0/4271538845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104300 msgr2=0x7fcf8c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104300 0x7fcf8c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 -- 172.21.15.135:0/4271538845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c10d770 msgr2=0x7fcf8c199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:10.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c10d770 0x7fcf8c199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 -- 172.21.15.135:0/4271538845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8c19a1f0 con 0x7fcf8c104c50 2024-05-20T17:32:10.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.245+0000 7fcf90d77700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000d980 tx=0x7fcf8000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:10.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.246+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80017070 con 0x7fcf8c104c50 2024-05-20T17:32:10.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.246+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8c19a4e0 con 0x7fcf8c104c50 2024-05-20T17:32:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.246+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf80005020 con 0x7fcf8c104c50 2024-05-20T17:32:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.246+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000fbf0 con 0x7fcf8c104c50 2024-05-20T17:32:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.246+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8c1a6770 con 0x7fcf8c104c50 2024-05-20T17:32:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.247+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8c06b7a0 con 0x7fcf8c104c50 2024-05-20T17:32:10.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.248+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcf800051d0 con 0x7fcf8c104c50 2024-05-20T17:32:10.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.249+0000 7fcf8a7fc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 0x7fcf740a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:10.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.249+0000 7fcf91578700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 0x7fcf740a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:10.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.249+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fcf800cf370 con 0x7fcf8c104c50 2024-05-20T17:32:10.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.249+0000 7fcf91578700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 0x7fcf740a51c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400f440 tx=0x7fcf840079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:10.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.252+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcf80020020 con 0x7fcf8c104c50 2024-05-20T17:32:10.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.465+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fcf8c19aff0 con 0x7fcf8c104c50 2024-05-20T17:32:10.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.465+0000 7fcf8a7fc700 1 -- 172.21.15.135:0/4271538845 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcf8009c150 con 0x7fcf8c104c50 2024-05-20T17:32:10.468 INFO:teuthology.orchestra.run.smithi135.stdout:253403070504 2024-05-20T17:32:10.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 msgr2=0x7fcf740a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:10.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 0x7fcf740a51c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400f440 tx=0x7fcf840079e0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 msgr2=0x7fcf8c19ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:10.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000d980 tx=0x7fcf8000dc90 comp rx=0 tx=0).stop 2024-05-20T17:32:10.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 shutdown_connections 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c10d770 0x7fcf8c199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf740a2cb0 0x7fcf740a51c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf8c104300 0x7fcf8c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 --2- 172.21.15.135:0/4271538845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf8c104c50 0x7fcf8c19ff00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.467+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 >> 172.21.15.135:0/4271538845 conn(0x7fcf8c0fddb0 msgr2=0x7fcf8c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.468+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 shutdown_connections 2024-05-20T17:32:10.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:10.468+0000 7fcf937dc700 1 -- 172.21.15.135:0/4271538845 wait complete. 2024-05-20T17:32:10.809 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2024-05-20T17:32:10.809 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:11.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4271538845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:32:11.023 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4271538845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:32:11.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4271538845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:32:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:11 smithi160 ceph-mon[36261]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-05-20T17:32:12.037 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:11 smithi135 ceph-mon[32027]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-05-20T17:32:12.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:11 smithi172 ceph-mon[36511]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-05-20T17:32:12.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 -- 172.21.15.135:0/3318027965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c1075c0 msgr2=0x7fb60c10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:12.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 --2- 172.21.15.135:0/3318027965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c1075c0 0x7fb60c10ef20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb6040099c0 tx=0x7fb604009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 -- 172.21.15.135:0/3318027965 shutdown_connections 2024-05-20T17:32:12.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 --2- 172.21.15.135:0/3318027965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c1075c0 0x7fb60c10ef20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 --2- 172.21.15.135:0/3318027965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 0x7fb60c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 --2- 172.21.15.135:0/3318027965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c106c70 0x7fb60c107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 -- 172.21.15.135:0/3318027965 >> 172.21.15.135:0/3318027965 conn(0x7fb60c0fdc40 msgr2=0x7fb60c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 -- 172.21.15.135:0/3318027965 shutdown_connections 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.161+0000 7fb611989700 1 -- 172.21.15.135:0/3318027965 wait complete. 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.162+0000 7fb611989700 1 Processor -- start 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.162+0000 7fb611989700 1 -- start start 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 0x7fb60c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c1075c0 0x7fb60c1a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c112340 con 0x7fb60c106c70 2024-05-20T17:32:12.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1121c0 con 0x7fb60c1075c0 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb611989700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1124c0 con 0x7fb60c102340 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60982/0 (socket says 172.21.15.135:60982) 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 -- 172.21.15.135:0/2173948165 learned_addr learned my addr 172.21.15.135:0/2173948165 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60affd700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 0x7fb60c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60b7fe700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c1075c0 0x7fb60c1a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 -- 172.21.15.135:0/2173948165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 msgr2=0x7fb60c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 0x7fb60c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 -- 172.21.15.135:0/2173948165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c1075c0 msgr2=0x7fb60c1a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c1075c0 0x7fb60c1a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 -- 172.21.15.135:0/2173948165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c19b8d0 con 0x7fb60c106c70 2024-05-20T17:32:12.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb60a7fc700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d950 tx=0x7fb5f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.163+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4016070 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.164+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f4004d10 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.164+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c1a61c0 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.164+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4005650 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.164+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c1a66d0 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.165+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c050170 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.166+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb5f4004750 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.167+0000 7fb610987700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 0x7fb5f80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.167+0000 7fb60affd700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 0x7fb5f80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.167+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fb5f40cf370 con 0x7fb60c106c70 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.167+0000 7fb60affd700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 0x7fb5f80a51c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009550 tx=0x7fb5fc0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:12.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.170+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb5f401f020 con 0x7fb60c106c70 2024-05-20T17:32:12.382 INFO:teuthology.orchestra.run.smithi135.stdout:77309411399 2024-05-20T17:32:12.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.380+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb60c02dc60 con 0x7fb60c106c70 2024-05-20T17:32:12.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.380+0000 7fb610987700 1 -- 172.21.15.135:0/2173948165 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5f409c150 con 0x7fb60c106c70 2024-05-20T17:32:12.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 msgr2=0x7fb5f80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:12.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 0x7fb5f80a51c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009550 tx=0x7fb5fc0091b0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 msgr2=0x7fb60c19b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:12.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d950 tx=0x7fb5f400dc60 comp rx=0 tx=0).stop 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 shutdown_connections 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c1075c0 0x7fb60c1a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5f80a2cb0 0x7fb5f80a51c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb60c102340 0x7fb60c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 --2- 172.21.15.135:0/2173948165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c106c70 0x7fb60c19b020 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 >> 172.21.15.135:0/2173948165 conn(0x7fb60c0fdc40 msgr2=0x7fb60c106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 shutdown_connections 2024-05-20T17:32:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:12.383+0000 7fb611989700 1 -- 172.21.15.135:0/2173948165 wait complete. 2024-05-20T17:32:12.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:12 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:32:12.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:12 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2173948165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:32:12.999 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:12 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:32:12.999 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:12 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2173948165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:32:13.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:12 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:32:13.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:12 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2173948165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:32:13.135 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:13 smithi160 ceph-mon[36261]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:14.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:13 smithi172 ceph-mon[36511]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:13 smithi135 ceph-mon[32027]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:14 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:14 smithi172 ceph-mon[36511]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:15.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:14 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:14 smithi135 ceph-mon[32027]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:14 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:14 smithi160 ceph-mon[36261]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 286 B/s, 1 keys/s, 1 objects/s recovering 2024-05-20T17:32:16.237 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 -- 172.21.15.135:0/3338408243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41043c0 msgr2=0x7f33a41047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3338408243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41043c0 0x7f33a41047d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f339400b0a0 tx=0x7f339400b3b0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 -- 172.21.15.135:0/3338408243 shutdown_connections 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3338408243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 0x7f33a410fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3338408243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41043c0 0x7f33a41047d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3338408243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a4104d10 0x7f33a410d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 -- 172.21.15.135:0/3338408243 >> 172.21.15.135:0/3338408243 conn(0x7f33a4077cd0 msgr2=0x7f33a4078110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:16.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 -- 172.21.15.135:0/3338408243 shutdown_connections 2024-05-20T17:32:16.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.467+0000 7f33a9e37700 1 -- 172.21.15.135:0/3338408243 wait complete. 2024-05-20T17:32:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.468+0000 7f33a9e37700 1 Processor -- start 2024-05-20T17:32:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.468+0000 7f33a9e37700 1 -- start start 2024-05-20T17:32:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a41043c0 0x7f33a4199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 0x7f33a419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41134d0 con 0x7f33a4104d10 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4113350 con 0x7f33a41043c0 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4113650 con 0x7f33a410d7a0 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60998/0 (socket says 172.21.15.135:60998) 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 -- 172.21.15.135:0/3777233128 learned_addr learned my addr 172.21.15.135:0/3777233128 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a3fff700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 0x7f33a419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a37fe700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a41043c0 0x7f33a4199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 -- 172.21.15.135:0/3777233128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 msgr2=0x7f33a419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 0x7f33a419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 -- 172.21.15.135:0/3777233128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a41043c0 msgr2=0x7f33a4199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a41043c0 0x7f33a4199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 -- 172.21.15.135:0/3777233128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a419ecd0 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a2ffd700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f338c00e970 tx=0x7f338c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c004a30 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a419efc0 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.469+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f338c00ccc0 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.470+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c005650 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.470+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a41a68e0 con 0x7f33a4104d10 2024-05-20T17:32:16.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.471+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a4050170 con 0x7f33a4104d10 2024-05-20T17:32:16.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.472+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f338c004bd0 con 0x7f33a4104d10 2024-05-20T17:32:16.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.473+0000 7f33a0ff9700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 0x7f33900a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:16.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.473+0000 7f33a37fe700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 0x7f33900a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:16.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.473+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f338c0cf5e0 con 0x7f33a4104d10 2024-05-20T17:32:16.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.474+0000 7f33a37fe700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 0x7f33900a51c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f33940062a0 tx=0x7f3394006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:16.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.477+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f338c053850 con 0x7f33a4104d10 2024-05-20T17:32:16.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.679+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f33a419b160 con 0x7f33a4104d10 2024-05-20T17:32:16.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.679+0000 7f33a0ff9700 1 -- 172.21.15.135:0/3777233128 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f338c09c3c0 con 0x7f33a4104d10 2024-05-20T17:32:16.682 INFO:teuthology.orchestra.run.smithi135.stdout:163208757304 2024-05-20T17:32:16.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 msgr2=0x7f33900a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:16.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 0x7f33900a51c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f33940062a0 tx=0x7f3394006210 comp rx=0 tx=0).stop 2024-05-20T17:32:16.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 msgr2=0x7f33a419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:16.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f338c00e970 tx=0x7f338c00ec80 comp rx=0 tx=0).stop 2024-05-20T17:32:16.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 shutdown_connections 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a41043c0 0x7f33a4199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33900a2cb0 0x7f33900a51c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a410d7a0 0x7f33a419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 --2- 172.21.15.135:0/3777233128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a4104d10 0x7f33a419a3a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 >> 172.21.15.135:0/3777233128 conn(0x7f33a4077cd0 msgr2=0x7f33a40fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:16.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 shutdown_connections 2024-05-20T17:32:16.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:16.682+0000 7f33a9e37700 1 -- 172.21.15.135:0/3777233128 wait complete. 2024-05-20T17:32:16.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:16 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3777233128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:32:17.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:16 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3777233128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:32:17.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:16 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3777233128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:32:17.806 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070501 got 253403070504 for osd.8 2024-05-20T17:32:17.807 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:17.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:17 smithi135 ceph-mon[32027]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 229 B/s, 0 keys/s, 1 objects/s recovering 2024-05-20T17:32:18.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:17 smithi160 ceph-mon[36261]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 229 B/s, 0 keys/s, 1 objects/s recovering 2024-05-20T17:32:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:17 smithi172 ceph-mon[36511]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s; 229 B/s, 0 keys/s, 1 objects/s recovering 2024-05-20T17:32:18.187 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:18.218 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411399 for osd.2 2024-05-20T17:32:18.218 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:18.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.608+0000 7efc24ea6700 1 -- 172.21.15.135:0/2080386838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc20104cd0 msgr2=0x7efc2010d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.608+0000 7efc24ea6700 1 --2- 172.21.15.135:0/2080386838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc20104cd0 0x7efc2010d220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc14009990 tx=0x7efc14009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 -- 172.21.15.135:0/2080386838 shutdown_connections 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 --2- 172.21.15.135:0/2080386838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc20104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 --2- 172.21.15.135:0/2080386838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2010d760 0x7efc2010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 --2- 172.21.15.135:0/2080386838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc20104cd0 0x7efc2010d220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 -- 172.21.15.135:0/2080386838 >> 172.21.15.135:0/2080386838 conn(0x7efc200fdc40 msgr2=0x7efc20100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 -- 172.21.15.135:0/2080386838 shutdown_connections 2024-05-20T17:32:18.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.609+0000 7efc24ea6700 1 -- 172.21.15.135:0/2080386838 wait complete. 2024-05-20T17:32:18.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 Processor -- start 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 -- start start 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc2019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20104cd0 0x7efc2019fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc20113410 con 0x7efc2010d760 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efc20113290 con 0x7efc20104380 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc24ea6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc20113590 con 0x7efc20104cd0 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc1ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc1ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32784/0 (socket says 172.21.15.135:32784) 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc1ed9d700 1 -- 172.21.15.135:0/3186145177 learned_addr learned my addr 172.21.15.135:0/3186145177 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc1e59c700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc2019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.610+0000 7efc1dd9b700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20104cd0 0x7efc2019fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 -- 172.21.15.135:0/3186145177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20104cd0 msgr2=0x7efc2019fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20104cd0 0x7efc2019fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 -- 172.21.15.135:0/3186145177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 msgr2=0x7efc2019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc2019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 -- 172.21.15.135:0/3186145177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2019a1d0 con 0x7efc2010d760 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1e59c700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc2019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc1ed9d700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efc18007d70 tx=0x7efc1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18016020 con 0x7efc2010d760 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2019a4c0 con 0x7efc2010d760 2024-05-20T17:32:18.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc1800ac90 con 0x7efc2010d760 2024-05-20T17:32:18.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180115c0 con 0x7efc2010d760 2024-05-20T17:32:18.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.611+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a6750 con 0x7efc2010d760 2024-05-20T17:32:18.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.612+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2006acd0 con 0x7efc2010d760 2024-05-20T17:32:18.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.614+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efc18019020 con 0x7efc2010d760 2024-05-20T17:32:18.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.614+0000 7efc0f7fe700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 0x7efc080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.614+0000 7efc1e59c700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 0x7efc080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.614+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7efc180cef90 con 0x7efc2010d760 2024-05-20T17:32:18.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.615+0000 7efc1e59c700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 0x7efc080a5240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc1000afd0 tx=0x7efc1000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:18.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.619+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efc18020020 con 0x7efc2010d760 2024-05-20T17:32:18.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.830+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efc201a6920 con 0x7efc2010d760 2024-05-20T17:32:18.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.831+0000 7efc0f7fe700 1 -- 172.21.15.135:0/3186145177 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc1809be80 con 0x7efc2010d760 2024-05-20T17:32:18.833 INFO:teuthology.orchestra.run.smithi135.stdout:55834574925 2024-05-20T17:32:18.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 msgr2=0x7efc080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 0x7efc080a5240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc1000afd0 tx=0x7efc1000a380 comp rx=0 tx=0).stop 2024-05-20T17:32:18.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 msgr2=0x7efc20199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efc18007d70 tx=0x7efc1800a340 comp rx=0 tx=0).stop 2024-05-20T17:32:18.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 shutdown_connections 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc20104380 0x7efc2019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efc080a2d30 0x7efc080a5240 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc2010d760 0x7efc20199b30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 --2- 172.21.15.135:0/3186145177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20104cd0 0x7efc2019fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 >> 172.21.15.135:0/3186145177 conn(0x7efc200fdc40 msgr2=0x7efc200fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 shutdown_connections 2024-05-20T17:32:18.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.833+0000 7efc24ea6700 1 -- 172.21.15.135:0/3186145177 wait complete. 2024-05-20T17:32:18.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- 172.21.15.135:0/3749559851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 msgr2=0x7fc298101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/3749559851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298101d70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2940099c0 tx=0x7fc294009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- 172.21.15.135:0/3749559851 shutdown_connections 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/3749559851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2981086d0 0x7fc298110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/3749559851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298101d70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/3749559851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc298107d80 0x7fc298108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- 172.21.15.135:0/3749559851 >> 172.21.15.135:0/3749559851 conn(0x7fc2980fd3a0 msgr2=0x7fc2980ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- 172.21.15.135:0/3749559851 shutdown_connections 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- 172.21.15.135:0/3749559851 wait complete. 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 Processor -- start 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.861+0000 7fc2a05e1700 1 -- start start 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 0x7fc29819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 0x7fc29819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc298113450 con 0x7fc298101960 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2981132d0 con 0x7fc298107d80 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc2a05e1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2981135d0 con 0x7fc2981086d0 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32808/0 (socket says 172.21.15.135:32808) 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 -- 172.21.15.135:0/4279413589 learned_addr learned my addr 172.21.15.135:0/4279413589 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29db7c700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 0x7fc29819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29eb7e700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 0x7fc29819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 -- 172.21.15.135:0/4279413589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 msgr2=0x7fc29819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 0x7fc29819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 -- 172.21.15.135:0/4279413589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 msgr2=0x7fc29819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 0x7fc29819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 -- 172.21.15.135:0/4279413589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29819ec30 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29eb7e700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 0x7fc29819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29db7c700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 0x7fc29819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.862+0000 7fc29e37d700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc294006010 tx=0x7fc29400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.863+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294003680 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.863+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29819eec0 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.863+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2940055b0 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.863+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940173f0 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.863+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2981a6840 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.864+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2981049f0 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.866+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc2940050d0 con 0x7fc298101960 2024-05-20T17:32:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.866+0000 7fc28f7fe700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 0x7fc2840a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:18.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.867+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc2940d0690 con 0x7fc298101960 2024-05-20T17:32:18.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.867+0000 7fc29db7c700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 0x7fc2840a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:18.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.867+0000 7fc29db7c700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 0x7fc2840a53e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc298106530 tx=0x7fc288009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:18.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:18.874+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc294013070 con 0x7fc298101960 2024-05-20T17:32:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.069+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc29819b0c0 con 0x7fc298101960 2024-05-20T17:32:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.069+0000 7fc28f7fe700 1 -- 172.21.15.135:0/4279413589 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc29409d530 con 0x7fc298101960 2024-05-20T17:32:19.071 INFO:teuthology.orchestra.run.smithi135.stdout:309237645343 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 msgr2=0x7fc2840a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 0x7fc2840a53e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc298106530 tx=0x7fc288009260 comp rx=0 tx=0).stop 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 msgr2=0x7fc298199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc294006010 tx=0x7fc29400f740 comp rx=0 tx=0).stop 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 shutdown_connections 2024-05-20T17:32:19.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2840a2ed0 0x7fc2840a53e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2981086d0 0x7fc29819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc298101960 0x7fc298199d60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 --2- 172.21.15.135:0/4279413589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298107d80 0x7fc29819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 >> 172.21.15.135:0/4279413589 conn(0x7fc2980fd3a0 msgr2=0x7fc298106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 shutdown_connections 2024-05-20T17:32:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:19.072+0000 7fc2a05e1700 1 -- 172.21.15.135:0/4279413589 wait complete. 2024-05-20T17:32:19.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574925 for osd.1 2024-05-20T17:32:19.585 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:19.814 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:19 smithi135 ceph-mon[32027]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 208 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:19.815 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3186145177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:32:19.815 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4279413589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:32:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:19 smithi160 ceph-mon[36261]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 208 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:19 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3186145177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:32:20.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:19 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4279413589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:32:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:19 smithi172 ceph-mon[36511]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 208 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:19 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3186145177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:32:20.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:19 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4279413589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:32:20.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 -- 172.21.15.135:0/3654369331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1023c0 msgr2=0x7f5b2c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 --2- 172.21.15.135:0/3654369331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c1027d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b280099c0 tx=0x7f5b28009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 -- 172.21.15.135:0/3654369331 shutdown_connections 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 --2- 172.21.15.135:0/3654369331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 --2- 172.21.15.135:0/3654369331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c1027d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 --2- 172.21.15.135:0/3654369331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 0x7f5b2c1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 -- 172.21.15.135:0/3654369331 >> 172.21.15.135:0/3654369331 conn(0x7f5b2c077cd0 msgr2=0x7f5b2c078110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 -- 172.21.15.135:0/3654369331 shutdown_connections 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.226+0000 7f5b3466b700 1 -- 172.21.15.135:0/3654369331 wait complete. 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 Processor -- start 2024-05-20T17:32:20.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 -- start start 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 0x7f5b2c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c1123e0 con 0x7f5b2c1075f0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c112260 con 0x7f5b2c1023c0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b3466b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c112560 con 0x7f5b2c106ca0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b32c08700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b32c08700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49090/0 (socket says 172.21.15.135:49090) 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b32c08700 1 -- 172.21.15.135:0/1080371238 learned_addr learned my addr 172.21.15.135:0/1080371238 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.227+0000 7f5b31c06700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 0x7f5b2c19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32407700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:20.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 -- 172.21.15.135:0/1080371238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 msgr2=0x7f5b2c19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 0x7f5b2c19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 -- 172.21.15.135:0/1080371238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1023c0 msgr2=0x7f5b2c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 -- 172.21.15.135:0/1080371238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c1a5f40 con 0x7f5b2c1075f0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b32c08700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b24007d70 tx=0x7f5b2400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24016020 con 0x7f5b2c1075f0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b2400ac90 con 0x7f5b2c1075f0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c1a6230 con 0x7f5b2c1075f0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b240115c0 con 0x7f5b2c1075f0 2024-05-20T17:32:20.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.228+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c1a6770 con 0x7f5b2c1075f0 2024-05-20T17:32:20.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.229+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c050170 con 0x7f5b2c1075f0 2024-05-20T17:32:20.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.231+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5b24019020 con 0x7f5b2c1075f0 2024-05-20T17:32:20.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.232+0000 7f5b237fe700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 0x7f5b180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:20.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.232+0000 7f5b32407700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 0x7f5b180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:20.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.232+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5b240cf400 con 0x7f5b2c1075f0 2024-05-20T17:32:20.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.232+0000 7f5b32407700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 0x7f5b180a5240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000c00 tx=0x7f5b2801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:20.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.235+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b24020020 con 0x7f5b2c1075f0 2024-05-20T17:32:20.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.437+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5b2c02dc60 con 0x7f5b2c1075f0 2024-05-20T17:32:20.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.437+0000 7f5b237fe700 1 -- 172.21.15.135:0/1080371238 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5b2409c2f0 con 0x7f5b2c1075f0 2024-05-20T17:32:20.439 INFO:teuthology.orchestra.run.smithi135.stdout:197568495668 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 msgr2=0x7f5b180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 0x7f5b180a5240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000c00 tx=0x7f5b2801a040 comp rx=0 tx=0).stop 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 msgr2=0x7f5b2c19b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b24007d70 tx=0x7f5b2400a340 comp rx=0 tx=0).stop 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 shutdown_connections 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b2c1023c0 0x7f5b2c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5b180a2d30 0x7f5b180a5240 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b2c1075f0 0x7f5b2c19b720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 --2- 172.21.15.135:0/1080371238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c106ca0 0x7f5b2c19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 >> 172.21.15.135:0/1080371238 conn(0x7f5b2c077cd0 msgr2=0x7f5b2c0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.439+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 shutdown_connections 2024-05-20T17:32:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:20.440+0000 7f5b3466b700 1 -- 172.21.15.135:0/1080371238 wait complete. 2024-05-20T17:32:20.750 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645336 got 309237645343 for osd.10 2024-05-20T17:32:20.750 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:20.971 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1080371238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:32:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:20 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1080371238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:32:21.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:20 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1080371238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 -- 172.21.15.135:0/2976716657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 msgr2=0x7fb56c107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 --2- 172.21.15.135:0/2976716657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c107080 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb5600099c0 tx=0x7fb560009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 -- 172.21.15.135:0/2976716657 shutdown_connections 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 --2- 172.21.15.135:0/2976716657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c102340 0x7fb56c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 --2- 172.21.15.135:0/2976716657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c1075c0 0x7fb56c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 --2- 172.21.15.135:0/2976716657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c107080 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.188+0000 7fb5712c9700 1 -- 172.21.15.135:0/2976716657 >> 172.21.15.135:0/2976716657 conn(0x7fb56c0fdc40 msgr2=0x7fb56c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.189+0000 7fb5712c9700 1 -- 172.21.15.135:0/2976716657 shutdown_connections 2024-05-20T17:32:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.189+0000 7fb5712c9700 1 -- 172.21.15.135:0/2976716657 wait complete. 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.189+0000 7fb5712c9700 1 Processor -- start 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.189+0000 7fb5712c9700 1 -- start start 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 0x7fb56c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c1075c0 0x7fb56c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c112320 con 0x7fb56c106c70 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c1121a0 con 0x7fb56c1075c0 2024-05-20T17:32:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb5712c9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c1124a0 con 0x7fb56c102340 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49106/0 (socket says 172.21.15.135:49106) 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 0x7fb56c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56a7fc700 1 -- 172.21.15.135:0/3593568917 learned_addr learned my addr 172.21.15.135:0/3593568917 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56b7fe700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c1075c0 0x7fb56c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 -- 172.21.15.135:0/3593568917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c1075c0 msgr2=0x7fb56c19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c1075c0 0x7fb56c19b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 -- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 msgr2=0x7fb56c19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 -- 172.21.15.135:0/3593568917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c1a5f30 con 0x7fb56c102340 2024-05-20T17:32:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56a7fc700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.190+0000 7fb56affd700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 0x7fb56c19abe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c970 tx=0x7fb55c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00ce60 con 0x7fb56c102340 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c1a6220 con 0x7fb56c102340 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb55c004830 con 0x7fb56c102340 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c005520 con 0x7fb56c102340 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c1a67b0 con 0x7fb56c102340 2024-05-20T17:32:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.191+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c050170 con 0x7fb56c102340 2024-05-20T17:32:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.193+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb55c0049e0 con 0x7fb56c102340 2024-05-20T17:32:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.193+0000 7fb553fff700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 0x7fb5540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.194+0000 7fb56a7fc700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 0x7fb5540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.194+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fb55c0cf0d0 con 0x7fb56c102340 2024-05-20T17:32:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.194+0000 7fb56a7fc700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 0x7fb5540a51c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb560009750 tx=0x7fb56001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:21.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.197+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb55c014030 con 0x7fb56c102340 2024-05-20T17:32:21.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.396+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb56c02dc60 con 0x7fb56c102340 2024-05-20T17:32:21.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.397+0000 7fb553fff700 1 -- 172.21.15.135:0/3593568917 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb55c09beb0 con 0x7fb56c102340 2024-05-20T17:32:21.399 INFO:teuthology.orchestra.run.smithi135.stdout:219043332143 2024-05-20T17:32:21.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 msgr2=0x7fb5540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:21.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 0x7fb5540a51c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb560009750 tx=0x7fb56001a040 comp rx=0 tx=0).stop 2024-05-20T17:32:21.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 msgr2=0x7fb56c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:21.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 0x7fb56c19abe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c970 tx=0x7fb55c00cc80 comp rx=0 tx=0).stop 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 shutdown_connections 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c1075c0 0x7fb56c19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb5540a2cb0 0x7fb5540a51c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb56c102340 0x7fb56c19abe0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 --2- 172.21.15.135:0/3593568917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb56c106c70 0x7fb56c19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.399+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 >> 172.21.15.135:0/3593568917 conn(0x7fb56c0fdc40 msgr2=0x7fb56c108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.400+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 shutdown_connections 2024-05-20T17:32:21.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:21.400+0000 7fb5712c9700 1 -- 172.21.15.135:0/3593568917 wait complete. 2024-05-20T17:32:22.001 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:21 smithi135 ceph-mon[32027]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 191 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:22.001 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:21 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3593568917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:32:22.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:21 smithi160 ceph-mon[36261]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 191 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:22.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:21 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3593568917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:32:22.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:21 smithi172 ceph-mon[36511]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 191 B/s, 0 keys/s, 0 objects/s recovering 2024-05-20T17:32:22.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:21 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3593568917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:32:23.306 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495665 got 197568495668 for osd.6 2024-05-20T17:32:23.306 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:23.867 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757298 got 163208757304 for osd.5 2024-05-20T17:32:23.868 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:24.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:23 smithi160 ceph-mon[36261]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 142 B/s, 0 objects/s recovering 2024-05-20T17:32:24.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:23 smithi172 ceph-mon[36511]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 142 B/s, 0 objects/s recovering 2024-05-20T17:32:24.147 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:23 smithi135 ceph-mon[32027]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 142 B/s, 0 objects/s recovering 2024-05-20T17:32:24.507 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332138 got 219043332143 for osd.7 2024-05-20T17:32:24.507 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 -- 172.21.15.135:0/711498247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 msgr2=0x7f8368101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 --2- 172.21.15.135:0/711498247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368101c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8358009990 tx=0x7f8358009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 -- 172.21.15.135:0/711498247 shutdown_connections 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 --2- 172.21.15.135:0/711498247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368102190 0x7f836810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 --2- 172.21.15.135:0/711498247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368107870 0x7f8368107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 --2- 172.21.15.135:0/711498247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368101c50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 -- 172.21.15.135:0/711498247 >> 172.21.15.135:0/711498247 conn(0x7f83680fd360 msgr2=0x7f83680ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 -- 172.21.15.135:0/711498247 shutdown_connections 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.948+0000 7f836fff7700 1 -- 172.21.15.135:0/711498247 wait complete. 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 Processor -- start 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 -- start start 2024-05-20T17:32:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368102190 0x7f83681989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368107870 0x7f836819e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8368111bc0 con 0x7f8368101840 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8368111a40 con 0x7f8368107870 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836fff7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8368111d40 con 0x7f8368102190 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49134/0 (socket says 172.21.15.135:49134) 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 -- 172.21.15.135:0/1405368480 learned_addr learned my addr 172.21.15.135:0/1405368480 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836e594700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368107870 0x7f836819e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:24.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836d592700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368102190 0x7f83681989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 -- 172.21.15.135:0/1405368480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368102190 msgr2=0x7f83681989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368102190 0x7f83681989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 -- 172.21.15.135:0/1405368480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368107870 msgr2=0x7f836819e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368107870 0x7f836819e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 -- 172.21.15.135:0/1405368480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836819eda0 con 0x7f8368101840 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.949+0000 7f836dd93700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f836400b500 tx=0x7f836400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.950+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364015020 con 0x7f8368101840 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.950+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836819f090 con 0x7f8368101840 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.950+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8364011d10 con 0x7f8368101840 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.950+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836400f2e0 con 0x7f8368101840 2024-05-20T17:32:24.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.950+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681a69e0 con 0x7f8368101840 2024-05-20T17:32:24.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.951+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8368050170 con 0x7f8368101840 2024-05-20T17:32:24.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.953+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8364018020 con 0x7f8368101840 2024-05-20T17:32:24.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.953+0000 7f835effd700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 0x7f83540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:24.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.954+0000 7f836d592700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 0x7f83540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:24.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.954+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f83640ced70 con 0x7f8368101840 2024-05-20T17:32:24.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.954+0000 7f836d592700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 0x7f83540a51c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8358006010 tx=0x7f8358005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:24.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:24.957+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f836401f020 con 0x7f8368101840 2024-05-20T17:32:25.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.157+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f836806ae00 con 0x7f8368101840 2024-05-20T17:32:25.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.157+0000 7f835effd700 1 -- 172.21.15.135:0/1405368480 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f836409bc60 con 0x7f8368101840 2024-05-20T17:32:25.159 INFO:teuthology.orchestra.run.smithi135.stdout:287762808870 2024-05-20T17:32:25.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 msgr2=0x7f83540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:25.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 0x7f83540a51c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8358006010 tx=0x7f8358005ec0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 msgr2=0x7f8368198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f836400b500 tx=0x7f836400b8c0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 shutdown_connections 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8368107870 0x7f836819e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f83540a2cb0 0x7f83540a51c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368101840 0x7f8368198460 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 --2- 172.21.15.135:0/1405368480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8368102190 0x7f83681989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 >> 172.21.15.135:0/1405368480 conn(0x7f83680fd360 msgr2=0x7f8368106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 shutdown_connections 2024-05-20T17:32:25.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:25.159+0000 7f836fff7700 1 -- 172.21.15.135:0/1405368480 wait complete. 2024-05-20T17:32:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:25 smithi160 ceph-mon[36261]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:25 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1405368480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:32:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:25 smithi172 ceph-mon[36511]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:26.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:25 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1405368480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:32:26.100 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:25 smithi135 ceph-mon[32027]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:26.100 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:25 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1405368480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:32:26.765 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808864 got 287762808870 for osd.9 2024-05-20T17:32:26.766 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:27 smithi160 ceph-mon[36261]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:28.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:27 smithi135 ceph-mon[32027]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:28.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:27 smithi172 ceph-mon[36511]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 -- 172.21.15.135:0/398200698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938106c90 msgr2=0x7f09381070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 --2- 172.21.15.135:0/398200698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938106c90 0x7f09381070a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f09200099c0 tx=0x7f0920009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 -- 172.21.15.135:0/398200698 shutdown_connections 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 --2- 172.21.15.135:0/398200698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938102360 0x7f0938102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 --2- 172.21.15.135:0/398200698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093810ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 --2- 172.21.15.135:0/398200698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938106c90 0x7f09381070a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 -- 172.21.15.135:0/398200698 >> 172.21.15.135:0/398200698 conn(0x7f09380fddd0 msgr2=0x7f09381001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 -- 172.21.15.135:0/398200698 shutdown_connections 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.367+0000 7f093ca69700 1 -- 172.21.15.135:0/398200698 wait complete. 2024-05-20T17:32:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 Processor -- start 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 -- start start 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 0x7f093819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09381134d0 con 0x7f0938102360 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0938113350 con 0x7f0938106c90 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093ca69700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0938113650 con 0x7f09381075e0 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.368+0000 7f093659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49144/0 (socket says 172.21.15.135:49144) 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 -- 172.21.15.135:0/1315235112 learned_addr learned my addr 172.21.15.135:0/1315235112 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f092ffff700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 0x7f093819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f0936d9d700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 -- 172.21.15.135:0/1315235112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 msgr2=0x7f093819e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093819e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 -- 172.21.15.135:0/1315235112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 msgr2=0x7f093819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 0x7f093819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 -- 172.21.15.135:0/1315235112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093819ecb0 con 0x7f0938102360 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f092ffff700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 0x7f093819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f0936d9d700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093819e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093659c700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f092800b530 tx=0x7f092800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928015020 con 0x7f0938102360 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093819efa0 con 0x7f0938102360 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0928011d10 con 0x7f0938102360 2024-05-20T17:32:28.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928010e50 con 0x7f0938102360 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stdout:343597383708 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.369+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09381a68c0 con 0x7f0938102360 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.370+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0938050170 con 0x7f0938102360 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.371+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0928018020 con 0x7f0938102360 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.372+0000 7f092f7fe700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 0x7f09240a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.372+0000 7f092ffff700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 0x7f09240a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.372+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f09280ce8d0 con 0x7f0938102360 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.373+0000 7f092ffff700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 0x7f09240a53e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0920000c00 tx=0x7f092001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.377+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f092801f020 con 0x7f0938102360 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.577+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f093819b140 con 0x7f0938102360 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.577+0000 7f092f7fe700 1 -- 172.21.15.135:0/1315235112 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f092809b7c0 con 0x7f0938102360 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 msgr2=0x7f09240a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 0x7f09240a53e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0920000c00 tx=0x7f092001a040 comp rx=0 tx=0).stop 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 msgr2=0x7f0938199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f092800b530 tx=0x7f092800b8f0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 shutdown_connections 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f09240a2ed0 0x7f09240a53e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09381075e0 0x7f093819e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0938102360 0x7f0938199de0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 --2- 172.21.15.135:0/1315235112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0938106c90 0x7f093819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:28.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.579+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 >> 172.21.15.135:0/1315235112 conn(0x7f09380fddd0 msgr2=0x7f09381063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:28.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.580+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 shutdown_connections 2024-05-20T17:32:28.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:28.580+0000 7f093ca69700 1 -- 172.21.15.135:0/1315235112 wait complete. 2024-05-20T17:32:28.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:28 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1315235112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:32:29.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:28 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1315235112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:32:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:28 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1315235112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:32:29.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383702 got 343597383708 for osd.11 2024-05-20T17:32:29.499 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 -- 172.21.15.135:0/3800040676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8107dc0 msgr2=0x7fc5d81081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 --2- 172.21.15.135:0/3800040676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8107dc0 0x7fc5d81081d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80099c0 tx=0x7fc5c8009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 -- 172.21.15.135:0/3800040676 shutdown_connections 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 --2- 172.21.15.135:0/3800040676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8108710 0x7fc5d8110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 --2- 172.21.15.135:0/3800040676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8101940 0x7fc5d8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 --2- 172.21.15.135:0/3800040676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8107dc0 0x7fc5d81081d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 -- 172.21.15.135:0/3800040676 >> 172.21.15.135:0/3800040676 conn(0x7fc5d80fd360 msgr2=0x7fc5d80ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:29.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 -- 172.21.15.135:0/3800040676 shutdown_connections 2024-05-20T17:32:29.985 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:29 smithi135 ceph-mon[32027]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.982+0000 7fc5e0032700 1 -- 172.21.15.135:0/3800040676 wait complete. 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 Processor -- start 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 -- start start 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8101940 0x7fc5d8102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 0x7fc5d8102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d8113460 con 0x7fc5d8108710 2024-05-20T17:32:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81132e0 con 0x7fc5d8101940 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.983+0000 7fc5e0032700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81135e0 con 0x7fc5d8107dc0 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53032/0 (socket says 172.21.15.135:53032) 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 -- 172.21.15.135:0/640743175 learned_addr learned my addr 172.21.15.135:0/640743175 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5dd5cd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 0x7fc5d8102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5dddce700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8101940 0x7fc5d8102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 -- 172.21.15.135:0/640743175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 msgr2=0x7fc5d8102dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 0x7fc5d8102dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 -- 172.21.15.135:0/640743175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8101940 msgr2=0x7fc5d8102890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8101940 0x7fc5d8102890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 -- 172.21.15.135:0/640743175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d81a8180 con 0x7fc5d8108710 2024-05-20T17:32:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5dd5cd700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 0x7fc5d8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5de5cf700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0007ee0 tx=0x7fc5d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000dbd0 con 0x7fc5d8108710 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5d000dd70 con 0x7fc5d8108710 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d81a8470 con 0x7fc5d8108710 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.984+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0005a60 con 0x7fc5d8108710 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.985+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d81a8930 con 0x7fc5d8108710 2024-05-20T17:32:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.986+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d8103d70 con 0x7fc5d8108710 2024-05-20T17:32:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.988+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc5d001a020 con 0x7fc5d8108710 2024-05-20T17:32:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.988+0000 7fc5ceffd700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 0x7fc5c40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.988+0000 7fc5dddce700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 0x7fc5c40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.989+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc5d00cef40 con 0x7fc5d8108710 2024-05-20T17:32:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.989+0000 7fc5dddce700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 0x7fc5c40a51c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5d806ab30 tx=0x7fc5d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:29.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:29.992+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc5d0010070 con 0x7fc5d8108710 2024-05-20T17:32:30.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:29 smithi172 ceph-mon[36511]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:30.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.200+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc5d802dc60 con 0x7fc5d8108710 2024-05-20T17:32:30.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.200+0000 7fc5ceffd700 1 -- 172.21.15.135:0/640743175 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc5d009bd20 con 0x7fc5d8108710 2024-05-20T17:32:30.202 INFO:teuthology.orchestra.run.smithi135.stdout:141733920832 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 msgr2=0x7fc5c40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 0x7fc5c40a51c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5d806ab30 tx=0x7fc5d4009260 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 msgr2=0x7fc5d8103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0007ee0 tx=0x7fc5d000d3b0 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 shutdown_connections 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5d8101940 0x7fc5d8102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc5c40a2cb0 0x7fc5c40a51c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d8108710 0x7fc5d8103310 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 --2- 172.21.15.135:0/640743175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d8107dc0 0x7fc5d8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.202+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 >> 172.21.15.135:0/640743175 conn(0x7fc5d80fd360 msgr2=0x7fc5d8105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:30.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.203+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 shutdown_connections 2024-05-20T17:32:30.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:30.203+0000 7fc5e0032700 1 -- 172.21.15.135:0/640743175 wait complete. 2024-05-20T17:32:30.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:29 smithi160 ceph-mon[36261]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:30.977 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920826 got 141733920832 for osd.4 2024-05-20T17:32:30.977 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:31.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:30 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/640743175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:32:31.149 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:30 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/640743175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:32:31.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:30 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/640743175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 -- 172.21.15.135:0/3428525684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081086e0 msgr2=0x7f3408110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 --2- 172.21.15.135:0/3428525684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081086e0 0x7f3408110040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f340000b0d0 tx=0x7f340000b3e0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 -- 172.21.15.135:0/3428525684 shutdown_connections 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 --2- 172.21.15.135:0/3428525684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f3408103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 --2- 172.21.15.135:0/3428525684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081086e0 0x7f3408110040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 --2- 172.21.15.135:0/3428525684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3408107d90 0x7f34081081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 -- 172.21.15.135:0/3428525684 >> 172.21.15.135:0/3428525684 conn(0x7f34080fecf0 msgr2=0x7f3408101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 -- 172.21.15.135:0/3428525684 shutdown_connections 2024-05-20T17:32:31.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.267+0000 7f341068c700 1 -- 172.21.15.135:0/3428525684 wait complete. 2024-05-20T17:32:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.268+0000 7f341068c700 1 Processor -- start 2024-05-20T17:32:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.268+0000 7f341068c700 1 -- start start 2024-05-20T17:32:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f340819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34081086e0 0x7f3408199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3408113480 con 0x7f3408107d90 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3408113300 con 0x7f3408103460 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f341068c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3408113600 con 0x7f34081086e0 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340e428700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f340819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53036/0 (socket says 172.21.15.135:53036) 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 -- 172.21.15.135:0/3343016699 learned_addr learned my addr 172.21.15.135:0/3343016699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340ec29700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34081086e0 0x7f3408199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 -- 172.21.15.135:0/3343016699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34081086e0 msgr2=0x7f3408199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34081086e0 0x7f3408199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 -- 172.21.15.135:0/3343016699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 msgr2=0x7f340819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f340819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340dc27700 1 -- 172.21.15.135:0/3343016699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340819a1e0 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.269+0000 7f340e428700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f340819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f340dc27700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f33f800d950 tx=0x7f33f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8017070 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8005020 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340819a4d0 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8009b20 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.270+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340819a900 con 0x7f3408107d90 2024-05-20T17:32:31.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.272+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408050170 con 0x7f3408107d90 2024-05-20T17:32:31.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.274+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f33f80051d0 con 0x7f3408107d90 2024-05-20T17:32:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.275+0000 7f33ff7fe700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 0x7f33f40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.275+0000 7f340e428700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 0x7f33f40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.275+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f33f80cee30 con 0x7f3408107d90 2024-05-20T17:32:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.275+0000 7f340e428700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 0x7f33f40a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f340819ac40 tx=0x7f340400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.279+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f33f809bc10 con 0x7f3408107d90 2024-05-20T17:32:31.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.528+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f340802dc60 con 0x7f3408107d90 2024-05-20T17:32:31.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.528+0000 7f33ff7fe700 1 -- 172.21.15.135:0/3343016699 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f33f809b510 con 0x7f3408107d90 2024-05-20T17:32:31.530 INFO:teuthology.orchestra.run.smithi135.stdout:107374182470 2024-05-20T17:32:31.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 msgr2=0x7f33f40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:31.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 0x7f33f40a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f340819ac40 tx=0x7f340400b410 comp rx=0 tx=0).stop 2024-05-20T17:32:31.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 msgr2=0x7f340819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f33f800d950 tx=0x7f33f800dc60 comp rx=0 tx=0).stop 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 shutdown_connections 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3408103460 0x7f340819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f33f40a2cb0 0x7f33f40a51c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34081086e0 0x7f3408199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 --2- 172.21.15.135:0/3343016699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3408107d90 0x7f340819fe20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:31.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.530+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 >> 172.21.15.135:0/3343016699 conn(0x7f34080fecf0 msgr2=0x7f3408107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:31.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.531+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 shutdown_connections 2024-05-20T17:32:31.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:31.531+0000 7f341068c700 1 -- 172.21.15.135:0/3343016699 wait complete. 2024-05-20T17:32:32.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:31 smithi172 ceph-mon[36511]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:32.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:31 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:31 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:31 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3343016699' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:32:32.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:31 smithi135 ceph-mon[32027]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:32.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:31 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:31 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3343016699' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:32:32.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182464 got 107374182470 for osd.3 2024-05-20T17:32:32.227 DEBUG:teuthology.parallel:result is None 2024-05-20T17:32:32.227 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-20T17:32:32.227 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T17:32:32.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:31 smithi160 ceph-mon[36261]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:32.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:31 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:31 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:32.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:31 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3343016699' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:32:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:32.852 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:32:32.853 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:32:32.853 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:32 smithi135 ceph-mon[32027]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:33.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:32:33.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:32:33.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:32 smithi172 ceph-mon[36511]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:32:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:32:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:32 smithi160 ceph-mon[36261]: from='mgr.14152 172.21.15.135:0/1665000367' entity='mgr.x' 2024-05-20T17:32:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:33 smithi135 ceph-mon[32027]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:34.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:33 smithi172 ceph-mon[36511]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:34.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:33 smithi160 ceph-mon[36261]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 -- 172.21.15.135:0/931490240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 msgr2=0x7f3660107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 --2- 172.21.15.135:0/931490240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f3660107c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3650009990 tx=0x7f3650009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 -- 172.21.15.135:0/931490240 shutdown_connections 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 --2- 172.21.15.135:0/931490240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660102190 0x7f366010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 --2- 172.21.15.135:0/931490240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f3660107c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 --2- 172.21.15.135:0/931490240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660101840 0x7f3660101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 -- 172.21.15.135:0/931490240 >> 172.21.15.135:0/931490240 conn(0x7f36600fd3a0 msgr2=0x7f36600ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 -- 172.21.15.135:0/931490240 shutdown_connections 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.271+0000 7f366573f700 1 -- 172.21.15.135:0/931490240 wait complete. 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 Processor -- start 2024-05-20T17:32:34.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 -- start start 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 0x7f366019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660102190 0x7f366019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111ae0 con 0x7f3660107870 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111960 con 0x7f3660101840 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f366573f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111c60 con 0x7f3660102190 2024-05-20T17:32:34.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53056/0 (socket says 172.21.15.135:53056) 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 -- 172.21.15.135:0/297860748 learned_addr learned my addr 172.21.15.135:0/297860748 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365effd700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 0x7f366019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 -- 172.21.15.135:0/297860748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660102190 msgr2=0x7f366019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660102190 0x7f366019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 -- 172.21.15.135:0/297860748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 msgr2=0x7f366019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 0x7f366019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 -- 172.21.15.135:0/297860748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366019eb90 con 0x7f3660107870 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365effd700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 0x7f366019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.272+0000 7f365f7fe700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3658007ee0 tx=0x7f365800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.273+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365800ddd0 con 0x7f3660107870 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.273+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3658004020 con 0x7f3660107870 2024-05-20T17:32:34.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.273+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366019ee80 con 0x7f3660107870 2024-05-20T17:32:34.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.273+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658015660 con 0x7f3660107870 2024-05-20T17:32:34.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.273+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366019f370 con 0x7f3660107870 2024-05-20T17:32:34.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.274+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3660050170 con 0x7f3660107870 2024-05-20T17:32:34.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.275+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f36580041d0 con 0x7f3660107870 2024-05-20T17:32:34.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.276+0000 7f365cff9700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 0x7f364c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:34.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.276+0000 7f365effd700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 0x7f364c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:34.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.276+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f36580cf460 con 0x7f3660107870 2024-05-20T17:32:34.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.276+0000 7f365effd700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 0x7f364c0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3650006010 tx=0x7f365001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:34.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.280+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3658010070 con 0x7f3660107870 2024-05-20T17:32:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.470+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36600fe4b0 con 0x7f364c0a2cb0 2024-05-20T17:32:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.478+0000 7f365cff9700 1 -- 172.21.15.135:0/297860748 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259008 (secure 0 0 0) 0x7f36600fe4b0 con 0x7f364c0a2cb0 2024-05-20T17:32:34.484 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 msgr2=0x7f364c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 0x7f364c0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3650006010 tx=0x7f365001a040 comp rx=0 tx=0).stop 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 msgr2=0x7f366019e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3658007ee0 tx=0x7f365800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 shutdown_connections 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3660101840 0x7f366019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f364c0a2cb0 0x7f364c0a51c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3660107870 0x7f366019e5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.480+0000 7f366573f700 1 --2- 172.21.15.135:0/297860748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660102190 0x7f366019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.481+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 >> 172.21.15.135:0/297860748 conn(0x7f36600fd3a0 msgr2=0x7f36600fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.481+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 shutdown_connections 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:34.481+0000 7f366573f700 1 -- 172.21.15.135:0/297860748 wait complete. 2024-05-20T17:32:34.487 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:32:35.203 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-05-20T17:32:32.730777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656040,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":597,"num_read_kb":421,"num_write":340,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1183030,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348312,"kb_used_data":11556,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593512,"statfs":{"total":1151940427776,"available":1151583756288,"internally_reserved":0,"allocated":11833344,"data_stored":7437780,"data_compressed":182382,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003578"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728740+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:32:07.728740+0000","last_peered":"2024-05-20T17:32:07.728740+0000","last_clean":"2024-05-20T17:32:07.728740+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:32:07.728740+0000","last_undegraded":"2024-05-20T17:32:07.728740+0000","last_fullsized":"2024-05-20T17:32:07.728740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726134+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:32:07.726134+0000","last_peered":"2024-05-20T17:32:07.726134+0000","last_clean":"2024-05-20T17:32:07.726134+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:32:07.726134+0000","last_undegraded":"2024-05-20T17:32:07.726134+0000","last_fullsized":"2024-05-20T17:32:07.726134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726004+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:32:07.726004+0000","last_peered":"2024-05-20T17:32:07.726004+0000","last_clean":"2024-05-20T17:32:07.726004+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:32:07.726004+0000","last_undegraded":"2024-05-20T17:32:07.726004+0000","last_fullsized":"2024-05-20T17:32:07.726004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725863+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:32:07.725863+0000","last_peered":"2024-05-20T17:32:07.725863+0000","last_clean":"2024-05-20T17:32:07.725863+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:32:07.725863+0000","last_undegraded":"2024-05-20T17:32:07.725863+0000","last_fullsized":"2024-05-20T17:32:07.725863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729124+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:32:07.729124+0000","last_peered":"2024-05-20T17:32:07.729124+0000","last_clean":"2024-05-20T17:32:07.729124+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:32:07.729124+0000","last_undegraded":"2024-05-20T17:32:07.729124+0000","last_fullsized":"2024-05-20T17:32:07.729124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:42.560376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730571+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:32:07.730571+0000","last_peered":"2024-05-20T17:32:07.730571+0000","last_clean":"2024-05-20T17:32:07.730571+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:32:07.730571+0000","last_undegraded":"2024-05-20T17:32:07.730571+0000","last_fullsized":"2024-05-20T17:32:07.730571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732758+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:32:07.732758+0000","last_peered":"2024-05-20T17:32:07.732758+0000","last_clean":"2024-05-20T17:32:07.732758+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:32:07.732758+0000","last_undegraded":"2024-05-20T17:32:07.732758+0000","last_fullsized":"2024-05-20T17:32:07.732758+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:04.966944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733005+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:32:07.733005+0000","last_peered":"2024-05-20T17:32:07.733005+0000","last_clean":"2024-05-20T17:32:07.733005+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:32:07.733005+0000","last_undegraded":"2024-05-20T17:32:07.733005+0000","last_fullsized":"2024-05-20T17:32:07.733005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908128+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:32:07.908128+0000","last_peered":"2024-05-20T17:32:07.908128+0000","last_clean":"2024-05-20T17:32:07.908128+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:32:07.908128+0000","last_undegraded":"2024-05-20T17:32:07.908128+0000","last_fullsized":"2024-05-20T17:32:07.908128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.731080+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:32:07.731080+0000","last_peered":"2024-05-20T17:32:07.731080+0000","last_clean":"2024-05-20T17:32:07.731080+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:32:07.731080+0000","last_undegraded":"2024-05-20T17:32:07.731080+0000","last_fullsized":"2024-05-20T17:32:07.731080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733472+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:32:07.733472+0000","last_peered":"2024-05-20T17:32:07.733472+0000","last_clean":"2024-05-20T17:32:07.733472+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:32:07.733472+0000","last_undegraded":"2024-05-20T17:32:07.733472+0000","last_fullsized":"2024-05-20T17:32:07.733472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:16.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725693+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:32:07.725693+0000","last_peered":"2024-05-20T17:32:07.725693+0000","last_clean":"2024-05-20T17:32:07.725693+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:32:07.725693+0000","last_undegraded":"2024-05-20T17:32:07.725693+0000","last_fullsized":"2024-05-20T17:32:07.725693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733290+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:32:07.733290+0000","last_peered":"2024-05-20T17:32:07.733290+0000","last_clean":"2024-05-20T17:32:07.733290+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:32:07.733290+0000","last_undegraded":"2024-05-20T17:32:07.733290+0000","last_fullsized":"2024-05-20T17:32:07.733290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725750+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:32:07.725750+0000","last_peered":"2024-05-20T17:32:07.725750+0000","last_clean":"2024-05-20T17:32:07.725750+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:32:07.725750+0000","last_undegraded":"2024-05-20T17:32:07.725750+0000","last_fullsized":"2024-05-20T17:32:07.725750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725855+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:32:07.725855+0000","last_peered":"2024-05-20T17:32:07.725855+0000","last_clean":"2024-05-20T17:32:07.725855+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:32:07.725855+0000","last_undegraded":"2024-05-20T17:32:07.725855+0000","last_fullsized":"2024-05-20T17:32:07.725855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907467+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:32:07.907467+0000","last_peered":"2024-05-20T17:32:07.907467+0000","last_clean":"2024-05-20T17:32:07.907467+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:32:07.907467+0000","last_undegraded":"2024-05-20T17:32:07.907467+0000","last_fullsized":"2024-05-20T17:32:07.907467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728510+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:32:07.728510+0000","last_peered":"2024-05-20T17:32:07.728510+0000","last_clean":"2024-05-20T17:32:07.728510+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:32:07.728510+0000","last_undegraded":"2024-05-20T17:32:07.728510+0000","last_fullsized":"2024-05-20T17:32:07.728510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730416+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:32:07.730416+0000","last_peered":"2024-05-20T17:32:07.730416+0000","last_clean":"2024-05-20T17:32:07.730416+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:32:07.730416+0000","last_undegraded":"2024-05-20T17:32:07.730416+0000","last_fullsized":"2024-05-20T17:32:07.730416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.731203+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:32:07.731203+0000","last_peered":"2024-05-20T17:32:07.731203+0000","last_clean":"2024-05-20T17:32:07.731203+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:32:07.731203+0000","last_undegraded":"2024-05-20T17:32:07.731203+0000","last_fullsized":"2024-05-20T17:32:07.731203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.744385+0000","last_change":"2024-05-20T17:32:07.744385+0000","last_active":"2024-05-20T17:32:07.744385+0000","last_peered":"2024-05-20T17:32:07.744385+0000","last_clean":"2024-05-20T17:32:07.744385+0000","last_became_active":"2024-05-20T17:32:07.734114+0000","last_became_peered":"2024-05-20T17:32:07.734114+0000","last_unstale":"2024-05-20T17:32:07.744385+0000","last_undegraded":"2024-05-20T17:32:07.744385+0000","last_fullsized":"2024-05-20T17:32:07.744385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:57.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733304+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:32:07.733304+0000","last_peered":"2024-05-20T17:32:07.733304+0000","last_clean":"2024-05-20T17:32:07.733304+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:32:07.733304+0000","last_undegraded":"2024-05-20T17:32:07.733304+0000","last_fullsized":"2024-05-20T17:32:07.733304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733602+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:32:07.733602+0000","last_peered":"2024-05-20T17:32:07.733602+0000","last_clean":"2024-05-20T17:32:07.733602+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:32:07.733602+0000","last_undegraded":"2024-05-20T17:32:07.733602+0000","last_fullsized":"2024-05-20T17:32:07.733602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726280+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:32:07.726280+0000","last_peered":"2024-05-20T17:32:07.726280+0000","last_clean":"2024-05-20T17:32:07.726280+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:32:07.726280+0000","last_undegraded":"2024-05-20T17:32:07.726280+0000","last_fullsized":"2024-05-20T17:32:07.726280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.742081+0000","last_change":"2024-05-20T17:32:07.741590+0000","last_active":"2024-05-20T17:32:07.742081+0000","last_peered":"2024-05-20T17:32:07.742081+0000","last_clean":"2024-05-20T17:32:07.742081+0000","last_became_active":"2024-05-20T17:32:07.736058+0000","last_became_peered":"2024-05-20T17:32:07.736058+0000","last_unstale":"2024-05-20T17:32:07.742081+0000","last_undegraded":"2024-05-20T17:32:07.742081+0000","last_fullsized":"2024-05-20T17:32:07.742081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:11.041568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907712+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:32:07.907712+0000","last_peered":"2024-05-20T17:32:07.907712+0000","last_clean":"2024-05-20T17:32:07.907712+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:32:07.907712+0000","last_undegraded":"2024-05-20T17:32:07.907712+0000","last_fullsized":"2024-05-20T17:32:07.907712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728608+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:32:07.728608+0000","last_peered":"2024-05-20T17:32:07.728608+0000","last_clean":"2024-05-20T17:32:07.728608+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:32:07.728608+0000","last_undegraded":"2024-05-20T17:32:07.728608+0000","last_fullsized":"2024-05-20T17:32:07.728608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908641+0000","last_change":"2024-05-20T17:32:07.908641+0000","last_active":"2024-05-20T17:32:07.908641+0000","last_peered":"2024-05-20T17:32:07.908641+0000","last_clean":"2024-05-20T17:32:07.908641+0000","last_became_active":"2024-05-20T17:32:07.908317+0000","last_became_peered":"2024-05-20T17:32:07.908317+0000","last_unstale":"2024-05-20T17:32:07.908641+0000","last_undegraded":"2024-05-20T17:32:07.908641+0000","last_fullsized":"2024-05-20T17:32:07.908641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:40.232683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:30.942628+0000","last_change":"2024-05-20T17:32:07.913292+0000","last_active":"2024-05-20T17:32:30.942628+0000","last_peered":"2024-05-20T17:32:30.942628+0000","last_clean":"2024-05-20T17:32:30.942628+0000","last_became_active":"2024-05-20T17:32:07.908905+0000","last_became_peered":"2024-05-20T17:32:07.908905+0000","last_unstale":"2024-05-20T17:32:30.942628+0000","last_undegraded":"2024-05-20T17:32:30.942628+0000","last_fullsized":"2024-05-20T17:32:30.942628+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:15.236246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728990+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:32:07.728990+0000","last_peered":"2024-05-20T17:32:07.728990+0000","last_clean":"2024-05-20T17:32:07.728990+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:32:07.728990+0000","last_undegraded":"2024-05-20T17:32:07.728990+0000","last_fullsized":"2024-05-20T17:32:07.728990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:00.930437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730628+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:32:07.730628+0000","last_peered":"2024-05-20T17:32:07.730628+0000","last_clean":"2024-05-20T17:32:07.730628+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:32:07.730628+0000","last_undegraded":"2024-05-20T17:32:07.730628+0000","last_fullsized":"2024-05-20T17:32:07.730628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730655+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:32:07.730655+0000","last_peered":"2024-05-20T17:32:07.730655+0000","last_clean":"2024-05-20T17:32:07.730655+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:32:07.730655+0000","last_undegraded":"2024-05-20T17:32:07.730655+0000","last_fullsized":"2024-05-20T17:32:07.730655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733372+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:32:07.733372+0000","last_peered":"2024-05-20T17:32:07.733372+0000","last_clean":"2024-05-20T17:32:07.733372+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:32:07.733372+0000","last_undegraded":"2024-05-20T17:32:07.733372+0000","last_fullsized":"2024-05-20T17:32:07.733372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732880+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:32:07.732880+0000","last_peered":"2024-05-20T17:32:07.732880+0000","last_clean":"2024-05-20T17:32:07.732880+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:32:07.732880+0000","last_undegraded":"2024-05-20T17:32:07.732880+0000","last_fullsized":"2024-05-20T17:32:07.732880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728292+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:32:07.728292+0000","last_peered":"2024-05-20T17:32:07.728292+0000","last_clean":"2024-05-20T17:32:07.728292+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:32:07.728292+0000","last_undegraded":"2024-05-20T17:32:07.728292+0000","last_fullsized":"2024-05-20T17:32:07.728292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730315+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:32:07.730315+0000","last_peered":"2024-05-20T17:32:07.730315+0000","last_clean":"2024-05-20T17:32:07.730315+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:32:07.730315+0000","last_undegraded":"2024-05-20T17:32:07.730315+0000","last_fullsized":"2024-05-20T17:32:07.730315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:30.941982+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:32:30.941982+0000","last_peered":"2024-05-20T17:32:30.941982+0000","last_clean":"2024-05-20T17:32:30.941982+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:32:30.941982+0000","last_undegraded":"2024-05-20T17:32:30.941982+0000","last_fullsized":"2024-05-20T17:32:30.941982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908274+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:32:07.908274+0000","last_peered":"2024-05-20T17:32:07.908274+0000","last_clean":"2024-05-20T17:32:07.908274+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:32:07.908274+0000","last_undegraded":"2024-05-20T17:32:07.908274+0000","last_fullsized":"2024-05-20T17:32:07.908274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733476+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:32:07.733476+0000","last_peered":"2024-05-20T17:32:07.733476+0000","last_clean":"2024-05-20T17:32:07.733476+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:32:07.733476+0000","last_undegraded":"2024-05-20T17:32:07.733476+0000","last_fullsized":"2024-05-20T17:32:07.733476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.735120+0000","last_change":"2024-05-20T17:32:07.735120+0000","last_active":"2024-05-20T17:32:07.735120+0000","last_peered":"2024-05-20T17:32:07.735120+0000","last_clean":"2024-05-20T17:32:07.735120+0000","last_became_active":"2024-05-20T17:32:07.734652+0000","last_became_peered":"2024-05-20T17:32:07.734652+0000","last_unstale":"2024-05-20T17:32:07.735120+0000","last_undegraded":"2024-05-20T17:32:07.735120+0000","last_fullsized":"2024-05-20T17:32:07.735120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:28.611313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733109+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:32:07.733109+0000","last_peered":"2024-05-20T17:32:07.733109+0000","last_clean":"2024-05-20T17:32:07.733109+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:32:07.733109+0000","last_undegraded":"2024-05-20T17:32:07.733109+0000","last_fullsized":"2024-05-20T17:32:07.733109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908098+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:32:07.908098+0000","last_peered":"2024-05-20T17:32:07.908098+0000","last_clean":"2024-05-20T17:32:07.908098+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:32:07.908098+0000","last_undegraded":"2024-05-20T17:32:07.908098+0000","last_fullsized":"2024-05-20T17:32:07.908098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'28","reported_seq":203,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:31.943617+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:32:31.943617+0000","last_peered":"2024-05-20T17:32:31.943617+0000","last_clean":"2024-05-20T17:32:31.943617+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:32:31.943617+0000","last_undegraded":"2024-05-20T17:32:31.943617+0000","last_fullsized":"2024-05-20T17:32:31.943617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":137,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729646+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:32:07.729646+0000","last_peered":"2024-05-20T17:32:07.729646+0000","last_clean":"2024-05-20T17:32:07.729646+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:32:07.729646+0000","last_undegraded":"2024-05-20T17:32:07.729646+0000","last_fullsized":"2024-05-20T17:32:07.729646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:10.914985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729413+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:32:07.729413+0000","last_peered":"2024-05-20T17:32:07.729413+0000","last_clean":"2024-05-20T17:32:07.729413+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:32:07.729413+0000","last_undegraded":"2024-05-20T17:32:07.729413+0000","last_fullsized":"2024-05-20T17:32:07.729413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733370+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:32:07.733370+0000","last_peered":"2024-05-20T17:32:07.733370+0000","last_clean":"2024-05-20T17:32:07.733370+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:32:07.733370+0000","last_undegraded":"2024-05-20T17:32:07.733370+0000","last_fullsized":"2024-05-20T17:32:07.733370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728376+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:32:07.728376+0000","last_peered":"2024-05-20T17:32:07.728376+0000","last_clean":"2024-05-20T17:32:07.728376+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:32:07.728376+0000","last_undegraded":"2024-05-20T17:32:07.728376+0000","last_fullsized":"2024-05-20T17:32:07.728376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733311+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:32:07.733311+0000","last_peered":"2024-05-20T17:32:07.733311+0000","last_clean":"2024-05-20T17:32:07.733311+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:32:07.733311+0000","last_undegraded":"2024-05-20T17:32:07.733311+0000","last_fullsized":"2024-05-20T17:32:07.733311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:28:49.912347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:27.150077+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:32:27.150077+0000","last_peered":"2024-05-20T17:32:27.150077+0000","last_clean":"2024-05-20T17:32:27.150077+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:32:27.150077+0000","last_undegraded":"2024-05-20T17:32:27.150077+0000","last_fullsized":"2024-05-20T17:32:27.150077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732864+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:32:07.732864+0000","last_peered":"2024-05-20T17:32:07.732864+0000","last_clean":"2024-05-20T17:32:07.732864+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:32:07.732864+0000","last_undegraded":"2024-05-20T17:32:07.732864+0000","last_fullsized":"2024-05-20T17:32:07.732864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:42:44.041243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728176+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:32:07.728176+0000","last_peered":"2024-05-20T17:32:07.728176+0000","last_clean":"2024-05-20T17:32:07.728176+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:32:07.728176+0000","last_undegraded":"2024-05-20T17:32:07.728176+0000","last_fullsized":"2024-05-20T17:32:07.728176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728990+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:32:07.728990+0000","last_peered":"2024-05-20T17:32:07.728990+0000","last_clean":"2024-05-20T17:32:07.728990+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:32:07.728990+0000","last_undegraded":"2024-05-20T17:32:07.728990+0000","last_fullsized":"2024-05-20T17:32:07.728990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729494+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:32:07.729494+0000","last_peered":"2024-05-20T17:32:07.729494+0000","last_clean":"2024-05-20T17:32:07.729494+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:32:07.729494+0000","last_undegraded":"2024-05-20T17:32:07.729494+0000","last_fullsized":"2024-05-20T17:32:07.729494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733408+0000","last_change":"2024-05-20T17:32:07.733408+0000","last_active":"2024-05-20T17:32:07.733408+0000","last_peered":"2024-05-20T17:32:07.733408+0000","last_clean":"2024-05-20T17:32:07.733408+0000","last_became_active":"2024-05-20T17:32:07.732989+0000","last_became_peered":"2024-05-20T17:32:07.732989+0000","last_unstale":"2024-05-20T17:32:07.733408+0000","last_undegraded":"2024-05-20T17:32:07.733408+0000","last_fullsized":"2024-05-20T17:32:07.733408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:48.103948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730416+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:32:07.730416+0000","last_peered":"2024-05-20T17:32:07.730416+0000","last_clean":"2024-05-20T17:32:07.730416+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:32:07.730416+0000","last_undegraded":"2024-05-20T17:32:07.730416+0000","last_fullsized":"2024-05-20T17:32:07.730416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.738327+0000","last_change":"2024-05-20T17:32:07.738327+0000","last_active":"2024-05-20T17:32:07.738327+0000","last_peered":"2024-05-20T17:32:07.738327+0000","last_clean":"2024-05-20T17:32:07.738327+0000","last_became_active":"2024-05-20T17:32:07.734897+0000","last_became_peered":"2024-05-20T17:32:07.734897+0000","last_unstale":"2024-05-20T17:32:07.738327+0000","last_undegraded":"2024-05-20T17:32:07.738327+0000","last_fullsized":"2024-05-20T17:32:07.738327+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.308883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733053+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:32:07.733053+0000","last_peered":"2024-05-20T17:32:07.733053+0000","last_clean":"2024-05-20T17:32:07.733053+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:32:07.733053+0000","last_undegraded":"2024-05-20T17:32:07.733053+0000","last_fullsized":"2024-05-20T17:32:07.733053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730663+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:32:07.730663+0000","last_peered":"2024-05-20T17:32:07.730663+0000","last_clean":"2024-05-20T17:32:07.730663+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:32:07.730663+0000","last_undegraded":"2024-05-20T17:32:07.730663+0000","last_fullsized":"2024-05-20T17:32:07.730663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729446+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:32:07.729446+0000","last_peered":"2024-05-20T17:32:07.729446+0000","last_clean":"2024-05-20T17:32:07.729446+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:32:07.729446+0000","last_undegraded":"2024-05-20T17:32:07.729446+0000","last_fullsized":"2024-05-20T17:32:07.729446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:28.150859+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:32:28.150859+0000","last_peered":"2024-05-20T17:32:28.150859+0000","last_clean":"2024-05-20T17:32:28.150859+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:32:28.150859+0000","last_undegraded":"2024-05-20T17:32:28.150859+0000","last_fullsized":"2024-05-20T17:32:28.150859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.734002+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:32:07.734002+0000","last_peered":"2024-05-20T17:32:07.734002+0000","last_clean":"2024-05-20T17:32:07.734002+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:32:07.734002+0000","last_undegraded":"2024-05-20T17:32:07.734002+0000","last_fullsized":"2024-05-20T17:32:07.734002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725704+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:32:07.725704+0000","last_peered":"2024-05-20T17:32:07.725704+0000","last_clean":"2024-05-20T17:32:07.725704+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:32:07.725704+0000","last_undegraded":"2024-05-20T17:32:07.725704+0000","last_fullsized":"2024-05-20T17:32:07.725704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733045+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:32:07.733045+0000","last_peered":"2024-05-20T17:32:07.733045+0000","last_clean":"2024-05-20T17:32:07.733045+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:32:07.733045+0000","last_undegraded":"2024-05-20T17:32:07.733045+0000","last_fullsized":"2024-05-20T17:32:07.733045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732922+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:32:07.732922+0000","last_peered":"2024-05-20T17:32:07.732922+0000","last_clean":"2024-05-20T17:32:07.732922+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:32:07.732922+0000","last_undegraded":"2024-05-20T17:32:07.732922+0000","last_fullsized":"2024-05-20T17:32:07.732922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733224+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:32:07.733224+0000","last_peered":"2024-05-20T17:32:07.733224+0000","last_clean":"2024-05-20T17:32:07.733224+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:32:07.733224+0000","last_undegraded":"2024-05-20T17:32:07.733224+0000","last_fullsized":"2024-05-20T17:32:07.733224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729905+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:32:07.729905+0000","last_peered":"2024-05-20T17:32:07.729905+0000","last_clean":"2024-05-20T17:32:07.729905+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:32:07.729905+0000","last_undegraded":"2024-05-20T17:32:07.729905+0000","last_fullsized":"2024-05-20T17:32:07.729905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733499+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:32:07.733499+0000","last_peered":"2024-05-20T17:32:07.733499+0000","last_clean":"2024-05-20T17:32:07.733499+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:32:07.733499+0000","last_undegraded":"2024-05-20T17:32:07.733499+0000","last_fullsized":"2024-05-20T17:32:07.733499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'8","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730487+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:32:07.730487+0000","last_peered":"2024-05-20T17:32:07.730487+0000","last_clean":"2024-05-20T17:32:07.730487+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:32:07.730487+0000","last_undegraded":"2024-05-20T17:32:07.730487+0000","last_fullsized":"2024-05-20T17:32:07.730487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.734163+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:32:07.734163+0000","last_peered":"2024-05-20T17:32:07.734163+0000","last_clean":"2024-05-20T17:32:07.734163+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:32:07.734163+0000","last_undegraded":"2024-05-20T17:32:07.734163+0000","last_fullsized":"2024-05-20T17:32:07.734163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726093+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:32:07.726093+0000","last_peered":"2024-05-20T17:32:07.726093+0000","last_clean":"2024-05-20T17:32:07.726093+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:32:07.726093+0000","last_undegraded":"2024-05-20T17:32:07.726093+0000","last_fullsized":"2024-05-20T17:32:07.726093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726214+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:32:07.726214+0000","last_peered":"2024-05-20T17:32:07.726214+0000","last_clean":"2024-05-20T17:32:07.726214+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:32:07.726214+0000","last_undegraded":"2024-05-20T17:32:07.726214+0000","last_fullsized":"2024-05-20T17:32:07.726214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907621+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:32:07.907621+0000","last_peered":"2024-05-20T17:32:07.907621+0000","last_clean":"2024-05-20T17:32:07.907621+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:32:07.907621+0000","last_undegraded":"2024-05-20T17:32:07.907621+0000","last_fullsized":"2024-05-20T17:32:07.907621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728572+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:32:07.728572+0000","last_peered":"2024-05-20T17:32:07.728572+0000","last_clean":"2024-05-20T17:32:07.728572+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:32:07.728572+0000","last_undegraded":"2024-05-20T17:32:07.728572+0000","last_fullsized":"2024-05-20T17:32:07.728572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:06.122038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733716+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:32:07.733716+0000","last_peered":"2024-05-20T17:32:07.733716+0000","last_clean":"2024-05-20T17:32:07.733716+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:32:07.733716+0000","last_undegraded":"2024-05-20T17:32:07.733716+0000","last_fullsized":"2024-05-20T17:32:07.733716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728176+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:32:07.728176+0000","last_peered":"2024-05-20T17:32:07.728176+0000","last_clean":"2024-05-20T17:32:07.728176+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:32:07.728176+0000","last_undegraded":"2024-05-20T17:32:07.728176+0000","last_fullsized":"2024-05-20T17:32:07.728176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729037+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:32:07.729037+0000","last_peered":"2024-05-20T17:32:07.729037+0000","last_clean":"2024-05-20T17:32:07.729037+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:32:07.729037+0000","last_undegraded":"2024-05-20T17:32:07.729037+0000","last_fullsized":"2024-05-20T17:32:07.729037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733103+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:32:07.733103+0000","last_peered":"2024-05-20T17:32:07.733103+0000","last_clean":"2024-05-20T17:32:07.733103+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:32:07.733103+0000","last_undegraded":"2024-05-20T17:32:07.733103+0000","last_fullsized":"2024-05-20T17:32:07.733103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729266+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:32:07.729266+0000","last_peered":"2024-05-20T17:32:07.729266+0000","last_clean":"2024-05-20T17:32:07.729266+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:32:07.729266+0000","last_undegraded":"2024-05-20T17:32:07.729266+0000","last_fullsized":"2024-05-20T17:32:07.729266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733225+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:32:07.733225+0000","last_peered":"2024-05-20T17:32:07.733225+0000","last_clean":"2024-05-20T17:32:07.733225+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:32:07.733225+0000","last_undegraded":"2024-05-20T17:32:07.733225+0000","last_fullsized":"2024-05-20T17:32:07.733225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:43.253987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.739105+0000","last_change":"2024-05-20T17:32:07.738590+0000","last_active":"2024-05-20T17:32:07.739105+0000","last_peered":"2024-05-20T17:32:07.739105+0000","last_clean":"2024-05-20T17:32:07.739105+0000","last_became_active":"2024-05-20T17:32:07.731009+0000","last_became_peered":"2024-05-20T17:32:07.731009+0000","last_unstale":"2024-05-20T17:32:07.739105+0000","last_undegraded":"2024-05-20T17:32:07.739105+0000","last_fullsized":"2024-05-20T17:32:07.739105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:25.383889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733661+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:32:07.733661+0000","last_peered":"2024-05-20T17:32:07.733661+0000","last_clean":"2024-05-20T17:32:07.733661+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:32:07.733661+0000","last_undegraded":"2024-05-20T17:32:07.733661+0000","last_fullsized":"2024-05-20T17:32:07.733661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:12:10.454896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732931+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:32:07.732931+0000","last_peered":"2024-05-20T17:32:07.732931+0000","last_clean":"2024-05-20T17:32:07.732931+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:32:07.732931+0000","last_undegraded":"2024-05-20T17:32:07.732931+0000","last_fullsized":"2024-05-20T17:32:07.732931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733184+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:32:07.733184+0000","last_peered":"2024-05-20T17:32:07.733184+0000","last_clean":"2024-05-20T17:32:07.733184+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:32:07.733184+0000","last_undegraded":"2024-05-20T17:32:07.733184+0000","last_fullsized":"2024-05-20T17:32:07.733184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:06.119241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733348+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:32:07.733348+0000","last_peered":"2024-05-20T17:32:07.733348+0000","last_clean":"2024-05-20T17:32:07.733348+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:32:07.733348+0000","last_undegraded":"2024-05-20T17:32:07.733348+0000","last_fullsized":"2024-05-20T17:32:07.733348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733537+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:32:07.733537+0000","last_peered":"2024-05-20T17:32:07.733537+0000","last_clean":"2024-05-20T17:32:07.733537+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:32:07.733537+0000","last_undegraded":"2024-05-20T17:32:07.733537+0000","last_fullsized":"2024-05-20T17:32:07.733537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:49.546477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728313+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:32:07.728313+0000","last_peered":"2024-05-20T17:32:07.728313+0000","last_clean":"2024-05-20T17:32:07.728313+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:32:07.728313+0000","last_undegraded":"2024-05-20T17:32:07.728313+0000","last_fullsized":"2024-05-20T17:32:07.728313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.736717+0000","last_change":"2024-05-20T17:32:07.736717+0000","last_active":"2024-05-20T17:32:07.736717+0000","last_peered":"2024-05-20T17:32:07.736717+0000","last_clean":"2024-05-20T17:32:07.736717+0000","last_became_active":"2024-05-20T17:32:07.736321+0000","last_became_peered":"2024-05-20T17:32:07.736321+0000","last_unstale":"2024-05-20T17:32:07.736717+0000","last_undegraded":"2024-05-20T17:32:07.736717+0000","last_fullsized":"2024-05-20T17:32:07.736717+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:59:32.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728885+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:32:07.728885+0000","last_peered":"2024-05-20T17:32:07.728885+0000","last_clean":"2024-05-20T17:32:07.728885+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:32:07.728885+0000","last_undegraded":"2024-05-20T17:32:07.728885+0000","last_fullsized":"2024-05-20T17:32:07.728885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725868+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:32:07.725868+0000","last_peered":"2024-05-20T17:32:07.725868+0000","last_clean":"2024-05-20T17:32:07.725868+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:32:07.725868+0000","last_undegraded":"2024-05-20T17:32:07.725868+0000","last_fullsized":"2024-05-20T17:32:07.725868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733604+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:32:07.733604+0000","last_peered":"2024-05-20T17:32:07.733604+0000","last_clean":"2024-05-20T17:32:07.733604+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:32:07.733604+0000","last_undegraded":"2024-05-20T17:32:07.733604+0000","last_fullsized":"2024-05-20T17:32:07.733604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.735868+0000","last_change":"2024-05-20T17:32:07.735868+0000","last_active":"2024-05-20T17:32:07.735868+0000","last_peered":"2024-05-20T17:32:07.735868+0000","last_clean":"2024-05-20T17:32:07.735868+0000","last_became_active":"2024-05-20T17:32:07.735314+0000","last_became_peered":"2024-05-20T17:32:07.735314+0000","last_unstale":"2024-05-20T17:32:07.735868+0000","last_undegraded":"2024-05-20T17:32:07.735868+0000","last_fullsized":"2024-05-20T17:32:07.735868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:33:52.756227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730499+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:32:07.730499+0000","last_peered":"2024-05-20T17:32:07.730499+0000","last_clean":"2024-05-20T17:32:07.730499+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:32:07.730499+0000","last_undegraded":"2024-05-20T17:32:07.730499+0000","last_fullsized":"2024-05-20T17:32:07.730499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733952+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:32:07.733952+0000","last_peered":"2024-05-20T17:32:07.733952+0000","last_clean":"2024-05-20T17:32:07.733952+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:32:07.733952+0000","last_undegraded":"2024-05-20T17:32:07.733952+0000","last_fullsized":"2024-05-20T17:32:07.733952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728410+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:32:07.728410+0000","last_peered":"2024-05-20T17:32:07.728410+0000","last_clean":"2024-05-20T17:32:07.728410+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:32:07.728410+0000","last_undegraded":"2024-05-20T17:32:07.728410+0000","last_fullsized":"2024-05-20T17:32:07.728410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733611+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:32:07.733611+0000","last_peered":"2024-05-20T17:32:07.733611+0000","last_clean":"2024-05-20T17:32:07.733611+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:32:07.733611+0000","last_undegraded":"2024-05-20T17:32:07.733611+0000","last_fullsized":"2024-05-20T17:32:07.733611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907889+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:32:07.907889+0000","last_peered":"2024-05-20T17:32:07.907889+0000","last_clean":"2024-05-20T17:32:07.907889+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:32:07.907889+0000","last_undegraded":"2024-05-20T17:32:07.907889+0000","last_fullsized":"2024-05-20T17:32:07.907889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733732+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:32:07.733732+0000","last_peered":"2024-05-20T17:32:07.733732+0000","last_clean":"2024-05-20T17:32:07.733732+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:32:07.733732+0000","last_undegraded":"2024-05-20T17:32:07.733732+0000","last_fullsized":"2024-05-20T17:32:07.733732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728989+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:32:07.728989+0000","last_peered":"2024-05-20T17:32:07.728989+0000","last_clean":"2024-05-20T17:32:07.728989+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:32:07.728989+0000","last_undegraded":"2024-05-20T17:32:07.728989+0000","last_fullsized":"2024-05-20T17:32:07.728989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246618,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65438,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":461,"num_read_kb":302,"num_write":157,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2177,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":196314,"data_compressed":5622,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383709,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":456969,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1109305,"data_compressed":43379,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":456740,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456543,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":1048282,"data_compressed":41505,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":456012,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517864,"data_compressed":7679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":457283,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":516997,"data_compressed":7679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":456206,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":457422,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757308,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1048157,"data_compressed":41505,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62059,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61192,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63015,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:32:35.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T17:32:35.452 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:35.851 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:35 smithi135 ceph-mon[32027]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:35.851 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:35 smithi135 ceph-mon[32027]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:36.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:35 smithi172 ceph-mon[36511]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:36.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:35 smithi172 ceph-mon[36511]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:36.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:35 smithi160 ceph-mon[36261]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:36.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:35 smithi160 ceph-mon[36261]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 -- 172.21.15.135:0/1344129461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 msgr2=0x7f6004101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 --2- 172.21.15.135:0/1344129461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004101d70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40099c0 tx=0x7f5ff4009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 -- 172.21.15.135:0/1344129461 shutdown_connections 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 --2- 172.21.15.135:0/1344129461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60041086d0 0x7f6004110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 --2- 172.21.15.135:0/1344129461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004101d70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 --2- 172.21.15.135:0/1344129461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6004107d80 0x7f6004108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 -- 172.21.15.135:0/1344129461 >> 172.21.15.135:0/1344129461 conn(0x7f60040fd360 msgr2=0x7f60040ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 -- 172.21.15.135:0/1344129461 shutdown_connections 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 -- 172.21.15.135:0/1344129461 wait complete. 2024-05-20T17:32:37.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.213+0000 7f60098a2700 1 Processor -- start 2024-05-20T17:32:37.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 -- start start 2024-05-20T17:32:37.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:37.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6004107d80 0x7f600419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:37.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60041086d0 0x7f600419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:37.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6004113450 con 0x7f6004101960 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f60041132d0 con 0x7f6004107d80 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60098a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60041135d0 con 0x7f60041086d0 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f6002ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f6002ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53070/0 (socket says 172.21.15.135:53070) 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f6002ffd700 1 -- 172.21.15.135:0/1279349594 learned_addr learned my addr 172.21.15.135:0/1279349594 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.214+0000 7f60027fc700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6004107d80 0x7f600419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f60037fe700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60041086d0 0x7f600419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 -- 172.21.15.135:0/1279349594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60041086d0 msgr2=0x7f600419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60041086d0 0x7f600419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 -- 172.21.15.135:0/1279349594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6004107d80 msgr2=0x7f600419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6004107d80 0x7f600419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 -- 172.21.15.135:0/1279349594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600419ec10 con 0x7f6004101960 2024-05-20T17:32:37.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f6002ffd700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40059d0 tx=0x7f5ff400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4027070 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600419eea0 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff4003680 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.215+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60041a6820 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.216+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4031060 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.217+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff0005330 con 0x7f6004101960 2024-05-20T17:32:37.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.218+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ff402a070 con 0x7f6004101960 2024-05-20T17:32:37.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.219+0000 7f60088a0700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 0x7f5fec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:37.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.219+0000 7f60027fc700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 0x7f5fec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:37.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.219+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5ff40cfc90 con 0x7f6004101960 2024-05-20T17:32:37.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.219+0000 7f60027fc700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 0x7f5fec0a51c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f600406a9a0 tx=0x7f5ff800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:37.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.225+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5ff40d5020 con 0x7f6004101960 2024-05-20T17:32:37.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.417+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ff0000bc0 con 0x7f5fec0a2cb0 2024-05-20T17:32:37.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.424+0000 7f60088a0700 1 -- 172.21.15.135:0/1279349594 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259010 (secure 0 0 0) 0x7f5ff0000bc0 con 0x7f5fec0a2cb0 2024-05-20T17:32:37.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 msgr2=0x7f5fec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 0x7f5fec0a51c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f600406a9a0 tx=0x7f5ff800b410 comp rx=0 tx=0).stop 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 msgr2=0x7f6004199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40059d0 tx=0x7f5ff400fa00 comp rx=0 tx=0).stop 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 shutdown_connections 2024-05-20T17:32:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5fec0a2cb0 0x7f5fec0a51c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60041086d0 0x7f600419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6004101960 0x7f6004199d40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 --2- 172.21.15.135:0/1279349594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6004107d80 0x7f600419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.427+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 >> 172.21.15.135:0/1279349594 conn(0x7f60040fd360 msgr2=0x7f6004106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.428+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 shutdown_connections 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:37.428+0000 7f60098a2700 1 -- 172.21.15.135:0/1279349594 wait complete. 2024-05-20T17:32:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:32:38.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:37 smithi172 ceph-mon[36511]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:38.170 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:37 smithi135 ceph-mon[32027]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:38.200 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-05-20T17:32:36.731739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656040,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":607,"num_read_kb":426,"num_write":340,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1183030,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348312,"kb_used_data":11556,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593512,"statfs":{"total":1151940427776,"available":1151583756288,"internally_reserved":0,"allocated":11833344,"data_stored":7437780,"data_compressed":182382,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003340"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728740+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:32:07.728740+0000","last_peered":"2024-05-20T17:32:07.728740+0000","last_clean":"2024-05-20T17:32:07.728740+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:32:07.728740+0000","last_undegraded":"2024-05-20T17:32:07.728740+0000","last_fullsized":"2024-05-20T17:32:07.728740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726134+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:32:07.726134+0000","last_peered":"2024-05-20T17:32:07.726134+0000","last_clean":"2024-05-20T17:32:07.726134+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:32:07.726134+0000","last_undegraded":"2024-05-20T17:32:07.726134+0000","last_fullsized":"2024-05-20T17:32:07.726134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726004+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:32:07.726004+0000","last_peered":"2024-05-20T17:32:07.726004+0000","last_clean":"2024-05-20T17:32:07.726004+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:32:07.726004+0000","last_undegraded":"2024-05-20T17:32:07.726004+0000","last_fullsized":"2024-05-20T17:32:07.726004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725863+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:32:07.725863+0000","last_peered":"2024-05-20T17:32:07.725863+0000","last_clean":"2024-05-20T17:32:07.725863+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:32:07.725863+0000","last_undegraded":"2024-05-20T17:32:07.725863+0000","last_fullsized":"2024-05-20T17:32:07.725863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729124+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:32:07.729124+0000","last_peered":"2024-05-20T17:32:07.729124+0000","last_clean":"2024-05-20T17:32:07.729124+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:32:07.729124+0000","last_undegraded":"2024-05-20T17:32:07.729124+0000","last_fullsized":"2024-05-20T17:32:07.729124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:42.560376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730571+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:32:07.730571+0000","last_peered":"2024-05-20T17:32:07.730571+0000","last_clean":"2024-05-20T17:32:07.730571+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:32:07.730571+0000","last_undegraded":"2024-05-20T17:32:07.730571+0000","last_fullsized":"2024-05-20T17:32:07.730571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732758+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:32:07.732758+0000","last_peered":"2024-05-20T17:32:07.732758+0000","last_clean":"2024-05-20T17:32:07.732758+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:32:07.732758+0000","last_undegraded":"2024-05-20T17:32:07.732758+0000","last_fullsized":"2024-05-20T17:32:07.732758+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:04.966944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733005+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:32:07.733005+0000","last_peered":"2024-05-20T17:32:07.733005+0000","last_clean":"2024-05-20T17:32:07.733005+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:32:07.733005+0000","last_undegraded":"2024-05-20T17:32:07.733005+0000","last_fullsized":"2024-05-20T17:32:07.733005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908128+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:32:07.908128+0000","last_peered":"2024-05-20T17:32:07.908128+0000","last_clean":"2024-05-20T17:32:07.908128+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:32:07.908128+0000","last_undegraded":"2024-05-20T17:32:07.908128+0000","last_fullsized":"2024-05-20T17:32:07.908128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.731080+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:32:07.731080+0000","last_peered":"2024-05-20T17:32:07.731080+0000","last_clean":"2024-05-20T17:32:07.731080+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:32:07.731080+0000","last_undegraded":"2024-05-20T17:32:07.731080+0000","last_fullsized":"2024-05-20T17:32:07.731080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733472+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:32:07.733472+0000","last_peered":"2024-05-20T17:32:07.733472+0000","last_clean":"2024-05-20T17:32:07.733472+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:32:07.733472+0000","last_undegraded":"2024-05-20T17:32:07.733472+0000","last_fullsized":"2024-05-20T17:32:07.733472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:16.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725693+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:32:07.725693+0000","last_peered":"2024-05-20T17:32:07.725693+0000","last_clean":"2024-05-20T17:32:07.725693+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:32:07.725693+0000","last_undegraded":"2024-05-20T17:32:07.725693+0000","last_fullsized":"2024-05-20T17:32:07.725693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733290+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:32:07.733290+0000","last_peered":"2024-05-20T17:32:07.733290+0000","last_clean":"2024-05-20T17:32:07.733290+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:32:07.733290+0000","last_undegraded":"2024-05-20T17:32:07.733290+0000","last_fullsized":"2024-05-20T17:32:07.733290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725750+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:32:07.725750+0000","last_peered":"2024-05-20T17:32:07.725750+0000","last_clean":"2024-05-20T17:32:07.725750+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:32:07.725750+0000","last_undegraded":"2024-05-20T17:32:07.725750+0000","last_fullsized":"2024-05-20T17:32:07.725750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725855+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:32:07.725855+0000","last_peered":"2024-05-20T17:32:07.725855+0000","last_clean":"2024-05-20T17:32:07.725855+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:32:07.725855+0000","last_undegraded":"2024-05-20T17:32:07.725855+0000","last_fullsized":"2024-05-20T17:32:07.725855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907467+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:32:07.907467+0000","last_peered":"2024-05-20T17:32:07.907467+0000","last_clean":"2024-05-20T17:32:07.907467+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:32:07.907467+0000","last_undegraded":"2024-05-20T17:32:07.907467+0000","last_fullsized":"2024-05-20T17:32:07.907467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728510+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:32:07.728510+0000","last_peered":"2024-05-20T17:32:07.728510+0000","last_clean":"2024-05-20T17:32:07.728510+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:32:07.728510+0000","last_undegraded":"2024-05-20T17:32:07.728510+0000","last_fullsized":"2024-05-20T17:32:07.728510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730416+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:32:07.730416+0000","last_peered":"2024-05-20T17:32:07.730416+0000","last_clean":"2024-05-20T17:32:07.730416+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:32:07.730416+0000","last_undegraded":"2024-05-20T17:32:07.730416+0000","last_fullsized":"2024-05-20T17:32:07.730416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.731203+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:32:07.731203+0000","last_peered":"2024-05-20T17:32:07.731203+0000","last_clean":"2024-05-20T17:32:07.731203+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:32:07.731203+0000","last_undegraded":"2024-05-20T17:32:07.731203+0000","last_fullsized":"2024-05-20T17:32:07.731203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.744385+0000","last_change":"2024-05-20T17:32:07.744385+0000","last_active":"2024-05-20T17:32:07.744385+0000","last_peered":"2024-05-20T17:32:07.744385+0000","last_clean":"2024-05-20T17:32:07.744385+0000","last_became_active":"2024-05-20T17:32:07.734114+0000","last_became_peered":"2024-05-20T17:32:07.734114+0000","last_unstale":"2024-05-20T17:32:07.744385+0000","last_undegraded":"2024-05-20T17:32:07.744385+0000","last_fullsized":"2024-05-20T17:32:07.744385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:57.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733304+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:32:07.733304+0000","last_peered":"2024-05-20T17:32:07.733304+0000","last_clean":"2024-05-20T17:32:07.733304+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:32:07.733304+0000","last_undegraded":"2024-05-20T17:32:07.733304+0000","last_fullsized":"2024-05-20T17:32:07.733304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733602+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:32:07.733602+0000","last_peered":"2024-05-20T17:32:07.733602+0000","last_clean":"2024-05-20T17:32:07.733602+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:32:07.733602+0000","last_undegraded":"2024-05-20T17:32:07.733602+0000","last_fullsized":"2024-05-20T17:32:07.733602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726280+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:32:07.726280+0000","last_peered":"2024-05-20T17:32:07.726280+0000","last_clean":"2024-05-20T17:32:07.726280+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:32:07.726280+0000","last_undegraded":"2024-05-20T17:32:07.726280+0000","last_fullsized":"2024-05-20T17:32:07.726280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.742081+0000","last_change":"2024-05-20T17:32:07.741590+0000","last_active":"2024-05-20T17:32:07.742081+0000","last_peered":"2024-05-20T17:32:07.742081+0000","last_clean":"2024-05-20T17:32:07.742081+0000","last_became_active":"2024-05-20T17:32:07.736058+0000","last_became_peered":"2024-05-20T17:32:07.736058+0000","last_unstale":"2024-05-20T17:32:07.742081+0000","last_undegraded":"2024-05-20T17:32:07.742081+0000","last_fullsized":"2024-05-20T17:32:07.742081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:11.041568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907712+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:32:07.907712+0000","last_peered":"2024-05-20T17:32:07.907712+0000","last_clean":"2024-05-20T17:32:07.907712+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:32:07.907712+0000","last_undegraded":"2024-05-20T17:32:07.907712+0000","last_fullsized":"2024-05-20T17:32:07.907712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728608+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:32:07.728608+0000","last_peered":"2024-05-20T17:32:07.728608+0000","last_clean":"2024-05-20T17:32:07.728608+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:32:07.728608+0000","last_undegraded":"2024-05-20T17:32:07.728608+0000","last_fullsized":"2024-05-20T17:32:07.728608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908641+0000","last_change":"2024-05-20T17:32:07.908641+0000","last_active":"2024-05-20T17:32:07.908641+0000","last_peered":"2024-05-20T17:32:07.908641+0000","last_clean":"2024-05-20T17:32:07.908641+0000","last_became_active":"2024-05-20T17:32:07.908317+0000","last_became_peered":"2024-05-20T17:32:07.908317+0000","last_unstale":"2024-05-20T17:32:07.908641+0000","last_undegraded":"2024-05-20T17:32:07.908641+0000","last_fullsized":"2024-05-20T17:32:07.908641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:40.232683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:30.942628+0000","last_change":"2024-05-20T17:32:07.913292+0000","last_active":"2024-05-20T17:32:30.942628+0000","last_peered":"2024-05-20T17:32:30.942628+0000","last_clean":"2024-05-20T17:32:30.942628+0000","last_became_active":"2024-05-20T17:32:07.908905+0000","last_became_peered":"2024-05-20T17:32:07.908905+0000","last_unstale":"2024-05-20T17:32:30.942628+0000","last_undegraded":"2024-05-20T17:32:30.942628+0000","last_fullsized":"2024-05-20T17:32:30.942628+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:15.236246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728990+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:32:07.728990+0000","last_peered":"2024-05-20T17:32:07.728990+0000","last_clean":"2024-05-20T17:32:07.728990+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:32:07.728990+0000","last_undegraded":"2024-05-20T17:32:07.728990+0000","last_fullsized":"2024-05-20T17:32:07.728990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:00.930437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730628+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:32:07.730628+0000","last_peered":"2024-05-20T17:32:07.730628+0000","last_clean":"2024-05-20T17:32:07.730628+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:32:07.730628+0000","last_undegraded":"2024-05-20T17:32:07.730628+0000","last_fullsized":"2024-05-20T17:32:07.730628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730655+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:32:07.730655+0000","last_peered":"2024-05-20T17:32:07.730655+0000","last_clean":"2024-05-20T17:32:07.730655+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:32:07.730655+0000","last_undegraded":"2024-05-20T17:32:07.730655+0000","last_fullsized":"2024-05-20T17:32:07.730655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733372+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:32:07.733372+0000","last_peered":"2024-05-20T17:32:07.733372+0000","last_clean":"2024-05-20T17:32:07.733372+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:32:07.733372+0000","last_undegraded":"2024-05-20T17:32:07.733372+0000","last_fullsized":"2024-05-20T17:32:07.733372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732880+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:32:07.732880+0000","last_peered":"2024-05-20T17:32:07.732880+0000","last_clean":"2024-05-20T17:32:07.732880+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:32:07.732880+0000","last_undegraded":"2024-05-20T17:32:07.732880+0000","last_fullsized":"2024-05-20T17:32:07.732880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728292+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:32:07.728292+0000","last_peered":"2024-05-20T17:32:07.728292+0000","last_clean":"2024-05-20T17:32:07.728292+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:32:07.728292+0000","last_undegraded":"2024-05-20T17:32:07.728292+0000","last_fullsized":"2024-05-20T17:32:07.728292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730315+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:32:07.730315+0000","last_peered":"2024-05-20T17:32:07.730315+0000","last_clean":"2024-05-20T17:32:07.730315+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:32:07.730315+0000","last_undegraded":"2024-05-20T17:32:07.730315+0000","last_fullsized":"2024-05-20T17:32:07.730315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:30.941982+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:32:30.941982+0000","last_peered":"2024-05-20T17:32:30.941982+0000","last_clean":"2024-05-20T17:32:30.941982+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:32:30.941982+0000","last_undegraded":"2024-05-20T17:32:30.941982+0000","last_fullsized":"2024-05-20T17:32:30.941982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908274+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:32:07.908274+0000","last_peered":"2024-05-20T17:32:07.908274+0000","last_clean":"2024-05-20T17:32:07.908274+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:32:07.908274+0000","last_undegraded":"2024-05-20T17:32:07.908274+0000","last_fullsized":"2024-05-20T17:32:07.908274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733476+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:32:07.733476+0000","last_peered":"2024-05-20T17:32:07.733476+0000","last_clean":"2024-05-20T17:32:07.733476+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:32:07.733476+0000","last_undegraded":"2024-05-20T17:32:07.733476+0000","last_fullsized":"2024-05-20T17:32:07.733476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.735120+0000","last_change":"2024-05-20T17:32:07.735120+0000","last_active":"2024-05-20T17:32:07.735120+0000","last_peered":"2024-05-20T17:32:07.735120+0000","last_clean":"2024-05-20T17:32:07.735120+0000","last_became_active":"2024-05-20T17:32:07.734652+0000","last_became_peered":"2024-05-20T17:32:07.734652+0000","last_unstale":"2024-05-20T17:32:07.735120+0000","last_undegraded":"2024-05-20T17:32:07.735120+0000","last_fullsized":"2024-05-20T17:32:07.735120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:28.611313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733109+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:32:07.733109+0000","last_peered":"2024-05-20T17:32:07.733109+0000","last_clean":"2024-05-20T17:32:07.733109+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:32:07.733109+0000","last_undegraded":"2024-05-20T17:32:07.733109+0000","last_fullsized":"2024-05-20T17:32:07.733109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.908098+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:32:07.908098+0000","last_peered":"2024-05-20T17:32:07.908098+0000","last_clean":"2024-05-20T17:32:07.908098+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:32:07.908098+0000","last_undegraded":"2024-05-20T17:32:07.908098+0000","last_fullsized":"2024-05-20T17:32:07.908098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'28","reported_seq":203,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:31.943617+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:32:31.943617+0000","last_peered":"2024-05-20T17:32:31.943617+0000","last_clean":"2024-05-20T17:32:31.943617+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:32:31.943617+0000","last_undegraded":"2024-05-20T17:32:31.943617+0000","last_fullsized":"2024-05-20T17:32:31.943617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":137,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729646+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:32:07.729646+0000","last_peered":"2024-05-20T17:32:07.729646+0000","last_clean":"2024-05-20T17:32:07.729646+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:32:07.729646+0000","last_undegraded":"2024-05-20T17:32:07.729646+0000","last_fullsized":"2024-05-20T17:32:07.729646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:10.914985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729413+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:32:07.729413+0000","last_peered":"2024-05-20T17:32:07.729413+0000","last_clean":"2024-05-20T17:32:07.729413+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:32:07.729413+0000","last_undegraded":"2024-05-20T17:32:07.729413+0000","last_fullsized":"2024-05-20T17:32:07.729413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733370+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:32:07.733370+0000","last_peered":"2024-05-20T17:32:07.733370+0000","last_clean":"2024-05-20T17:32:07.733370+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:32:07.733370+0000","last_undegraded":"2024-05-20T17:32:07.733370+0000","last_fullsized":"2024-05-20T17:32:07.733370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728376+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:32:07.728376+0000","last_peered":"2024-05-20T17:32:07.728376+0000","last_clean":"2024-05-20T17:32:07.728376+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:32:07.728376+0000","last_undegraded":"2024-05-20T17:32:07.728376+0000","last_fullsized":"2024-05-20T17:32:07.728376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733311+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:32:07.733311+0000","last_peered":"2024-05-20T17:32:07.733311+0000","last_clean":"2024-05-20T17:32:07.733311+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:32:07.733311+0000","last_undegraded":"2024-05-20T17:32:07.733311+0000","last_fullsized":"2024-05-20T17:32:07.733311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:28:49.912347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:32.159446+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:32:32.159446+0000","last_peered":"2024-05-20T17:32:32.159446+0000","last_clean":"2024-05-20T17:32:32.159446+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:32:32.159446+0000","last_undegraded":"2024-05-20T17:32:32.159446+0000","last_fullsized":"2024-05-20T17:32:32.159446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732864+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:32:07.732864+0000","last_peered":"2024-05-20T17:32:07.732864+0000","last_clean":"2024-05-20T17:32:07.732864+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:32:07.732864+0000","last_undegraded":"2024-05-20T17:32:07.732864+0000","last_fullsized":"2024-05-20T17:32:07.732864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:42:44.041243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728176+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:32:07.728176+0000","last_peered":"2024-05-20T17:32:07.728176+0000","last_clean":"2024-05-20T17:32:07.728176+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:32:07.728176+0000","last_undegraded":"2024-05-20T17:32:07.728176+0000","last_fullsized":"2024-05-20T17:32:07.728176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728990+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:32:07.728990+0000","last_peered":"2024-05-20T17:32:07.728990+0000","last_clean":"2024-05-20T17:32:07.728990+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:32:07.728990+0000","last_undegraded":"2024-05-20T17:32:07.728990+0000","last_fullsized":"2024-05-20T17:32:07.728990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729494+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:32:07.729494+0000","last_peered":"2024-05-20T17:32:07.729494+0000","last_clean":"2024-05-20T17:32:07.729494+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:32:07.729494+0000","last_undegraded":"2024-05-20T17:32:07.729494+0000","last_fullsized":"2024-05-20T17:32:07.729494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733408+0000","last_change":"2024-05-20T17:32:07.733408+0000","last_active":"2024-05-20T17:32:07.733408+0000","last_peered":"2024-05-20T17:32:07.733408+0000","last_clean":"2024-05-20T17:32:07.733408+0000","last_became_active":"2024-05-20T17:32:07.732989+0000","last_became_peered":"2024-05-20T17:32:07.732989+0000","last_unstale":"2024-05-20T17:32:07.733408+0000","last_undegraded":"2024-05-20T17:32:07.733408+0000","last_fullsized":"2024-05-20T17:32:07.733408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:48.103948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730416+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:32:07.730416+0000","last_peered":"2024-05-20T17:32:07.730416+0000","last_clean":"2024-05-20T17:32:07.730416+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:32:07.730416+0000","last_undegraded":"2024-05-20T17:32:07.730416+0000","last_fullsized":"2024-05-20T17:32:07.730416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.738327+0000","last_change":"2024-05-20T17:32:07.738327+0000","last_active":"2024-05-20T17:32:07.738327+0000","last_peered":"2024-05-20T17:32:07.738327+0000","last_clean":"2024-05-20T17:32:07.738327+0000","last_became_active":"2024-05-20T17:32:07.734897+0000","last_became_peered":"2024-05-20T17:32:07.734897+0000","last_unstale":"2024-05-20T17:32:07.738327+0000","last_undegraded":"2024-05-20T17:32:07.738327+0000","last_fullsized":"2024-05-20T17:32:07.738327+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.308883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733053+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:32:07.733053+0000","last_peered":"2024-05-20T17:32:07.733053+0000","last_clean":"2024-05-20T17:32:07.733053+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:32:07.733053+0000","last_undegraded":"2024-05-20T17:32:07.733053+0000","last_fullsized":"2024-05-20T17:32:07.733053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730663+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:32:07.730663+0000","last_peered":"2024-05-20T17:32:07.730663+0000","last_clean":"2024-05-20T17:32:07.730663+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:32:07.730663+0000","last_undegraded":"2024-05-20T17:32:07.730663+0000","last_fullsized":"2024-05-20T17:32:07.730663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729446+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:32:07.729446+0000","last_peered":"2024-05-20T17:32:07.729446+0000","last_clean":"2024-05-20T17:32:07.729446+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:32:07.729446+0000","last_undegraded":"2024-05-20T17:32:07.729446+0000","last_fullsized":"2024-05-20T17:32:07.729446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":100,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:33.160354+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:32:33.160354+0000","last_peered":"2024-05-20T17:32:33.160354+0000","last_clean":"2024-05-20T17:32:33.160354+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:32:33.160354+0000","last_undegraded":"2024-05-20T17:32:33.160354+0000","last_fullsized":"2024-05-20T17:32:33.160354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.734002+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:32:07.734002+0000","last_peered":"2024-05-20T17:32:07.734002+0000","last_clean":"2024-05-20T17:32:07.734002+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:32:07.734002+0000","last_undegraded":"2024-05-20T17:32:07.734002+0000","last_fullsized":"2024-05-20T17:32:07.734002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725704+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:32:07.725704+0000","last_peered":"2024-05-20T17:32:07.725704+0000","last_clean":"2024-05-20T17:32:07.725704+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:32:07.725704+0000","last_undegraded":"2024-05-20T17:32:07.725704+0000","last_fullsized":"2024-05-20T17:32:07.725704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733045+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:32:07.733045+0000","last_peered":"2024-05-20T17:32:07.733045+0000","last_clean":"2024-05-20T17:32:07.733045+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:32:07.733045+0000","last_undegraded":"2024-05-20T17:32:07.733045+0000","last_fullsized":"2024-05-20T17:32:07.733045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732922+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:32:07.732922+0000","last_peered":"2024-05-20T17:32:07.732922+0000","last_clean":"2024-05-20T17:32:07.732922+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:32:07.732922+0000","last_undegraded":"2024-05-20T17:32:07.732922+0000","last_fullsized":"2024-05-20T17:32:07.732922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733224+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:32:07.733224+0000","last_peered":"2024-05-20T17:32:07.733224+0000","last_clean":"2024-05-20T17:32:07.733224+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:32:07.733224+0000","last_undegraded":"2024-05-20T17:32:07.733224+0000","last_fullsized":"2024-05-20T17:32:07.733224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729905+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:32:07.729905+0000","last_peered":"2024-05-20T17:32:07.729905+0000","last_clean":"2024-05-20T17:32:07.729905+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:32:07.729905+0000","last_undegraded":"2024-05-20T17:32:07.729905+0000","last_fullsized":"2024-05-20T17:32:07.729905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733499+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:32:07.733499+0000","last_peered":"2024-05-20T17:32:07.733499+0000","last_clean":"2024-05-20T17:32:07.733499+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:32:07.733499+0000","last_undegraded":"2024-05-20T17:32:07.733499+0000","last_fullsized":"2024-05-20T17:32:07.733499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'8","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730487+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:32:07.730487+0000","last_peered":"2024-05-20T17:32:07.730487+0000","last_clean":"2024-05-20T17:32:07.730487+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:32:07.730487+0000","last_undegraded":"2024-05-20T17:32:07.730487+0000","last_fullsized":"2024-05-20T17:32:07.730487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.734163+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:32:07.734163+0000","last_peered":"2024-05-20T17:32:07.734163+0000","last_clean":"2024-05-20T17:32:07.734163+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:32:07.734163+0000","last_undegraded":"2024-05-20T17:32:07.734163+0000","last_fullsized":"2024-05-20T17:32:07.734163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726093+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:32:07.726093+0000","last_peered":"2024-05-20T17:32:07.726093+0000","last_clean":"2024-05-20T17:32:07.726093+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:32:07.726093+0000","last_undegraded":"2024-05-20T17:32:07.726093+0000","last_fullsized":"2024-05-20T17:32:07.726093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.726214+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:32:07.726214+0000","last_peered":"2024-05-20T17:32:07.726214+0000","last_clean":"2024-05-20T17:32:07.726214+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:32:07.726214+0000","last_undegraded":"2024-05-20T17:32:07.726214+0000","last_fullsized":"2024-05-20T17:32:07.726214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907621+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:32:07.907621+0000","last_peered":"2024-05-20T17:32:07.907621+0000","last_clean":"2024-05-20T17:32:07.907621+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:32:07.907621+0000","last_undegraded":"2024-05-20T17:32:07.907621+0000","last_fullsized":"2024-05-20T17:32:07.907621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728572+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:32:07.728572+0000","last_peered":"2024-05-20T17:32:07.728572+0000","last_clean":"2024-05-20T17:32:07.728572+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:32:07.728572+0000","last_undegraded":"2024-05-20T17:32:07.728572+0000","last_fullsized":"2024-05-20T17:32:07.728572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:06.122038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733716+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:32:07.733716+0000","last_peered":"2024-05-20T17:32:07.733716+0000","last_clean":"2024-05-20T17:32:07.733716+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:32:07.733716+0000","last_undegraded":"2024-05-20T17:32:07.733716+0000","last_fullsized":"2024-05-20T17:32:07.733716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728176+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:32:07.728176+0000","last_peered":"2024-05-20T17:32:07.728176+0000","last_clean":"2024-05-20T17:32:07.728176+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:32:07.728176+0000","last_undegraded":"2024-05-20T17:32:07.728176+0000","last_fullsized":"2024-05-20T17:32:07.728176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729037+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:32:07.729037+0000","last_peered":"2024-05-20T17:32:07.729037+0000","last_clean":"2024-05-20T17:32:07.729037+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:32:07.729037+0000","last_undegraded":"2024-05-20T17:32:07.729037+0000","last_fullsized":"2024-05-20T17:32:07.729037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733103+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:32:07.733103+0000","last_peered":"2024-05-20T17:32:07.733103+0000","last_clean":"2024-05-20T17:32:07.733103+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:32:07.733103+0000","last_undegraded":"2024-05-20T17:32:07.733103+0000","last_fullsized":"2024-05-20T17:32:07.733103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.729266+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:32:07.729266+0000","last_peered":"2024-05-20T17:32:07.729266+0000","last_clean":"2024-05-20T17:32:07.729266+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:32:07.729266+0000","last_undegraded":"2024-05-20T17:32:07.729266+0000","last_fullsized":"2024-05-20T17:32:07.729266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733225+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:32:07.733225+0000","last_peered":"2024-05-20T17:32:07.733225+0000","last_clean":"2024-05-20T17:32:07.733225+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:32:07.733225+0000","last_undegraded":"2024-05-20T17:32:07.733225+0000","last_fullsized":"2024-05-20T17:32:07.733225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:43.253987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.739105+0000","last_change":"2024-05-20T17:32:07.738590+0000","last_active":"2024-05-20T17:32:07.739105+0000","last_peered":"2024-05-20T17:32:07.739105+0000","last_clean":"2024-05-20T17:32:07.739105+0000","last_became_active":"2024-05-20T17:32:07.731009+0000","last_became_peered":"2024-05-20T17:32:07.731009+0000","last_unstale":"2024-05-20T17:32:07.739105+0000","last_undegraded":"2024-05-20T17:32:07.739105+0000","last_fullsized":"2024-05-20T17:32:07.739105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:25.383889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733661+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:32:07.733661+0000","last_peered":"2024-05-20T17:32:07.733661+0000","last_clean":"2024-05-20T17:32:07.733661+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:32:07.733661+0000","last_undegraded":"2024-05-20T17:32:07.733661+0000","last_fullsized":"2024-05-20T17:32:07.733661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:12:10.454896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.732931+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:32:07.732931+0000","last_peered":"2024-05-20T17:32:07.732931+0000","last_clean":"2024-05-20T17:32:07.732931+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:32:07.732931+0000","last_undegraded":"2024-05-20T17:32:07.732931+0000","last_fullsized":"2024-05-20T17:32:07.732931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733184+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:32:07.733184+0000","last_peered":"2024-05-20T17:32:07.733184+0000","last_clean":"2024-05-20T17:32:07.733184+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:32:07.733184+0000","last_undegraded":"2024-05-20T17:32:07.733184+0000","last_fullsized":"2024-05-20T17:32:07.733184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:06.119241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733348+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:32:07.733348+0000","last_peered":"2024-05-20T17:32:07.733348+0000","last_clean":"2024-05-20T17:32:07.733348+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:32:07.733348+0000","last_undegraded":"2024-05-20T17:32:07.733348+0000","last_fullsized":"2024-05-20T17:32:07.733348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733537+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:32:07.733537+0000","last_peered":"2024-05-20T17:32:07.733537+0000","last_clean":"2024-05-20T17:32:07.733537+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:32:07.733537+0000","last_undegraded":"2024-05-20T17:32:07.733537+0000","last_fullsized":"2024-05-20T17:32:07.733537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:49.546477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728313+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:32:07.728313+0000","last_peered":"2024-05-20T17:32:07.728313+0000","last_clean":"2024-05-20T17:32:07.728313+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:32:07.728313+0000","last_undegraded":"2024-05-20T17:32:07.728313+0000","last_fullsized":"2024-05-20T17:32:07.728313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.736717+0000","last_change":"2024-05-20T17:32:07.736717+0000","last_active":"2024-05-20T17:32:07.736717+0000","last_peered":"2024-05-20T17:32:07.736717+0000","last_clean":"2024-05-20T17:32:07.736717+0000","last_became_active":"2024-05-20T17:32:07.736321+0000","last_became_peered":"2024-05-20T17:32:07.736321+0000","last_unstale":"2024-05-20T17:32:07.736717+0000","last_undegraded":"2024-05-20T17:32:07.736717+0000","last_fullsized":"2024-05-20T17:32:07.736717+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:59:32.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728885+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:32:07.728885+0000","last_peered":"2024-05-20T17:32:07.728885+0000","last_clean":"2024-05-20T17:32:07.728885+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:32:07.728885+0000","last_undegraded":"2024-05-20T17:32:07.728885+0000","last_fullsized":"2024-05-20T17:32:07.728885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.725868+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:32:07.725868+0000","last_peered":"2024-05-20T17:32:07.725868+0000","last_clean":"2024-05-20T17:32:07.725868+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:32:07.725868+0000","last_undegraded":"2024-05-20T17:32:07.725868+0000","last_fullsized":"2024-05-20T17:32:07.725868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733604+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:32:07.733604+0000","last_peered":"2024-05-20T17:32:07.733604+0000","last_clean":"2024-05-20T17:32:07.733604+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:32:07.733604+0000","last_undegraded":"2024-05-20T17:32:07.733604+0000","last_fullsized":"2024-05-20T17:32:07.733604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.735868+0000","last_change":"2024-05-20T17:32:07.735868+0000","last_active":"2024-05-20T17:32:07.735868+0000","last_peered":"2024-05-20T17:32:07.735868+0000","last_clean":"2024-05-20T17:32:07.735868+0000","last_became_active":"2024-05-20T17:32:07.735314+0000","last_became_peered":"2024-05-20T17:32:07.735314+0000","last_unstale":"2024-05-20T17:32:07.735868+0000","last_undegraded":"2024-05-20T17:32:07.735868+0000","last_fullsized":"2024-05-20T17:32:07.735868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:33:52.756227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.730499+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:32:07.730499+0000","last_peered":"2024-05-20T17:32:07.730499+0000","last_clean":"2024-05-20T17:32:07.730499+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:32:07.730499+0000","last_undegraded":"2024-05-20T17:32:07.730499+0000","last_fullsized":"2024-05-20T17:32:07.730499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733952+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:32:07.733952+0000","last_peered":"2024-05-20T17:32:07.733952+0000","last_clean":"2024-05-20T17:32:07.733952+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:32:07.733952+0000","last_undegraded":"2024-05-20T17:32:07.733952+0000","last_fullsized":"2024-05-20T17:32:07.733952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728410+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:32:07.728410+0000","last_peered":"2024-05-20T17:32:07.728410+0000","last_clean":"2024-05-20T17:32:07.728410+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:32:07.728410+0000","last_undegraded":"2024-05-20T17:32:07.728410+0000","last_fullsized":"2024-05-20T17:32:07.728410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733611+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:32:07.733611+0000","last_peered":"2024-05-20T17:32:07.733611+0000","last_clean":"2024-05-20T17:32:07.733611+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:32:07.733611+0000","last_undegraded":"2024-05-20T17:32:07.733611+0000","last_fullsized":"2024-05-20T17:32:07.733611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.907889+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:32:07.907889+0000","last_peered":"2024-05-20T17:32:07.907889+0000","last_clean":"2024-05-20T17:32:07.907889+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:32:07.907889+0000","last_undegraded":"2024-05-20T17:32:07.907889+0000","last_fullsized":"2024-05-20T17:32:07.907889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.733732+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:32:07.733732+0000","last_peered":"2024-05-20T17:32:07.733732+0000","last_clean":"2024-05-20T17:32:07.733732+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:32:07.733732+0000","last_undegraded":"2024-05-20T17:32:07.733732+0000","last_fullsized":"2024-05-20T17:32:07.733732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:32:07.728989+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:32:07.728989+0000","last_peered":"2024-05-20T17:32:07.728989+0000","last_clean":"2024-05-20T17:32:07.728989+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:32:07.728989+0000","last_undegraded":"2024-05-20T17:32:07.728989+0000","last_fullsized":"2024-05-20T17:32:07.728989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246618,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65438,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":471,"num_read_kb":307,"num_write":157,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2177,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":196314,"data_compressed":5622,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383710,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":456969,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1109305,"data_compressed":43379,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":962560,"data_stored":456740,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456543,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332147,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":1048282,"data_compressed":41505,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":456012,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517864,"data_compressed":7679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":457283,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":516997,"data_compressed":7679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":456206,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":457422,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757308,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1048157,"data_compressed":41505,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34059,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62059,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61192,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63015,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:32:38.203 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-20T17:32:38.204 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-20T17:32:38.204 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-20T17:32:38.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph health --format=json 2024-05-20T17:32:38.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:37 smithi160 ceph-mon[36261]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:38.446 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:38.826 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:38 smithi135 ceph-mon[32027]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:38.826 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:38 smithi135 ceph-mon[32027]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-05-20T17:32:38.826 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:38 smithi135 ceph-mon[32027]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-20T17:32:39.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:38 smithi172 ceph-mon[36511]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:39.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:38 smithi172 ceph-mon[36511]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-05-20T17:32:39.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:38 smithi172 ceph-mon[36511]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-20T17:32:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:38 smithi160 ceph-mon[36261]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:32:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:38 smithi160 ceph-mon[36261]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-05-20T17:32:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:38 smithi160 ceph-mon[36261]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-20T17:32:40.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/2197503763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca0106c70 msgr2=0x7f3ca0107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/2197503763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca0106c70 0x7f3ca0107080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3c900099c0 tx=0x7f3c90009cd0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/2197503763 shutdown_connections 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/2197503763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/2197503763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca01075c0 0x7f3ca010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/2197503763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca0106c70 0x7f3ca0107080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/2197503763 >> 172.21.15.135:0/2197503763 conn(0x7f3ca00fdc70 msgr2=0x7f3ca0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/2197503763 shutdown_connections 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.196+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/2197503763 wait complete. 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 Processor -- start 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 -- start start 2024-05-20T17:32:40.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 0x7f3ca019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112410 con 0x7f3ca01075c0 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112290 con 0x7f3ca0102340 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca7d6d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112590 con 0x7f3ca0106c70 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca630a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca630a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39792/0 (socket says 172.21.15.135:39792) 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca630a700 1 -- 172.21.15.135:0/1143176637 learned_addr learned my addr 172.21.15.135:0/1143176637 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca5308700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 0x7f3ca019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca630a700 1 -- 172.21.15.135:0/1143176637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 msgr2=0x7f3ca019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:40.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.197+0000 7f3ca5b09700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca630a700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 0x7f3ca019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca630a700 1 -- 172.21.15.135:0/1143176637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 msgr2=0x7f3ca019adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca630a700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca019adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca630a700 1 -- 172.21.15.135:0/1143176637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca01a6120 con 0x7f3ca01075c0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca5308700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 0x7f3ca019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca5b09700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca630a700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b970 tx=0x7f3c9800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98019070 con 0x7f3ca01075c0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca01a6410 con 0x7f3ca01075c0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c98014440 con 0x7f3ca01075c0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c980075d0 con 0x7f3ca01075c0 2024-05-20T17:32:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.198+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a6900 con 0x7f3ca01075c0 2024-05-20T17:32:40.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.199+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0050170 con 0x7f3ca01075c0 2024-05-20T17:32:40.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.200+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f3c9801c070 con 0x7f3ca01075c0 2024-05-20T17:32:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.201+0000 7f3c96ffd700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 0x7f3c8c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.201+0000 7f3ca5b09700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 0x7f3c8c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.201+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3c980ce990 con 0x7f3ca01075c0 2024-05-20T17:32:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.201+0000 7f3ca5b09700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 0x7f3c8c0a5130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007900 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:40.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.204+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3c9809b8d0 con 0x7f3ca01075c0 2024-05-20T17:32:40.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.444+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ca0074e80 con 0x7f3ca01075c0 2024-05-20T17:32:40.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.444+0000 7f3c96ffd700 1 -- 172.21.15.135:0/1143176637 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3c9809b1d0 con 0x7f3ca01075c0 2024-05-20T17:32:40.446 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:40.446 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 msgr2=0x7f3c8c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 0x7f3c8c0a5130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007900 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 msgr2=0x7f3ca019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b970 tx=0x7f3c9800bd30 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 shutdown_connections 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ca0102340 0x7f3ca019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3c8c0a2c20 0x7f3c8c0a5130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca01075c0 0x7f3ca019b870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 --2- 172.21.15.135:0/1143176637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca0106c70 0x7f3ca019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.446+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 >> 172.21.15.135:0/1143176637 conn(0x7f3ca00fdc70 msgr2=0x7f3ca0108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:40.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.447+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 shutdown_connections 2024-05-20T17:32:40.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:40.447+0000 7f3ca7d6d700 1 -- 172.21.15.135:0/1143176637 wait complete. 2024-05-20T17:32:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:40 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1143176637' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:32:40.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:40 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1143176637' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:32:40.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:40 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1143176637' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:32:41.154 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-20T17:32:41.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 -- 172.21.15.135:0/2873515365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c1078d0 msgr2=0x7fc84c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 --2- 172.21.15.135:0/2873515365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c1078d0 0x7fc84c109cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc844009ca0 tx=0x7fc84402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 -- 172.21.15.135:0/2873515365 shutdown_connections 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 --2- 172.21.15.135:0/2873515365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c1078d0 0x7fc84c109cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 --2- 172.21.15.135:0/2873515365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84c102bd0 0x7fc84c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 --2- 172.21.15.135:0/2873515365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c101990 0x7fc84c102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 -- 172.21.15.135:0/2873515365 >> 172.21.15.135:0/2873515365 conn(0x7fc84c0fcb80 msgr2=0x7fc84c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 -- 172.21.15.135:0/2873515365 shutdown_connections 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.266+0000 7fc853ea2640 1 -- 172.21.15.135:0/2873515365 wait complete. 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 Processor -- start 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 -- start start 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c102bd0 0x7fc84c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84c1078d0 0x7fc84c19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10d610 con 0x7fc84c101990 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10d490 con 0x7fc84c1078d0 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc853ea2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10d790 con 0x7fc84c102bd0 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc851c3e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.267+0000 7fc851c3e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39798/0 (socket says 172.21.15.135:39798) 2024-05-20T17:32:41.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 -- 172.21.15.135:0/4062061879 learned_addr learned my addr 172.21.15.135:0/4062061879 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc85143d640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c102bd0 0x7fc84c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 -- 172.21.15.135:0/4062061879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c102bd0 msgr2=0x7fc84c1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c102bd0 0x7fc84c1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 -- 172.21.15.135:0/4062061879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84c1078d0 msgr2=0x7fc84c19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84c1078d0 0x7fc84c19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 -- 172.21.15.135:0/4062061879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c19fcd0 con 0x7fc84c101990 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc851c3e640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c970 tx=0x7fc84000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840004220 con 0x7fc84c101990 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8400043c0 con 0x7fc84c101990 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c19ffc0 con 0x7fc84c101990 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840004a00 con 0x7fc84c101990 2024-05-20T17:32:41.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.268+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c1a0420 con 0x7fc84c101990 2024-05-20T17:32:41.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.269+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c1066e0 con 0x7fc84c101990 2024-05-20T17:32:41.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.270+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc8400079b0 con 0x7fc84c101990 2024-05-20T17:32:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.271+0000 7fc83effd640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 0x7fc8380a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.271+0000 7fc85143d640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 0x7fc8380a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.271+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc8400cf2e0 con 0x7fc84c101990 2024-05-20T17:32:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.271+0000 7fc85143d640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 0x7fc8380a50a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc848005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.274+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc840014030 con 0x7fc84c101990 2024-05-20T17:32:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.451+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc84c02d510 con 0x7fc84c101990 2024-05-20T17:32:41.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.453+0000 7fc83effd640 1 -- 172.21.15.135:0/4062061879 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7fc84009c220 con 0x7fc84c101990 2024-05-20T17:32:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:41.455 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 msgr2=0x7fc8380a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 0x7fc8380a50a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc848005850 comp rx=0 tx=0).stop 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 msgr2=0x7fc84c198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c970 tx=0x7fc84000ce30 comp rx=0 tx=0).stop 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 shutdown_connections 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc8380a2b90 0x7fc8380a50a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84c1078d0 0x7fc84c19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c102bd0 0x7fc84c1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 --2- 172.21.15.135:0/4062061879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c101990 0x7fc84c198190 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 >> 172.21.15.135:0/4062061879 conn(0x7fc84c0fcb80 msgr2=0x7fc84c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:41.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 shutdown_connections 2024-05-20T17:32:41.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.455+0000 7fc853ea2640 1 -- 172.21.15.135:0/4062061879 wait complete. 2024-05-20T17:32:41.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:32:41.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:32:41.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 -- 172.21.15.135:0/2481219043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 msgr2=0x7fbc6c10a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 --2- 172.21.15.135:0/2481219043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c10a300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009900 tx=0x7fbc6002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:41.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 -- 172.21.15.135:0/2481219043 shutdown_connections 2024-05-20T17:32:41.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 --2- 172.21.15.135:0/2481219043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c10a990 0x7fbc6c10ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 --2- 172.21.15.135:0/2481219043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c10a300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 --2- 172.21.15.135:0/2481219043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c102fa0 0x7fbc6c1033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.581+0000 7fbc71196640 1 -- 172.21.15.135:0/2481219043 >> 172.21.15.135:0/2481219043 conn(0x7fbc6c0fc300 msgr2=0x7fbc6c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.582+0000 7fbc71196640 1 -- 172.21.15.135:0/2481219043 shutdown_connections 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.582+0000 7fbc71196640 1 -- 172.21.15.135:0/2481219043 wait complete. 2024-05-20T17:32:41.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.582+0000 7fbc71196640 1 Processor -- start 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.582+0000 7fbc71196640 1 -- start start 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c102fa0 0x7fbc6c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c10a990 0x7fbc6c1a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c110940 con 0x7fbc6c107e80 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1107c0 con 0x7fbc6c102fa0 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc71196640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c110ac0 con 0x7fbc6c10a990 2024-05-20T17:32:41.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39814/0 (socket says 172.21.15.135:39814) 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 -- 172.21.15.135:0/2337293664 learned_addr learned my addr 172.21.15.135:0/2337293664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6b59e640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c10a990 0x7fbc6c1a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6ad9d640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c102fa0 0x7fbc6c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 -- 172.21.15.135:0/2337293664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c10a990 msgr2=0x7fbc6c1a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c10a990 0x7fbc6c1a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 -- 172.21.15.135:0/2337293664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c102fa0 msgr2=0x7fbc6c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c102fa0 0x7fbc6c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 -- 172.21.15.135:0/2337293664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c1a2f50 con 0x7fbc6c107e80 2024-05-20T17:32:41.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc6a59c640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006010 tx=0x7fbc600043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.583+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6003f030 con 0x7fbc6c107e80 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.584+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c1a31e0 con 0x7fbc6c107e80 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.584+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc60003ce0 con 0x7fbc6c107e80 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.584+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60035070 con 0x7fbc6c107e80 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.584+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c1a36d0 con 0x7fbc6c107e80 2024-05-20T17:32:41.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.585+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6c069110 con 0x7fbc6c107e80 2024-05-20T17:32:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.586+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fbc60042030 con 0x7fbc6c107e80 2024-05-20T17:32:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.586+0000 7fbc53fff640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 0x7fbc540a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.586+0000 7fbc6ad9d640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 0x7fbc540a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.587+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fbc600ef670 con 0x7fbc6c107e80 2024-05-20T17:32:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.587+0000 7fbc6ad9d640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 0x7fbc540a50a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06a340 tx=0x7fbc5c009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.591+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbc600bc5b0 con 0x7fbc6c107e80 2024-05-20T17:32:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:41 smithi160 ceph-mon[36261]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:41 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4062061879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:41.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.765+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc6c062750 con 0x7fbc6c107e80 2024-05-20T17:32:41.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.765+0000 7fbc53fff640 1 -- 172.21.15.135:0/2337293664 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fbc600bbeb0 con 0x7fbc6c107e80 2024-05-20T17:32:41.766 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 msgr2=0x7fbc540a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 0x7fbc540a50a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06a340 tx=0x7fbc5c009870 comp rx=0 tx=0).stop 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 msgr2=0x7fbc6c19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006010 tx=0x7fbc600043b0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 shutdown_connections 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fbc540a2b90 0x7fbc540a50a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc6c10a990 0x7fbc6c1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc6c107e80 0x7fbc6c19ba00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 --2- 172.21.15.135:0/2337293664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc6c102fa0 0x7fbc6c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 >> 172.21.15.135:0/2337293664 conn(0x7fbc6c0fc300 msgr2=0x7fbc6c10b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:41.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 shutdown_connections 2024-05-20T17:32:41.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.767+0000 7fbc71196640 1 -- 172.21.15.135:0/2337293664 wait complete. 2024-05-20T17:32:41.779 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:41 smithi135 ceph-mon[32027]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:41.779 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:41 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4062061879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:41.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:32:41.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:41 smithi172 ceph-mon[36511]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:41 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4062061879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:41.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 -- 172.21.15.135:0/3499518250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 msgr2=0x7fcfa8102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/3499518250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa8102690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009900 tx=0x7fcf9802a410 comp rx=0 tx=0).stop 2024-05-20T17:32:41.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 -- 172.21.15.135:0/3499518250 shutdown_connections 2024-05-20T17:32:41.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/3499518250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 0x7fcfa8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/3499518250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 0x7fcfa8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/3499518250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa8102690 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 -- 172.21.15.135:0/3499518250 >> 172.21.15.135:0/3499518250 conn(0x7fcfa80fcb80 msgr2=0x7fcfa80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 -- 172.21.15.135:0/3499518250 shutdown_connections 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.893+0000 7fcfacfaa640 1 -- 172.21.15.135:0/3499518250 wait complete. 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 Processor -- start 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 -- start start 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 0x7fcfa8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 0x7fcfa819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa810d5e0 con 0x7fcfa8101990 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa810d460 con 0x7fcfa81078d0 2024-05-20T17:32:41.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfacfaa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa810d760 con 0x7fcfa8102bd0 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfa659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfa659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39822/0 (socket says 172.21.15.135:39822) 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.894+0000 7fcfa659c640 1 -- 172.21.15.135:0/2759552792 learned_addr learned my addr 172.21.15.135:0/2759552792 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcf9ffff640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 0x7fcfa8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa6d9d640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 0x7fcfa819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 -- 172.21.15.135:0/2759552792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 msgr2=0x7fcfa8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 0x7fcfa8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 -- 172.21.15.135:0/2759552792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 msgr2=0x7fcfa819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 0x7fcfa819f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 -- 172.21.15.135:0/2759552792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa819fdb0 con 0x7fcfa8101990 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfa659c640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf98006010 tx=0x7fcf98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98046070 con 0x7fcfa8101990 2024-05-20T17:32:41.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa8073d80 con 0x7fcfa8101990 2024-05-20T17:32:41.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf98003ad0 con 0x7fcfa8101990 2024-05-20T17:32:41.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98035050 con 0x7fcfa8101990 2024-05-20T17:32:41.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.895+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa80742c0 con 0x7fcfa8101990 2024-05-20T17:32:41.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.896+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa8069110 con 0x7fcfa8101990 2024-05-20T17:32:41.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.897+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcf98049070 con 0x7fcfa8101990 2024-05-20T17:32:41.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.898+0000 7fcf9f7fe640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 0x7fcf940a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:41.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.898+0000 7fcf9ffff640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 0x7fcf940a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:41.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.898+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fcf980f0c30 con 0x7fcfa8101990 2024-05-20T17:32:41.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.899+0000 7fcf9ffff640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 0x7fcf940a50a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8199380 tx=0x7fcf9000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:41.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:41.903+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcf9807d850 con 0x7fcfa8101990 2024-05-20T17:32:42.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.078+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcfa81066c0 con 0x7fcfa8101990 2024-05-20T17:32:42.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.079+0000 7fcf9f7fe640 1 -- 172.21.15.135:0/2759552792 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fcf980bdb70 con 0x7fcfa8101990 2024-05-20T17:32:42.080 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:32:42.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 msgr2=0x7fcf940a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 0x7fcf940a50a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8199380 tx=0x7fcf9000b390 comp rx=0 tx=0).stop 2024-05-20T17:32:42.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 msgr2=0x7fcfa81982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf98006010 tx=0x7fcf98004270 comp rx=0 tx=0).stop 2024-05-20T17:32:42.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 shutdown_connections 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcf940a2b90 0x7fcf940a50a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfa81078d0 0x7fcfa819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfa8102bd0 0x7fcfa8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 --2- 172.21.15.135:0/2759552792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8101990 0x7fcfa81982e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 >> 172.21.15.135:0/2759552792 conn(0x7fcfa80fcb80 msgr2=0x7fcfa81038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 shutdown_connections 2024-05-20T17:32:42.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.081+0000 7fcfacfaa640 1 -- 172.21.15.135:0/2759552792 wait complete. 2024-05-20T17:32:42.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 -- 172.21.15.135:0/929041797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c102bf0 msgr2=0x7fa95c103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 --2- 172.21.15.135:0/929041797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c102bf0 0x7fa95c103000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa950009900 tx=0x7fa95002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 -- 172.21.15.135:0/929041797 shutdown_connections 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 --2- 172.21.15.135:0/929041797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa95c1078f0 0x7fa95c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 --2- 172.21.15.135:0/929041797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c102bf0 0x7fa95c103000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 --2- 172.21.15.135:0/929041797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa95c1019b0 0x7fa95c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 -- 172.21.15.135:0/929041797 >> 172.21.15.135:0/929041797 conn(0x7fa95c0fcba0 msgr2=0x7fa95c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 -- 172.21.15.135:0/929041797 shutdown_connections 2024-05-20T17:32:42.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.207+0000 7fa96478f640 1 -- 172.21.15.135:0/929041797 wait complete. 2024-05-20T17:32:42.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 Processor -- start 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 -- start start 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa95c102bf0 0x7fa95c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa95c1078f0 0x7fa95c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c10d680 con 0x7fa95c1019b0 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c10d500 con 0x7fa95c1078f0 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96478f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c10d800 con 0x7fa95c102bf0 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39854/0 (socket says 172.21.15.135:39854) 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 -- 172.21.15.135:0/3959158866 learned_addr learned my addr 172.21.15.135:0/3959158866 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 -- 172.21.15.135:0/3959158866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa95c102bf0 msgr2=0x7fa95c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa95c102bf0 0x7fa95c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 -- 172.21.15.135:0/3959158866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa95c1078f0 msgr2=0x7fa95c19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa95c1078f0 0x7fa95c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.208+0000 7fa96252b640 1 -- 172.21.15.135:0/3959158866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c19fd00 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa96252b640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa958005fd0 tx=0x7fa95800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958017070 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa958009c30 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958003e40 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c19fff0 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.209+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c1a04b0 con 0x7fa95c1019b0 2024-05-20T17:32:42.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.210+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c106700 con 0x7fa95c1019b0 2024-05-20T17:32:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.211+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa958004000 con 0x7fa95c1019b0 2024-05-20T17:32:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.212+0000 7fa94f7fe640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 0x7fa9480a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.212+0000 7fa961d2a640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 0x7fa9480a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.212+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fa9580cf5a0 con 0x7fa95c1019b0 2024-05-20T17:32:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.213+0000 7fa961d2a640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 0x7fa9480a50a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa950009230 tx=0x7fa950031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.216+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa958020030 con 0x7fa95c1019b0 2024-05-20T17:32:42.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.392+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa95c02d450 con 0x7fa95c1019b0 2024-05-20T17:32:42.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.392+0000 7fa94f7fe640 1 -- 172.21.15.135:0/3959158866 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fa95809c4e0 con 0x7fa95c1019b0 2024-05-20T17:32:42.394 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.394+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 msgr2=0x7fa9480a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.394+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 0x7fa9480a50a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa950009230 tx=0x7fa950031400 comp rx=0 tx=0).stop 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.394+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 msgr2=0x7fa95c1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.394+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa958005fd0 tx=0x7fa95800dde0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 shutdown_connections 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa9480a2b90 0x7fa9480a50a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa95c1078f0 0x7fa95c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa95c102bf0 0x7fa95c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 --2- 172.21.15.135:0/3959158866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c1019b0 0x7fa95c1981c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 >> 172.21.15.135:0/3959158866 conn(0x7fa95c0fcba0 msgr2=0x7fa95c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 shutdown_connections 2024-05-20T17:32:42.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.395+0000 7fa96478f640 1 -- 172.21.15.135:0/3959158866 wait complete. 2024-05-20T17:32:42.407 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 -- 172.21.15.135:0/340932471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8214101970 msgr2=0x7f8214102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 --2- 172.21.15.135:0/340932471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8214101970 0x7f8214102670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8204009900 tx=0x7f820402a410 comp rx=0 tx=0).stop 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 -- 172.21.15.135:0/340932471 shutdown_connections 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 --2- 172.21.15.135:0/340932471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82141078b0 0x7f8214109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 --2- 172.21.15.135:0/340932471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 0x7f8214102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 --2- 172.21.15.135:0/340932471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8214101970 0x7f8214102670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 -- 172.21.15.135:0/340932471 >> 172.21.15.135:0/340932471 conn(0x7f82140fcb80 msgr2=0x7f82140ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 -- 172.21.15.135:0/340932471 shutdown_connections 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.516+0000 7f821a24b640 1 -- 172.21.15.135:0/340932471 wait complete. 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 Processor -- start 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 -- start start 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 0x7f8214197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 0x7f8214197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c520 con 0x7f82141078b0 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c3a0 con 0x7f8214101970 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f821a24b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c6a0 con 0x7f8214102bb0 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f8213fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f8213fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39882/0 (socket says 172.21.15.135:39882) 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f8213fff640 1 -- 172.21.15.135:0/3857430231 learned_addr learned my addr 172.21.15.135:0/3857430231 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f82137fe640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 0x7f8214197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.517+0000 7f8212ffd640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 0x7f8214197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 -- 172.21.15.135:0/3857430231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 msgr2=0x7f8214197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 0x7f8214197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 -- 172.21.15.135:0/3857430231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 msgr2=0x7f8214197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 0x7f8214197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 -- 172.21.15.135:0/3857430231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821419ebc0 con 0x7f82141078b0 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f82137fe640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 0x7f8214197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8213fff640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cf10 tx=0x7f820c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c00ebf0 con 0x7f82141078b0 2024-05-20T17:32:42.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820c00ed90 con 0x7f82141078b0 2024-05-20T17:32:42.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821419eeb0 con 0x7f82141078b0 2024-05-20T17:32:42.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c015690 con 0x7f82141078b0 2024-05-20T17:32:42.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.518+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821419f340 con 0x7f82141078b0 2024-05-20T17:32:42.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.519+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82141066c0 con 0x7f82141078b0 2024-05-20T17:32:42.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.521+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f820c004a40 con 0x7f82141078b0 2024-05-20T17:32:42.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.522+0000 7f8210ff9640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 0x7f81fc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.522+0000 7f82137fe640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 0x7f81fc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.522+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f820c0d1290 con 0x7f82141078b0 2024-05-20T17:32:42.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.522+0000 7f82137fe640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 0x7f81fc0a50a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8204009230 tx=0x7f8204000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.525+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f820c09e170 con 0x7f82141078b0 2024-05-20T17:32:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2337293664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2759552792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3959158866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.741+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f821402d2a0 con 0x7f82141078b0 2024-05-20T17:32:42.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.742+0000 7f8210ff9640 1 -- 172.21.15.135:0/3857430231 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f820c09da70 con 0x7f82141078b0 2024-05-20T17:32:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:42.744 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:32:42.744 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 msgr2=0x7f81fc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 0x7f81fc0a50a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8204009230 tx=0x7f8204000bc0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 msgr2=0x7f821419e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cf10 tx=0x7f820c00e420 comp rx=0 tx=0).stop 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 shutdown_connections 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f81fc0a2b90 0x7f81fc0a50a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82141078b0 0x7f821419e600 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214102bb0 0x7f8214197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 --2- 172.21.15.135:0/3857430231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8214101970 0x7f8214197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.744+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 >> 172.21.15.135:0/3857430231 conn(0x7f82140fcb80 msgr2=0x7f8214103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.745+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 shutdown_connections 2024-05-20T17:32:42.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.745+0000 7f821a24b640 1 -- 172.21.15.135:0/3857430231 wait complete. 2024-05-20T17:32:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2337293664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2759552792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3959158866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:32:42.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2337293664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2759552792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3959158866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:42.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- 172.21.15.135:0/1950677594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684103cf0 msgr2=0x7ff684104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/1950677594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684103cf0 0x7ff684104100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff678009900 tx=0x7ff67802a410 comp rx=0 tx=0).stop 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- 172.21.15.135:0/1950677594 shutdown_connections 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/1950677594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6841089f0 0x7ff68410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/1950677594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684103cf0 0x7ff684104100 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/1950677594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 0x7ff6841037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- 172.21.15.135:0/1950677594 >> 172.21.15.135:0/1950677594 conn(0x7ff6840fdca0 msgr2=0x7ff684100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- 172.21.15.135:0/1950677594 shutdown_connections 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- 172.21.15.135:0/1950677594 wait complete. 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 Processor -- start 2024-05-20T17:32:42.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.870+0000 7ff68a5bc640 1 -- start start 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 0x7ff684075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 0x7ff684073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff68410e770 con 0x7ff6841089f0 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff68410e5f0 con 0x7ff684103cf0 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff68a5bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff68410e8f0 con 0x7ff684102ab0 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39886/0 (socket says 172.21.15.135:39886) 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 -- 172.21.15.135:0/2660507471 learned_addr learned my addr 172.21.15.135:0/2660507471 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:42.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff683fff640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 0x7ff684075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff6837fe640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 0x7ff684073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 -- 172.21.15.135:0/2660507471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 msgr2=0x7ff684075800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 0x7ff684075800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 -- 172.21.15.135:0/2660507471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 msgr2=0x7ff684073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 0x7ff684073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 -- 172.21.15.135:0/2660507471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684074b10 con 0x7ff6841089f0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff6837fe640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 0x7ff684073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.871+0000 7ff688b59640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00cad0 tx=0x7ff67c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.872+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00ae20 con 0x7ff6841089f0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.872+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff67c005020 con 0x7ff6841089f0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.872+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6841a3350 con 0x7ff6841089f0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.872+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00f6f0 con 0x7ff6841089f0 2024-05-20T17:32:42.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.872+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6841a37c0 con 0x7ff6841089f0 2024-05-20T17:32:42.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.873+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff684107800 con 0x7ff6841089f0 2024-05-20T17:32:42.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.874+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff67c0051d0 con 0x7ff6841089f0 2024-05-20T17:32:42.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.874+0000 7ff6817fa640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 0x7ff66c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:42.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.875+0000 7ff683fff640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 0x7ff66c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:42.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.875+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff67c0cf100 con 0x7ff6841089f0 2024-05-20T17:32:42.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.875+0000 7ff683fff640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 0x7ff66c0a50a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff674005fd0 tx=0x7ff67400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:42.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:42.879+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff67c014030 con 0x7ff6841089f0 2024-05-20T17:32:43.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.057+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff684062750 con 0x7ff6841089f0 2024-05-20T17:32:43.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.058+0000 7ff6817fa640 1 -- 172.21.15.135:0/2660507471 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7ff67c09c040 con 0x7ff6841089f0 2024-05-20T17:32:43.060 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:43.060 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:32:43.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 msgr2=0x7ff66c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 0x7ff66c0a50a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff674005fd0 tx=0x7ff67400b390 comp rx=0 tx=0).stop 2024-05-20T17:32:43.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 msgr2=0x7ff6840743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00cad0 tx=0x7ff67c00cf90 comp rx=0 tx=0).stop 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 shutdown_connections 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff66c0a2b90 0x7ff66c0a50a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6841089f0 0x7ff6840743e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff684103cf0 0x7ff684073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 --2- 172.21.15.135:0/2660507471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff684102ab0 0x7ff684075800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 >> 172.21.15.135:0/2660507471 conn(0x7ff6840fdca0 msgr2=0x7ff6841049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 shutdown_connections 2024-05-20T17:32:43.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.061+0000 7ff68a5bc640 1 -- 172.21.15.135:0/2660507471 wait complete. 2024-05-20T17:32:43.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:32:43.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:32:43.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 -- 172.21.15.135:0/2814110639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30102910 msgr2=0x7f9c30102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 --2- 172.21.15.135:0/2814110639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30102910 0x7f9c30102da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009900 tx=0x7f9c2402a410 comp rx=0 tx=0).stop 2024-05-20T17:32:43.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 -- 172.21.15.135:0/2814110639 shutdown_connections 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 --2- 172.21.15.135:0/2814110639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 0x7f9c30109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 --2- 172.21.15.135:0/2814110639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30102910 0x7f9c30102da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 --2- 172.21.15.135:0/2814110639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101f30 0x7f9c30102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 -- 172.21.15.135:0/2814110639 >> 172.21.15.135:0/2814110639 conn(0x7f9c300fc330 msgr2=0x7f9c300fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 -- 172.21.15.135:0/2814110639 shutdown_connections 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.188+0000 7f9c3654c640 1 -- 172.21.15.135:0/2814110639 wait complete. 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 Processor -- start 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 -- start start 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30102910 0x7f9c30199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 0x7f9c301a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3010e750 con 0x7f9c30101f30 2024-05-20T17:32:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3010e5d0 con 0x7f9c30103430 2024-05-20T17:32:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c3654c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3010e8d0 con 0x7f9c30102910 2024-05-20T17:32:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39914/0 (socket says 172.21.15.135:39914) 2024-05-20T17:32:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c2ffff640 1 -- 172.21.15.135:0/110905834 learned_addr learned my addr 172.21.15.135:0/110905834 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.189+0000 7f9c2f7fe640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30102910 0x7f9c30199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c34ae9640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 0x7f9c301a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 -- 172.21.15.135:0/110905834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30102910 msgr2=0x7f9c30199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30102910 0x7f9c30199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 -- 172.21.15.135:0/110905834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 msgr2=0x7f9c301a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 0x7f9c301a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 -- 172.21.15.135:0/110905834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301a0d00 con 0x7f9c30101f30 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2ffff640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000c970 tx=0x7f9c2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20014070 con 0x7f9c30101f30 2024-05-20T17:32:43.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301a0ff0 con 0x7f9c30101f30 2024-05-20T17:32:43.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c20004440 con 0x7f9c30101f30 2024-05-20T17:32:43.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000f450 con 0x7f9c30101f30 2024-05-20T17:32:43.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.190+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301a14b0 con 0x7f9c30101f30 2024-05-20T17:32:43.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.191+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c301068d0 con 0x7f9c30101f30 2024-05-20T17:32:43.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.192+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9c20017070 con 0x7f9c30101f30 2024-05-20T17:32:43.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.193+0000 7f9c2d7fa640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 0x7f9c180a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.193+0000 7f9c2f7fe640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 0x7f9c180a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.193+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f9c200ceea0 con 0x7f9c30101f30 2024-05-20T17:32:43.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.193+0000 7f9c2f7fe640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 0x7f9c180a50a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009230 tx=0x7f9c24031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.198+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9c2001e020 con 0x7f9c30101f30 2024-05-20T17:32:43.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.374+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c30062750 con 0x7f9c30101f30 2024-05-20T17:32:43.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.374+0000 7f9c2d7fa640 1 -- 172.21.15.135:0/110905834 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f9c2009bde0 con 0x7f9c30101f30 2024-05-20T17:32:43.376 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 msgr2=0x7f9c180a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 0x7f9c180a50a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009230 tx=0x7f9c24031400 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 msgr2=0x7f9c301992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000c970 tx=0x7f9c2000ce30 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 shutdown_connections 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c180a2b90 0x7f9c180a50a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c30103430 0x7f9c301a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30102910 0x7f9c30199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 --2- 172.21.15.135:0/110905834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c30101f30 0x7f9c301992e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 >> 172.21.15.135:0/110905834 conn(0x7f9c300fc330 msgr2=0x7f9c30103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 shutdown_connections 2024-05-20T17:32:43.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.376+0000 7f9c3654c640 1 -- 172.21.15.135:0/110905834 wait complete. 2024-05-20T17:32:43.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 -- 172.21.15.135:0/3417042672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac100710 msgr2=0x7f79ac100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 --2- 172.21.15.135:0/3417042672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac100710 0x7f79ac100b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f799c009900 tx=0x7f799c02a410 comp rx=0 tx=0).stop 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 -- 172.21.15.135:0/3417042672 shutdown_connections 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 --2- 172.21.15.135:0/3417042672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 --2- 172.21.15.135:0/3417042672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac100710 0x7f79ac100b80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 --2- 172.21.15.135:0/3417042672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac104060 0x7f79ac104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 -- 172.21.15.135:0/3417042672 >> 172.21.15.135:0/3417042672 conn(0x7f79ac0fc330 msgr2=0x7f79ac0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 -- 172.21.15.135:0/3417042672 shutdown_connections 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.501+0000 7f79b1eca640 1 -- 172.21.15.135:0/3417042672 wait complete. 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 Processor -- start 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 -- start start 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 0x7f79ac199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac10e720 con 0x7f79ac104060 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac10e5a0 con 0x7f79ac101210 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79b1eca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac10e8a0 con 0x7f79ac100710 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39942/0 (socket says 172.21.15.135:39942) 2024-05-20T17:32:43.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.502+0000 7f79abfff640 1 -- 172.21.15.135:0/2617351318 learned_addr learned my addr 172.21.15.135:0/2617351318 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79ab7fe640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 0x7f79ac199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79aaffd640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 -- 172.21.15.135:0/2617351318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 msgr2=0x7f79ac199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 0x7f79ac199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 -- 172.21.15.135:0/2617351318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 msgr2=0x7f79ac199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 -- 172.21.15.135:0/2617351318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac1a0d70 con 0x7f79ac104060 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79ab7fe640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 0x7f79ac199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79aaffd640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79abfff640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f79a400cad0 tx=0x7f79a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a400ae20 con 0x7f79ac104060 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79a4005020 con 0x7f79ac104060 2024-05-20T17:32:43.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac1a1060 con 0x7f79ac104060 2024-05-20T17:32:43.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a400f6f0 con 0x7f79ac104060 2024-05-20T17:32:43.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.503+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac1a1560 con 0x7f79ac104060 2024-05-20T17:32:43.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.504+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac1079f0 con 0x7f79ac104060 2024-05-20T17:32:43.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.506+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f79a40051d0 con 0x7f79ac104060 2024-05-20T17:32:43.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.507+0000 7f79a8ff9640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 0x7f79940a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.507+0000 7f79ab7fe640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 0x7f79940a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.507+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f79a40cf1b0 con 0x7f79ac104060 2024-05-20T17:32:43.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.508+0000 7f79ab7fe640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 0x7f79940a50a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06a280 tx=0x7f79a000a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.513+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f79a4014030 con 0x7f79ac104060 2024-05-20T17:32:43.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.691+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79ac062750 con 0x7f79ac104060 2024-05-20T17:32:43.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.691+0000 7f79a8ff9640 1 -- 172.21.15.135:0/2617351318 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f79a409c0f0 con 0x7f79ac104060 2024-05-20T17:32:43.693 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.693+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 msgr2=0x7f79940a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.693+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 0x7f79940a50a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06a280 tx=0x7f79a000a5e0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.693+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 msgr2=0x7f79ac1a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.693+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f79a400cad0 tx=0x7f79a400cf90 comp rx=0 tx=0).stop 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 shutdown_connections 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f79940a2b90 0x7f79940a50a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79ac104060 0x7f79ac1a07b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79ac101210 0x7f79ac199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 --2- 172.21.15.135:0/2617351318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac100710 0x7f79ac199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 >> 172.21.15.135:0/2617351318 conn(0x7f79ac0fc330 msgr2=0x7f79ac104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 shutdown_connections 2024-05-20T17:32:43.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.694+0000 7f79b1eca640 1 -- 172.21.15.135:0/2617351318 wait complete. 2024-05-20T17:32:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:43 smithi135 ceph-mon[32027]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:43 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3857430231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:43 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2660507471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:43 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/110905834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:43.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:32:43.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- 172.21.15.135:0/4154190939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 msgr2=0x7f5e341026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 --2- 172.21.15.135:0/4154190939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341026b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009900 tx=0x7f5e3002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:43.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- 172.21.15.135:0/4154190939 shutdown_connections 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 --2- 172.21.15.135:0/4154190939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 0x7f5e34109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 --2- 172.21.15.135:0/4154190939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 0x7f5e34103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 --2- 172.21.15.135:0/4154190939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341026b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- 172.21.15.135:0/4154190939 >> 172.21.15.135:0/4154190939 conn(0x7f5e340fcba0 msgr2=0x7f5e340ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- 172.21.15.135:0/4154190939 shutdown_connections 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- 172.21.15.135:0/4154190939 wait complete. 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 Processor -- start 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.819+0000 7f5e3c073640 1 -- start start 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 0x7f5e34199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 0x7f5e341a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410e6f0 con 0x7f5e341019b0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410e570 con 0x7f5e341078f0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410e870 con 0x7f5e34102bf0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39952/0 (socket says 172.21.15.135:39952) 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 -- 172.21.15.135:0/3508011971 learned_addr learned my addr 172.21.15.135:0/3508011971 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3a610640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 0x7f5e341a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3960e640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 0x7f5e34199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 -- 172.21.15.135:0/3508011971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 msgr2=0x7f5e34199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 0x7f5e34199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 -- 172.21.15.135:0/3508011971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 msgr2=0x7f5e341a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:43.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 0x7f5e341a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 -- 172.21.15.135:0/3508011971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e341a0e00 con 0x7f5e341019b0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e39e0f640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e30031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3003f030 con 0x7f5e341019b0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e30003ad0 con 0x7f5e341019b0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e341a1090 con 0x7f5e341019b0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.820+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30035070 con 0x7f5e341019b0 2024-05-20T17:32:43.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.821+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e341a1580 con 0x7f5e341019b0 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.822+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e34106700 con 0x7f5e341019b0 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.823+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5e30042030 con 0x7f5e341019b0 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.823+0000 7f5e2affd640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 0x7f5e200a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.824+0000 7f5e3960e640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 0x7f5e200a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.824+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5e300ef820 con 0x7f5e341019b0 2024-05-20T17:32:43.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.824+0000 7f5e3960e640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 0x7f5e200a50a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e3419a360 tx=0x7f5e24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:43.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:43.827+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5e300bc110 con 0x7f5e341019b0 2024-05-20T17:32:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:43 smithi172 ceph-mon[36511]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:43 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3857430231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:43 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2660507471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:43 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/110905834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.002+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5e34062750 con 0x7f5e341019b0 2024-05-20T17:32:44.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.003+0000 7f5e2affd640 1 -- 172.21.15.135:0/3508011971 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f5e300c0410 con 0x7f5e341019b0 2024-05-20T17:32:44.004 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:32:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:43 smithi160 ceph-mon[36261]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:43 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3857430231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:43 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2660507471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:43 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/110905834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 msgr2=0x7f5e200a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 0x7f5e200a50a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e3419a360 tx=0x7f5e24005f90 comp rx=0 tx=0).stop 2024-05-20T17:32:44.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 msgr2=0x7f5e341992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e30031b60 comp rx=0 tx=0).stop 2024-05-20T17:32:44.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 shutdown_connections 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5e200a2b90 0x7f5e200a50a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e341078f0 0x7f5e341a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34102bf0 0x7f5e34199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 --2- 172.21.15.135:0/3508011971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e341019b0 0x7f5e341992c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 >> 172.21.15.135:0/3508011971 conn(0x7f5e340fcba0 msgr2=0x7f5e341038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 shutdown_connections 2024-05-20T17:32:44.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.005+0000 7f5e3c073640 1 -- 172.21.15.135:0/3508011971 wait complete. 2024-05-20T17:32:44.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:32:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 -- 172.21.15.135:0/1529508224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0102bb0 msgr2=0x7f96c0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1529508224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0102bb0 0x7f96c0102fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009900 tx=0x7f96b002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 -- 172.21.15.135:0/1529508224 shutdown_connections 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1529508224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c01078b0 0x7f96c0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1529508224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0102bb0 0x7f96c0102fc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1529508224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96c0101970 0x7f96c0102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 -- 172.21.15.135:0/1529508224 >> 172.21.15.135:0/1529508224 conn(0x7f96c00fcb80 msgr2=0x7f96c00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 -- 172.21.15.135:0/1529508224 shutdown_connections 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.127+0000 7f96c7e32640 1 -- 172.21.15.135:0/1529508224 wait complete. 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 Processor -- start 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 -- start start 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c0102bb0 0x7f96c019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96c01078b0 0x7f96c01a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96c010d5c0 con 0x7f96c0101970 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f96c010d440 con 0x7f96c01078b0 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c7e32640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96c010d740 con 0x7f96c0102bb0 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39976/0 (socket says 172.21.15.135:39976) 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 -- 172.21.15.135:0/1898939077 learned_addr learned my addr 172.21.15.135:0/1898939077 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 -- 172.21.15.135:0/1898939077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c0102bb0 msgr2=0x7f96c019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c0102bb0 0x7f96c019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 -- 172.21.15.135:0/1898939077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96c01078b0 msgr2=0x7f96c01a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96c01078b0 0x7f96c01a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 -- 172.21.15.135:0/1898939077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c01a0db0 con 0x7f96c0101970 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.128+0000 7f96c5bce640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f96b800d740 tx=0x7f96b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.129+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8017070 con 0x7f96c0101970 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.129+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c01a10a0 con 0x7f96c0101970 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.129+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b800de50 con 0x7f96c0101970 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.129+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8003e00 con 0x7f96c0101970 2024-05-20T17:32:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.129+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c01a15f0 con 0x7f96c0101970 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.130+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c01066c0 con 0x7f96c0101970 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.131+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f96b8003fa0 con 0x7f96c0101970 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.131+0000 7f96b6ffd640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 0x7f96ac0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.132+0000 7f96c53cd640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 0x7f96ac0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.132+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f96b80ceef0 con 0x7f96c0101970 2024-05-20T17:32:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.132+0000 7f96c53cd640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 0x7f96ac0a50a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96b00096c0 tx=0x7f96b0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.135+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f96b809be30 con 0x7f96c0101970 2024-05-20T17:32:44.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.348+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96c002d2a0 con 0x7f96c0101970 2024-05-20T17:32:44.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.349+0000 7f96b6ffd640 1 -- 172.21.15.135:0/1898939077 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f96b809b730 con 0x7f96c0101970 2024-05-20T17:32:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:44.350 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:32:44.351 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:32:44.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 msgr2=0x7f96ac0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 0x7f96ac0a50a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96b00096c0 tx=0x7f96b0031400 comp rx=0 tx=0).stop 2024-05-20T17:32:44.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 msgr2=0x7f96c0069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f96b800d740 tx=0x7f96b800dc00 comp rx=0 tx=0).stop 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 shutdown_connections 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96ac0a2b90 0x7f96ac0a50a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96c01078b0 0x7f96c01a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c0102bb0 0x7f96c019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 --2- 172.21.15.135:0/1898939077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c0101970 0x7f96c0069910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 >> 172.21.15.135:0/1898939077 conn(0x7f96c00fcb80 msgr2=0x7f96c0103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 shutdown_connections 2024-05-20T17:32:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.351+0000 7f96c7e32640 1 -- 172.21.15.135:0/1898939077 wait complete. 2024-05-20T17:32:44.364 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:32:44.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/3734209532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 msgr2=0x7fcb94102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/3734209532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94102690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009900 tx=0x7fcb9002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:44.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/3734209532 shutdown_connections 2024-05-20T17:32:44.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/3734209532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb941078d0 0x7fcb94109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/3734209532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb94102bd0 0x7fcb94102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/3734209532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94102690 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/3734209532 >> 172.21.15.135:0/3734209532 conn(0x7fcb940fcb80 msgr2=0x7fcb940ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/3734209532 shutdown_connections 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.473+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/3734209532 wait complete. 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 Processor -- start 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 -- start start 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb94102bd0 0x7fcb94198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb941078d0 0x7fcb9419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9410d610 con 0x7fcb94101990 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9410d490 con 0x7fcb94102bd0 2024-05-20T17:32:44.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9c0f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9410d790 con 0x7fcb941078d0 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39988/0 (socket says 172.21.15.135:39988) 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 -- 172.21.15.135:0/2226924024 learned_addr learned my addr 172.21.15.135:0/2226924024 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9a68d640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb941078d0 0x7fcb9419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb9968b640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb94102bd0 0x7fcb94198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 -- 172.21.15.135:0/2226924024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb941078d0 msgr2=0x7fcb9419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb941078d0 0x7fcb9419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 -- 172.21.15.135:0/2226924024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb94102bd0 msgr2=0x7fcb94198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb94102bd0 0x7fcb94198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.474+0000 7fcb99e8c640 1 -- 172.21.15.135:0/2226924024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9419fd60 con 0x7fcb94101990 2024-05-20T17:32:44.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb99e8c640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb90031610 tx=0x7fcb90032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90046070 con 0x7fcb94101990 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb90003ad0 con 0x7fcb94101990 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb94073d80 con 0x7fcb94101990 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90035050 con 0x7fcb94101990 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.475+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb94074270 con 0x7fcb94101990 2024-05-20T17:32:44.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.476+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb94069140 con 0x7fcb94101990 2024-05-20T17:32:44.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.477+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcb90049070 con 0x7fcb94101990 2024-05-20T17:32:44.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.478+0000 7fcb8affd640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 0x7fcb800a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.478+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fcb900f0e10 con 0x7fcb94101990 2024-05-20T17:32:44.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.478+0000 7fcb9968b640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 0x7fcb800a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.478+0000 7fcb9968b640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 0x7fcb800a50a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb84005d00 tx=0x7fcb84005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.481+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcb90050080 con 0x7fcb94101990 2024-05-20T17:32:44.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.660+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb94106150 con 0x7fcb94101990 2024-05-20T17:32:44.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.662+0000 7fcb8affd640 1 -- 172.21.15.135:0/2226924024 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7fcb900bdd50 con 0x7fcb94101990 2024-05-20T17:32:44.663 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:44.664 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:32:44.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 msgr2=0x7fcb800a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 0x7fcb800a50a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb84005d00 tx=0x7fcb84005c70 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 msgr2=0x7fcb94198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb90031610 tx=0x7fcb90032c60 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 shutdown_connections 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcb800a2b90 0x7fcb800a50a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb941078d0 0x7fcb9419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb94102bd0 0x7fcb94198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 --2- 172.21.15.135:0/2226924024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94101990 0x7fcb94198220 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 >> 172.21.15.135:0/2226924024 conn(0x7fcb940fcb80 msgr2=0x7fcb941038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 shutdown_connections 2024-05-20T17:32:44.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.664+0000 7fcb9c0f0640 1 -- 172.21.15.135:0/2226924024 wait complete. 2024-05-20T17:32:44.676 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2617351318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.676 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3508011971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.676 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1898939077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:44.677 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:32:44.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- 172.21.15.135:0/559070372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8105ec0 msgr2=0x7f3fa81082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/559070372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8105ec0 0x7f3fa81082e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009900 tx=0x7f3f9002a410 comp rx=0 tx=0).stop 2024-05-20T17:32:44.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- 172.21.15.135:0/559070372 shutdown_connections 2024-05-20T17:32:44.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/559070372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8108820 0x7f3fa810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/559070372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8105ec0 0x7f3fa81082e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/559070372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8103560 0x7f3fa8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- 172.21.15.135:0/559070372 >> 172.21.15.135:0/559070372 conn(0x7f3fa80fcb80 msgr2=0x7f3fa80ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- 172.21.15.135:0/559070372 shutdown_connections 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- 172.21.15.135:0/559070372 wait complete. 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 Processor -- start 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.787+0000 7f3fadbe3640 1 -- start start 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8103560 0x7f3fa8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 0x7f3fa8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa810e6f0 con 0x7f3fa8108820 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa810e570 con 0x7f3fa8103560 2024-05-20T17:32:44.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa810e870 con 0x7f3fa8105ec0 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40008/0 (socket says 172.21.15.135:40008) 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 -- 172.21.15.135:0/114990111 learned_addr learned my addr 172.21.15.135:0/114990111 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa77fe640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8103560 0x7f3fa8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3f9effd640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 0x7f3fa8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 -- 172.21.15.135:0/114990111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 msgr2=0x7f3fa8199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 0x7f3fa8199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 -- 172.21.15.135:0/114990111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8103560 msgr2=0x7f3fa8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8103560 0x7f3fa8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 -- 172.21.15.135:0/114990111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa81a0e60 con 0x7f3fa8108820 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3f9effd640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 0x7f3fa8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa7fff640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000e9d0 tx=0x7f3fa000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000cd80 con 0x7f3fa8108820 2024-05-20T17:32:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa0005020 con 0x7f3fa8108820 2024-05-20T17:32:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa81a1150 con 0x7f3fa8108820 2024-05-20T17:32:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00116d0 con 0x7f3fa8108820 2024-05-20T17:32:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.788+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81a16a0 con 0x7f3fa8108820 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.789+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80fe6a0 con 0x7f3fa8108820 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.791+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f3fa00051d0 con 0x7f3fa8108820 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.792+0000 7f3fa57fa640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 0x7f3f940a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.792+0000 7f3fa77fe640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 0x7f3f940a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.792+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3fa00cf570 con 0x7f3fa8108820 2024-05-20T17:32:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.792+0000 7f3fa77fe640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 0x7f3f940a5120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f980058c0 tx=0x7f3f9800a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:44.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:44.795+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3fa0016030 con 0x7f3fa8108820 2024-05-20T17:32:44.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:44 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2617351318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:44 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3508011971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:44.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:44 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1898939077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:45.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:44 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2617351318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:32:45.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:44 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3508011971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:32:45.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:44 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1898939077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:45.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.009+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fa802d2a0 con 0x7f3fa8108820 2024-05-20T17:32:45.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.009+0000 7f3fa57fa640 1 -- 172.21.15.135:0/114990111 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7f3fa009c530 con 0x7f3fa8108820 2024-05-20T17:32:45.011 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:32:45.011 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:32:45.011 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 msgr2=0x7f3f940a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 0x7f3f940a5120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f980058c0 tx=0x7f3f9800a250 comp rx=0 tx=0).stop 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 msgr2=0x7f3fa81a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000e9d0 tx=0x7f3fa000ee90 comp rx=0 tx=0).stop 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 shutdown_connections 2024-05-20T17:32:45.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f3f940a2c10 0x7f3f940a5120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fa8108820 0x7f3fa81a07f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa8105ec0 0x7f3fa8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 --2- 172.21.15.135:0/114990111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fa8103560 0x7f3fa8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 >> 172.21.15.135:0/114990111 conn(0x7f3fa80fcb80 msgr2=0x7f3fa8104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 shutdown_connections 2024-05-20T17:32:45.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.012+0000 7f3fadbe3640 1 -- 172.21.15.135:0/114990111 wait complete. 2024-05-20T17:32:45.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-20T17:31:14.132666+0000', 'modified': '2024-05-20T17:31:18.165890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24523, 'mds_2': 24521}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/3094095088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3094095088}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3094095088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/4160320010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 4160320010}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 4160320010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/3276473516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3276473516}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3276473516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.160:6837/320557399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 320557399}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 320557399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.172:6839/380136788', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 380136788}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 380136788}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6839/1255615526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 1255615526}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 1255615526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24521, 24523, 24560]} 2024-05-20T17:32:45.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-20T17:32:45.025 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-20T17:32:45.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 -- 172.21.15.135:0/2898890594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180108850 msgr2=0x7f218010ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 --2- 172.21.15.135:0/2898890594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180108850 0x7f218010ac70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2178009ca0 tx=0x7f217802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 -- 172.21.15.135:0/2898890594 shutdown_connections 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 --2- 172.21.15.135:0/2898890594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180108850 0x7f218010ac70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 --2- 172.21.15.135:0/2898890594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180105ef0 0x7f2180108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 --2- 172.21.15.135:0/2898890594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f21801059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 -- 172.21.15.135:0/2898890594 >> 172.21.15.135:0/2898890594 conn(0x7f21800fcb70 msgr2=0x7f21800ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 -- 172.21.15.135:0/2898890594 shutdown_connections 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.134+0000 7f21884fe640 1 -- 172.21.15.135:0/2898890594 wait complete. 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 Processor -- start 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 -- start start 2024-05-20T17:32:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f2180199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180108850 0x7f21801a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f218010e720 con 0x7f2180105ef0 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f218010e5a0 con 0x7f2180103590 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f21884fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f218010e8a0 con 0x7f2180108850 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f2185a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f2185a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40020/0 (socket says 172.21.15.135:40020) 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f2186a9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180108850 0x7f21801a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.135+0000 7f2185a99640 1 -- 172.21.15.135:0/2143798580 learned_addr learned my addr 172.21.15.135:0/2143798580 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f218629a640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f2180199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 -- 172.21.15.135:0/2143798580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180108850 msgr2=0x7f21801a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180108850 0x7f21801a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 -- 172.21.15.135:0/2143798580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 msgr2=0x7f2180199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f2180199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 -- 172.21.15.135:0/2143798580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21801a0da0 con 0x7f2180105ef0 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f218629a640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f2180199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f2185a99640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f217000d770 tx=0x7f217000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f21777fe640 1 -- 172.21.15.135:0/2143798580 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170017070 con 0x7f2180105ef0 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f21777fe640 1 -- 172.21.15.135:0/2143798580 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2170005500 con 0x7f2180105ef0 2024-05-20T17:32:45.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21801a1090 con 0x7f2180105ef0 2024-05-20T17:32:45.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f21777fe640 1 -- 172.21.15.135:0/2143798580 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170004e00 con 0x7f2180105ef0 2024-05-20T17:32:45.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.136+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801a15e0 con 0x7f2180105ef0 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f21777fe640 1 -- 172.21.15.135:0/2143798580 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2170004fa0 con 0x7f2180105ef0 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 Processor -- start 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 -- start start 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814fb5270 0x55b815355470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f94590 0x55b81535c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b8152b94d0 con 0x55b814f8c3b0 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b8152613e0 con 0x55b814f94590 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218f3a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b8152b5490 con 0x55b814fb5270 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.139+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40024/0 (socket says 172.21.15.135:40024) 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 -- 172.21.15.135:0/2203611316 learned_addr learned my addr 172.21.15.135:0/2203611316 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814fb5270 0x55b815355470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f21777fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 0x7f216c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2185a99640 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f94590 0x55b81535c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 0x7f216c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 -- 172.21.15.135:0/2203611316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814fb5270 msgr2=0x55b815355470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814fb5270 0x55b815355470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 -- 172.21.15.135:0/2203611316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f94590 msgr2=0x55b81535c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f94590 0x55b81535c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 -- 172.21.15.135:0/2203611316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b814fcd2d0 con 0x55b814f8c3b0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f21777fe640 1 -- 172.21.15.135:0/2143798580 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f21700cea30 con 0x7f2180105ef0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f218629a640 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f217c009cf0 tx=0x7f217c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06a3de81c670355 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 0x7f216c0a5120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2178005e30 tx=0x7f217802a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2174bfe640 1 -- 172.21.15.135:0/2203611316 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c012450 con 0x55b814f8c3b0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2174bfe640 1 -- 172.21.15.135:0/2203611316 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c012ad0 con 0x55b814f8c3b0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.140+0000 7f2174bfe640 1 -- 172.21.15.135:0/2203611316 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00fc00 con 0x55b814f8c3b0 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 -- 172.21.15.135:0/2203611316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 msgr2=0x55b8153559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f217c009cf0 tx=0x7f217c0117b0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 -- 172.21.15.135:0/2203611316 shutdown_connections 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f94590 0x55b81535c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b8153559f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2203611316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814fb5270 0x55b815355470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 -- 172.21.15.135:0/2203611316 >> 172.21.15.135:0/2203611316 conn(0x55b814fa93c0 msgr2=0x55b815350e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 -- 172.21.15.135:0/2203611316 shutdown_connections 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.141+0000 7f218f3a5740 1 -- 172.21.15.135:0/2203611316 wait complete. 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 -- start start 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 Processor -- start 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b81535f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814fb5270 0x55b815366700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b81535d340 con 0x55b814f8c3b0 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b8152748e0 con 0x55b814fb5270 2024-05-20T17:32:45.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b81535d4c0 con 0x55b814f94590 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218f3a5740 10 client.0 _ll_register_callbacks cb 0x55b8152419c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40040/0 (socket says 172.21.15.135:40040) 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 -- 172.21.15.135:0/4000220785 learned_addr learned my addr 172.21.15.135:0/4000220785 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f2186a9b640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814fb5270 0x55b815366700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 -- 172.21.15.135:0/4000220785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 msgr2=0x55b81535f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b81535f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 -- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814fb5270 msgr2=0x55b815366700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814fb5270 0x55b815366700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.142+0000 7f218629a640 1 -- 172.21.15.135:0/4000220785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8150976b0 con 0x55b814f8c3b0 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218629a640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f217c000c00 tx=0x7f217c0097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56141617291dc830 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c028020 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f217c004250 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c012ad0 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f217c033050 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 10 client.15078 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b815369680 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c012ad0 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f217c005050 con 0x55b814f8c3b0 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 10 client.15078 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 20 client.15078 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814f73e40 0x55b81536cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 4 client.15078 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.143+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8152c6c00 con 0x55b814f73e40 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.144+0000 7f2185a99640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814f73e40 0x55b81536cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.144+0000 7f2169ffb640 10 client.15078 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.144+0000 7f2185a99640 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814f73e40 0x55b81536cec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c57d3a902b5055a server_cookie=a27d181dfb830689 in_seq=0 out_seq=0 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.145+0000 7f2169ffb640 1 -- 172.21.15.135:0/4000220785 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b8152c6c00 con 0x55b814f73e40 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.145+0000 7f2169ffb640 10 client.15078 handle_command_reply: tid=0 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.145+0000 7f218f3a5740 1 client.15078 shutdown 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 msgr2=0x55b81535f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f217c000c00 tx=0x7f217c0097e0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 shutdown_connections 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814f73e40 0x55b81536cec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814fb5270 0x55b815366700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b81535f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f2169ffb640 0 client.15078 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 --2- 172.21.15.135:0/4000220785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f8c3b0 0x55b81535f260 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 >> 172.21.15.135:0/4000220785 conn(0x55b814fa93c0 msgr2=0x55b81534fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 shutdown_connections 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 1 -- 172.21.15.135:0/4000220785 wait complete. 2024-05-20T17:32:45.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.146+0000 7f218f3a5740 20 client.15078 trim_cache size 0 max 16384 2024-05-20T17:32:45.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 Processor -- start 2024-05-20T17:32:45.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 -- start start 2024-05-20T17:32:45.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f8c3b0 0x55b815358a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b815353ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b81536b200 con 0x55b814f73e40 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b81536b8d0 con 0x55b814f8c3b0 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218f3a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b81536bfa0 con 0x55b814f94590 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40056/0 (socket says 172.21.15.135:40056) 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 -- 172.21.15.135:0/3318163995 learned_addr learned my addr 172.21.15.135:0/3318163995 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f2185a99640 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f8c3b0 0x55b815358a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 -- 172.21.15.135:0/3318163995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 msgr2=0x55b815353ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b815353ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 -- 172.21.15.135:0/3318163995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f8c3b0 msgr2=0x55b815358a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f8c3b0 0x55b815358a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.164+0000 7f218629a640 1 -- 172.21.15.135:0/3318163995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81535ca30 con 0x55b814f73e40 2024-05-20T17:32:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218629a640 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f217c005470 tx=0x7f217c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf4fbd1b1ae0181 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f216bfff640 1 -- 172.21.15.135:0/3318163995 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c03c070 con 0x55b814f73e40 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f216bfff640 1 -- 172.21.15.135:0/3318163995 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c009b40 con 0x55b814f73e40 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f216bfff640 1 -- 172.21.15.135:0/3318163995 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c028040 con 0x55b814f73e40 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 -- 172.21.15.135:0/3318163995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 msgr2=0x55b8153584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f217c005470 tx=0x7f217c0092c0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 -- 172.21.15.135:0/3318163995 shutdown_connections 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f94590 0x55b815353ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f8c3b0 0x55b815358a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 --2- 172.21.15.135:0/3318163995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f73e40 0x55b8153584e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 -- 172.21.15.135:0/3318163995 >> 172.21.15.135:0/3318163995 conn(0x55b814fa93c0 msgr2=0x55b8153507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 -- 172.21.15.135:0/3318163995 shutdown_connections 2024-05-20T17:32:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.165+0000 7f218f3a5740 1 -- 172.21.15.135:0/3318163995 wait complete. 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 -- start start 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 Processor -- start 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 0x55b815362df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f8c3b0 0x55b815363330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b81536cd40 con 0x55b814f94590 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b81536c670 con 0x55b814f73e40 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b81536d410 con 0x55b814f8c3b0 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218f3a5740 10 client.0 _ll_register_callbacks cb 0x7f2178009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40068/0 (socket says 172.21.15.135:40068) 2024-05-20T17:32:45.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 -- 172.21.15.135:0/2204870808 learned_addr learned my addr 172.21.15.135:0/2204870808 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218629a640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 0x55b815362df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2185a99640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f8c3b0 0x55b815363330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 -- 172.21.15.135:0/2204870808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f8c3b0 msgr2=0x55b815363330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f8c3b0 0x55b815363330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 -- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 msgr2=0x55b815362df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 0x55b815362df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f2186a9b640 1 -- 172.21.15.135:0/2204870808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8153d42f0 con 0x55b814f94590 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.166+0000 7f218629a640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 0x55b815362df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2186a9b640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2180074e60 tx=0x7f2178009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee67b87ffd90de8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217804f070 con 0x55b814f94590 2024-05-20T17:32:45.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f2178004040 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c009b40 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f217805b050 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 10 client.15084 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b8153d5550 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c009b40 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f217802fc90 con 0x55b814f94590 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 10 client.15084 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 20 client.15084 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814fb5270 0x55b8153d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 4 client.15084 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:32:45.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.167+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "status"}) -- 0x55b8152c0f50 con 0x55b814fb5270 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218629a640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814fb5270 0x55b8153d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218629a640 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814fb5270 0x55b8153d6ce0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fcfdffe89b6409ff server_cookie=c355492a1b1afcfe in_seq=0 out_seq=0 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f2169ffb640 10 client.15084 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f2169ffb640 1 -- 172.21.15.135:0/2204870808 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b8152c0f50 con 0x55b814fb5270 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f2169ffb640 10 client.15084 handle_command_reply: tid=0 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 client.15084 shutdown 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 msgr2=0x55b8153d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2180074e60 tx=0x7f2178009380 comp rx=0 tx=0).stop 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 shutdown_connections 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55b814fb5270 0x55b8153d6ce0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b814f94590 0x55b8153d3d30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b814f8c3b0 0x55b815363330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 --2- 172.21.15.135:0/2204870808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b814f73e40 0x55b815362df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 >> 172.21.15.135:0/2204870808 conn(0x55b814fa93c0 msgr2=0x55b8153584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f2169ffb640 0 client.15084 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 shutdown_connections 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.168+0000 7f218f3a5740 1 -- 172.21.15.135:0/2204870808 wait complete. 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f218f3a5740 20 client.15084 trim_cache size 0 max 16384 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:32:45.178 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24521, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 87.361450656000002, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 108.786905902 2024-05-20T17:32:45.179 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 msgr2=0x7f216c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 0x7f216c0a5120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2178005e30 tx=0x7f217802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 msgr2=0x7f21801997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f217000d770 tx=0x7f217000dc30 comp rx=0 tx=0).stop 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 shutdown_connections 2024-05-20T17:32:45.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f216c0a2c10 0x7f216c0a5120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2180108850 0x7f21801a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2180105ef0 0x7f21801997a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 --2- 172.21.15.135:0/2143798580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2180103590 0x7f2180199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 >> 172.21.15.135:0/2143798580 conn(0x7f21800fcb70 msgr2=0x7f2180104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 shutdown_connections 2024-05-20T17:32:45.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.169+0000 7f21884fe640 1 -- 172.21.15.135:0/2143798580 wait complete. 2024-05-20T17:32:45.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-20T17:32:45.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 -- 172.21.15.135:0/3045937192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20102370 msgr2=0x7faf20102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 --2- 172.21.15.135:0/3045937192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20102370 0x7faf20102780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faf1000aa10 tx=0x7faf1002b720 comp rx=0 tx=0).stop 2024-05-20T17:32:45.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 -- 172.21.15.135:0/3045937192 shutdown_connections 2024-05-20T17:32:45.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 --2- 172.21.15.135:0/3045937192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20107070 0x7faf20109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 --2- 172.21.15.135:0/3045937192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20102370 0x7faf20102780 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 --2- 172.21.15.135:0/3045937192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 0x7faf20101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 -- 172.21.15.135:0/3045937192 >> 172.21.15.135:0/3045937192 conn(0x7faf200fc300 msgr2=0x7faf200fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 -- 172.21.15.135:0/3045937192 shutdown_connections 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.293+0000 7faf274f6640 1 -- 172.21.15.135:0/3045937192 wait complete. 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 Processor -- start 2024-05-20T17:32:45.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 -- start start 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 0x7faf20199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20102370 0x7faf201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010c510 con 0x7faf20107070 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010c390 con 0x7faf20101130 2024-05-20T17:32:45.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf274f6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf2010c690 con 0x7faf20102370 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf25a93640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.294+0000 7faf25a93640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40092/0 (socket says 172.21.15.135:40092) 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 -- 172.21.15.135:0/3942316427 learned_addr learned my addr 172.21.15.135:0/3942316427 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25292640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 0x7faf20199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf24a91640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20102370 0x7faf201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 -- 172.21.15.135:0/3942316427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20102370 msgr2=0x7faf201997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20102370 0x7faf201997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 -- 172.21.15.135:0/3942316427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 msgr2=0x7faf20199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 0x7faf20199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 -- 172.21.15.135:0/3942316427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf201a0da0 con 0x7faf20107070 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf25a93640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf1800eaa0 tx=0x7faf1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf167fc640 1 -- 172.21.15.135:0/3942316427 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1800cdb0 con 0x7faf20107070 2024-05-20T17:32:45.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf201a1090 con 0x7faf20107070 2024-05-20T17:32:45.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf167fc640 1 -- 172.21.15.135:0/3942316427 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf18005020 con 0x7faf20107070 2024-05-20T17:32:45.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf167fc640 1 -- 172.21.15.135:0/3942316427 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180116d0 con 0x7faf20107070 2024-05-20T17:32:45.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.295+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf201a15e0 con 0x7faf20107070 2024-05-20T17:32:45.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.297+0000 7faf167fc640 1 -- 172.21.15.135:0/3942316427 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7faf180054d0 con 0x7faf20107070 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 Processor -- start 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 -- start start 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e965270 0x555d3ed05470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d3ec694d0 con 0x555d3e944590 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555d3ec113e0 con 0x555d3e93c3b0 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf2e395740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d3ec65490 con 0x555d3e965270 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf167fc640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 0x7faf0c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40102/0 (socket says 172.21.15.135:40102) 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf24a91640 1 -- 172.21.15.135:0/3731843319 learned_addr learned my addr 172.21.15.135:0/3731843319 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf25a93640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 0x7faf0c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.298+0000 7faf25292640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e965270 0x555d3ed05470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf167fc640 1 -- 172.21.15.135:0/3942316427 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7faf180cf280 con 0x7faf20107070 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 -- 172.21.15.135:0/3731843319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e965270 msgr2=0x555d3ed05470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e965270 0x555d3ed05470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 -- 172.21.15.135:0/3731843319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 msgr2=0x555d3ed059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 -- 172.21.15.135:0/3731843319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3e97d2d0 con 0x555d3e944590 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf25292640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf24a91640 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faf100057c0 tx=0x7faf10030510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafe597b9552ccc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf25a93640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 0x7faf0c0a50a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf180cd0d0 tx=0x7faf180c6650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf0b7fe640 1 -- 172.21.15.135:0/3731843319 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10045070 con 0x555d3e944590 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf0b7fe640 1 -- 172.21.15.135:0/3731843319 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf10030a80 con 0x555d3e944590 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.299+0000 7faf0b7fe640 1 -- 172.21.15.135:0/3731843319 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10036030 con 0x555d3e944590 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- 172.21.15.135:0/3731843319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 msgr2=0x555d3ed0c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faf100057c0 tx=0x7faf10030510 comp rx=0 tx=0).stop 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- 172.21.15.135:0/3731843319 shutdown_connections 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed0c8f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 --2- 172.21.15.135:0/3731843319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e965270 0x555d3ed05470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- 172.21.15.135:0/3731843319 >> 172.21.15.135:0/3731843319 conn(0x555d3e9593c0 msgr2=0x555d3ed00e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- 172.21.15.135:0/3731843319 shutdown_connections 2024-05-20T17:32:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- 172.21.15.135:0/3731843319 wait complete. 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 -- start start 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.300+0000 7faf2e395740 1 Processor -- start 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed0f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 0x555d3ed0f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed0d2e0 con 0x555d3e965270 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555d3ec248e0 con 0x555d3e944590 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed0d460 con 0x555d3e93c3b0 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf2e395740 10 client.0 _ll_register_callbacks cb 0x555d3ebf19c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40106/0 (socket says 172.21.15.135:40106) 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 -- 172.21.15.135:0/4129968662 learned_addr learned my addr 172.21.15.135:0/4129968662 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed0f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf25292640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 0x555d3ed0f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 -- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 msgr2=0x555d3ed0f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed0f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 -- 172.21.15.135:0/4129968662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 msgr2=0x555d3ed0f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 0x555d3ed0f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf24a91640 1 -- 172.21.15.135:0/4129968662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3ea476b0 con 0x555d3e965270 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.301+0000 7faf25292640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 0x555d3ed0f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf24a91640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf1000aa10 tx=0x7faf10030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6316582d13bd6e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10036070 con 0x555d3e965270 2024-05-20T17:32:45.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7faf10003e90 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf10030a80 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faf10045070 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 10 client.15096 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555d3ed19690 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf10030a80 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faf1003b040 con 0x555d3e965270 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 10 client.15096 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 20 client.15096 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e923e40 0x555d3ed1cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 4 client.15096 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.302+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d3ec76c00 con 0x555d3e923e40 2024-05-20T17:32:45.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.303+0000 7faf25292640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e923e40 0x555d3ed1cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.303+0000 7faf08ff9640 10 client.15096 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.303+0000 7faf25292640 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e923e40 0x555d3ed1cbb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19b24c762aab19c4 server_cookie=cc6f9fb236ffa1a4 in_seq=0 out_seq=0 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf08ff9640 1 -- 172.21.15.135:0/4129968662 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d3ec76c00 con 0x555d3e923e40 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf08ff9640 10 client.15096 handle_command_reply: tid=0 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 client.15096 shutdown 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 msgr2=0x555d3ed16780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf1000aa10 tx=0x7faf10030c30 comp rx=0 tx=0).stop 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 shutdown_connections 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e923e40 0x555d3ed1cbb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed16780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf08ff9640 0 client.15096 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e944590 0x555d3ed0f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 --2- 172.21.15.135:0/4129968662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed0f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 >> 172.21.15.135:0/4129968662 conn(0x555d3e9593c0 msgr2=0x555d3ecffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 shutdown_connections 2024-05-20T17:32:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 1 -- 172.21.15.135:0/4129968662 wait complete. 2024-05-20T17:32:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.304+0000 7faf2e395740 20 client.15096 trim_cache size 0 max 16384 2024-05-20T17:32:45.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 Processor -- start 2024-05-20T17:32:45.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 -- start start 2024-05-20T17:32:45.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed09740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e944590 0x555d3ed09c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1aef0 con 0x555d3e965270 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1b5c0 con 0x555d3e93c3b0 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf2e395740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1bc90 con 0x555d3e944590 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40110/0 (socket says 172.21.15.135:40110) 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 -- 172.21.15.135:0/417130958 learned_addr learned my addr 172.21.15.135:0/417130958 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 -- 172.21.15.135:0/417130958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e944590 msgr2=0x555d3ed09c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e944590 0x555d3ed09c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 -- 172.21.15.135:0/417130958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 msgr2=0x555d3ed09740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed09740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.323+0000 7faf24a91640 1 -- 172.21.15.135:0/417130958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3ed017c0 con 0x555d3e965270 2024-05-20T17:32:45.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf24a91640 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf1002be40 tx=0x7faf10030510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b7878253654813 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf0affd640 1 -- 172.21.15.135:0/417130958 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10036040 con 0x555d3e965270 2024-05-20T17:32:45.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf0affd640 1 -- 172.21.15.135:0/417130958 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf1005e070 con 0x555d3e965270 2024-05-20T17:32:45.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf0affd640 1 -- 172.21.15.135:0/417130958 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10003800 con 0x555d3e965270 2024-05-20T17:32:45.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf2e395740 1 -- 172.21.15.135:0/417130958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 msgr2=0x555d3ed0d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.324+0000 7faf2e395740 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf1002be40 tx=0x7faf10030510 comp rx=0 tx=0).stop 2024-05-20T17:32:45.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- 172.21.15.135:0/417130958 shutdown_connections 2024-05-20T17:32:45.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e965270 0x555d3ed0d920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e944590 0x555d3ed09c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- 172.21.15.135:0/417130958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e93c3b0 0x555d3ed09740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- 172.21.15.135:0/417130958 >> 172.21.15.135:0/417130958 conn(0x555d3e9593c0 msgr2=0x555d3ed007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- 172.21.15.135:0/417130958 shutdown_connections 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- 172.21.15.135:0/417130958 wait complete. 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- start start 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 Processor -- start 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e965270 0x555d3ed15660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1ca30 con 0x555d3e944590 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1c360 con 0x555d3e965270 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d3ed1d100 con 0x555d3e93c3b0 2024-05-20T17:32:45.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.325+0000 7faf2e395740 10 client.0 _ll_register_callbacks cb 0x7faf10043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40120/0 (socket says 172.21.15.135:40120) 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 -- 172.21.15.135:0/2971002705 learned_addr learned my addr 172.21.15.135:0/2971002705 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf24a91640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 -- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 msgr2=0x555d3ed121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 -- 172.21.15.135:0/2971002705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e965270 msgr2=0x555d3ed15660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e965270 0x555d3ed15660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 -- 172.21.15.135:0/2971002705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3ed15c20 con 0x555d3e944590 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf24a91640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf25292640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x555d3ed06850 tx=0x7faf1c0044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57cd36ad647a548 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0202f0 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7faf1c020490 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf1005e070 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faf1c020690 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf2e395740 10 client.15102 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555d3ed16fa0 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.326+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf1005e070 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faf1c029400 con 0x555d3e944590 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 10 client.15102 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 20 client.15102 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e8f9280 0x555d3ed88e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 4 client.15102 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "status"}) -- 0x555d3ec70f50 con 0x555d3e8f9280 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf24a91640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e8f9280 0x555d3ed88e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf08ff9640 10 client.15102 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.327+0000 7faf24a91640 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e8f9280 0x555d3ed88e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f967634fffb87716 server_cookie=7037698ccb09651c in_seq=0 out_seq=0 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf08ff9640 1 -- 172.21.15.135:0/2971002705 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555d3ec70f50 con 0x555d3e8f9280 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf08ff9640 10 client.15102 handle_command_reply: tid=0 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 client.15102 shutdown 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 msgr2=0x555d3ed12720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x555d3ed06850 tx=0x7faf1c0044d0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 shutdown_connections 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x555d3e8f9280 0x555d3ed88e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d3e965270 0x555d3ed15660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d3e944590 0x555d3ed12720 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf08ff9640 0 client.15102 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 --2- 172.21.15.135:0/2971002705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d3e93c3b0 0x555d3ed121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 >> 172.21.15.135:0/2971002705 conn(0x555d3e9593c0 msgr2=0x555d3ed0d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 shutdown_connections 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 1 -- 172.21.15.135:0/2971002705 wait complete. 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.328+0000 7faf2e395740 20 client.15102 trim_cache size 0 max 16384 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:32:45.336 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24523, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 88.527632561000004, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:32:45.337 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 106.195961717 2024-05-20T17:32:45.338 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 msgr2=0x7faf0c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 0x7faf0c0a50a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf180cd0d0 tx=0x7faf180c6650 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 msgr2=0x7faf201a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf1800eaa0 tx=0x7faf1800ef60 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 shutdown_connections 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7faf0c0a2b90 0x7faf0c0a50a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf20107070 0x7faf201a0730 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf20102370 0x7faf201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 --2- 172.21.15.135:0/3942316427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf20101130 0x7faf20199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 >> 172.21.15.135:0/3942316427 conn(0x7faf200fc300 msgr2=0x7faf20103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 shutdown_connections 2024-05-20T17:32:45.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.329+0000 7faf274f6640 1 -- 172.21.15.135:0/3942316427 wait complete. 2024-05-20T17:32:45.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 -- 172.21.15.135:0/1679716178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a41019a0 msgr2=0x7f32a41026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 --2- 172.21.15.135:0/1679716178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a41019a0 0x7f32a41026a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3294009900 tx=0x7f329402a410 comp rx=0 tx=0).stop 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 -- 172.21.15.135:0/1679716178 shutdown_connections 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 --2- 172.21.15.135:0/1679716178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 0x7f32a4109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 --2- 172.21.15.135:0/1679716178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a4102be0 0x7f32a4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 --2- 172.21.15.135:0/1679716178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a41019a0 0x7f32a41026a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 -- 172.21.15.135:0/1679716178 >> 172.21.15.135:0/1679716178 conn(0x7f32a40fcbb0 msgr2=0x7f32a40ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 -- 172.21.15.135:0/1679716178 shutdown_connections 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.452+0000 7f32aa661640 1 -- 172.21.15.135:0/1679716178 wait complete. 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 Processor -- start 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 -- start start 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a41019a0 0x7f32a4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 0x7f32a419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32a410d5f0 con 0x7f32a4102be0 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32a410d470 con 0x7f32a41078e0 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32aa661640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f32a410d770 con 0x7f32a41019a0 2024-05-20T17:32:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40142/0 (socket says 172.21.15.135:40142) 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 -- 172.21.15.135:0/3354887521 learned_addr learned my addr 172.21.15.135:0/3354887521 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 0x7f32a419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f32a3fff640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a41019a0 0x7f32a4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 -- 172.21.15.135:0/3354887521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a41019a0 msgr2=0x7f32a4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a41019a0 0x7f32a4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 -- 172.21.15.135:0/3354887521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 msgr2=0x7f32a419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 0x7f32a419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 -- 172.21.15.135:0/3354887521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a419fd10 con 0x7f32a4102be0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.453+0000 7f329bfff640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f328c00d770 tx=0x7f328c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.454+0000 7f32a1ffb640 1 -- 172.21.15.135:0/3354887521 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c017070 con 0x7f32a4102be0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.454+0000 7f32a1ffb640 1 -- 172.21.15.135:0/3354887521 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328c005500 con 0x7f32a4102be0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.454+0000 7f32a1ffb640 1 -- 172.21.15.135:0/3354887521 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004e00 con 0x7f32a4102be0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.454+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a419ffa0 con 0x7f32a4102be0 2024-05-20T17:32:45.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.454+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a41a0410 con 0x7f32a4102be0 2024-05-20T17:32:45.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32a1ffb640 1 -- 172.21.15.135:0/3354887521 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f328c004fa0 con 0x7f32a4102be0 2024-05-20T17:32:45.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 Processor -- start 2024-05-20T17:32:45.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 -- start start 2024-05-20T17:32:45.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aaca33b0 0x5562ab06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 0x5562ab075b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562aafd04d0 con 0x5562aaccc270 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5562aaf783e0 con 0x5562aacab590 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32b15e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5562aafcc490 con 0x5562aaca33b0 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32a8bfe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32a8bfe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40152/0 (socket says 172.21.15.135:40152) 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.456+0000 7f32a8bfe640 1 -- 172.21.15.135:0/4164958715 learned_addr learned my addr 172.21.15.135:0/4164958715 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a1ffb640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 0x7f32900a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a3fff640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aaca33b0 0x5562ab06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f329bfff640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 0x5562ab075b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 -- 172.21.15.135:0/4164958715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aaca33b0 msgr2=0x5562ab06ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aaca33b0 0x5562ab06ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 -- 172.21.15.135:0/4164958715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 msgr2=0x5562ab075b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 0x5562ab075b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 -- 172.21.15.135:0/4164958715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aace42d0 con 0x5562aaccc270 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f329bfff640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 0x5562ab075b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a1ffb640 1 -- 172.21.15.135:0/3354887521 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f328c0ceae0 con 0x7f32a4102be0 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 0x7f32900a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f329c011590 tx=0x7f329c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb3f069200c49c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f329a7fc640 1 -- 172.21.15.135:0/4164958715 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c017050 con 0x5562aaccc270 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f329a7fc640 1 -- 172.21.15.135:0/4164958715 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f329c00fd20 con 0x5562aaccc270 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.457+0000 7f329a7fc640 1 -- 172.21.15.135:0/4164958715 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c01bb30 con 0x5562aaccc270 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- 172.21.15.135:0/4164958715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 msgr2=0x5562ab06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 0x7f32900a50a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f329c022000 tx=0x7f329c023000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f329c011590 tx=0x7f329c011a50 comp rx=0 tx=0).stop 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- 172.21.15.135:0/4164958715 shutdown_connections 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aacab590 0x5562ab075b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aaca33b0 0x5562ab06ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 --2- 172.21.15.135:0/4164958715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaccc270 0x5562ab06e680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- 172.21.15.135:0/4164958715 >> 172.21.15.135:0/4164958715 conn(0x5562aacc03c0 msgr2=0x5562ab067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- 172.21.15.135:0/4164958715 shutdown_connections 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- 172.21.15.135:0/4164958715 wait complete. 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.458+0000 7f32b15e7740 1 -- start start 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 Processor -- start 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0789b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaccc270 0x5562ab07f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562ab076550 con 0x5562aaca33b0 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5562aaf8b8e0 con 0x5562aaccc270 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5562ab0766d0 con 0x5562aacab590 2024-05-20T17:32:45.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32b15e7740 10 client.0 _ll_register_callbacks cb 0x5562aaf589c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40164/0 (socket says 172.21.15.135:40164) 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 -- 172.21.15.135:0/3097759634 learned_addr learned my addr 172.21.15.135:0/3097759634 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f329bfff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaccc270 0x5562ab07f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 -- 172.21.15.135:0/3097759634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 msgr2=0x5562ab0789b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0789b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 -- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaccc270 msgr2=0x5562ab07f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaccc270 0x5562ab07f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.459+0000 7f32a3fff640 1 -- 172.21.15.135:0/3097759634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562aadae6b0 con 0x5562aaca33b0 2024-05-20T17:32:45.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32a3fff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3294009900 tx=0x7f3294031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd158f6ff0df2e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294035070 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3294004240 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f329c00fd20 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f329404a070 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 10 client.15114 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5562ab082820 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f329c00fd20 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3294004a90 con 0x5562aaca33b0 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 10 client.15114 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 20 client.15114 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aac8ae40 0x5562ab0862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 4 client.15114 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.460+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562aafddc00 con 0x5562aac8ae40 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.461+0000 7f329bfff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aac8ae40 0x5562ab0862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.461+0000 7f32837fe640 10 client.15114 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.461+0000 7f329bfff640 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aac8ae40 0x5562ab0862d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76ff2eda7abf1cf7 server_cookie=a8e4d22e69b54760 in_seq=0 out_seq=0 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32837fe640 1 -- 172.21.15.135:0/3097759634 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5562aafddc00 con 0x5562aac8ae40 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32837fe640 10 client.15114 handle_command_reply: tid=0 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 client.15114 shutdown 2024-05-20T17:32:45.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 msgr2=0x5562ab078470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3294009900 tx=0x7f3294031960 comp rx=0 tx=0).stop 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 shutdown_connections 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aac8ae40 0x5562ab0862d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaccc270 0x5562ab07f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32837fe640 0 client.15114 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0789b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 --2- 172.21.15.135:0/3097759634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab078470 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 >> 172.21.15.135:0/3097759634 conn(0x5562aacc03c0 msgr2=0x5562ab066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 shutdown_connections 2024-05-20T17:32:45.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 1 -- 172.21.15.135:0/3097759634 wait complete. 2024-05-20T17:32:45.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.462+0000 7f32b15e7740 20 client.15114 trim_cache size 0 max 16384 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.480+0000 7f32b15e7740 1 Processor -- start 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.480+0000 7f32b15e7740 1 -- start start 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.480+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aac8ae40 0x5562ab077180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.480+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32b15e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562ab084610 con 0x5562aaca33b0 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32b15e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5562ab084ce0 con 0x5562aac8ae40 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32b15e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5562ab0853b0 con 0x5562aacab590 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40168/0 (socket says 172.21.15.135:40168) 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 -- 172.21.15.135:0/1668476034 learned_addr learned my addr 172.21.15.135:0/1668476034 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32a3fff640 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aac8ae40 0x5562ab077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 -- 172.21.15.135:0/1668476034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 msgr2=0x5562ab0677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 -- 172.21.15.135:0/1668476034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aac8ae40 msgr2=0x5562ab077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aac8ae40 0x5562ab077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 -- 172.21.15.135:0/1668476034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ab06f240 con 0x5562aaca33b0 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f329bfff640 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cc5c0 tx=0x7f328c06e3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24810042106c81d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f3299ffb640 1 -- 172.21.15.135:0/1668476034 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c020040 con 0x5562aaca33b0 2024-05-20T17:32:45.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f3299ffb640 1 -- 172.21.15.135:0/1668476034 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328c09b320 con 0x5562aaca33b0 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.481+0000 7f3299ffb640 1 -- 172.21.15.135:0/1668476034 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c099620 con 0x5562aaca33b0 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- 172.21.15.135:0/1668476034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 msgr2=0x5562ab07f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cc5c0 tx=0x7f328c06e3e0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- 172.21.15.135:0/1668476034 shutdown_connections 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab0677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aaca33b0 0x5562ab07f830 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1668476034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aac8ae40 0x5562ab077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- 172.21.15.135:0/1668476034 >> 172.21.15.135:0/1668476034 conn(0x5562aacc03c0 msgr2=0x5562ab076a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- 172.21.15.135:0/1668476034 shutdown_connections 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- 172.21.15.135:0/1668476034 wait complete. 2024-05-20T17:32:45.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.482+0000 7f32b15e7740 1 -- start start 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 Processor -- start 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaca33b0 0x5562ab07af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab07dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5562ab086150 con 0x5562aac8ae40 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5562ab085a80 con 0x5562aaca33b0 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5562ab086820 con 0x5562aacab590 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32b15e7740 10 client.0 _ll_register_callbacks cb 0x7f329c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40182/0 (socket says 172.21.15.135:40182) 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 -- 172.21.15.135:0/1480062894 learned_addr learned my addr 172.21.15.135:0/1480062894 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f329bfff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaca33b0 0x5562ab07af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a8bfe640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab07dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 -- 172.21.15.135:0/1480062894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 msgr2=0x5562ab07dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab07dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 -- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaca33b0 msgr2=0x5562ab07af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaca33b0 0x5562ab07af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 -- 172.21.15.135:0/1480062894 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ab07e460 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32a3fff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3294000c00 tx=0x7f3294031aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd2ed5984713dd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.483+0000 7f32837fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294035070 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f32940048c0 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328c09b320 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f329405f050 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 10 client.15120 fetch_fsmap learned FSMap version 21 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5562ab07f750 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328c09b320 con 0x5562aac8ae40 2024-05-20T17:32:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f329404f750 con 0x5562aac8ae40 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 10 client.15120 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 20 client.15120 populate_metadata read hostname 'smithi135' 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aaccc270 0x5562ab0f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 4 client.15120 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "status"}) -- 0x5562aafd7f50 con 0x5562aaccc270 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.484+0000 7f329bfff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aaccc270 0x5562ab0f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32837fe640 10 client.15120 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f329bfff640 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aaccc270 0x5562ab0f23f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc916ecfedc24d55 server_cookie=18e793aab3818ba1 in_seq=0 out_seq=0 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32837fe640 1 -- 172.21.15.135:0/1480062894 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5562aafd7f50 con 0x5562aaccc270 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32837fe640 10 client.15120 handle_command_reply: tid=0 2024-05-20T17:32:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 client.15120 shutdown 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 msgr2=0x5562ab07aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3294000c00 tx=0x7f3294031aa0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 shutdown_connections 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5562aaccc270 0x5562ab0f23f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562aacab590 0x5562ab07dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32837fe640 0 client.15120 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562aaca33b0 0x5562ab07af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 --2- 172.21.15.135:0/1480062894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562aac8ae40 0x5562ab07aa20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 >> 172.21.15.135:0/1480062894 conn(0x5562aacc03c0 msgr2=0x5562ab0677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 shutdown_connections 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 1 -- 172.21.15.135:0/1480062894 wait complete. 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.485+0000 7f32b15e7740 20 client.15120 trim_cache size 0 max 16384 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24560, 2024-05-20T17:32:45.497 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 90.700416735999994, 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 97.707943213999997 2024-05-20T17:32:45.498 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 msgr2=0x7f32900a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 0x7f32900a50a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f329c022000 tx=0x7f329c023000 comp rx=0 tx=0).stop 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 msgr2=0x7f32a4198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f328c00d770 tx=0x7f328c00dc30 comp rx=0 tx=0).stop 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 shutdown_connections 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f32900a2b90 0x7f32900a50a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a41078e0 0x7f32a419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a4102be0 0x7f32a4198760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 --2- 172.21.15.135:0/3354887521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a41019a0 0x7f32a4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 >> 172.21.15.135:0/3354887521 conn(0x7f32a40fcbb0 msgr2=0x7f32a41038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 shutdown_connections 2024-05-20T17:32:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:45.486+0000 7f32aa661640 1 -- 172.21.15.135:0/3354887521 wait complete. 2024-05-20T17:32:45.501 INFO:tasks.cephadm:Setup complete, yielding 2024-05-20T17:32:45.502 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-20T17:32:45.512 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:32:45.513 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch status' 2024-05-20T17:32:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2226924024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:45 smithi135 ceph-mon[32027]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/114990111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:45.751 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:45.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2226924024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:45 smithi172 ceph-mon[36511]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/114990111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2226924024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:32:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:45 smithi160 ceph-mon[36261]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-20T17:32:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/114990111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:32:47.187 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:46 smithi135 ceph-mon[32027]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-20T17:32:47.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:46 smithi160 ceph-mon[36261]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-20T17:32:47.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:46 smithi172 ceph-mon[36511]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-05-20T17:32:47.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 -- 172.21.15.135:0/149079057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c781031f0 msgr2=0x7f1c78103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:47.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/149079057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c781031f0 0x7f1c78103600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009990 tx=0x7f1c60009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 -- 172.21.15.135:0/149079057 shutdown_connections 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/149079057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781020c0 0x7f1c781024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/149079057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78103b90 0x7f1c7810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/149079057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c781031f0 0x7f1c78103600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.574+0000 7f1c7d94b700 1 -- 172.21.15.135:0/149079057 >> 172.21.15.135:0/149079057 conn(0x7f1c780fd700 msgr2=0x7f1c780ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.575+0000 7f1c7d94b700 1 -- 172.21.15.135:0/149079057 shutdown_connections 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.575+0000 7f1c7d94b700 1 -- 172.21.15.135:0/149079057 wait complete. 2024-05-20T17:32:47.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.575+0000 7f1c7d94b700 1 Processor -- start 2024-05-20T17:32:47.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.575+0000 7f1c7d94b700 1 -- start start 2024-05-20T17:32:47.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c781020c0 0x7f1c7806af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:47.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781031f0 0x7f1c7819e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:47.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:47.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7810dcb0 con 0x7f1c78103b90 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7810db30 con 0x7f1c781031f0 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7810de30 con 0x7f1c781020c0 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40200/0 (socket says 172.21.15.135:40200) 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c76ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c781020c0 0x7f1c7806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 -- 172.21.15.135:0/2403012979 learned_addr learned my addr 172.21.15.135:0/2403012979 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c767fc700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781031f0 0x7f1c7819e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 -- 172.21.15.135:0/2403012979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c781020c0 msgr2=0x7f1c7806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c781020c0 0x7f1c7806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 -- 172.21.15.135:0/2403012979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781031f0 msgr2=0x7f1c7819e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:47.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781031f0 0x7f1c7819e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 -- 172.21.15.135:0/2403012979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c781a13f0 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c777fe700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800d980 tx=0x7f1c6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68017070 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c781a16e0 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.576+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c68005020 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.577+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800fbf0 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.577+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781a1c70 con 0x7f1c78103b90 2024-05-20T17:32:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.577+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c78050170 con 0x7f1c78103b90 2024-05-20T17:32:47.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.579+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1c680051d0 con 0x7f1c78103b90 2024-05-20T17:32:47.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.579+0000 7f1c7c949700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 0x7f1c640a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:47.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.580+0000 7f1c76ffd700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 0x7f1c640a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:47.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.580+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f1c680cf190 con 0x7f1c78103b90 2024-05-20T17:32:47.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.580+0000 7f1c76ffd700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 0x7f1c640a5130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c781030f0 tx=0x7f1c700091c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:47.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.583+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c68020020 con 0x7f1c78103b90 2024-05-20T17:32:47.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.798+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1c78062a80 con 0x7f1c640a2c20 2024-05-20T17:32:47.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.799+0000 7f1c7c949700 1 -- 172.21.15.135:0/2403012979 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1c78062a80 con 0x7f1c640a2c20 2024-05-20T17:32:47.800 INFO:teuthology.orchestra.run.smithi135.stdout:Backend: cephadm 2024-05-20T17:32:47.801 INFO:teuthology.orchestra.run.smithi135.stdout:Available: Yes 2024-05-20T17:32:47.801 INFO:teuthology.orchestra.run.smithi135.stdout:Paused: No 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 msgr2=0x7f1c640a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 0x7f1c640a5130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c781030f0 tx=0x7f1c700091c0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 msgr2=0x7f1c781a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800d980 tx=0x7f1c6800dc90 comp rx=0 tx=0).stop 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 shutdown_connections 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f1c640a2c20 0x7f1c640a5130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c78103b90 0x7f1c781a0bc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c781020c0 0x7f1c7806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 --2- 172.21.15.135:0/2403012979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c781031f0 0x7f1c7819e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:47.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.801+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 >> 172.21.15.135:0/2403012979 conn(0x7f1c780fd700 msgr2=0x7f1c78106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:47.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.802+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 shutdown_connections 2024-05-20T17:32:47.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:47.802+0000 7f1c7d94b700 1 -- 172.21.15.135:0/2403012979 wait complete. 2024-05-20T17:32:48.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-20T17:32:48.885 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:48.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:48 smithi135 ceph-mon[32027]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:48.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:48 smithi135 ceph-mon[32027]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:49.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:48 smithi172 ceph-mon[36511]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:49.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:48 smithi172 ceph-mon[36511]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:49.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:48 smithi160 ceph-mon[36261]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:49.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:48 smithi160 ceph-mon[36261]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/466395642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e41020c0 msgr2=0x7fc2e41024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/466395642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e41020c0 0x7fc2e41024d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009990 tx=0x7fc2d8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/466395642 shutdown_connections 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/466395642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e4103b90 0x7fc2e410a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/466395642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e41020c0 0x7fc2e41024d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/466395642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 0x7fc2e4103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/466395642 >> 172.21.15.135:0/466395642 conn(0x7fc2e40fd700 msgr2=0x7fc2e40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/466395642 shutdown_connections 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.622+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/466395642 wait complete. 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 Processor -- start 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 -- start start 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 0x7fc2e41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 0x7fc2e4198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410dd50 con 0x7fc2e4103b90 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410dbd0 con 0x7fc2e41020c0 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.623+0000 7fc2ec3bf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e410ded0 con 0x7fc2e41031f0 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47128/0 (socket says 172.21.15.135:47128) 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 -- 172.21.15.135:0/20808134 learned_addr learned my addr 172.21.15.135:0/20808134 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2e995a700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 0x7fc2e4198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea15b700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 0x7fc2e41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 -- 172.21.15.135:0/20808134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 msgr2=0x7fc2e4198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 0x7fc2e4198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 -- 172.21.15.135:0/20808134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 msgr2=0x7fc2e41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 0x7fc2e41988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 -- 172.21.15.135:0/20808134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e41a0450 con 0x7fc2e4103b90 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea15b700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 0x7fc2e41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ea95c700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00b970 tx=0x7fc2dc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc019070 con 0x7fc2e4103b90 2024-05-20T17:32:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e41a0740 con 0x7fc2e4103b90 2024-05-20T17:32:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2dc00ce10 con 0x7fc2e4103b90 2024-05-20T17:32:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc007370 con 0x7fc2e4103b90 2024-05-20T17:32:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.624+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e41a0d00 con 0x7fc2e4103b90 2024-05-20T17:32:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.625+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e4050170 con 0x7fc2e4103b90 2024-05-20T17:32:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.627+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc2dc01c070 con 0x7fc2e4103b90 2024-05-20T17:32:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.627+0000 7fc2d77fe700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 0x7fc2d00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.627+0000 7fc2ea15b700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 0x7fc2d00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.627+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc2dc0ce8a0 con 0x7fc2e4103b90 2024-05-20T17:32:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.628+0000 7fc2ea15b700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 0x7fc2d00a5130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80039c0 tx=0x7fc2d801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:50.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.631+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc2dc09b7e0 con 0x7fc2e4103b90 2024-05-20T17:32:50.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.842+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc2e4062a80 con 0x7fc2d00a2c20 2024-05-20T17:32:50.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.856+0000 7fc2d77fe700 1 -- 172.21.15.135:0/20808134 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fc2e4062a80 con 0x7fc2d00a2c20 2024-05-20T17:32:50.857 INFO:teuthology.orchestra.run.smithi135.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-20T17:32:50.857 INFO:teuthology.orchestra.run.smithi135.stdout:mds.a smithi135 running (106s) 19s ago 105s 80.3M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 4c0dbf90428a 2024-05-20T17:32:50.857 INFO:teuthology.orchestra.run.smithi135.stdout:mds.b smithi160 running (103s) 37s ago 103s 93.2M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 e8963aa90051 2024-05-20T17:32:50.857 INFO:teuthology.orchestra.run.smithi135.stdout:mds.c smithi172 running (117s) 37s ago 117s 86.9M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 e5895e855f37 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.d smithi135 running (2m) 19s ago 2m 83.0M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 b7d6c4e94fa7 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.e smithi160 running (2m) 37s ago 2m 83.4M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 743de2d8c9f6 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.f smithi172 running (2m) 37s ago 2m 83.4M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 28c8345983d5 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.g smithi135 running (109s) 19s ago 108s 81.3M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 9d90ca9a09f5 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.h smithi160 running (114s) 37s ago 114s 87.0M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 d6aa6a030ad8 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.i smithi172 running (112s) 37s ago 111s 86.9M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 e71018bbef41 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.j smithi135 running (2m) 19s ago 2m 82.9M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 2ce3f63b2cbe 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.k smithi160 running (2m) 37s ago 2m 83.7M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 9364cc18c20f 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mds.l smithi172 running (2m) 37s ago 2m 80.5M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 9cac0e586578 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.x smithi135 *:9283,8765 running (9m) 19s ago 9m 583M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 572bd28b4303 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.y smithi160 *:8443,8765 running (7m) 37s ago 7m 524M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 306ef2f4149b 2024-05-20T17:32:50.858 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.z smithi172 *:8443,8765 running (7m) 37s ago 7m 521M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 868f8ca09fd1 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:mon.a smithi135 running (9m) 19s ago 9m 116M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 4e20ba46cad5 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:mon.b smithi160 running (7m) 37s ago 7m 106M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 d69df5f96247 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:mon.c smithi172 running (8m) 37s ago 7m 106M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 f67153ce685b 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 smithi135 running (7m) 19s ago 7m 114M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 0b6372f2b19d 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 smithi160 running (6m) 37s ago 6m 113M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 fb86de8a3f38 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 smithi172 running (6m) 37s ago 6m 114M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 cfe7793c034a 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 smithi135 running (6m) 19s ago 6m 122M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 c79634ef9d44 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 smithi160 running (5m) 37s ago 5m 123M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 528511516de5 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 smithi172 running (5m) 37s ago 5m 110M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 0cc34a7257ef 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 smithi135 running (4m) 19s ago 4m 109M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 9b643cfeb3fa 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 smithi160 running (4m) 37s ago 4m 110M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 b40b8d620a00 2024-05-20T17:32:50.859 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 smithi172 running (3m) 37s ago 3m 110M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 9cfdf66136d7 2024-05-20T17:32:50.860 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 smithi135 running (3m) 19s ago 3m 119M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 5824f28cc4e6 2024-05-20T17:32:50.860 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 smithi160 running (2m) 37s ago 2m 113M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 28515380afa7 2024-05-20T17:32:50.860 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 smithi172 running (2m) 37s ago 2m 108M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 fd64d626d04b 2024-05-20T17:32:50.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 msgr2=0x7fc2d00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:50.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 0x7fc2d00a5130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80039c0 tx=0x7fc2d801a040 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 msgr2=0x7fc2e419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00b970 tx=0x7fc2dc00bc80 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 shutdown_connections 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2e41020c0 0x7fc2e41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fc2d00a2c20 0x7fc2d00a5130 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e4103b90 0x7fc2e419fdd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 --2- 172.21.15.135:0/20808134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e41031f0 0x7fc2e4198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.858+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 >> 172.21.15.135:0/20808134 conn(0x7fc2e40fd700 msgr2=0x7fc2e4106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.859+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 shutdown_connections 2024-05-20T17:32:50.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:50.859+0000 7fc2ec3bf700 1 -- 172.21.15.135:0/20808134 wait complete. 2024-05-20T17:32:50.871 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:50 smithi135 ceph-mon[32027]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:32:51.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:50 smithi160 ceph-mon[36261]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:32:51.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:50 smithi172 ceph-mon[36511]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-20T17:32:51.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-20T17:32:51.900 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:51 smithi135 ceph-mon[32027]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:52.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:51 smithi160 ceph-mon[36261]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:52.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:51 smithi172 ceph-mon[36511]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:53.163 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:52 smithi135 ceph-mon[32027]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:52 smithi160 ceph-mon[36261]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:53.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:52 smithi172 ceph-mon[36511]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 -- 172.21.15.135:0/2318238796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0101aa0 msgr2=0x7f93b0103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:53.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 --2- 172.21.15.135:0/2318238796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0101aa0 0x7f93b0103ec0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009990 tx=0x7f93ac009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 -- 172.21.15.135:0/2318238796 shutdown_connections 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 --2- 172.21.15.135:0/2318238796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0106d60 0x7f93b0107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 --2- 172.21.15.135:0/2318238796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0101aa0 0x7f93b0103ec0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 --2- 172.21.15.135:0/2318238796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0104400 0x7f93b0106820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 -- 172.21.15.135:0/2318238796 >> 172.21.15.135:0/2318238796 conn(0x7f93b00fd6f0 msgr2=0x7f93b00ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 -- 172.21.15.135:0/2318238796 shutdown_connections 2024-05-20T17:32:53.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.749+0000 7f93b7d72700 1 -- 172.21.15.135:0/2318238796 wait complete. 2024-05-20T17:32:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 Processor -- start 2024-05-20T17:32:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 -- start start 2024-05-20T17:32:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0101aa0 0x7f93b019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:53.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 0x7f93b01a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01153b0 con 0x7f93b0104400 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0115230 con 0x7f93b0101aa0 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b7d72700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0115530 con 0x7f93b0106d60 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47150/0 (socket says 172.21.15.135:47150) 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 -- 172.21.15.135:0/4168478052 learned_addr learned my addr 172.21.15.135:0/4168478052 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b5b0e700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0101aa0 0x7f93b019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b630f700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 0x7f93b01a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 -- 172.21.15.135:0/4168478052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 msgr2=0x7f93b01a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 0x7f93b01a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 -- 172.21.15.135:0/4168478052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0101aa0 msgr2=0x7f93b019fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0101aa0 0x7f93b019fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b530d700 1 -- 172.21.15.135:0/4168478052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b01a79e0 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.750+0000 7f93b630f700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 0x7f93b01a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93b530d700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c920 tx=0x7f93a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0007b00 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b01a7cd0 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a0004d10 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0005630 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.751+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b01a8230 con 0x7f93b0104400 2024-05-20T17:32:53.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.752+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b0050170 con 0x7f93b0104400 2024-05-20T17:32:53.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.753+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f93a0004750 con 0x7f93b0104400 2024-05-20T17:32:53.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.754+0000 7f93a6ffd700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 0x7f939c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:53.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.754+0000 7f93b5b0e700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 0x7f939c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:53.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.754+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f93a00cf030 con 0x7f93b0104400 2024-05-20T17:32:53.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.754+0000 7f93b5b0e700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 0x7f939c0a5130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b5c0 tx=0x7f93ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:53.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.758+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f93a0014030 con 0x7f93b0104400 2024-05-20T17:32:53.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.965+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f93b0062a80 con 0x7f939c0a2c20 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.971+0000 7f93a6ffd700 1 -- 172.21.15.135:0/4168478052 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f93b0062a80 con 0x7f939c0a2c20 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:mds.all 12/12 40s ago 2m smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:mgr 3/3 40s ago 7m smithi135=x;smithi160=y;smithi172=z;count:3 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:mon 3/3 40s ago 8m smithi135:172.21.15.135=a;smithi160:172.21.15.160=b;smithi172:172.21.15.172=c;count:3 2024-05-20T17:32:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:osd 12 40s ago - 2024-05-20T17:32:53.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 msgr2=0x7f939c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:53.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 0x7f939c0a5130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b5c0 tx=0x7f93ac01a040 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 msgr2=0x7f93b01a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c920 tx=0x7f93a000cc30 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 shutdown_connections 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b0101aa0 0x7f93b019fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f939c0a2c20 0x7f939c0a5130 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b0106d60 0x7f93b01a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 --2- 172.21.15.135:0/4168478052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b0104400 0x7f93b01a03c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 >> 172.21.15.135:0/4168478052 conn(0x7f93b00fd6f0 msgr2=0x7f93b01028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 shutdown_connections 2024-05-20T17:32:53.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:53.973+0000 7f93b7d72700 1 -- 172.21.15.135:0/4168478052 wait complete. 2024-05-20T17:32:54.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-20T17:32:54.921 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:55.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:54 smithi135 ceph-mon[32027]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:55.198 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:54 smithi135 ceph-mon[32027]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:55.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:54 smithi160 ceph-mon[36261]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:55.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:54 smithi160 ceph-mon[36261]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:55.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:54 smithi172 ceph-mon[36511]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:55.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:54 smithi172 ceph-mon[36511]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 -- 172.21.15.135:0/1642013142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 msgr2=0x7f6c1c102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 --2- 172.21.15.135:0/1642013142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c102da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009990 tx=0x7f6c10009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 -- 172.21.15.135:0/1642013142 shutdown_connections 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 --2- 172.21.15.135:0/1642013142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c103330 0x7f6c1c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 --2- 172.21.15.135:0/1642013142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c101860 0x7f6c1c101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 --2- 172.21.15.135:0/1642013142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c102da0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 -- 172.21.15.135:0/1642013142 >> 172.21.15.135:0/1642013142 conn(0x7f6c1c0fcea0 msgr2=0x7f6c1c0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:56.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 -- 172.21.15.135:0/1642013142 shutdown_connections 2024-05-20T17:32:56.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.684+0000 7f6c23c66700 1 -- 172.21.15.135:0/1642013142 wait complete. 2024-05-20T17:32:56.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 Processor -- start 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 -- start start 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c101860 0x7f6c1c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c103330 0x7f6c1c19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d420 con 0x7f6c1c102990 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d2a0 con 0x7f6c1c101860 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.685+0000 7f6c23c66700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d5a0 con 0x7f6c1c103330 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47168/0 (socket says 172.21.15.135:47168) 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 -- 172.21.15.135:0/3148871114 learned_addr learned my addr 172.21.15.135:0/3148871114 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c22203700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c103330 0x7f6c1c19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:56.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21a02700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c101860 0x7f6c1c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 -- 172.21.15.135:0/3148871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c103330 msgr2=0x7f6c1c19fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c103330 0x7f6c1c19fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 -- 172.21.15.135:0/3148871114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c101860 msgr2=0x7f6c1c19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c101860 0x7f6c1c19add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 -- 172.21.15.135:0/3148871114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c1a02c0 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c21201700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c10005b40 tx=0x7f6c1000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10026070 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c1a0550 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c10003b20 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10021670 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.686+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1a0a00 con 0x7f6c1c102990 2024-05-20T17:32:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.687+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c050170 con 0x7f6c1c102990 2024-05-20T17:32:56.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.689+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6c10029070 con 0x7f6c1c102990 2024-05-20T17:32:56.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.690+0000 7f6c1affd700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 0x7f6c040a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:56.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.690+0000 7f6c21a02700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 0x7f6c040a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:56.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.690+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f6c100d08d0 con 0x7f6c1c102990 2024-05-20T17:32:56.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.690+0000 7f6c21a02700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 0x7f6c040a5130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06b130 tx=0x7f6c0c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:56.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.694+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6c10013070 con 0x7f6c1c102990 2024-05-20T17:32:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.899+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6c1c062a80 con 0x7f6c040a2c20 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.901+0000 7f6c1affd700 1 -- 172.21.15.135:0/3148871114 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6c1c062a80 con 0x7f6c040a2c20 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stdout:HOST ADDR LABELS STATUS 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 172.21.15.135 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stdout:smithi160 172.21.15.160 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stdout:smithi172 172.21.15.172 2024-05-20T17:32:56.902 INFO:teuthology.orchestra.run.smithi135.stdout:3 hosts in cluster 2024-05-20T17:32:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 msgr2=0x7f6c040a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 0x7f6c040a5130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06b130 tx=0x7f6c0c009040 comp rx=0 tx=0).stop 2024-05-20T17:32:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 msgr2=0x7f6c1c19d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c10005b40 tx=0x7f6c1000bc60 comp rx=0 tx=0).stop 2024-05-20T17:32:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 shutdown_connections 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c1c101860 0x7f6c1c19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f6c040a2c20 0x7f6c040a5130 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1c103330 0x7f6c1c19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 --2- 172.21.15.135:0/3148871114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c102990 0x7f6c1c19d360 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 >> 172.21.15.135:0/3148871114 conn(0x7f6c1c0fcea0 msgr2=0x7f6c1c105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 shutdown_connections 2024-05-20T17:32:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:56.903+0000 7f6c23c66700 1 -- 172.21.15.135:0/3148871114 wait complete. 2024-05-20T17:32:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:56 smithi135 ceph-mon[32027]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:57.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:56 smithi160 ceph-mon[36261]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:57.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:56 smithi172 ceph-mon[36511]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:32:57.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-20T17:32:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:57 smithi135 ceph-mon[32027]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:57.970 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:32:58.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:57 smithi160 ceph-mon[36261]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:58.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:57 smithi172 ceph-mon[36511]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:32:59.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:32:58 smithi135 ceph-mon[32027]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:32:58 smithi160 ceph-mon[36261]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:59.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:32:58 smithi172 ceph-mon[36511]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 -- 172.21.15.135:0/3959424095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028101860 msgr2=0x7ff028101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3959424095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028101860 0x7ff028101c70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff018009990 tx=0x7ff018009ca0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 -- 172.21.15.135:0/3959424095 shutdown_connections 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3959424095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff028109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3959424095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028101860 0x7ff028101c70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3959424095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028102990 0x7ff028102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 -- 172.21.15.135:0/3959424095 >> 172.21.15.135:0/3959424095 conn(0x7ff0280fcea0 msgr2=0x7ff0280ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 -- 172.21.15.135:0/3959424095 shutdown_connections 2024-05-20T17:32:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.798+0000 7ff02c81e700 1 -- 172.21.15.135:0/3959424095 wait complete. 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 Processor -- start 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 -- start start 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028101860 0x7ff028199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff0281a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff02810edd0 con 0x7ff028102990 2024-05-20T17:32:59.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff02810ec50 con 0x7ff028103330 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02c81e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff02810ef50 con 0x7ff028101860 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff025d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff025d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50152/0 (socket says 172.21.15.135:50152) 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff025d9b700 1 -- 172.21.15.135:0/3645556013 learned_addr learned my addr 172.21.15.135:0/3645556013 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.799+0000 7ff02659c700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028101860 0x7ff028199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff026d9d700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff0281a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 -- 172.21.15.135:0/3645556013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028101860 msgr2=0x7ff028199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028101860 0x7ff028199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 -- 172.21.15.135:0/3645556013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 msgr2=0x7ff0281a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff0281a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 -- 172.21.15.135:0/3645556013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0281a13e0 con 0x7ff028102990 2024-05-20T17:32:59.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff026d9d700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff0281a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff025d9b700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d980 tx=0x7ff01c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c016070 con 0x7ff028102990 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff01c004d10 con 0x7ff028102990 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0281a16d0 con 0x7ff028102990 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0055f0 con 0x7ff028102990 2024-05-20T17:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.800+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0281a1c10 con 0x7ff028102990 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.801+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff028050170 con 0x7ff028102990 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.803+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff01c004750 con 0x7ff028102990 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.803+0000 7ff0177fe700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 0x7ff0100a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.803+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff01c0cf440 con 0x7ff028102990 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.803+0000 7ff02659c700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 0x7ff0100a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:32:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.804+0000 7ff02659c700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 0x7ff0100a5130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0180098e0 tx=0x7ff01801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:32:59.807+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff01c01f020 con 0x7ff028102990 2024-05-20T17:33:00.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.009+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 --> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff028062a80 con 0x7ff0100a2c20 2024-05-20T17:33:00.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.011+0000 7ff0177fe700 1 -- 172.21.15.135:0/3645556013 <== mgr.14152 v2:172.21.15.135:6800/3106262554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff028062a80 con 0x7ff0100a2c20 2024-05-20T17:33:00.012 INFO:teuthology.orchestra.run.smithi135.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-20T17:33:00.013 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-20T17:33:00.013 INFO:teuthology.orchestra.run.smithi135.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-20T17:33:00.013 INFO:teuthology.orchestra.run.smithi135.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.013+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 msgr2=0x7ff0100a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.013+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 0x7ff0100a5130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0180098e0 tx=0x7ff01801a040 comp rx=0 tx=0).stop 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.013+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 msgr2=0x7ff028199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.013+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d980 tx=0x7ff01c00dc90 comp rx=0 tx=0).stop 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 shutdown_connections 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff028103330 0x7ff0281a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff0100a2c20 0x7ff0100a5130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff028101860 0x7ff028199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:00.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 --2- 172.21.15.135:0/3645556013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff028102990 0x7ff028199dc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:00.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 >> 172.21.15.135:0/3645556013 conn(0x7ff0280fcea0 msgr2=0x7ff028105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:00.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 shutdown_connections 2024-05-20T17:33:00.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:00.014+0000 7ff02c81e700 1 -- 172.21.15.135:0/3645556013 wait complete. 2024-05-20T17:33:00.839 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-20T17:33:00.848 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:33:00.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-20T17:33:01.094 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:33:01.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:00 smithi135 ceph-mon[32027]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:01.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:00 smithi135 ceph-mon[32027]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:01.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:00 smithi160 ceph-mon[36261]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:01.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:00 smithi160 ceph-mon[36261]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:00 smithi172 ceph-mon[36511]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:00 smithi172 ceph-mon[36511]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:02.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 -- 172.21.15.135:0/3680785280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 msgr2=0x7f8f6c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:02.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 --2- 172.21.15.135:0/3680785280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c1024e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009990 tx=0x7f8f60009ca0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 -- 172.21.15.135:0/3680785280 shutdown_connections 2024-05-20T17:33:02.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 --2- 172.21.15.135:0/3680785280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 --2- 172.21.15.135:0/3680785280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c1024e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 --2- 172.21.15.135:0/3680785280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 0x7f8f6c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.947+0000 7f8f7324e700 1 -- 172.21.15.135:0/3680785280 >> 172.21.15.135:0/3680785280 conn(0x7f8f6c0fd710 msgr2=0x7f8f6c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- 172.21.15.135:0/3680785280 shutdown_connections 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- 172.21.15.135:0/3680785280 wait complete. 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 Processor -- start 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- start start 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 0x7f8f6c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:02.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c10dc70 con 0x7f8f6c1020d0 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c10daf0 con 0x7f8f6c103ba0 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.948+0000 7f8f7324e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c10ddf0 con 0x7f8f6c103200 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50164/0 (socket says 172.21.15.135:50164) 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 -- 172.21.15.135:0/2439323117 learned_addr learned my addr 172.21.15.135:0/2439323117 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f6bfff700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 0x7f8f6c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f717eb700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:02.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 -- 172.21.15.135:0/2439323117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 msgr2=0x7f8f6c19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:02.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 0x7f8f6c19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 -- 172.21.15.135:0/2439323117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 msgr2=0x7f8f6c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:02.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:02.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 -- 172.21.15.135:0/2439323117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c1a13c0 con 0x7f8f6c1020d0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f717eb700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f70fea700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000c00 tx=0x7f8f60009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60027070 con 0x7f8f6c1020d0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f60004150 con 0x7f8f6c1020d0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000f460 con 0x7f8f6c1020d0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c1a1650 con 0x7f8f6c1020d0 2024-05-20T17:33:02.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.949+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c1a1a50 con 0x7f8f6c1020d0 2024-05-20T17:33:02.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.950+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6c050170 con 0x7f8f6c1020d0 2024-05-20T17:33:02.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.952+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8f6002a070 con 0x7f8f6c1020d0 2024-05-20T17:33:02.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.953+0000 7f8f69ffb700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 0x7f8f5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:02.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.953+0000 7f8f6bfff700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 0x7f8f5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:02.957 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:02 smithi135 ceph-mon[32027]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:02.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.953+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f8f600d06c0 con 0x7f8f6c1020d0 2024-05-20T17:33:02.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.953+0000 7f8f6bfff700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 0x7f8f5c0a51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c074c80 tx=0x7f8f5800b5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:02.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:02.956+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8f60031080 con 0x7f8f6c1020d0 2024-05-20T17:33:03.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.199+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8f6c02dd30 con 0x7f8f6c1020d0 2024-05-20T17:33:03.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.200+0000 7f8f69ffb700 1 -- 172.21.15.135:0/2439323117 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3058 (secure 0 0 0) 0x7f8f60013070 con 0x7f8f6c1020d0 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:e21 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:legacy client fscid: 1 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:Filesystem 'cephfs' (1) 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:fs_name cephfs 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 21 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-20T17:31:14.132666+0000 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-05-20T17:31:18.165890+0000 2024-05-20T17:33:03.202 INFO:teuthology.orchestra.run.smithi135.stdout:tableserver 0 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:root 0 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:session_timeout 300 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:session_autoclose 300 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:max_file_size 1099511627776 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:max_xattr_size 65536 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:required_client_features {} 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure 0 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure_osd_epoch 0 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:max_mds 3 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:in 0,1,2 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:up {0=24560,1=24523,2=24521} 2024-05-20T17:33:03.203 INFO:teuthology.orchestra.run.smithi135.stdout:failed 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:damaged 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:stopped 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:data_pools [3] 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:metadata_pool 2 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:inline_data disabled 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:balancer 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:bal_rank_mask -1 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:standby_count_wanted 0 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:qdb_cluster leader: 24560 members: 24521,24523,24560 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b{0:24560} state up:active seq 3 addr [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c{0:24493} state up:standby-replay seq 1 addr [v2:172.21.15.172:6836/3276473516,v1:172.21.15.172:6837/3276473516] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.i{1:24523} state up:active seq 6 addr [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.204 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e{1:24485} state up:standby-replay seq 1 addr [v2:172.21.15.160:6834/4160320010,v1:172.21.15.160:6835/4160320010] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.h{2:24521} state up:active seq 7 addr [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f{2:24481} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/3094095088,v1:172.21.15.172:6835/3094095088] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:Standby daemons: 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.135:6834/185728746,v1:172.21.15.135:6835/185728746] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.135:6836/456498361,v1:172.21.15.135:6837/456498361] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.g{-1:14643} state up:standby seq 1 addr [v2:172.21.15.135:6838/2845322204,v1:172.21.15.135:6839/2845322204] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a{-1:14655} state up:standby seq 1 addr [v2:172.21.15.135:6840/2294779524,v1:172.21.15.135:6841/2294779524] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.l{-1:24424} state up:standby seq 1 addr [v2:172.21.15.172:6832/2047222973,v1:172.21.15.172:6833/2047222973] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.205 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.k{-1:24446} state up:standby seq 1 addr [v2:172.21.15.160:6832/3469044918,v1:172.21.15.160:6833/3469044918] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:33:03.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 msgr2=0x7f8f5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:03.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 0x7f8f5c0a51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c074c80 tx=0x7f8f5800b5d0 comp rx=0 tx=0).stop 2024-05-20T17:33:03.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 msgr2=0x7f8f6c0752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000c00 tx=0x7f8f60009510 comp rx=0 tx=0).stop 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 shutdown_connections 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f6c103ba0 0x7f8f6c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f8f5c0a2ca0 0x7f8f5c0a51b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f6c1020d0 0x7f8f6c0752d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 --2- 172.21.15.135:0/2439323117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f6c103200 0x7f8f6c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 >> 172.21.15.135:0/2439323117 conn(0x7f8f6c0fd710 msgr2=0x7f8f6c106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 shutdown_connections 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:03.203+0000 7f8f7324e700 1 -- 172.21.15.135:0/2439323117 wait complete. 2024-05-20T17:33:03.207 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:33:03.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:02 smithi160 ceph-mon[36261]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:02 smithi172 ceph-mon[36511]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:04.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-20T17:33:04.262 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:33:04.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:04 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2439323117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:33:04.385 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:04 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2439323117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:33:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:04 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2439323117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:33:05.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:05 smithi172 ceph-mon[36511]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:05 smithi135 ceph-mon[32027]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:05 smithi160 ceph-mon[36261]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:06.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 -- 172.21.15.135:0/1975938285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce4103ba0 msgr2=0x7efce410a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:06.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 --2- 172.21.15.135:0/1975938285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce4103ba0 0x7efce410a450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00b0a0 tx=0x7efcdc00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 -- 172.21.15.135:0/1975938285 shutdown_connections 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 --2- 172.21.15.135:0/1975938285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce4103ba0 0x7efce410a450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 --2- 172.21.15.135:0/1975938285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce41020d0 0x7efce41024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 --2- 172.21.15.135:0/1975938285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 0x7efce4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 -- 172.21.15.135:0/1975938285 >> 172.21.15.135:0/1975938285 conn(0x7efce40fd710 msgr2=0x7efce40ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 -- 172.21.15.135:0/1975938285 shutdown_connections 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.096+0000 7efce8d84700 1 -- 172.21.15.135:0/1975938285 wait complete. 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 Processor -- start 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 -- start start 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:06.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 0x7efce4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce4103ba0 0x7efce419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efce410dca0 con 0x7efce41020d0 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efce410db20 con 0x7efce4103200 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce8d84700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efce410de20 con 0x7efce4103ba0 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50186/0 (socket says 172.21.15.135:50186) 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 -- 172.21.15.135:0/350615043 learned_addr learned my addr 172.21.15.135:0/350615043 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 -- 172.21.15.135:0/350615043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce4103ba0 msgr2=0x7efce419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce1d9b700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 0x7efce4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce4103ba0 0x7efce419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 -- 172.21.15.135:0/350615043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 msgr2=0x7efce4198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 0x7efce4198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.097+0000 7efce259c700 1 -- 172.21.15.135:0/350615043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce40748f0 con 0x7efce41020d0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efce259c700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c970 tx=0x7efcd400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004220 con 0x7efce41020d0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd4007de0 con 0x7efce41020d0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4003e10 con 0x7efce41020d0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce4074be0 con 0x7efce41020d0 2024-05-20T17:33:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.098+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce4075120 con 0x7efce41020d0 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.099+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce4050170 con 0x7efce41020d0 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.100+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7efcd4007900 con 0x7efce41020d0 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.101+0000 7efcd37fe700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 0x7efccc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.101+0000 7efce1d9b700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 0x7efccc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.101+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7efcd40cf040 con 0x7efce41020d0 2024-05-20T17:33:06.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.101+0000 7efce1d9b700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 0x7efccc0a5130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcd8005950 tx=0x7efcd8005d10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:06.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.104+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efcd4014030 con 0x7efce41020d0 2024-05-20T17:33:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.301+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7efce4075460 con 0x7efce41020d0 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.302+0000 7efcd37fe700 1 -- 172.21.15.135:0/350615043 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5362 (secure 0 0 0) 0x7efcd409bf80 con 0x7efce41020d0 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 87 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-20T17:23:02.934506+0000 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-05-20T17:32:07.715249+0000 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:crush_version 26 2024-05-20T17:33:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:full_ratio 0.95 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:backfillfull_ratio 0.9 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:nearfull_ratio 0.85 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:require_min_compat_client luminous 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:min_compat_client luminous 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:require_osd_release squid 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:stretch_mode_enabled false 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:max_osd 12 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6802/2987635953,v1:172.21.15.135:6803/2987635953] [v2:172.21.15.135:6804/2987635953,v1:172.21.15.135:6805/2987635953] exists,up 2c2f64d8-041a-4069-ac15-ee66c1c8566e 2024-05-20T17:33:06.305 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/2448318206,v1:172.21.15.160:6801/2448318206] [v2:172.21.15.160:6802/2448318206,v1:172.21.15.160:6803/2448318206] exists,up b6293c0f-9f2a-42bc-9625-0b20b435ccad 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/1279158957,v1:172.21.15.172:6801/1279158957] [v2:172.21.15.172:6802/1279158957,v1:172.21.15.172:6803/1279158957] exists,up 70accd73-e32c-49e3-b39e-57fe0ec0feeb 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6810/3128080158,v1:172.21.15.135:6811/3128080158] [v2:172.21.15.135:6812/3128080158,v1:172.21.15.135:6813/3128080158] exists,up 2b46ffe6-ac15-448e-b812-4c6971b5f472 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 up in weight 1 up_from 33 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/3098243466,v1:172.21.15.160:6809/3098243466] [v2:172.21.15.160:6810/3098243466,v1:172.21.15.160:6811/3098243466] exists,up 29001f18-bab2-47ab-b41e-20cdb7f07e02 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 up in weight 1 up_from 38 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/1955442624,v1:172.21.15.172:6809/1955442624] [v2:172.21.15.172:6810/1955442624,v1:172.21.15.172:6811/1955442624] exists,up cc6409a5-0a57-4e8a-8022-5a724f80b78a 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 up in weight 1 up_from 46 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6818/4265227752,v1:172.21.15.135:6819/4265227752] [v2:172.21.15.135:6820/4265227752,v1:172.21.15.135:6821/4265227752] exists,up c5a64e7c-1cd9-4642-89a7-1912095262e5 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 up in weight 1 up_from 51 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/350268889,v1:172.21.15.160:6817/350268889] [v2:172.21.15.160:6818/350268889,v1:172.21.15.160:6819/350268889] exists,up ab9e3e44-dbb7-4321-9527-b5973b470ca7 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 up in weight 1 up_from 59 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/695820543,v1:172.21.15.172:6817/695820543] [v2:172.21.15.172:6818/695820543,v1:172.21.15.172:6819/695820543] exists,up ac3346f2-6419-4db2-95e0-78374b3cf793 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6826/1712068572,v1:172.21.15.135:6827/1712068572] [v2:172.21.15.135:6828/1712068572,v1:172.21.15.135:6829/1712068572] exists,up 5a7483eb-245c-4c6c-91f5-8b41e6de11ee 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/1618218869,v1:172.21.15.160:6825/1618218869] [v2:172.21.15.160:6826/1618218869,v1:172.21.15.160:6827/1618218869] exists,up 216e927a-b7f6-447d-86ae-fdad237ebf34 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/3648204338,v1:172.21.15.172:6825/3648204338] [v2:172.21.15.172:6826/3648204338,v1:172.21.15.172:6827/3648204338] exists,up 293fc85d-ffca-4069-9a9c-980c69ba701d 2024-05-20T17:33:06.306 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.c [2,4] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1b [2,1] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1d [8,11] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1f [7,11] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.5 [3,9] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.e [4,8] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.17 [4,7] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.1d [4,6] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.21 [5,9] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.25 [5,9] 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2777149070 expires 2024-05-21T17:24:06.618654+0000 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2727321726 expires 2024-05-21T17:24:06.618654+0000 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/45942653 expires 2024-05-21T17:24:06.618654+0000 2024-05-20T17:33:06.307 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/700489570 expires 2024-05-21T17:23:40.271295+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2923289945 expires 2024-05-21T17:23:40.271295+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/45942653 expires 2024-05-21T17:24:06.618654+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/3053430682 expires 2024-05-21T17:23:40.271295+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/3053430682 expires 2024-05-21T17:23:40.271295+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3033784790 expires 2024-05-21T17:23:40.271295+0000 2024-05-20T17:33:06.308 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3446450726 expires 2024-05-21T17:24:06.618654+0000 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 msgr2=0x7efccc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 0x7efccc0a5130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcd8005950 tx=0x7efcd8005d10 comp rx=0 tx=0).stop 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 msgr2=0x7efce4198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c970 tx=0x7efcd400cd30 comp rx=0 tx=0).stop 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 shutdown_connections 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7efccc0a2c20 0x7efccc0a5130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce4103ba0 0x7efce419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efce41020d0 0x7efce4198750 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 --2- 172.21.15.135:0/350615043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce4103200 0x7efce4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:06.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 >> 172.21.15.135:0/350615043 conn(0x7efce40fd710 msgr2=0x7efce4106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:06.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 shutdown_connections 2024-05-20T17:33:06.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:06.305+0000 7efce8d84700 1 -- 172.21.15.135:0/350615043 wait complete. 2024-05-20T17:33:06.675 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:06 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/350615043' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:33:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:06 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/350615043' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:33:06.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:06 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/350615043' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:33:07.040 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-20T17:33:07.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 -- 172.21.15.135:0/1615785630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8101200 msgr2=0x7fcdb810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/1615785630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8101200 0x7fcdb810ac60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009ca0 tx=0x7fcdb002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 -- 172.21.15.135:0/1615785630 shutdown_connections 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/1615785630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8101200 0x7fcdb810ac60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/1615785630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8100700 0x7fcdb8100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/1615785630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8104050 0x7fcdb8104460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.169+0000 7fcdbefe3640 1 -- 172.21.15.135:0/1615785630 >> 172.21.15.135:0/1615785630 conn(0x7fcdb80fc320 msgr2=0x7fcdb80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- 172.21.15.135:0/1615785630 shutdown_connections 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- 172.21.15.135:0/1615785630 wait complete. 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 Processor -- start 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- start start 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8100700 0x7fcdb81991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 0x7fcdb8199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb810e710 con 0x7fcdb8104050 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb810e590 con 0x7fcdb8101200 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.170+0000 7fcdbefe3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb810e890 con 0x7fcdb8100700 2024-05-20T17:33:07.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50206/0 (socket says 172.21.15.135:50206) 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 -- 172.21.15.135:0/2620305683 learned_addr learned my addr 172.21.15.135:0/2620305683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdb7fff640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 0x7fcdb8199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbcd7f640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8100700 0x7fcdb81991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 -- 172.21.15.135:0/2620305683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8100700 msgr2=0x7fcdb81991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8100700 0x7fcdb81991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 -- 172.21.15.135:0/2620305683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 msgr2=0x7fcdb8199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 0x7fcdb8199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 -- 172.21.15.135:0/2620305683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb81a0c60 con 0x7fcdb8104050 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdb7fff640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 0x7fcdb8199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbd580640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009430 tx=0x7fcdb002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0003c30 con 0x7fcdb8104050 2024-05-20T17:33:07.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb0003dd0 con 0x7fcdb8104050 2024-05-20T17:33:07.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb81a0ef0 con 0x7fcdb8104050 2024-05-20T17:33:07.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.171+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00047e0 con 0x7fcdb8104050 2024-05-20T17:33:07.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.172+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb81a1350 con 0x7fcdb8104050 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.172+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb8069170 con 0x7fcdb8104050 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.174+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcdb002f800 con 0x7fcdb8104050 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.175+0000 7fcdb5ffb640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 0x7fcda80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.175+0000 7fcdbcd7f640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 0x7fcda80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.175+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fcdb00f0760 con 0x7fcdb8104050 2024-05-20T17:33:07.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.175+0000 7fcdbcd7f640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 0x7fcda80a50a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806a2d0 tx=0x7fcdac00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.178+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcdb8069170 con 0x7fcdb8104050 2024-05-20T17:33:07.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.355+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdb802d360 con 0x7fcdb8104050 2024-05-20T17:33:07.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.356+0000 7fcdb5ffb640 1 -- 172.21.15.135:0/2620305683 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7fcdb00bd640 con 0x7fcdb8104050 2024-05-20T17:33:07.359 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:07.359 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:07.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 msgr2=0x7fcda80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 0x7fcda80a50a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806a2d0 tx=0x7fcdac00a2d0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 msgr2=0x7fcdb81a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009430 tx=0x7fcdb002f610 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 shutdown_connections 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fcda80a2b90 0x7fcda80a50a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdb8104050 0x7fcdb81a06a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdb8101200 0x7fcdb8199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 --2- 172.21.15.135:0/2620305683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb8100700 0x7fcdb81991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.358+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 >> 172.21.15.135:0/2620305683 conn(0x7fcdb80fc320 msgr2=0x7fcdb8106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.359+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 shutdown_connections 2024-05-20T17:33:07.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.359+0000 7fcdbefe3640 1 -- 172.21.15.135:0/2620305683 wait complete. 2024-05-20T17:33:07.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:33:07.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:33:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- 172.21.15.135:0/1003363886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 msgr2=0x7f970c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- 172.21.15.135:0/1003363886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c100b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009900 tx=0x7f96fc02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- 172.21.15.135:0/1003363886 shutdown_connections 2024-05-20T17:33:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- 172.21.15.135:0/1003363886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c101210 0x7f970c10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- 172.21.15.135:0/1003363886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c100b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- 172.21.15.135:0/1003363886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c104060 0x7f970c104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- 172.21.15.135:0/1003363886 >> 172.21.15.135:0/1003363886 conn(0x7f970c0fc330 msgr2=0x7f970c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- 172.21.15.135:0/1003363886 shutdown_connections 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- 172.21.15.135:0/1003363886 wait complete. 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 Processor -- start 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 -- start start 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.487+0000 7f9713737640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 0x7f970c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c104060 0x7f970c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f970c10e740 con 0x7f970c100710 2024-05-20T17:33:07.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f970c10e5c0 con 0x7f970c104060 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f970c10e8c0 con 0x7f970c101210 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50216/0 (socket says 172.21.15.135:50216) 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 -- 172.21.15.135:0/1774376954 learned_addr learned my addr 172.21.15.135:0/1774376954 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9710cd2640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 0x7f970c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9711cd4640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c104060 0x7f970c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 -- 172.21.15.135:0/1774376954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 msgr2=0x7f970c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 0x7f970c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 -- 172.21.15.135:0/1774376954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c104060 msgr2=0x7f970c1a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c104060 0x7f970c1a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 -- 172.21.15.135:0/1774376954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1a0d90 con 0x7f970c100710 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9710cd2640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 0x7f970c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97114d3640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9708005d00 tx=0x7f970800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708017070 con 0x7f970c100710 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9708009c30 con 0x7f970c100710 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c1a1080 con 0x7f970c100710 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970800f620 con 0x7f970c100710 2024-05-20T17:33:07.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.488+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c1a1580 con 0x7f970c100710 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.489+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c1079f0 con 0x7f970c100710 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.491+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f970801a070 con 0x7f970c100710 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.492+0000 7f97027fc640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 0x7f96f80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.492+0000 7f9710cd2640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 0x7f96f80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.492+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f97080cebd0 con 0x7f970c100710 2024-05-20T17:33:07.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.492+0000 7f9710cd2640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 0x7f96f80a50a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc0095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.495+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9708009de0 con 0x7f970c100710 2024-05-20T17:33:07.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.670+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f970c02d430 con 0x7f970c100710 2024-05-20T17:33:07.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.670+0000 7f97027fc640 1 -- 172.21.15.135:0/1774376954 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f970809bab0 con 0x7f970c100710 2024-05-20T17:33:07.672 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:33:07.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 msgr2=0x7f96f80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 0x7f96f80a50a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc0095f0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 msgr2=0x7f970c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9708005d00 tx=0x7f970800dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 shutdown_connections 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f96f80a2b90 0x7f96f80a50a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970c104060 0x7f970c1a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f970c101210 0x7f970c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 --2- 172.21.15.135:0/1774376954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f970c100710 0x7f970c199370 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.672+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 >> 172.21.15.135:0/1774376954 conn(0x7f970c0fc330 msgr2=0x7f970c104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.673+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 shutdown_connections 2024-05-20T17:33:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.673+0000 7f9713737640 1 -- 172.21.15.135:0/1774376954 wait complete. 2024-05-20T17:33:07.684 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:07 smithi135 ceph-mon[32027]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:33:07.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:33:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:07 smithi160 ceph-mon[36261]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:33:07.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 -- 172.21.15.135:0/2468522490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00102bd0 msgr2=0x7f0d00102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 --2- 172.21.15.135:0/2468522490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00102bd0 0x7f0d00102fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009900 tx=0x7f0cf002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:07.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 -- 172.21.15.135:0/2468522490 shutdown_connections 2024-05-20T17:33:07.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 --2- 172.21.15.135:0/2468522490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 0x7f0d00109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 --2- 172.21.15.135:0/2468522490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00102bd0 0x7f0d00102fe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 --2- 172.21.15.135:0/2468522490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d00101990 0x7f0d00102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 -- 172.21.15.135:0/2468522490 >> 172.21.15.135:0/2468522490 conn(0x7f0d000fcb80 msgr2=0x7f0d000ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 -- 172.21.15.135:0/2468522490 shutdown_connections 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.798+0000 7f0d07275640 1 -- 172.21.15.135:0/2468522490 wait complete. 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 Processor -- start 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 -- start start 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d00102bd0 0x7f0d0019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 0x7f0d001a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0010d600 con 0x7f0d00101990 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0010d480 con 0x7f0d001078d0 2024-05-20T17:33:07.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0010d780 con 0x7f0d00102bd0 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50242/0 (socket says 172.21.15.135:50242) 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 -- 172.21.15.135:0/2438080549 learned_addr learned my addr 172.21.15.135:0/2438080549 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05812640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 0x7f0d001a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 -- 172.21.15.135:0/2438080549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d00102bd0 msgr2=0x7f0d0019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d00102bd0 0x7f0d0019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 -- 172.21.15.135:0/2438080549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 msgr2=0x7f0d001a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 0x7f0d001a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 -- 172.21.15.135:0/2438080549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d001a10f0 con 0x7f0d00101990 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d05011640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc005d00 tx=0x7f0cfc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc017070 con 0x7f0d00101990 2024-05-20T17:33:07.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cfc009c30 con 0x7f0d00101990 2024-05-20T17:33:07.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d001a13e0 con 0x7f0d00101990 2024-05-20T17:33:07.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.799+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00f620 con 0x7f0d00101990 2024-05-20T17:33:07.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.800+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d001a18e0 con 0x7f0d00101990 2024-05-20T17:33:07.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.801+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d001066e0 con 0x7f0d00101990 2024-05-20T17:33:07.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.802+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0cfc01a070 con 0x7f0d00101990 2024-05-20T17:33:07.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.802+0000 7f0cf67fc640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 0x7f0cec0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:07.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.803+0000 7f0d04810640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 0x7f0cec0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:07.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.803+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f0cfc0ceb70 con 0x7f0d00101990 2024-05-20T17:33:07.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.803+0000 7f0d04810640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 0x7f0cec0a50a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00096c0 tx=0x7f0cf0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:07.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.806+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0cfc009de0 con 0x7f0d00101990 2024-05-20T17:33:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:07 smithi172 ceph-mon[36511]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:33:07.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.981+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d0006b250 con 0x7f0d00101990 2024-05-20T17:33:07.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.982+0000 7f0cf67fc640 1 -- 172.21.15.135:0/2438080549 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f0cfc09bab0 con 0x7f0d00101990 2024-05-20T17:33:07.983 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 msgr2=0x7f0cec0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 0x7f0cec0a50a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00096c0 tx=0x7f0cf0031400 comp rx=0 tx=0).stop 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 msgr2=0x7f0d000698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc005d00 tx=0x7f0cfc00dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 shutdown_connections 2024-05-20T17:33:07.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f0cec0a2b90 0x7f0cec0a50a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d001078d0 0x7f0d001a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d00102bd0 0x7f0d0019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 --2- 172.21.15.135:0/2438080549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d00101990 0x7f0d000698d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 >> 172.21.15.135:0/2438080549 conn(0x7f0d000fcb80 msgr2=0x7f0d001038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 shutdown_connections 2024-05-20T17:33:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:07.984+0000 7f0d07275640 1 -- 172.21.15.135:0/2438080549 wait complete. 2024-05-20T17:33:07.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:33:08.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- 172.21.15.135:0/2640672209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648102aa0 msgr2=0x7f66481037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 --2- 172.21.15.135:0/2640672209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648102aa0 0x7f66481037a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6644009ca0 tx=0x7f664402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- 172.21.15.135:0/2640672209 shutdown_connections 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 --2- 172.21.15.135:0/2640672209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66481089e0 0x7f664810ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 --2- 172.21.15.135:0/2640672209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648103ce0 0x7f66481040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 --2- 172.21.15.135:0/2640672209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648102aa0 0x7f66481037a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- 172.21.15.135:0/2640672209 >> 172.21.15.135:0/2640672209 conn(0x7f66480fdc90 msgr2=0x7f6648100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- 172.21.15.135:0/2640672209 shutdown_connections 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- 172.21.15.135:0/2640672209 wait complete. 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 Processor -- start 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.111+0000 7f6650437640 1 -- start start 2024-05-20T17:33:08.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 0x7f66481992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 0x7f6648199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f664810e720 con 0x7f66481089e0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f664810e5a0 con 0x7f6648102aa0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f664810e8a0 con 0x7f6648103ce0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50252/0 (socket says 172.21.15.135:50252) 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 -- 172.21.15.135:0/1582398888 learned_addr learned my addr 172.21.15.135:0/1582398888 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664d9d2640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 0x7f6648199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e1d3640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 0x7f66481992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 -- 172.21.15.135:0/1582398888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 msgr2=0x7f6648199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 0x7f6648199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 -- 172.21.15.135:0/1582398888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 msgr2=0x7f66481992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 0x7f66481992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 -- 172.21.15.135:0/1582398888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66481a0e30 con 0x7f66481089e0 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e1d3640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 0x7f66481992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664d9d2640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 0x7f6648199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f664e9d4640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f664000c970 tx=0x7f664000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640007bb0 con 0x7f66481089e0 2024-05-20T17:33:08.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6640007d50 con 0x7f66481089e0 2024-05-20T17:33:08.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66481a1120 con 0x7f66481089e0 2024-05-20T17:33:08.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664000f450 con 0x7f66481089e0 2024-05-20T17:33:08.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.112+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a1670 con 0x7f66481089e0 2024-05-20T17:33:08.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.113+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66481077f0 con 0x7f66481089e0 2024-05-20T17:33:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.115+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6640004f00 con 0x7f66481089e0 2024-05-20T17:33:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.115+0000 7f663f7fe640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 0x7f66340a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.115+0000 7f664e1d3640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 0x7f66340a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.116+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f66400cf170 con 0x7f66481089e0 2024-05-20T17:33:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.116+0000 7f664e1d3640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 0x7f66340a50a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f66481036a0 tx=0x7f6644005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.119+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6640014030 con 0x7f66481089e0 2024-05-20T17:33:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.295+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6648062750 con 0x7f66481089e0 2024-05-20T17:33:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.295+0000 7f663f7fe640 1 -- 172.21.15.135:0/1582398888 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f664009c0b0 con 0x7f66481089e0 2024-05-20T17:33:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 msgr2=0x7f66340a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 0x7f66340a50a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f66481036a0 tx=0x7f6644005fd0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 msgr2=0x7f66481a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f664000c970 tx=0x7f664000ce30 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 shutdown_connections 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f66340a2b90 0x7f66340a50a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66481089e0 0x7f66481a07c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6648103ce0 0x7f6648199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 --2- 172.21.15.135:0/1582398888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6648102aa0 0x7f66481992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 >> 172.21.15.135:0/1582398888 conn(0x7f66480fdc90 msgr2=0x7f66481049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 shutdown_connections 2024-05-20T17:33:08.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.297+0000 7f6650437640 1 -- 172.21.15.135:0/1582398888 wait complete. 2024-05-20T17:33:08.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 -- 172.21.15.135:0/2099063353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c4102bd0 msgr2=0x7fb1c4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/2099063353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c4102bd0 0x7fb1c4102fe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009900 tx=0x7fb1b802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 -- 172.21.15.135:0/2099063353 shutdown_connections 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/2099063353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c41078d0 0x7fb1c4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/2099063353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c4102bd0 0x7fb1c4102fe0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/2099063353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 0x7fb1c4102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 -- 172.21.15.135:0/2099063353 >> 172.21.15.135:0/2099063353 conn(0x7fb1c40fcba0 msgr2=0x7fb1c40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 -- 172.21.15.135:0/2099063353 shutdown_connections 2024-05-20T17:33:08.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.421+0000 7fb1c93ea640 1 -- 172.21.15.135:0/2099063353 wait complete. 2024-05-20T17:33:08.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 Processor -- start 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 -- start start 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 0x7fb1c40747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 0x7fb1c419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c410d600 con 0x7fb1c41078d0 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c410d480 con 0x7fb1c4102bd0 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c93ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c410d780 con 0x7fb1c4101990 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50276/0 (socket says 172.21.15.135:50276) 2024-05-20T17:33:08.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.422+0000 7fb1c37fe640 1 -- 172.21.15.135:0/3377728200 learned_addr learned my addr 172.21.15.135:0/3377728200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c2ffd640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 0x7fb1c40747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c27fc640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 0x7fb1c419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 -- 172.21.15.135:0/3377728200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 msgr2=0x7fb1c40747f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 0x7fb1c40747f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 -- 172.21.15.135:0/3377728200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 msgr2=0x7fb1c419e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 0x7fb1c419e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 -- 172.21.15.135:0/3377728200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41a0e50 con 0x7fb1c41078d0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c27fc640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 0x7fb1c419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c37fe640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00eb10 tx=0x7fb1bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc004b20 con 0x7fb1c41078d0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c41a1140 con 0x7fb1c41078d0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1bc004cc0 con 0x7fb1c41078d0 2024-05-20T17:33:08.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc010760 con 0x7fb1c41078d0 2024-05-20T17:33:08.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.423+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41a1640 con 0x7fb1c41078d0 2024-05-20T17:33:08.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.424+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c41066e0 con 0x7fb1c41078d0 2024-05-20T17:33:08.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.425+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb1bc005000 con 0x7fb1c41078d0 2024-05-20T17:33:08.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.426+0000 7fb1abfff640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 0x7fb1ac0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.426+0000 7fb1c2ffd640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 0x7fb1ac0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.426+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fb1bc0cf990 con 0x7fb1c41078d0 2024-05-20T17:33:08.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.427+0000 7fb1c2ffd640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 0x7fb1ac0a50a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40058c0 tx=0x7fb1b400a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.429+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb1bc053850 con 0x7fb1c41078d0 2024-05-20T17:33:08.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.640+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1c402d2a0 con 0x7fb1c41078d0 2024-05-20T17:33:08.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.641+0000 7fb1abfff640 1 -- 172.21.15.135:0/3377728200 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7fb1bc09c8d0 con 0x7fb1c41078d0 2024-05-20T17:33:08.643 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:08.643 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:33:08.643 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 msgr2=0x7fb1ac0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 0x7fb1ac0a50a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40058c0 tx=0x7fb1b400a4c0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 msgr2=0x7fb1c41a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00eb10 tx=0x7fb1bc00c2d0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 shutdown_connections 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fb1ac0a2b90 0x7fb1ac0a50a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1c41078d0 0x7fb1c41a0630 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1c4102bd0 0x7fb1c419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 --2- 172.21.15.135:0/3377728200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1c4101990 0x7fb1c40747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.643+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 >> 172.21.15.135:0/3377728200 conn(0x7fb1c40fcba0 msgr2=0x7fb1c41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.644+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 shutdown_connections 2024-05-20T17:33:08.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.644+0000 7fb1c93ea640 1 -- 172.21.15.135:0/3377728200 wait complete. 2024-05-20T17:33:08.655 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:08 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2620305683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:08.656 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:08 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1774376954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.656 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:08 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2438080549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.656 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:08 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1582398888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:08 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2620305683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:08 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1774376954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:08 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2438080549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:08 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1582398888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 -- 172.21.15.135:0/4112116735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 msgr2=0x7f5850109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 --2- 172.21.15.135:0/4112116735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f5850109cd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5848009ca0 tx=0x7f584802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 -- 172.21.15.135:0/4112116735 shutdown_connections 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 --2- 172.21.15.135:0/4112116735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f5850109cd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 --2- 172.21.15.135:0/4112116735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850102bb0 0x7f5850102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 --2- 172.21.15.135:0/4112116735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850101970 0x7f5850102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 -- 172.21.15.135:0/4112116735 >> 172.21.15.135:0/4112116735 conn(0x7f58500fcb80 msgr2=0x7f58500ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 -- 172.21.15.135:0/4112116735 shutdown_connections 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 -- 172.21.15.135:0/4112116735 wait complete. 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.767+0000 7f5855cf0640 1 Processor -- start 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 -- start start 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850101970 0x7f5850198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850102bb0 0x7f58501986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d5f0 con 0x7f58501078b0 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d470 con 0x7f5850102bb0 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f5855cf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d770 con 0x7f5850101970 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50288/0 (socket says 172.21.15.135:50288) 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 -- 172.21.15.135:0/3024559985 learned_addr learned my addr 172.21.15.135:0/3024559985 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584effd640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850102bb0 0x7f58501986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584f7fe640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850101970 0x7f5850198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 -- 172.21.15.135:0/3024559985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850101970 msgr2=0x7f5850198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850101970 0x7f5850198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 -- 172.21.15.135:0/3024559985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850102bb0 msgr2=0x7f58501986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850102bb0 0x7f58501986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.768+0000 7f584ffff640 1 -- 172.21.15.135:0/3024559985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585019fc60 con 0x7f58501078b0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f584ffff640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5848005e30 tx=0x7f5848031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848003b70 con 0x7f58501078b0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585019fef0 con 0x7f58501078b0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5848003d10 con 0x7f58501078b0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584802fb70 con 0x7f58501078b0 2024-05-20T17:33:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.769+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501a03b0 con 0x7f58501078b0 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.770+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58501066c0 con 0x7f58501078b0 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.771+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f584802fd10 con 0x7f58501078b0 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.772+0000 7f584cff9640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 0x7f58380a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.772+0000 7f584f7fe640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 0x7f58380a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.772+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f58480f0470 con 0x7f58501078b0 2024-05-20T17:33:08.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.772+0000 7f584f7fe640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 0x7f58380a50a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5850102570 tx=0x7f5840005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:08.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.775+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f58480bd3b0 con 0x7f58501078b0 2024-05-20T17:33:08.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:08 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2620305683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:08.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:08 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1774376954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:08 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2438080549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:08 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1582398888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:08.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.953+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5850062750 con 0x7f58501078b0 2024-05-20T17:33:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.954+0000 7f584cff9640 1 -- 172.21.15.135:0/3024559985 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7f58480bccb0 con 0x7f58501078b0 2024-05-20T17:33:08.956 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:08.956 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 msgr2=0x7f58380a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 0x7f58380a50a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5850102570 tx=0x7f5840005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 msgr2=0x7f585019f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5848005e30 tx=0x7f5848031ee0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 shutdown_connections 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58380a2b90 0x7f58380a50a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58501078b0 0x7f585019f5f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5850102bb0 0x7f58501986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 --2- 172.21.15.135:0/3024559985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5850101970 0x7f5850198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.956+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 >> 172.21.15.135:0/3024559985 conn(0x7f58500fcb80 msgr2=0x7f5850103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.957+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 shutdown_connections 2024-05-20T17:33:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:08.957+0000 7f5855cf0640 1 -- 172.21.15.135:0/3024559985 wait complete. 2024-05-20T17:33:08.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:33:08.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 -- 172.21.15.135:0/2270207180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc102bd0 msgr2=0x7f40dc102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 --2- 172.21.15.135:0/2270207180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc102bd0 0x7f40dc102fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009900 tx=0x7f40c402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 -- 172.21.15.135:0/2270207180 shutdown_connections 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 --2- 172.21.15.135:0/2270207180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 0x7f40dc109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 --2- 172.21.15.135:0/2270207180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc102bd0 0x7f40dc102fe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 --2- 172.21.15.135:0/2270207180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40dc101990 0x7f40dc102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 -- 172.21.15.135:0/2270207180 >> 172.21.15.135:0/2270207180 conn(0x7f40dc0fcb80 msgr2=0x7f40dc0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 -- 172.21.15.135:0/2270207180 shutdown_connections 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.084+0000 7f40e15aa640 1 -- 172.21.15.135:0/2270207180 wait complete. 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 Processor -- start 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 -- start start 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40dc102bd0 0x7f40dc199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 0x7f40dc1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc10d5e0 con 0x7f40dc101990 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc10d460 con 0x7f40dc1078d0 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40e15aa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc10d760 con 0x7f40dc102bd0 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50312/0 (socket says 172.21.15.135:50312) 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 -- 172.21.15.135:0/3015368845 learned_addr learned my addr 172.21.15.135:0/3015368845 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 -- 172.21.15.135:0/3015368845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40dc102bd0 msgr2=0x7f40dc199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40db7fe640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 0x7f40dc1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40dc102bd0 0x7f40dc199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 -- 172.21.15.135:0/3015368845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 msgr2=0x7f40dc1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 0x7f40dc1a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.085+0000 7f40daffd640 1 -- 172.21.15.135:0/3015368845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc1a10f0 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40daffd640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00d740 tx=0x7f40cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc017070 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40cc00de50 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc1a13e0 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc003e00 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.086+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc1a1930 con 0x7f40dc101990 2024-05-20T17:33:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.087+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc06b250 con 0x7f40dc101990 2024-05-20T17:33:09.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.088+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f40cc003fa0 con 0x7f40dc101990 2024-05-20T17:33:09.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.089+0000 7f40d8ff9640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 0x7f40c80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.089+0000 7f40d3fff640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 0x7f40c80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.089+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f40cc0cef10 con 0x7f40dc101990 2024-05-20T17:33:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.089+0000 7f40d3fff640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 0x7f40c80a50a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f40c40096c0 tx=0x7f40c4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.092+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f40cc09be50 con 0x7f40dc101990 2024-05-20T17:33:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.270+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f40dc1a1b90 con 0x7f40dc101990 2024-05-20T17:33:09.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.270+0000 7f40d8ff9640 1 -- 172.21.15.135:0/3015368845 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f40cc09b750 con 0x7f40dc101990 2024-05-20T17:33:09.272 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:33:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.272+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 msgr2=0x7f40c80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.272+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 0x7f40c80a50a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f40c40096c0 tx=0x7f40c4031400 comp rx=0 tx=0).stop 2024-05-20T17:33:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.272+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 msgr2=0x7f40dc1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.272+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00d740 tx=0x7f40cc00dc00 comp rx=0 tx=0).stop 2024-05-20T17:33:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 shutdown_connections 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f40c80a2b90 0x7f40c80a50a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40dc1078d0 0x7f40dc1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40dc102bd0 0x7f40dc199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 --2- 172.21.15.135:0/3015368845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40dc101990 0x7f40dc1995b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 >> 172.21.15.135:0/3015368845 conn(0x7f40dc0fcb80 msgr2=0x7f40dc068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 shutdown_connections 2024-05-20T17:33:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.273+0000 7f40e15aa640 1 -- 172.21.15.135:0/3015368845 wait complete. 2024-05-20T17:33:09.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:33:09.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 -- 172.21.15.135:0/4261953168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f4102bd0 msgr2=0x7fd1f4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/4261953168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f4102bd0 0x7fd1f4102fe0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009900 tx=0x7fd1dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:09.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 -- 172.21.15.135:0/4261953168 shutdown_connections 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/4261953168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f41078d0 0x7fd1f4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/4261953168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f4102bd0 0x7fd1f4102fe0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/4261953168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 0x7fd1f4102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 -- 172.21.15.135:0/4261953168 >> 172.21.15.135:0/4261953168 conn(0x7fd1f40fcb80 msgr2=0x7fd1f40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 -- 172.21.15.135:0/4261953168 shutdown_connections 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.400+0000 7fd1fa56b640 1 -- 172.21.15.135:0/4261953168 wait complete. 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 Processor -- start 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 -- start start 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 0x7fd1f4069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 0x7fd1f419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f410d600 con 0x7fd1f41078d0 2024-05-20T17:33:09.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f410d480 con 0x7fd1f4102bd0 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1fa56b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f410d780 con 0x7fd1f4101990 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50340/0 (socket says 172.21.15.135:50340) 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 -- 172.21.15.135:0/1282256949 learned_addr learned my addr 172.21.15.135:0/1282256949 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1ebfff640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 0x7fd1f419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 -- 172.21.15.135:0/1282256949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 msgr2=0x7fd1f4069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f3fff640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 0x7fd1f4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 0x7fd1f4069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 -- 172.21.15.135:0/1282256949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 msgr2=0x7fd1f419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 0x7fd1f419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1f8b08640 1 -- 172.21.15.135:0/1282256949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f41a1060 con 0x7fd1f41078d0 2024-05-20T17:33:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.401+0000 7fd1ebfff640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 0x7fd1f419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1f8b08640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00cce0 tx=0x7fd1ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00f450 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1ec00fad0 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f41a1350 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec018c10 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.402+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f41a18a0 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.403+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f41066e0 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.404+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd1ec00f5f0 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.405+0000 7fd1f1ffb640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 0x7fd1e00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.405+0000 7fd1f3fff640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 0x7fd1e00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.405+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fd1ec0cf7f0 con 0x7fd1f41078d0 2024-05-20T17:33:09.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.405+0000 7fd1f3fff640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 0x7fd1e00a5120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005fd0 tx=0x7fd1e4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.408+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd1ec014030 con 0x7fd1f41078d0 2024-05-20T17:33:09.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.585+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd1f402d460 con 0x7fd1f41078d0 2024-05-20T17:33:09.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.585+0000 7fd1f1ffb640 1 -- 172.21.15.135:0/1282256949 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fd1ec09c840 con 0x7fd1f41078d0 2024-05-20T17:33:09.587 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 msgr2=0x7fd1e00a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 0x7fd1e00a5120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005fd0 tx=0x7fd1e4005850 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 msgr2=0x7fd1f41a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00cce0 tx=0x7fd1ec00a620 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 shutdown_connections 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd1e00a2c10 0x7fd1e00a5120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1f41078d0 0x7fd1f41a08d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1f4102bd0 0x7fd1f419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 --2- 172.21.15.135:0/1282256949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f4101990 0x7fd1f4069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 >> 172.21.15.135:0/1282256949 conn(0x7fd1f40fcb80 msgr2=0x7fd1f41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 shutdown_connections 2024-05-20T17:33:09.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.587+0000 7fd1fa56b640 1 -- 172.21.15.135:0/1282256949 wait complete. 2024-05-20T17:33:09.599 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:09 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3377728200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.599 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:09 smithi135 ceph-mon[32027]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:09.599 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:09 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3024559985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.599 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:09 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3015368845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:09.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 -- 172.21.15.135:0/1095503757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c101210 msgr2=0x7ff93c10ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 --2- 172.21.15.135:0/1095503757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c101210 0x7ff93c10ac70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff934009ca0 tx=0x7ff93402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 -- 172.21.15.135:0/1095503757 shutdown_connections 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 --2- 172.21.15.135:0/1095503757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c101210 0x7ff93c10ac70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 --2- 172.21.15.135:0/1095503757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 --2- 172.21.15.135:0/1095503757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c104060 0x7ff93c104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 -- 172.21.15.135:0/1095503757 >> 172.21.15.135:0/1095503757 conn(0x7ff93c0fc330 msgr2=0x7ff93c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 -- 172.21.15.135:0/1095503757 shutdown_connections 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.713+0000 7ff943db5640 1 -- 172.21.15.135:0/1095503757 wait complete. 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 Processor -- start 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 -- start start 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c101210 0x7ff93c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c10e740 con 0x7ff93c104060 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c10e5c0 con 0x7ff93c100710 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff943db5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c10e8c0 con 0x7ff93c101210 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff942352640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff942352640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35112/0 (socket says 172.21.15.135:35112) 2024-05-20T17:33:09.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff942352640 1 -- 172.21.15.135:0/1493316918 learned_addr learned my addr 172.21.15.135:0/1493316918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.714+0000 7ff941350640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c101210 0x7ff93c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff941b51640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 -- 172.21.15.135:0/1493316918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c101210 msgr2=0x7ff93c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c101210 0x7ff93c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 -- 172.21.15.135:0/1493316918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 msgr2=0x7ff93c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 -- 172.21.15.135:0/1493316918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c1a0d90 con 0x7ff93c104060 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff941b51640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff942352640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff934005cc0 tx=0x7ff934004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934003b70 con 0x7ff93c104060 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934003d10 con 0x7ff93c104060 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c1a1020 con 0x7ff93c104060 2024-05-20T17:33:09.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93402fbd0 con 0x7ff93c104060 2024-05-20T17:33:09.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.715+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c1a1570 con 0x7ff93c104060 2024-05-20T17:33:09.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.716+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c109a00 con 0x7ff93c104060 2024-05-20T17:33:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.718+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff93402fd70 con 0x7ff93c104060 2024-05-20T17:33:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.719+0000 7ff932ffd640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 0x7ff9280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.719+0000 7ff941b51640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 0x7ff9280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.719+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff9340f04e0 con 0x7ff93c104060 2024-05-20T17:33:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.719+0000 7ff941b51640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 0x7ff9280a50a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06a280 tx=0x7ff92c005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:09.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.723+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff9340bd420 con 0x7ff93c104060 2024-05-20T17:33:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:09 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3377728200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:09 smithi160 ceph-mon[36261]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:09 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3024559985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:09 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3015368845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:09 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3377728200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:09 smithi172 ceph-mon[36511]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-20T17:33:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:09 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3024559985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:09 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3015368845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.901+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff93c062750 con 0x7ff93c104060 2024-05-20T17:33:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.902+0000 7ff932ffd640 1 -- 172.21.15.135:0/1493316918 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7ff9340bcd20 con 0x7ff93c104060 2024-05-20T17:33:09.903 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 msgr2=0x7ff9280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 0x7ff9280a50a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06a280 tx=0x7ff92c005e70 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 msgr2=0x7ff93c1a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff934005cc0 tx=0x7ff934004ab0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 shutdown_connections 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9280a2b90 0x7ff9280a50a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c104060 0x7ff93c1a0720 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff93c101210 0x7ff93c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 --2- 172.21.15.135:0/1493316918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff93c100710 0x7ff93c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 >> 172.21.15.135:0/1493316918 conn(0x7ff93c0fc330 msgr2=0x7ff93c106bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:09.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 shutdown_connections 2024-05-20T17:33:09.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:09.904+0000 7ff943db5640 1 -- 172.21.15.135:0/1493316918 wait complete. 2024-05-20T17:33:09.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:33:10.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 -- 172.21.15.135:0/2145318328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4102900 msgr2=0x7fd9d4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 --2- 172.21.15.135:0/2145318328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4102900 0x7fd9d4102d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009900 tx=0x7fd9bc02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:10.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 -- 172.21.15.135:0/2145318328 shutdown_connections 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 --2- 172.21.15.135:0/2145318328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4103420 0x7fd9d4109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 --2- 172.21.15.135:0/2145318328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4102900 0x7fd9d4102d90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 --2- 172.21.15.135:0/2145318328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4101f20 0x7fd9d4102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 -- 172.21.15.135:0/2145318328 >> 172.21.15.135:0/2145318328 conn(0x7fd9d40fc320 msgr2=0x7fd9d40fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 -- 172.21.15.135:0/2145318328 shutdown_connections 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.026+0000 7fd9d948d640 1 -- 172.21.15.135:0/2145318328 wait complete. 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 Processor -- start 2024-05-20T17:33:10.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 -- start start 2024-05-20T17:33:10.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 0x7fd9d419e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4103420 0x7fd9d41a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410d640 con 0x7fd9d4101f20 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410d4c0 con 0x7fd9d4103420 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.027+0000 7fd9d948d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410d7c0 con 0x7fd9d4102900 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35126/0 (socket says 172.21.15.135:35126) 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 -- 172.21.15.135:0/274215262 learned_addr learned my addr 172.21.15.135:0/274215262 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d27fc640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 0x7fd9d419e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 -- 172.21.15.135:0/274215262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 msgr2=0x7fd9d419e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 0x7fd9d419e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 -- 172.21.15.135:0/274215262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4103420 msgr2=0x7fd9d41a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4103420 0x7fd9d41a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 -- 172.21.15.135:0/274215262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41a0dd0 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d27fc640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 0x7fd9d419e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d2ffd640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ea50 tx=0x7fd9cc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00cdc0 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9cc005020 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41a10c0 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011690 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.028+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d41a15c0 con 0x7fd9d4101f20 2024-05-20T17:33:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.029+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d41068c0 con 0x7fd9d4101f20 2024-05-20T17:33:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.031+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd9cc005540 con 0x7fd9d4101f20 2024-05-20T17:33:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.032+0000 7fd9cbfff640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 0x7fd9c00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.032+0000 7fd9d27fc640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 0x7fd9c00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.032+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fd9cc0cf7e0 con 0x7fd9d4101f20 2024-05-20T17:33:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.033+0000 7fd9d27fc640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 0x7fd9c00a50a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc000c00 tx=0x7fd9bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.036+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd9cc016030 con 0x7fd9d4101f20 2024-05-20T17:33:10.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.248+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9d402d2a0 con 0x7fd9d4101f20 2024-05-20T17:33:10.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.249+0000 7fd9cbfff640 1 -- 172.21.15.135:0/274215262 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11884 (secure 0 0 0) 0x7fd9cc09c6c0 con 0x7fd9d4101f20 2024-05-20T17:33:10.250 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:10.251 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:31:18.165890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:33:10.251 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 21 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 msgr2=0x7fd9c00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 0x7fd9c00a50a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc000c00 tx=0x7fd9bc031400 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 msgr2=0x7fd9d41011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ea50 tx=0x7fd9cc00ef10 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 shutdown_connections 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fd9c00a2b90 0x7fd9c00a50a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9d4103420 0x7fd9d41a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9d4102900 0x7fd9d419e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 --2- 172.21.15.135:0/274215262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d4101f20 0x7fd9d41011c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 >> 172.21.15.135:0/274215262 conn(0x7fd9d40fc320 msgr2=0x7fd9d4103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 shutdown_connections 2024-05-20T17:33:10.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.251+0000 7fd9d948d640 1 -- 172.21.15.135:0/274215262 wait complete. 2024-05-20T17:33:10.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:10.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 -- 172.21.15.135:0/3526264545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 msgr2=0x7f590c102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 --2- 172.21.15.135:0/3526264545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c102670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5908009900 tx=0x7f590802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 -- 172.21.15.135:0/3526264545 shutdown_connections 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 --2- 172.21.15.135:0/3526264545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1078b0 0x7f590c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 --2- 172.21.15.135:0/3526264545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c102bb0 0x7f590c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 --2- 172.21.15.135:0/3526264545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c102670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 -- 172.21.15.135:0/3526264545 >> 172.21.15.135:0/3526264545 conn(0x7f590c0fcb80 msgr2=0x7f590c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 -- 172.21.15.135:0/3526264545 shutdown_connections 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.375+0000 7f5913a1b640 1 -- 172.21.15.135:0/3526264545 wait complete. 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 Processor -- start 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 -- start start 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c102bb0 0x7f590c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c1078b0 0x7f590c19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d610 con 0x7f590c101970 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d490 con 0x7f590c1078b0 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5913a1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d790 con 0x7f590c102bb0 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35140/0 (socket says 172.21.15.135:35140) 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 -- 172.21.15.135:0/2868109186 learned_addr learned my addr 172.21.15.135:0/2868109186 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5911fb8640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c1078b0 0x7f590c19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f5910fb6640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c102bb0 0x7f590c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 -- 172.21.15.135:0/2868109186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c102bb0 msgr2=0x7f590c1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c102bb0 0x7f590c1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 -- 172.21.15.135:0/2868109186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c1078b0 msgr2=0x7f590c19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c1078b0 0x7f590c19f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 -- 172.21.15.135:0/2868109186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c19fcd0 con 0x7f590c101970 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.376+0000 7f59117b7640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5908031440 tx=0x7f5908032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.377+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590803f030 con 0x7f590c101970 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.377+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5908003ce0 con 0x7f590c101970 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.377+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908035070 con 0x7f590c101970 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.377+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c19ff60 con 0x7f590c101970 2024-05-20T17:33:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.377+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c1a03c0 con 0x7f590c101970 2024-05-20T17:33:10.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.378+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c1066c0 con 0x7f590c101970 2024-05-20T17:33:10.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.379+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5908042030 con 0x7f590c101970 2024-05-20T17:33:10.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.379+0000 7f59027fc640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.380+0000 7f5910fb6640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.380+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f59080ef450 con 0x7f590c101970 2024-05-20T17:33:10.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.380+0000 7f5910fb6640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 0x7f58f80a5120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58fc005fd0 tx=0x7f58fc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.384+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f59080bc390 con 0x7f590c101970 2024-05-20T17:33:10.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.560+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f590c02d4c0 con 0x7f590c101970 2024-05-20T17:33:10.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.562+0000 7f59027fc640 1 -- 172.21.15.135:0/2868109186 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7f59080bbc90 con 0x7f590c101970 2024-05-20T17:33:10.563 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:10.564 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:10.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 msgr2=0x7f58f80a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 0x7f58f80a5120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58fc005fd0 tx=0x7f58fc005850 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 msgr2=0x7f590c198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5908031440 tx=0x7f5908032ce0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 shutdown_connections 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f590c1078b0 0x7f590c19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c102bb0 0x7f590c1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 --2- 172.21.15.135:0/2868109186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f590c101970 0x7f590c198190 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 >> 172.21.15.135:0/2868109186 conn(0x7f590c0fcb80 msgr2=0x7f590c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 shutdown_connections 2024-05-20T17:33:10.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.564+0000 7f5913a1b640 1 -- 172.21.15.135:0/2868109186 wait complete. 2024-05-20T17:33:10.576 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1282256949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.577 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1493316918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.577 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:10 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/274215262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:10.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-20T17:31:14.132666+0000', 'modified': '2024-05-20T17:31:18.165890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24523, 'mds_2': 24521}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/3094095088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3094095088}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3094095088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/4160320010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 4160320010}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 4160320010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/3276473516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3276473516}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3276473516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.160:6837/320557399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 320557399}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 320557399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.172:6839/380136788', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 380136788}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 380136788}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6839/1255615526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 1255615526}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 1255615526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24521, 24523, 24560]} 2024-05-20T17:33:10.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-20T17:33:10.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-20T17:33:10.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 -- 172.21.15.135:0/3596537648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 msgr2=0x7fe514103790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 --2- 172.21.15.135:0/3596537648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514103790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe504009900 tx=0x7fe50402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 -- 172.21.15.135:0/3596537648 shutdown_connections 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 --2- 172.21.15.135:0/3596537648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5141089d0 0x7fe51410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 --2- 172.21.15.135:0/3596537648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe5141040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 --2- 172.21.15.135:0/3596537648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514103790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 -- 172.21.15.135:0/3596537648 >> 172.21.15.135:0/3596537648 conn(0x7fe5140fdc80 msgr2=0x7fe514100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 -- 172.21.15.135:0/3596537648 shutdown_connections 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 -- 172.21.15.135:0/3596537648 wait complete. 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.691+0000 7fe51a11a640 1 Processor -- start 2024-05-20T17:33:10.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 -- start start 2024-05-20T17:33:10.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe514199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5141089d0 0x7fe5141a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe51410e710 con 0x7fe514102a90 2024-05-20T17:33:10.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe51410e590 con 0x7fe514103cd0 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe51a11a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe51410e890 con 0x7fe5141089d0 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35160/0 (socket says 172.21.15.135:35160) 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 -- 172.21.15.135:0/2226491793 learned_addr learned my addr 172.21.15.135:0/2226491793 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe514199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 -- 172.21.15.135:0/2226491793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5141089d0 msgr2=0x7fe5141a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5141089d0 0x7fe5141a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 -- 172.21.15.135:0/2226491793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 msgr2=0x7fe514199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe514199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 -- 172.21.15.135:0/2226491793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5141a0e10 con 0x7fe514102a90 2024-05-20T17:33:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe514199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe504031440 tx=0x7fe504032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.692+0000 7fe510ff9640 1 -- 172.21.15.135:0/2226491793 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50403f030 con 0x7fe514102a90 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.693+0000 7fe510ff9640 1 -- 172.21.15.135:0/2226491793 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe504003ce0 con 0x7fe514102a90 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.693+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5141a10a0 con 0x7fe514102a90 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.693+0000 7fe510ff9640 1 -- 172.21.15.135:0/2226491793 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504035070 con 0x7fe514102a90 2024-05-20T17:33:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.693+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5141a1590 con 0x7fe514102a90 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 Processor -- start 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 -- start start 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe510ff9640 1 -- 172.21.15.135:0/2226491793 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe504042030 con 0x7fe514102a90 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d562470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 0x55fb3d5698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d4c64d0 con 0x55fb3d1993b0 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d46e3e0 con 0x55fb3d1a1590 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe520fc3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d4c2490 con 0x55fb3d1c2270 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35166/0 (socket says 172.21.15.135:35166) 2024-05-20T17:33:10.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.695+0000 7fe5137fe640 1 -- 172.21.15.135:0/1623140935 learned_addr learned my addr 172.21.15.135:0/1623140935 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe513fff640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d562470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe512ffd640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 0x55fb3d5698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 -- 172.21.15.135:0/1623140935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 msgr2=0x55fb3d562470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d562470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 -- 172.21.15.135:0/1623140935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 msgr2=0x55fb3d5698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 0x55fb3d5698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 -- 172.21.15.135:0/1623140935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3d1da2d0 con 0x55fb3d1993b0 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe512ffd640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 0x55fb3d5698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe510ff9640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 0x7fe4fc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe5137fe640 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe5040f5cf0 tx=0x7fe5040f5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc69a6b32717aff server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe513fff640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 0x7fe4fc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe510ff9640 1 -- 172.21.15.135:0/2226491793 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe5040ef690 con 0x7fe514102a90 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe4f9ffb640 1 -- 172.21.15.135:0/1623140935 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040b8170 con 0x55fb3d1993b0 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe4f9ffb640 1 -- 172.21.15.135:0/1623140935 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5040bc5d0 con 0x55fb3d1993b0 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.696+0000 7fe4f9ffb640 1 -- 172.21.15.135:0/1623140935 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040bb830 con 0x55fb3d1993b0 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 -- 172.21.15.135:0/1623140935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 msgr2=0x55fb3d5629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe513fff640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 0x7fe4fc0a50a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe50c007750 tx=0x7fe50c0076e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe5040f5cf0 tx=0x7fe5040f5de0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 -- 172.21.15.135:0/1623140935 shutdown_connections 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1a1590 0x55fb3d5698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1993b0 0x55fb3d5629f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 --2- 172.21.15.135:0/1623140935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d562470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 -- 172.21.15.135:0/1623140935 >> 172.21.15.135:0/1623140935 conn(0x55fb3d1b63c0 msgr2=0x55fb3d55de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 -- 172.21.15.135:0/1623140935 shutdown_connections 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.697+0000 7fe520fc3740 1 -- 172.21.15.135:0/1623140935 wait complete. 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 -- start start 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 Processor -- start 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d573510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d56a100 con 0x55fb3d1a1590 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d4818e0 con 0x55fb3d1993b0 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d56a280 con 0x55fb3d1c2270 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe520fc3740 10 client.0 _ll_register_callbacks cb 0x55fb3d44e9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe512ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe512ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35172/0 (socket says 172.21.15.135:35172) 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe512ffd640 1 -- 172.21.15.135:0/3537789997 learned_addr learned my addr 172.21.15.135:0/3537789997 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.698+0000 7fe5137fe640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe513fff640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d573510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 -- 172.21.15.135:0/3537789997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 msgr2=0x55fb3d573510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d573510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 -- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 msgr2=0x55fb3d56c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 -- 172.21.15.135:0/3537789997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3d2a46b0 con 0x55fb3d1a1590 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe513fff640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d573510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe512ffd640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe5080106a0 tx=0x7fe508010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69e5d8473a46d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508010ea0 con 0x55fb3d1a1590 2024-05-20T17:33:10.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe50800cab0 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5040bc5d0 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe508022070 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe520fc3740 10 client.15240 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fb3d576510 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5040bc5d0 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.699+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe50800e030 con 0x55fb3d1a1590 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 10 client.15240 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 10 client.15240 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 20 client.15240 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d180e40 0x55fb3d579ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 4 client.15240 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:10.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb3d4d3c00 con 0x55fb3d180e40 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe5137fe640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d180e40 0x55fb3d579ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe5137fe640 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d180e40 0x55fb3d579ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39e382e5a7c0472a server_cookie=e4a7df687fdcca63 in_seq=0 out_seq=0 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.700+0000 7fe4f2ffd640 10 client.15240 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/3537789997 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fb3d4d3c00 con 0x55fb3d180e40 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe4f2ffd640 10 client.15240 handle_command_reply: tid=0 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 client.15240 shutdown 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 msgr2=0x55fb3d56c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe5080106a0 tx=0x7fe508010b60 comp rx=0 tx=0).stop 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 shutdown_connections 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d180e40 0x55fb3d579ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1c2270 0x55fb3d573510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d1a1590 0x55fb3d56c5b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe4f2ffd640 0 client.15240 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 --2- 172.21.15.135:0/3537789997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 >> 172.21.15.135:0/3537789997 conn(0x55fb3d1b63c0 msgr2=0x55fb3d55cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 shutdown_connections 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 1 -- 172.21.15.135:0/3537789997 wait complete. 2024-05-20T17:33:10.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.701+0000 7fe520fc3740 20 client.15240 trim_cache size 0 max 16384 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 Processor -- start 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 -- start start 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d573430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d56aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d578330 con 0x55fb3d180e40 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d578a00 con 0x55fb3d1993b0 2024-05-20T17:33:10.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.720+0000 7fe520fc3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d5790d0 con 0x55fb3d1a1590 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35184/0 (socket says 172.21.15.135:35184) 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 -- 172.21.15.135:0/2116339588 learned_addr learned my addr 172.21.15.135:0/2116339588 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe513fff640 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d56aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d573430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 -- 172.21.15.135:0/2116339588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 msgr2=0x55fb3d56aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d56aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 -- 172.21.15.135:0/2116339588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 msgr2=0x55fb3d573430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d573430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 -- 172.21.15.135:0/2116339588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3d562020 con 0x55fb3d180e40 2024-05-20T17:33:10.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5040f5f10 tx=0x7fe504009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594dd8b3a666223c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe4f97fa640 1 -- 172.21.15.135:0/2116339588 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504049040 con 0x55fb3d180e40 2024-05-20T17:33:10.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe4f97fa640 1 -- 172.21.15.135:0/2116339588 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5040bc5d0 con 0x55fb3d180e40 2024-05-20T17:33:10.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.721+0000 7fe4f97fa640 1 -- 172.21.15.135:0/2116339588 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040bba10 con 0x55fb3d180e40 2024-05-20T17:33:10.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 -- 172.21.15.135:0/2116339588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 msgr2=0x55fb3d56a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5040f5f10 tx=0x7fe504009260 comp rx=0 tx=0).stop 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 -- 172.21.15.135:0/2116339588 shutdown_connections 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d56aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d573430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2116339588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56a570 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 -- 172.21.15.135:0/2116339588 >> 172.21.15.135:0/2116339588 conn(0x55fb3d1b63c0 msgr2=0x55fb3d566780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 -- 172.21.15.135:0/2116339588 shutdown_connections 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.722+0000 7fe520fc3740 1 -- 172.21.15.135:0/2116339588 wait complete. 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 -- start start 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 Processor -- start 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d5e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d579e70 con 0x55fb3d180e40 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d5797a0 con 0x55fb3d1993b0 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb3d57a540 con 0x55fb3d1a1590 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe520fc3740 10 client.0 _ll_register_callbacks cb 0x7fe50800e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35194/0 (socket says 172.21.15.135:35194) 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.723+0000 7fe5137fe640 1 -- 172.21.15.135:0/2046949915 learned_addr learned my addr 172.21.15.135:0/2046949915 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe513fff640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d5e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 -- 172.21.15.135:0/2046949915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 msgr2=0x55fb3d5e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d5e0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 -- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 msgr2=0x55fb3d56e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 -- 172.21.15.135:0/2046949915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3d5e13a0 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe5137fe640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe5040c4610 tx=0x7fe5040314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2e19e11a924152 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe4f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504049070 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe5040ba1d0 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5040bc5d0 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe5040bbca0 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe520fc3740 10 client.15246 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.724+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fb3d5e2540 con 0x55fb3d180e40 2024-05-20T17:33:10.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5040bc5d0 con 0x55fb3d180e40 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe50403bcd0 con 0x55fb3d180e40 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 10 client.15246 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 10 client.15246 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 20 client.15246 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d1c2270 0x55fb3d5e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 4 client.15246 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "status"}) -- 0x55fb3d4cdf50 con 0x55fb3d1c2270 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d1c2270 0x55fb3d5e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe4f2ffd640 10 client.15246 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.725+0000 7fe512ffd640 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d1c2270 0x55fb3d5e5b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3440c2983e4d027b server_cookie=40d250965c095672 in_seq=0 out_seq=0 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe4f2ffd640 1 -- 172.21.15.135:0/2046949915 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55fb3d4cdf50 con 0x55fb3d1c2270 2024-05-20T17:33:10.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe4f2ffd640 10 client.15246 handle_command_reply: tid=0 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 client.15246 shutdown 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 msgr2=0x55fb3d56e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe5040c4610 tx=0x7fe5040314e0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 shutdown_connections 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55fb3d1c2270 0x55fb3d5e5b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb3d1a1590 0x55fb3d5e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb3d1993b0 0x55fb3d56e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 --2- 172.21.15.135:0/2046949915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb3d180e40 0x55fb3d56e440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 >> 172.21.15.135:0/2046949915 conn(0x55fb3d1b63c0 msgr2=0x55fb3d56a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe4f2ffd640 0 client.15246 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 shutdown_connections 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 1 -- 172.21.15.135:0/2046949915 wait complete. 2024-05-20T17:33:10.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.726+0000 7fe520fc3740 20 client.15246 trim_cache size 0 max 16384 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24521, 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 112.918968581, 2024-05-20T17:33:10.735 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:33:10.736 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:33:10.736 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:33:10.736 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 134.34442328 2024-05-20T17:33:10.736 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:10.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 msgr2=0x7fe4fc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 0x7fe4fc0a50a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe50c007750 tx=0x7fe50c0076e0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 msgr2=0x7fe514199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe504031440 tx=0x7fe504032ce0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 shutdown_connections 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4fc0a2b90 0x7fe4fc0a50a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5141089d0 0x7fe5141a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514103cd0 0x7fe514199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 --2- 172.21.15.135:0/2226491793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe514102a90 0x7fe514199340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 >> 172.21.15.135:0/2226491793 conn(0x7fe5140fdc80 msgr2=0x7fe5141049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 shutdown_connections 2024-05-20T17:33:10.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.727+0000 7fe51a11a640 1 -- 172.21.15.135:0/2226491793 wait complete. 2024-05-20T17:33:10.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-20T17:33:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1282256949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1493316918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:10 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/274215262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:10.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1282256949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1493316918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:10.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:10 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/274215262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:10.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 -- 172.21.15.135:0/3162523511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 msgr2=0x7f85e8102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 --2- 172.21.15.135:0/3162523511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8102690 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009900 tx=0x7f85dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:10.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 -- 172.21.15.135:0/3162523511 shutdown_connections 2024-05-20T17:33:10.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 --2- 172.21.15.135:0/3162523511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e81078d0 0x7f85e8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 --2- 172.21.15.135:0/3162523511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e8102bd0 0x7f85e8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 --2- 172.21.15.135:0/3162523511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8102690 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 -- 172.21.15.135:0/3162523511 >> 172.21.15.135:0/3162523511 conn(0x7f85e80fcb80 msgr2=0x7f85e80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 -- 172.21.15.135:0/3162523511 shutdown_connections 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.852+0000 7f85ef31a640 1 -- 172.21.15.135:0/3162523511 wait complete. 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 Processor -- start 2024-05-20T17:33:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 -- start start 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8102bd0 0x7f85e8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 0x7f85e819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85e810d5e0 con 0x7f85e8101990 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f85e810d460 con 0x7f85e8102bd0 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ef31a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85e810d760 con 0x7f85e81078d0 2024-05-20T17:33:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35206/0 (socket says 172.21.15.135:35206) 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 -- 172.21.15.135:0/979470346 learned_addr learned my addr 172.21.15.135:0/979470346 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8102bd0 0x7f85e8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 0x7f85e819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 -- 172.21.15.135:0/979470346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 msgr2=0x7f85e819f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 0x7f85e819f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 -- 172.21.15.135:0/979470346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8102bd0 msgr2=0x7f85e8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8102bd0 0x7f85e8198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed0b6640 1 -- 172.21.15.135:0/979470346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e81a0020 con 0x7f85e8101990 2024-05-20T17:33:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.853+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 0x7f85e819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f85dc006010 tx=0x7f85dc031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85da7fc640 1 -- 172.21.15.135:0/979470346 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc03f030 con 0x7f85e8101990 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85da7fc640 1 -- 172.21.15.135:0/979470346 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85dc003ad0 con 0x7f85e8101990 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e81a02b0 con 0x7f85e8101990 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85da7fc640 1 -- 172.21.15.135:0/979470346 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc035070 con 0x7f85e8101990 2024-05-20T17:33:10.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.854+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e81a07a0 con 0x7f85e8101990 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.856+0000 7f85da7fc640 1 -- 172.21.15.135:0/979470346 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f85dc042030 con 0x7f85e8101990 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 Processor -- start 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 -- start start 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9244d0 con 0x55f62a5f73b0 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f62a8cc3e0 con 0x55f62a5ff590 2024-05-20T17:33:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85f61c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f62a920490 con 0x55f62a620270 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35218/0 (socket says 172.21.15.135:35218) 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85ed0b6640 1 -- 172.21.15.135:0/257281541 learned_addr learned my addr 172.21.15.135:0/257281541 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.857+0000 7f85da7fc640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 0x7f85d40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 0x7f85d40a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 -- 172.21.15.135:0/257281541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 msgr2=0x55f62a9c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 -- 172.21.15.135:0/257281541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 msgr2=0x55f62a9c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 -- 172.21.15.135:0/257281541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f62a6382d0 con 0x55f62a5f73b0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85da7fc640 1 -- 172.21.15.135:0/979470346 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f85dc0ef690 con 0x7f85e8101990 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85dc032c00 tx=0x7f85dc04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acaffb17f871120 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 0x7f85d40a50a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55f62a9c1640 tx=0x7f85e0004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85d37fe640 1 -- 172.21.15.135:0/257281541 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0bb830 con 0x55f62a5f73b0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85d37fe640 1 -- 172.21.15.135:0/257281541 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85dc004780 con 0x55f62a5f73b0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.858+0000 7f85d37fe640 1 -- 172.21.15.135:0/257281541 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc008220 con 0x55f62a5f73b0 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- 172.21.15.135:0/257281541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 msgr2=0x55f62a9c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85dc032c00 tx=0x7f85dc04b000 comp rx=0 tx=0).stop 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- 172.21.15.135:0/257281541 shutdown_connections 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c09f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 --2- 172.21.15.135:0/257281541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- 172.21.15.135:0/257281541 >> 172.21.15.135:0/257281541 conn(0x55f62a6143c0 msgr2=0x55f62a9bbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- 172.21.15.135:0/257281541 shutdown_connections 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- 172.21.15.135:0/257281541 wait complete. 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 -- start start 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.859+0000 7f85f61c2740 1 Processor -- start 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a5f73b0 0x55f62a9c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9c8100 con 0x55f62a620270 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f62a8df8e0 con 0x55f62a5ff590 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9c8280 con 0x55f62a5f73b0 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85f61c2740 10 client.0 _ll_register_callbacks cb 0x55f62a8ac9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:10.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35228/0 (socket says 172.21.15.135:35228) 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 -- 172.21.15.135:0/367067257 learned_addr learned my addr 172.21.15.135:0/367067257 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a5f73b0 0x55f62a9c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 -- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a5f73b0 msgr2=0x55f62a9c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a5f73b0 0x55f62a9c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 -- 172.21.15.135:0/367067257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 msgr2=0x55f62a9ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 -- 172.21.15.135:0/367067257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62a7026b0 con 0x55f62a620270 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f85e0012960 tx=0x7f85e0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d75766eff905f23 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.860+0000 7f85d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0022070 con 0x55f62a620270 2024-05-20T17:33:10.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f85e0011da0 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f62a931c00 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f85e001e420 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 10 client.15258 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f62a9d4430 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f62a931c00 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f85e001c740 con 0x55f62a620270 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 10 client.15258 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 10 client.15258 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 20 client.15258 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5dee40 0x55f62a9d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 4 client.15258 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:10.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f62a92bf50 con 0x55f62a5dee40 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.861+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5dee40 0x55f62a9d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.862+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5dee40 0x55f62a9d7f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dbb36c20d2359663 server_cookie=a6d9b58622d4c312 in_seq=0 out_seq=0 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.862+0000 7f85d0ff9640 10 client.15258 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85d0ff9640 1 -- 172.21.15.135:0/367067257 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f62a92bf50 con 0x55f62a5dee40 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85d0ff9640 10 client.15258 handle_command_reply: tid=0 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 client.15258 shutdown 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 msgr2=0x55f62a9d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f85e0012960 tx=0x7f85e0009500 comp rx=0 tx=0).stop 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 shutdown_connections 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5dee40 0x55f62a9d7f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a620270 0x55f62a9d1490 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85d0ff9640 0 client.15258 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:10.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 --2- 172.21.15.135:0/367067257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a5f73b0 0x55f62a9c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 >> 172.21.15.135:0/367067257 conn(0x55f62a6143c0 msgr2=0x55f62a9baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 shutdown_connections 2024-05-20T17:33:10.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 1 -- 172.21.15.135:0/367067257 wait complete. 2024-05-20T17:33:10.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.863+0000 7f85f61c2740 20 client.15258 trim_cache size 0 max 16384 2024-05-20T17:33:10.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 Processor -- start 2024-05-20T17:33:10.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 -- start start 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d6260 con 0x55f62a5f73b0 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d6930 con 0x55f62a5ff590 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.881+0000 7f85f61c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d7000 con 0x55f62a620270 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35240/0 (socket says 172.21.15.135:35240) 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 -- 172.21.15.135:0/1632136935 learned_addr learned my addr 172.21.15.135:0/1632136935 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 -- 172.21.15.135:0/1632136935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 msgr2=0x55f62a9d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 -- 172.21.15.135:0/1632136935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 msgr2=0x55f62a9c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 -- 172.21.15.135:0/1632136935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f62a9c7b60 con 0x55f62a5f73b0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b8330 tx=0x7f85dc0bbb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f43dd4423d9198f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85d2ffd640 1 -- 172.21.15.135:0/1632136935 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0c4b40 con 0x55f62a5f73b0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85d2ffd640 1 -- 172.21.15.135:0/1632136935 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85dc0c0280 con 0x55f62a5f73b0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.882+0000 7f85d2ffd640 1 -- 172.21.15.135:0/1632136935 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b8540 con 0x55f62a5f73b0 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- 172.21.15.135:0/1632136935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 msgr2=0x55f62a9c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b8330 tx=0x7f85dc0bbb10 comp rx=0 tx=0).stop 2024-05-20T17:33:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- 172.21.15.135:0/1632136935 shutdown_connections 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62a9d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5ff590 0x55f62a9c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 --2- 172.21.15.135:0/1632136935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5f73b0 0x55f62a9c4df0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- 172.21.15.135:0/1632136935 >> 172.21.15.135:0/1632136935 conn(0x55f62a6143c0 msgr2=0x55f62a9c3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- 172.21.15.135:0/1632136935 shutdown_connections 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- 172.21.15.135:0/1632136935 wait complete. 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 -- start start 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.883+0000 7f85f61c2740 1 Processor -- start 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5f73b0 0x55f62a9d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62aa40da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d7da0 con 0x55f62a5ff590 2024-05-20T17:33:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d76d0 con 0x55f62a5f73b0 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f62a9d8470 con 0x55f62a620270 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85f61c2740 10 client.0 _ll_register_callbacks cb 0x7f85e0012610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35256/0 (socket says 172.21.15.135:35256) 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 -- 172.21.15.135:0/222172376 learned_addr learned my addr 172.21.15.135:0/222172376 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ed8b7640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62aa40da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5f73b0 0x55f62a9d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 -- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 msgr2=0x55f62aa40da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62aa40da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 -- 172.21.15.135:0/222172376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5f73b0 msgr2=0x55f62a9d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5f73b0 0x55f62a9d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 -- 172.21.15.135:0/222172376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62aa412e0 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85ec8b5640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85e400bfb0 tx=0x7f85e40138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8bb7c6f56e526e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4005020 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.884+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f85e40051c0 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85dc0c0280 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f85e40053c0 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 10 client.15264 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f62aa42460 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85dc0c0280 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f85e4010760 con 0x55f62a5ff590 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 10 client.15264 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:33:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 20 client.15264 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5b4280 0x55f62aa45da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 4 client.15264 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "status"}) -- 0x55f62a9b6ee0 con 0x55f62a5b4280 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.885+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5b4280 0x55f62aa45da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85d0ff9640 10 client.15264 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85ed0b6640 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5b4280 0x55f62aa45da0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a07191bbfe6a061c server_cookie=b83c4eae1db49277 in_seq=0 out_seq=0 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85d0ff9640 1 -- 172.21.15.135:0/222172376 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f62a9b6ee0 con 0x55f62a5b4280 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85d0ff9640 10 client.15264 handle_command_reply: tid=0 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 client.15264 shutdown 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 msgr2=0x55f62a9d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85e400bfb0 tx=0x7f85e40138f0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 shutdown_connections 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55f62a5b4280 0x55f62aa45da0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f62a620270 0x55f62aa40da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85d0ff9640 0 client.15264 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f62a5ff590 0x55f62a9d1af0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 --2- 172.21.15.135:0/222172376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f62a5f73b0 0x55f62a9d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 >> 172.21.15.135:0/222172376 conn(0x55f62a6143c0 msgr2=0x55f62a9ba470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 shutdown_connections 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 1 -- 172.21.15.135:0/222172376 wait complete. 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.886+0000 7f85f61c2740 20 client.15264 trim_cache size 0 max 16384 2024-05-20T17:33:10.895 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24523, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 114.085822798, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 131.754151423 2024-05-20T17:33:10.896 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 msgr2=0x7f85d40a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 0x7f85d40a50a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55f62a9c1640 tx=0x7f85e0004ab0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 msgr2=0x7f85e8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f85dc006010 tx=0x7f85dc031b60 comp rx=0 tx=0).stop 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 shutdown_connections 2024-05-20T17:33:10.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f85d40a2b90 0x7f85d40a50a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85e81078d0 0x7f85e819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8102bd0 0x7f85e8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 --2- 172.21.15.135:0/979470346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85e8101990 0x7f85e8198550 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 >> 172.21.15.135:0/979470346 conn(0x7f85e80fcb80 msgr2=0x7f85e81038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 shutdown_connections 2024-05-20T17:33:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:10.887+0000 7f85ef31a640 1 -- 172.21.15.135:0/979470346 wait complete. 2024-05-20T17:33:10.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 -- 172.21.15.135:0/3277528660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c1089e0 msgr2=0x7fe41c10ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 --2- 172.21.15.135:0/3277528660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c1089e0 0x7fe41c10ae00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe414009ca0 tx=0x7fe41402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 -- 172.21.15.135:0/3277528660 shutdown_connections 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 --2- 172.21.15.135:0/3277528660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c1089e0 0x7fe41c10ae00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 --2- 172.21.15.135:0/3277528660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c106080 0x7fe41c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 --2- 172.21.15.135:0/3277528660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c100ed0 0x7fe41c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 -- 172.21.15.135:0/3277528660 >> 172.21.15.135:0/3277528660 conn(0x7fe41c0fc330 msgr2=0x7fe41c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 -- 172.21.15.135:0/3277528660 shutdown_connections 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.009+0000 7fe42391d640 1 -- 172.21.15.135:0/3277528660 wait complete. 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 Processor -- start 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 -- start start 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c106080 0x7fe41c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c1089e0 0x7fe41c1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10e7d0 con 0x7fe41c100ed0 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10e650 con 0x7fe41c1089e0 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe42391d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10e950 con 0x7fe41c106080 2024-05-20T17:33:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35278/0 (socket says 172.21.15.135:35278) 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 -- 172.21.15.135:0/1356232277 learned_addr learned my addr 172.21.15.135:0/1356232277 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe420eb8640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c106080 0x7fe41c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe421eba640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c1089e0 0x7fe41c1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 -- 172.21.15.135:0/1356232277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c106080 msgr2=0x7fe41c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c106080 0x7fe41c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 -- 172.21.15.135:0/1356232277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c1089e0 msgr2=0x7fe41c1a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c1089e0 0x7fe41c1a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.010+0000 7fe4216b9640 1 -- 172.21.15.135:0/1356232277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c1a0de0 con 0x7fe41c100ed0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00e9f0 tx=0x7fe40c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe4127fc640 1 -- 172.21.15.135:0/1356232277 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00ccc0 con 0x7fe41c100ed0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe4127fc640 1 -- 172.21.15.135:0/1356232277 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe40c005500 con 0x7fe41c100ed0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c1a10d0 con 0x7fe41c100ed0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe4127fc640 1 -- 172.21.15.135:0/1356232277 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c010690 con 0x7fe41c100ed0 2024-05-20T17:33:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.011+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c1a15d0 con 0x7fe41c100ed0 2024-05-20T17:33:11.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.013+0000 7fe4127fc640 1 -- 172.21.15.135:0/1356232277 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe40c0046c0 con 0x7fe41c100ed0 2024-05-20T17:33:11.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.013+0000 7fe42a7bd740 1 Processor -- start 2024-05-20T17:33:11.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.013+0000 7fe42a7bd740 1 -- start start 2024-05-20T17:33:11.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 0x557ae63b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5ff0590 0x557ae63b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae63154d0 con 0x557ae6011270 2024-05-20T17:33:11.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557ae62bd3e0 con 0x557ae5fe83b0 2024-05-20T17:33:11.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ae6311490 con 0x557ae5ff0590 2024-05-20T17:33:11.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35294/0 (socket says 172.21.15.135:35294) 2024-05-20T17:33:11.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 -- 172.21.15.135:0/18328036 learned_addr learned my addr 172.21.15.135:0/18328036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe4216b9640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 0x557ae63b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe420eb8640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5ff0590 0x557ae63b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe4127fc640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 0x7fe4080a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 -- 172.21.15.135:0/18328036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5ff0590 msgr2=0x557ae63b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5ff0590 0x557ae63b88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 -- 172.21.15.135:0/18328036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 msgr2=0x557ae63b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 0x557ae63b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 -- 172.21.15.135:0/18328036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae60292d0 con 0x557ae6011270 2024-05-20T17:33:11.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe4216b9640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 0x557ae63b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:11.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 0x7fe4080a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe4127fc640 1 -- 172.21.15.135:0/1356232277 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe40c0cf540 con 0x7fe41c100ed0 2024-05-20T17:33:11.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.014+0000 7fe421eba640 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe414035000 tx=0x7fe41402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c92f00dd35d6d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.015+0000 7fe4077fe640 1 -- 172.21.15.135:0/18328036 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414041040 con 0x557ae6011270 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.015+0000 7fe421eba640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 0x7fe4080a50a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe41404c000 tx=0x7fe41404d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.015+0000 7fe4077fe640 1 -- 172.21.15.135:0/18328036 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe414036070 con 0x557ae6011270 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.015+0000 7fe4077fe640 1 -- 172.21.15.135:0/18328036 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41402fb10 con 0x557ae6011270 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- 172.21.15.135:0/18328036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 msgr2=0x557ae63b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe414035000 tx=0x7fe41402f440 comp rx=0 tx=0).stop 2024-05-20T17:33:11.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- 172.21.15.135:0/18328036 shutdown_connections 2024-05-20T17:33:11.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5ff0590 0x557ae63b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5fe83b0 0x557ae63b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/18328036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63b1470 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- 172.21.15.135:0/18328036 >> 172.21.15.135:0/18328036 conn(0x557ae60053c0 msgr2=0x557ae63ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- 172.21.15.135:0/18328036 shutdown_connections 2024-05-20T17:33:11.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- 172.21.15.135:0/18328036 wait complete. 2024-05-20T17:33:11.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- start start 2024-05-20T17:33:11.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 Processor -- start 2024-05-20T17:33:11.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63bb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae63b9340 con 0x557ae6011270 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557ae62d08e0 con 0x557ae5ff0590 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.016+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ae63b94c0 con 0x557ae5fe83b0 2024-05-20T17:33:11.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe42a7bd740 10 client.0 _ll_register_callbacks cb 0x557ae629d9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35302/0 (socket says 172.21.15.135:35302) 2024-05-20T17:33:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 -- 172.21.15.135:0/4275487366 learned_addr learned my addr 172.21.15.135:0/4275487366 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe4216b9640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe420eb8640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 -- 172.21.15.135:0/4275487366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 msgr2=0x557ae63bb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 -- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 msgr2=0x557ae63bb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63bb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 -- 172.21.15.135:0/4275487366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae60f36b0 con 0x557ae6011270 2024-05-20T17:33:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe420eb8640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe421eba640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe414006010 tx=0x7fe4140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e847ed89735bc6a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe404ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414041030 con 0x557ae6011270 2024-05-20T17:33:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe41402f8f0 con 0x557ae6011270 2024-05-20T17:33:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe414036070 con 0x557ae6011270 2024-05-20T17:33:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe414004710 con 0x557ae6011270 2024-05-20T17:33:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe42a7bd740 10 client.15276 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.017+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557ae63b9340 con 0x557ae6011270 2024-05-20T17:33:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe414036070 con 0x557ae6011270 2024-05-20T17:33:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe414030c00 con 0x557ae6011270 2024-05-20T17:33:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 10 client.15276 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:33:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 20 client.15276 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fcfe40 0x557ae63c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 4 client.15276 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ae6322c00 con 0x557ae5fcfe40 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.018+0000 7fe4216b9640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fcfe40 0x557ae63c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.019+0000 7fe404ff9640 10 client.15276 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.019+0000 7fe4216b9640 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fcfe40 0x557ae63c8e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31446dca41f711df server_cookie=65ed51d3e77a926e in_seq=0 out_seq=0 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.019+0000 7fe404ff9640 1 -- 172.21.15.135:0/4275487366 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557ae6322c00 con 0x557ae5fcfe40 2024-05-20T17:33:11.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.019+0000 7fe404ff9640 10 client.15276 handle_command_reply: tid=0 2024-05-20T17:33:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.019+0000 7fe42a7bd740 1 client.15276 shutdown 2024-05-20T17:33:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 msgr2=0x557ae63c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe414006010 tx=0x7fe4140048f0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 shutdown_connections 2024-05-20T17:33:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fcfe40 0x557ae63c8e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae6011270 0x557ae63c27c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe404ff9640 0 client.15276 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:11.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/4275487366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 >> 172.21.15.135:0/4275487366 conn(0x557ae60053c0 msgr2=0x557ae63abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 shutdown_connections 2024-05-20T17:33:11.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 1 -- 172.21.15.135:0/4275487366 wait complete. 2024-05-20T17:33:11.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.020+0000 7fe42a7bd740 20 client.15276 trim_cache size 0 max 16384 2024-05-20T17:33:11.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 Processor -- start 2024-05-20T17:33:11.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 -- start start 2024-05-20T17:33:11.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae6011270 0x557ae63b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c7190 con 0x557ae5fe83b0 2024-05-20T17:33:11.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c7860 con 0x557ae5ff0590 2024-05-20T17:33:11.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c7f30 con 0x557ae6011270 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe4216b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe4216b9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35312/0 (socket says 172.21.15.135:35312) 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.038+0000 7fe4216b9640 1 -- 172.21.15.135:0/1417253495 learned_addr learned my addr 172.21.15.135:0/1417253495 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe420eb8640 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 -- 172.21.15.135:0/1417253495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae6011270 msgr2=0x557ae63b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae6011270 0x557ae63b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 -- 172.21.15.135:0/1417253495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 msgr2=0x557ae63c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 -- 172.21.15.135:0/1417253495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae63b1020 con 0x557ae5fe83b0 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe420eb8640 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe4216b9640 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0981e0 tx=0x7fe40c004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a283ad665bce055f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe406ffd640 1 -- 172.21.15.135:0/1417253495 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0056b0 con 0x557ae5fe83b0 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe406ffd640 1 -- 172.21.15.135:0/1417253495 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe40c09c480 con 0x557ae5fe83b0 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.039+0000 7fe406ffd640 1 -- 172.21.15.135:0/1417253495 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c09a080 con 0x557ae5fe83b0 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- 172.21.15.135:0/1417253495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 msgr2=0x557ae63b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0981e0 tx=0x7fe40c004ba0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- 172.21.15.135:0/1417253495 shutdown_connections 2024-05-20T17:33:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae6011270 0x557ae63b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae5ff0590 0x557ae63c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/1417253495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5fe83b0 0x557ae63b5d80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- 172.21.15.135:0/1417253495 >> 172.21.15.135:0/1417253495 conn(0x557ae60053c0 msgr2=0x557ae63b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- 172.21.15.135:0/1417253495 shutdown_connections 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- 172.21.15.135:0/1417253495 wait complete. 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 -- start start 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 Processor -- start 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.040+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae6011270 0x557ae63c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c8cd0 con 0x557ae5ff0590 2024-05-20T17:33:11.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c8600 con 0x557ae6011270 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ae63c93a0 con 0x557ae5fe83b0 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 10 client.0 _ll_register_callbacks cb 0x7fe40c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35324/0 (socket says 172.21.15.135:35324) 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 -- 172.21.15.135:0/403469190 learned_addr learned my addr 172.21.15.135:0/403469190 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe421eba640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae6011270 0x557ae63c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe4216b9640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 -- 172.21.15.135:0/403469190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 msgr2=0x557ae63bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 -- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae6011270 msgr2=0x557ae63c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae6011270 0x557ae63c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 -- 172.21.15.135:0/403469190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae63c17c0 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe420eb8640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x557ae63adc30 tx=0x7fe418012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723b3a9bd41e8283 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe404ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800fad0 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe41800fc70 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe40c09c480 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe41800fe70 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 10 client.15282 fetch_fsmap learned FSMap version 21 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557ae6431cd0 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.041+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe40c09c480 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe41801c4a0 con 0x557ae5ff0590 2024-05-20T17:33:11.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 10 client.15282 fetch_fsmap finished waiting for FSMap version 21 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 20 client.15282 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fa5280 0x557ae6433370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 4 client.15282 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "status"}) -- 0x557ae63a7ee0 con 0x557ae5fa5280 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe4216b9640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fa5280 0x557ae6433370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe404ff9640 10 client.15282 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.042+0000 7fe4216b9640 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fa5280 0x557ae6433370 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b3e959ea6adbfb server_cookie=662466b2a714b81d in_seq=0 out_seq=0 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe404ff9640 1 -- 172.21.15.135:0/403469190 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x557ae63a7ee0 con 0x557ae5fa5280 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe404ff9640 10 client.15282 handle_command_reply: tid=0 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 client.15282 shutdown 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 msgr2=0x557ae63be2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x557ae63adc30 tx=0x7fe418012b60 comp rx=0 tx=0).stop 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 shutdown_connections 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557ae5fa5280 0x557ae6433370 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557ae6011270 0x557ae63c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae5ff0590 0x557ae63be2c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 --2- 172.21.15.135:0/403469190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ae5fe83b0 0x557ae63bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe404ff9640 0 client.15282 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 >> 172.21.15.135:0/403469190 conn(0x557ae60053c0 msgr2=0x557ae63ab470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 shutdown_connections 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 1 -- 172.21.15.135:0/403469190 wait complete. 2024-05-20T17:33:11.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42a7bd740 20 client.15282 trim_cache size 0 max 16384 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "76c4e726-16cd-11ef-bc9a-c7b262605968", 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24560, 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 116.257923629, 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 21, 2024-05-20T17:33:11.071 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 87, 2024-05-20T17:33:11.072 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 85, 2024-05-20T17:33:11.072 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 123.265438661 2024-05-20T17:33:11.072 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 msgr2=0x7fe4080a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 0x7fe4080a50a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe41404c000 tx=0x7fe41404d000 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 msgr2=0x7fe41c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00e9f0 tx=0x7fe40c00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 shutdown_connections 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fe4080a2b90 0x7fe4080a50a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41c1089e0 0x7fe41c1a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe41c106080 0x7fe41c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 --2- 172.21.15.135:0/1356232277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe41c100ed0 0x7fe41c1992a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.043+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 >> 172.21.15.135:0/1356232277 conn(0x7fe41c0fc330 msgr2=0x7fe41c104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.044+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 shutdown_connections 2024-05-20T17:33:11.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.044+0000 7fe42391d640 1 -- 172.21.15.135:0/1356232277 wait complete. 2024-05-20T17:33:11.075 INFO:teuthology.run_tasks:Running task sequential... 2024-05-20T17:33:11.087 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-20T17:33:11.087 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-20T17:33:11.088 INFO:teuthology.task.print:Enabling mgr modules 2024-05-20T17:33:11.088 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-20T17:33:11.089 INFO:teuthology.task.exec:Executing custom commands... 2024-05-20T17:33:11.089 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:33:11.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 -- 172.21.15.135:0/4089338614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60103690 msgr2=0x7f5f60109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4089338614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60103690 0x7f5f60109de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009ca0 tx=0x7f5f5802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 -- 172.21.15.135:0/4089338614 shutdown_connections 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4089338614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60103690 0x7f5f60109de0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4089338614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60102b30 0x7f5f60103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4089338614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60101fd0 0x7f5f601023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 -- 172.21.15.135:0/4089338614 >> 172.21.15.135:0/4089338614 conn(0x7f5f600fc370 msgr2=0x7f5f600fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 -- 172.21.15.135:0/4089338614 shutdown_connections 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.197+0000 7f5f678f0640 1 -- 172.21.15.135:0/4089338614 wait complete. 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 Processor -- start 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 -- start start 2024-05-20T17:33:11.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60101fd0 0x7f5f60199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 0x7f5f601995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6010e9b0 con 0x7f5f6019e530 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6010e830 con 0x7f5f60101fd0 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f678f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6010eb30 con 0x7f5f60102b30 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f65e8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f65e8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35344/0 (socket says 172.21.15.135:35344) 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.198+0000 7f5f65e8d640 1 -- 172.21.15.135:0/4190208830 learned_addr learned my addr 172.21.15.135:0/4190208830 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f6568c640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60101fd0 0x7f5f60199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f64e8b640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 0x7f5f601995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 -- 172.21.15.135:0/4190208830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 msgr2=0x7f5f601995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 0x7f5f601995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 -- 172.21.15.135:0/4190208830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60101fd0 msgr2=0x7f5f60199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60101fd0 0x7f5f60199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 -- 172.21.15.135:0/4190208830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601a0f10 con 0x7f5f6019e530 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f64e8b640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 0x7f5f601995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f65e8d640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009430 tx=0x7f5f5802f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58003c30 con 0x7f5f6019e530 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f58003dd0 con 0x7f5f6019e530 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601a11a0 con 0x7f5f6019e530 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580047e0 con 0x7f5f6019e530 2024-05-20T17:33:11.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.199+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601a16f0 con 0x7f5f6019e530 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.200+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6006a4d0 con 0x7f5f6019e530 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.202+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f5f5802f800 con 0x7f5f6019e530 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.202+0000 7f5f567fc640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 0x7f5f4c0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.202+0000 7f5f6568c640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 0x7f5f4c0a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.202+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5f580f0700 con 0x7f5f6019e530 2024-05-20T17:33:11.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.203+0000 7f5f6568c640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 0x7f5f4c0a5090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f500058c0 tx=0x7f5f5000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:11.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.206+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5f580bd640 con 0x7f5f6019e530 2024-05-20T17:33:11.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:11.437+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f5f6002d5c0 con 0x7f5f6019e530 2024-05-20T17:33:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:11 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2868109186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:11 smithi135 ceph-mon[32027]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:11 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2868109186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:11 smithi160 ceph-mon[36261]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:11.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:11 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2868109186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:11 smithi172 ceph-mon[36511]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:33:12.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.384+0000 7f5f567fc640 1 -- 172.21.15.135:0/4190208830 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f5f580bcf40 con 0x7f5f6019e530 2024-05-20T17:33:12.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.387+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 msgr2=0x7f5f4c0a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:12.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 0x7f5f4c0a5090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f500058c0 tx=0x7f5f5000a250 comp rx=0 tx=0).stop 2024-05-20T17:33:12.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 msgr2=0x7f5f601a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:12.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009430 tx=0x7f5f5802f610 comp rx=0 tx=0).stop 2024-05-20T17:33:12.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 shutdown_connections 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5f4c0a2b80 0x7f5f4c0a5090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f6019e530 0x7f5f601a0950 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60102b30 0x7f5f601995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 --2- 172.21.15.135:0/4190208830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f60101fd0 0x7f5f60199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 >> 172.21.15.135:0/4190208830 conn(0x7f5f600fc370 msgr2=0x7f5f60105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 shutdown_connections 2024-05-20T17:33:12.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:12.388+0000 7f5f678f0640 1 -- 172.21.15.135:0/4190208830 wait complete. 2024-05-20T17:33:12.409 INFO:teuthology.run_tasks:Running task kclient... 2024-05-20T17:33:12.436 INFO:tasks.kclient:Mounting kernel clients... 2024-05-20T17:33:12.436 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-20T17:33:12.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:12.436 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-20T17:33:12.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:12.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-20T17:33:12.521 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-05-20T17:33:12.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:33:12.523 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-20T17:33:12.523 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:33:12.523 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:12.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph fs ls 2024-05-20T17:33:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:12 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-20T17:33:12.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setuser ceph since I am not root 2024-05-20T17:33:12.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: ignoring --setgroup ceph since I am not root 2024-05-20T17:33:12.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:12.606+0000 7f2718b1b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:33:12.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:12 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-20T17:33:12.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: ignoring --setuser ceph since I am not root 2024-05-20T17:33:12.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: ignoring --setgroup ceph since I am not root 2024-05-20T17:33:12.757 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-mgr[37686]: -- 172.21.15.160:0/3346086090 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1168705a0 con 0x55b1169ae900 2024-05-20T17:33:12.757 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:12.595+0000 7f0cbca50200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:12 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: ignoring --setuser ceph since I am not root 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: ignoring --setgroup ceph since I am not root 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-mgr[38256]: -- 172.21.15.172:0/827393574 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d44d3785a0 con 0x55d44d4b6000 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:12.591+0000 7f0b874fb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:33:12.777 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:12.775+0000 7f0b874fb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:12.817 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:33:13.080 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:12.879+0000 7f0b874fb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:33:13.105 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:12.812+0000 7f2718b1b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:13.105 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:12.924+0000 7f2718b1b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:33:13.204 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:12.785+0000 7f0cbca50200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:13.204 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:12.890+0000 7f0cbca50200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:33:13.367 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:13.245+0000 7f2718b1b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:33:13.367 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:13.342+0000 7f2718b1b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:33:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:13 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-20T17:33:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:13 smithi160 ceph-mon[36261]: mgrmap e19: x(active, since 9m), standbys: y, z 2024-05-20T17:33:13.506 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:13.203+0000 7f0cbca50200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:33:13.507 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:13.290+0000 7f0cbca50200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:33:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:13 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-20T17:33:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:13 smithi172 ceph-mon[36511]: mgrmap e19: x(active, since 9m), standbys: y, z 2024-05-20T17:33:13.580 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:13.186+0000 7f0b874fb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:33:13.581 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:13.272+0000 7f0b874fb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:33:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:13 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4190208830' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-20T17:33:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:13 smithi135 ceph-mon[32027]: mgrmap e19: x(active, since 9m), standbys: y, z 2024-05-20T17:33:14.596 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:14.566+0000 7f2718b1b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:33:14.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- 172.21.15.135:0/1677244290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60381075e0 msgr2=0x7f603810ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:14.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 --2- 172.21.15.135:0/1677244290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60381075e0 0x7f603810ef40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f603000b0d0 tx=0x7f603000b3e0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- 172.21.15.135:0/1677244290 shutdown_connections 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 --2- 172.21.15.135:0/1677244290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f6038102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 --2- 172.21.15.135:0/1677244290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60381075e0 0x7f603810ef40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 --2- 172.21.15.135:0/1677244290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6038106c90 0x7f60381070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- 172.21.15.135:0/1677244290 >> 172.21.15.135:0/1677244290 conn(0x7f60380fddb0 msgr2=0x7f60381001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- 172.21.15.135:0/1677244290 shutdown_connections 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- 172.21.15.135:0/1677244290 wait complete. 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 Processor -- start 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.711+0000 7f603f0b3700 1 -- start start 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f603819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 0x7f603819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:14.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60381075e0 0x7f6038198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60381123b0 con 0x7f6038106c90 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6038112230 con 0x7f6038102360 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603f0b3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6038112530 con 0x7f60381075e0 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603ce4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f603819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 0x7f603819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603ce4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f603819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35494/0 (socket says 172.21.15.135:35494) 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603ce4f700 1 -- 172.21.15.135:0/3460879960 learned_addr learned my addr 172.21.15.135:0/3460879960 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f603d650700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60381075e0 0x7f6038198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60381075e0 msgr2=0x7f6038198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60381075e0 0x7f6038198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 msgr2=0x7f603819e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:14.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f603819e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 -- 172.21.15.135:0/3460879960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6038199120 con 0x7f6038106c90 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.712+0000 7f6037fff700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 0x7f603819ed90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f602400d720 tx=0x7f602400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.713+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024014030 con 0x7f6038106c90 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.713+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6024004500 con 0x7f6038106c90 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.713+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024005480 con 0x7f6038106c90 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.713+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6038199410 con 0x7f6038106c90 2024-05-20T17:33:14.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.713+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381a56e0 con 0x7f6038106c90 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.714+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6038050170 con 0x7f6038106c90 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.715+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f6024005620 con 0x7f6038106c90 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.716+0000 7f6035ffb700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 0x7f60280a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.716+0000 7f603ce4f700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 msgr2=0x7f60280a5200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.716+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f60240ce820 con 0x7f6038106c90 2024-05-20T17:33:14.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.716+0000 7f603ce4f700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 0x7f60280a5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:14.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.721+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f602409b760 con 0x7f6038106c90 2024-05-20T17:33:14.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:14.486+0000 7f0cbca50200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:33:14.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:14.661+0000 7f0cbca50200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:14.807 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:14.457+0000 7f0b874fb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:33:14.807 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:14.630+0000 7f0b874fb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:14.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.917+0000 7f603ce4f700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 msgr2=0x7f60280a5200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:14.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.917+0000 7f603ce4f700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 0x7f60280a5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:33:14.918 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:14.754+0000 7f2718b1b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:14.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.974+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6038199fa0 con 0x7f6038106c90 2024-05-20T17:33:14.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.975+0000 7f6035ffb700 1 -- 172.21.15.135:0/3460879960 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f602409b060 con 0x7f6038106c90 2024-05-20T17:33:14.976 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:33:14.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 msgr2=0x7f60280a5200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:14.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 0x7f60280a5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 msgr2=0x7f603819ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 0x7f603819ed90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f602400d720 tx=0x7f602400da30 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 shutdown_connections 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6038102360 0x7f603819e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f60280a2cf0 0x7f60280a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60381075e0 0x7f6038198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 --2- 172.21.15.135:0/3460879960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038106c90 0x7f603819ed90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 >> 172.21.15.135:0/3460879960 conn(0x7f60380fddb0 msgr2=0x7f6038106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 shutdown_connections 2024-05-20T17:33:14.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:14.977+0000 7f603f0b3700 1 -- 172.21.15.135:0/3460879960 wait complete. 2024-05-20T17:33:15.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:15 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3460879960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:33:15.080 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:14.805+0000 7f0b874fb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:33:15.134 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:15 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3460879960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:33:15.134 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:14.838+0000 7f0cbca50200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:33:15.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:15 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3460879960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:33:15.205 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:14.932+0000 7f2718b1b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:33:15.404 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:15.103+0000 7f0b874fb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:33:15.404 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:15.197+0000 7f0b874fb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:33:15.435 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:15.132+0000 7f0cbca50200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:33:15.435 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:15.227+0000 7f0cbca50200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:33:15.581 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:15.249+0000 7f2718b1b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:33:15.581 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:15.351+0000 7f2718b1b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:33:15.758 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:15.433+0000 7f0cbca50200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:33:15.759 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:15.632+0000 7f0cbca50200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:33:15.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:33:15.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:33:15.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:15.818 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-20T17:33:15.829 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:15.403+0000 7f0b874fb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:33:15.830 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:15.600+0000 7f0b874fb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:33:15.835 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42120sec preferred_lft 42120sec 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2024-05-20T17:33:15.836 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:33:15.837 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:33:15.837 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-20T17:33:15.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:15.933 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:15.579+0000 7f2718b1b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:33:15.933 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:15.788+0000 7f2718b1b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:33:16.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:16.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:16.039 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:33:16.065 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-20T17:33:16.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:16.067 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-20T17:33:16.152 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-20T17:33:16.152 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:33:16.152 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:33:16.153 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:33:16.153 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:33:16.153 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-20T17:33:16.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:16.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:16.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:16.423 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-20T17:33:16.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:16.440 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-20T17:33:16.495 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:33:16.495 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-20T17:33:16.495 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:33:16.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-20T17:33:16.496 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-20T17:33:16.506 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:16.241+0000 7f0cbca50200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:33:16.580 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:16.206+0000 7f0b874fb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:33:16.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:16.593 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:16.442+0000 7f2718b1b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:33:16.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:16.615 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-20T17:33:16.615 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-20T17:33:16.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:16.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:16.747 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:33:16.747 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-20T17:33:16.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-20T17:33:16.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:33:16.747 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-20T17:33:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:16.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:16.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:33:16.827 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:16.842 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:33:16.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:33:16.843 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:16.899 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-20T17:33:16.899 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-20T17:33:16.899 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a 2024-05-20T17:33:16.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:16.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-20T17:33:16.948 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:16.638+0000 7f0b874fb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:33:16.948 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:16.738+0000 7f0b874fb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:33:16.975 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:16.669+0000 7f0cbca50200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:33:16.975 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:16.767+0000 7f0cbca50200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:33:17.000 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-20T17:33:17.001 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-20T17:33:17.001 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-05-20T17:33:17.126 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-20T17:33:17.126 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.135:3300,172.21.15.160:3300,172.21.15.172:3300" 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.135:3300,172.21.15.160:3300,172.21.15.172:3300:/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=76c4e726-16cd-11ef-bc9a-c7b262605968" will pass to kernel 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:33:17.127 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:33:17.128 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:33:17.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:33:17.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:17.129 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:17.156 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:33:17.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:16.911+0000 7f2718b1b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:33:17.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:17.020+0000 7f2718b1b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:33:17.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:33:17.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:17.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:16.973+0000 7f0cbca50200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:33:17.257 INFO:teuthology.orchestra.run.smithi135.stdout:client25025 2024-05-20T17:33:17.257 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:33:17.257 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:33:17.315 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:33:17.329 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:16.946+0000 7f0b874fb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:33:17.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:33:17.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:17.418 INFO:teuthology.orchestra.run.smithi135.stdout:client25025 2024-05-20T17:33:17.418 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:33:17.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:33:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:17.478 INFO:teuthology.orchestra.run.smithi135.stdout:client25025 2024-05-20T17:33:17.479 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968.client25025/status') 2024-05-20T17:33:17.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:33:17.537 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:17.246+0000 7f2718b1b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:33:17.539 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.25025 (3)172.21.15.135:0/3957865546 2024-05-20T17:33:17.539 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-05-20T17:33:17.540 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-05-20T17:33:17.540 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-05-20T17:33:17.540 INFO:teuthology.orchestra.run.smithi135.stderr:72 bytes copied, 2.2335e-05 s, 3.2 MB/s 2024-05-20T17:33:17.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:33:17.547 INFO:teuthology.run_tasks:Running task exec... 2024-05-20T17:33:17.561 INFO:teuthology.task.exec:Executing custom commands... 2024-05-20T17:33:17.561 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:33:17.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-20T17:33:17.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 -- 172.21.15.135:0/402999911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201023b0 msgr2=0x7f92201027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:17.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 --2- 172.21.15.135:0/402999911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201023b0 0x7f92201027c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f920c009900 tx=0x7f920c02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 -- 172.21.15.135:0/402999911 shutdown_connections 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 --2- 172.21.15.135:0/402999911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201070b0 0x7f92201094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 --2- 172.21.15.135:0/402999911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201023b0 0x7f92201027c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 --2- 172.21.15.135:0/402999911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 0x7f9220101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 -- 172.21.15.135:0/402999911 >> 172.21.15.135:0/402999911 conn(0x7f92200fc340 msgr2=0x7f92200fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 -- 172.21.15.135:0/402999911 shutdown_connections 2024-05-20T17:33:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.674+0000 7f922725a640 1 -- 172.21.15.135:0/402999911 wait complete. 2024-05-20T17:33:17.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 Processor -- start 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 -- start start 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 0x7f92201981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201023b0 0x7f92201986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f922010d660 con 0x7f92201070b0 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f922010d4e0 con 0x7f9220101170 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f922725a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f922010d7e0 con 0x7f92201023b0 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35400/0 (socket says 172.21.15.135:35400) 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 -- 172.21.15.135:0/1804142669 learned_addr learned my addr 172.21.15.135:0/1804142669 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f9224ff6640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 0x7f92201981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:17.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f921ffff640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201023b0 0x7f92201986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201023b0 msgr2=0x7f92201986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201023b0 0x7f92201986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 msgr2=0x7f92201981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 0x7f92201981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.675+0000 7f92257f7640 1 -- 172.21.15.135:0/1804142669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922019fce0 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f92257f7640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f921800eb10 tx=0x7f921800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218004b20 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9218004cc0 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218010760 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922019ffd0 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.676+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92201a0490 con 0x7f92201070b0 2024-05-20T17:33:17.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.677+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9220105ec0 con 0x7f92201070b0 2024-05-20T17:33:17.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.679+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f9218005000 con 0x7f92201070b0 2024-05-20T17:33:17.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.680+0000 7f921dffb640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 0x7f92100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:17.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.680+0000 7f9224ff6640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 msgr2=0x7f92100a5160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:17.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.680+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f92180cfac0 con 0x7f92201070b0 2024-05-20T17:33:17.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.680+0000 7f9224ff6640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 0x7f92100a5160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:17.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.683+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f921809c9a0 con 0x7f92201070b0 2024-05-20T17:33:17.819 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:17.473+0000 7f0b874fb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:33:17.819 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:17.567+0000 7f0b874fb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:33:17.850 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:17.505+0000 7f0cbca50200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:33:17.850 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:17.599+0000 7f0cbca50200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:33:17.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.881+0000 7f9224ff6640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 msgr2=0x7f92100a5160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:17.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.881+0000 7f9224ff6640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 0x7f92100a5160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T17:33:17.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.907+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f922002d2a0 con 0x7f92201070b0 2024-05-20T17:33:17.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.959+0000 7f921dffb640 1 -- 172.21.15.135:0/1804142669 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7f921809c2a0 con 0x7f92201070b0 2024-05-20T17:33:17.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.961+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 msgr2=0x7f92100a5160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:17.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.961+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 0x7f92100a5160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.961+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 msgr2=0x7f922019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:17.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.961+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f921800eb10 tx=0x7f921800c2d0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 shutdown_connections 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f92100a2c50 0x7f92100a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92201070b0 0x7f922019f670 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92201023b0 0x7f92201986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 --2- 172.21.15.135:0/1804142669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9220101170 0x7f92201981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 >> 172.21.15.135:0/1804142669 conn(0x7f92200fc340 msgr2=0x7f9220103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 shutdown_connections 2024-05-20T17:33:17.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:17.962+0000 7f922725a640 1 -- 172.21.15.135:0/1804142669 wait complete. 2024-05-20T17:33:17.975 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-20T17:33:17.986 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-20T17:33:17.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:18.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:17 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:33:18.080 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:17.817+0000 7f0b874fb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:33:18.080 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:17.953+0000 7f0b874fb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:33:18.080 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:18.052+0000 7f0b874fb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 -- 172.21.15.135:0/1566108641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 msgr2=0x7fa734101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/1566108641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa734101e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa730009900 tx=0x7fa73002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 -- 172.21.15.135:0/1566108641 shutdown_connections 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/1566108641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734107050 0x7fa734109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/1566108641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734102350 0x7fa734102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/1566108641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa734101e10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 -- 172.21.15.135:0/1566108641 >> 172.21.15.135:0/1566108641 conn(0x7fa7340fc2e0 msgr2=0x7fa7340fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 -- 172.21.15.135:0/1566108641 shutdown_connections 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.110+0000 7fa73bc5a640 1 -- 172.21.15.135:0/1566108641 wait complete. 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 Processor -- start 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 -- start start 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734102350 0x7fa734199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734107050 0x7fa7341a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa73410cda0 con 0x7fa734101110 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa73410cc20 con 0x7fa734102350 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73bc5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa73410cf20 con 0x7fa734107050 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa7399f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa7399f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35422/0 (socket says 172.21.15.135:35422) 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa7399f6640 1 -- 172.21.15.135:0/2117404639 learned_addr learned my addr 172.21.15.135:0/2117404639 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:18.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa7391f5640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734102350 0x7fa734199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.111+0000 7fa73a1f7640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734107050 0x7fa7341a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 -- 172.21.15.135:0/2117404639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734107050 msgr2=0x7fa7341a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734107050 0x7fa7341a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 -- 172.21.15.135:0/2117404639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734102350 msgr2=0x7fa734199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734102350 0x7fa734199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 -- 172.21.15.135:0/2117404639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7341a0e00 con 0x7fa734101110 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa7399f6640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa730031440 tx=0x7fa730032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73003f030 con 0x7fa734101110 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa730003ce0 con 0x7fa734101110 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730035070 con 0x7fa734101110 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7341a1090 con 0x7fa734101110 2024-05-20T17:33:18.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.112+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7341a1580 con 0x7fa734101110 2024-05-20T17:33:18.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.113+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7341a17e0 con 0x7fa734101110 2024-05-20T17:33:18.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.115+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7fa730042030 con 0x7fa734101110 2024-05-20T17:33:18.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.115+0000 7fa72affd640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 0x7fa7200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.116+0000 7fa7391f5640 1 -- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 msgr2=0x7fa7200a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:18.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.116+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fa7300ef840 con 0x7fa734101110 2024-05-20T17:33:18.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.116+0000 7fa7391f5640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 0x7fa7200a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:18.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.119+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa7300bc110 con 0x7fa734101110 2024-05-20T17:33:18.180 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:17 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:33:18.181 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:17.809+0000 7f2718b1b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:33:18.181 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:17.908+0000 7f2718b1b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:33:18.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:17 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:33:18.205 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:17.848+0000 7f0cbca50200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:33:18.205 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:17.985+0000 7f0cbca50200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:33:18.205 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:18.083+0000 7f0cbca50200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:33:18.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.305+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7341a19b0 con 0x7fa734101110 2024-05-20T17:33:18.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.307+0000 7fa72affd640 1 -- 172.21.15.135:0/2117404639 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7fa7300c0410 con 0x7fa734101110 2024-05-20T17:33:18.308 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:18.308 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:18.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 msgr2=0x7fa7200a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:18.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 0x7fa7200a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 msgr2=0x7fa7341992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa730031440 tx=0x7fa730032ce0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 shutdown_connections 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7fa7200a2be0 0x7fa7200a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734107050 0x7fa7341a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa734102350 0x7fa734199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 --2- 172.21.15.135:0/2117404639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa734101110 0x7fa7341992c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 >> 172.21.15.135:0/2117404639 conn(0x7fa7340fc2e0 msgr2=0x7fa7340ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 shutdown_connections 2024-05-20T17:33:18.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.309+0000 7fa73bc5a640 1 -- 172.21.15.135:0/2117404639 wait complete. 2024-05-20T17:33:18.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:33:18.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:33:18.433 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:18.179+0000 7f2718b1b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:33:18.433 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:18.322+0000 7f2718b1b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:33:18.433 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:18.432+0000 7f2718b1b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:33:18.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- 172.21.15.135:0/3220021673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 msgr2=0x7f3534102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 --2- 172.21.15.135:0/3220021673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f3534102320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3530009900 tx=0x7f353002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:18.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- 172.21.15.135:0/3220021673 shutdown_connections 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 --2- 172.21.15.135:0/3220021673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3534103410 0x7f3534109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 --2- 172.21.15.135:0/3220021673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35341028f0 0x7f3534102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 --2- 172.21.15.135:0/3220021673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f3534102320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- 172.21.15.135:0/3220021673 >> 172.21.15.135:0/3220021673 conn(0x7f35340fc2f0 msgr2=0x7f35340fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- 172.21.15.135:0/3220021673 shutdown_connections 2024-05-20T17:33:18.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- 172.21.15.135:0/3220021673 wait complete. 2024-05-20T17:33:18.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 Processor -- start 2024-05-20T17:33:18.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.438+0000 7f353c784640 1 -- start start 2024-05-20T17:33:18.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35341028f0 0x7f353419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3534103410 0x7f35341a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f353410d600 con 0x7f3534101f10 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f353410d480 con 0x7f35341028f0 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353c784640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f353410d780 con 0x7f3534103410 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35434/0 (socket says 172.21.15.135:35434) 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 -- 172.21.15.135:0/790435241 learned_addr learned my addr 172.21.15.135:0/790435241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f3539d1f640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35341028f0 0x7f353419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353ad21640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3534103410 0x7f35341a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 -- 172.21.15.135:0/790435241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3534103410 msgr2=0x7f35341a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3534103410 0x7f35341a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 -- 172.21.15.135:0/790435241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35341028f0 msgr2=0x7f353419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35341028f0 0x7f353419e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 -- 172.21.15.135:0/790435241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341a0da0 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f353a520640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3530005ab0 tx=0x7f3530004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.439+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353003f030 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.440+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35341a1030 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.440+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341a1570 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.440+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3530003ad0 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.440+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530049060 con 0x7f3534101f10 2024-05-20T17:33:18.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.440+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35180052c0 con 0x7f3534101f10 2024-05-20T17:33:18.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.442+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f3530042030 con 0x7f3534101f10 2024-05-20T17:33:18.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.443+0000 7f352b7fe640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 0x7f35200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.443+0000 7f3539d1f640 1 -- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 msgr2=0x7f35200a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:18.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.443+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f35300ef7c0 con 0x7f3534101f10 2024-05-20T17:33:18.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.443+0000 7f3539d1f640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 0x7f35200a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:18.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.451+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f35300bc0b0 con 0x7f3534101f10 2024-05-20T17:33:18.479 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:18.173+0000 7f0b874fb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:18.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.633+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3518005880 con 0x7f3534101f10 2024-05-20T17:33:18.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.633+0000 7f352b7fe640 1 -- 172.21.15.135:0/790435241 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f35300dc0c0 con 0x7f3534101f10 2024-05-20T17:33:18.635 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 msgr2=0x7f35200a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 0x7f35200a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 msgr2=0x7f35341011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3530005ab0 tx=0x7f3530004270 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 shutdown_connections 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f35200a2be0 0x7f35200a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3534103410 0x7f35341a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35341028f0 0x7f353419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 --2- 172.21.15.135:0/790435241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3534101f10 0x7f35341011d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 >> 172.21.15.135:0/790435241 conn(0x7f35340fc2f0 msgr2=0x7f3534103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 shutdown_connections 2024-05-20T17:33:18.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.635+0000 7f353c784640 1 -- 172.21.15.135:0/790435241 wait complete. 2024-05-20T17:33:18.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:33:18.704 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:18.561+0000 7f2718b1b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/559417436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 msgr2=0x7f9c88108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/559417436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88108090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009900 tx=0x7f9c7002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/559417436 shutdown_connections 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/559417436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c88108720 0x7f9c8810ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/559417436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88108090 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/559417436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c881031c0 0x7f9c881055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/559417436 >> 172.21.15.135:0/559417436 conn(0x7f9c880fcb80 msgr2=0x7f9c880ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/559417436 shutdown_connections 2024-05-20T17:33:18.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.768+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/559417436 wait complete. 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 Processor -- start 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 -- start start 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 0x7f9c881995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c88108720 0x7f9c881a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810e730 con 0x7f9c88105bb0 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810e5b0 con 0x7f9c88108720 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8cf6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8810e8b0 con 0x7f9c881031c0 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c7ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c7ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35466/0 (socket says 172.21.15.135:35466) 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c7ffff640 1 -- 172.21.15.135:0/3610053437 learned_addr learned my addr 172.21.15.135:0/3610053437 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:18.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c8659c640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 0x7f9c881995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.769+0000 7f9c86d9d640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c88108720 0x7f9c881a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 -- 172.21.15.135:0/3610053437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 msgr2=0x7f9c881995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 0x7f9c881995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 -- 172.21.15.135:0/3610053437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c88108720 msgr2=0x7f9c881a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c88108720 0x7f9c881a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 -- 172.21.15.135:0/3610053437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c881a1100 con 0x7f9c88105bb0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c8659c640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 0x7f9c881995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7ffff640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c70031440 tx=0x7f9c70032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7003f030 con 0x7f9c88105bb0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c881a1390 con 0x7f9c88105bb0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c70003ce0 con 0x7f9c88105bb0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70035070 con 0x7f9c88105bb0 2024-05-20T17:33:18.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.770+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c881a18d0 con 0x7f9c88105bb0 2024-05-20T17:33:18.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.771+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8806b250 con 0x7f9c88105bb0 2024-05-20T17:33:18.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.773+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f9c70042030 con 0x7f9c88105bb0 2024-05-20T17:33:18.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.774+0000 7f9c7f7fe640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 0x7f9c740a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:18.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.774+0000 7f9c8659c640 1 -- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 msgr2=0x7f9c740a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:18.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.774+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f9c700ef900 con 0x7f9c88105bb0 2024-05-20T17:33:18.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.774+0000 7f9c8659c640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 0x7f9c740a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.777+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9c700bc310 con 0x7f9c88105bb0 2024-05-20T17:33:18.829 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:18.478+0000 7f0b874fb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:33:18.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.960+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9c881a1dc0 con 0x7f9c88105bb0 2024-05-20T17:33:18.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.960+0000 7f9c7f7fe640 1 -- 172.21.15.135:0/3610053437 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f9c700c0610 con 0x7f9c88105bb0 2024-05-20T17:33:18.962 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:33:18.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.962+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 msgr2=0x7f9c740a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:18.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.962+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 0x7f9c740a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 msgr2=0x7f9c88199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:18.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c70031440 tx=0x7f9c70032ce0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 shutdown_connections 2024-05-20T17:33:18.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f9c740a2be0 0x7f9c740a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c88108720 0x7f9c881a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c88105bb0 0x7f9c88199b00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 --2- 172.21.15.135:0/3610053437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c881031c0 0x7f9c881995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:18.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 >> 172.21.15.135:0/3610053437 conn(0x7f9c880fcb80 msgr2=0x7f9c88104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:18.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 shutdown_connections 2024-05-20T17:33:18.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:18.963+0000 7f9c8cf6b640 1 -- 172.21.15.135:0/3610053437 wait complete. 2024-05-20T17:33:18.968 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:18.203+0000 7f0cbca50200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:33:18.968 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:18.508+0000 7f0cbca50200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:33:18.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:33:19.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.088+0000 7ff974673640 1 -- 172.21.15.135:0/3079629169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c102be0 msgr2=0x7ff96c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.088+0000 7ff974673640 1 --2- 172.21.15.135:0/3079629169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c102be0 0x7ff96c102ff0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009900 tx=0x7ff95c02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 -- 172.21.15.135:0/3079629169 shutdown_connections 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 --2- 172.21.15.135:0/3079629169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c1078e0 0x7ff96c109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 --2- 172.21.15.135:0/3079629169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c102be0 0x7ff96c102ff0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 --2- 172.21.15.135:0/3079629169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1019a0 0x7ff96c1026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 -- 172.21.15.135:0/3079629169 >> 172.21.15.135:0/3079629169 conn(0x7ff96c0fcb70 msgr2=0x7ff96c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 -- 172.21.15.135:0/3079629169 shutdown_connections 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 -- 172.21.15.135:0/3079629169 wait complete. 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 Processor -- start 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 -- start start 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.089+0000 7ff974673640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 0x7ff96c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 0x7ff96c1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10e720 con 0x7ff96c1019a0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10e5a0 con 0x7ff96c102be0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c10e8a0 con 0x7ff96c1078e0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff972c10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 0x7ff96c1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35494/0 (socket says 172.21.15.135:35494) 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 -- 172.21.15.135:0/4187239867 learned_addr learned my addr 172.21.15.135:0/4187239867 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff971c0e640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 0x7ff96c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 -- 172.21.15.135:0/4187239867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 msgr2=0x7ff96c1a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 0x7ff96c1a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 -- 172.21.15.135:0/4187239867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 msgr2=0x7ff96c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 0x7ff96c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 -- 172.21.15.135:0/4187239867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c1a0de0 con 0x7ff96c1019a0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff972c10640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 0x7ff96c1a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff971c0e640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 0x7ff96c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff97240f640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96800ccc0 con 0x7ff96c1019a0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c1a10d0 con 0x7ff96c1019a0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9680035f0 con 0x7ff96c1019a0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.090+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96800ce60 con 0x7ff96c1019a0 2024-05-20T17:33:19.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.091+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c1a1620 con 0x7ff96c1019a0 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.092+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c1066f0 con 0x7ff96c1019a0 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.094+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7ff9680037a0 con 0x7ff96c1019a0 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.094+0000 7ff9637fe640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 0x7ff9580a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.094+0000 7ff971c0e640 1 -- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 msgr2=0x7ff9580a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.095+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff9680cf490 con 0x7ff96c1019a0 2024-05-20T17:33:19.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.095+0000 7ff971c0e640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 0x7ff9580a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:19.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.097+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff96809c3d0 con 0x7ff96c1019a0 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:18.885+0000 7f2718b1b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:18 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2117404639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/790435241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:18 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3610053437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:19.119+0000 7f0cbca50200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:33:19.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:33:19.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:18 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:33:19.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2117404639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/790435241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:18 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3610053437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.275+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff96c062750 con 0x7ff96c1019a0 2024-05-20T17:33:19.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.276+0000 7ff9637fe640 1 -- 172.21.15.135:0/4187239867 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7ff96809bcd0 con 0x7ff96c1019a0 2024-05-20T17:33:19.277 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:33:19.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 msgr2=0x7ff9580a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 0x7ff9580a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 msgr2=0x7ff96c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 shutdown_connections 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7ff9580a2be0 0x7ff9580a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1078e0 0x7ff96c1a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff96c102be0 0x7ff96c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 --2- 172.21.15.135:0/4187239867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff96c1019a0 0x7ff96c1992a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 >> 172.21.15.135:0/4187239867 conn(0x7ff96c0fcb70 msgr2=0x7ff96c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 shutdown_connections 2024-05-20T17:33:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.278+0000 7ff974673640 1 -- 172.21.15.135:0/4187239867 wait complete. 2024-05-20T17:33:19.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:19.307 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:19.084+0000 7f0b874fb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:33:19.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1804142669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:33:19.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:18 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:33:19.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2117404639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:19.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/790435241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:18 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3610053437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 -- 172.21.15.135:0/2249902954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 msgr2=0x7f8988102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 --2- 172.21.15.135:0/2249902954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f8988102680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f897c009900 tx=0x7f897c02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 -- 172.21.15.135:0/2249902954 shutdown_connections 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 --2- 172.21.15.135:0/2249902954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 0x7f8988109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 --2- 172.21.15.135:0/2249902954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 0x7f8988102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 --2- 172.21.15.135:0/2249902954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f8988102680 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 -- 172.21.15.135:0/2249902954 >> 172.21.15.135:0/2249902954 conn(0x7f89880fcb50 msgr2=0x7f89880ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 -- 172.21.15.135:0/2249902954 shutdown_connections 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.401+0000 7f898ec99640 1 -- 172.21.15.135:0/2249902954 wait complete. 2024-05-20T17:33:19.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 Processor -- start 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 -- start start 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 0x7f89881a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 0x7f89881a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f898810d5d0 con 0x7f8988101980 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f898810d450 con 0x7f89881078c0 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ec99640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f898810d750 con 0x7f8988102bc0 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35514/0 (socket says 172.21.15.135:35514) 2024-05-20T17:33:19.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 -- 172.21.15.135:0/4098845780 learned_addr learned my addr 172.21.15.135:0/4098845780 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898d236640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 0x7f89881a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f8987fff640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 0x7f89881a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 -- 172.21.15.135:0/4098845780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 msgr2=0x7f89881a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 0x7f89881a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 -- 172.21.15.135:0/4098845780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 msgr2=0x7f89881a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 0x7f89881a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.402+0000 7f898ca35640 1 -- 172.21.15.135:0/4098845780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89881a2ff0 con 0x7f8988101980 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f898ca35640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f897c005ab0 tx=0x7f897c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c03f030 con 0x7f8988101980 2024-05-20T17:33:19.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89881a3280 con 0x7f8988101980 2024-05-20T17:33:19.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897c003ad0 con 0x7f8988101980 2024-05-20T17:33:19.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c035070 con 0x7f8988101980 2024-05-20T17:33:19.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.403+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89881a3770 con 0x7f8988101980 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.404+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89881066d0 con 0x7f8988101980 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.406+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f897c042030 con 0x7f8988101980 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.407+0000 7f8985ffb640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 0x7f89780a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.407+0000 7f8987fff640 1 -- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 msgr2=0x7f89780a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.407+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f897c0ef780 con 0x7f8988101980 2024-05-20T17:33:19.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.407+0000 7f8987fff640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 0x7f89780a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:19.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.416+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f897c0bc660 con 0x7f8988101980 2024-05-20T17:33:19.527 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:33:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y[37682]: 2024-05-20T17:33:19.341+0000 7f0cbca50200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:33:19.580 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:33:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z[38234]: 2024-05-20T17:33:19.306+0000 7f0b874fb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:33:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.597+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8988062750 con 0x7f8988101980 2024-05-20T17:33:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.599+0000 7f8985ffb640 1 -- 172.21.15.135:0/4098845780 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22813 (secure 0 0 0) 0x7f897c0bbf60 con 0x7f8988101980 2024-05-20T17:33:19.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:19.601 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":87,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:32:07.715249+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 msgr2=0x7f89780a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 0x7f89780a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 msgr2=0x7f898806acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f897c005ab0 tx=0x7f897c004270 comp rx=0 tx=0).stop 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 shutdown_connections 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f89780a2be0 0x7f89780a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89881078c0 0x7f89881a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988102bc0 0x7f89881a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 --2- 172.21.15.135:0/4098845780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8988101980 0x7f898806acf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.601+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 >> 172.21.15.135:0/4098845780 conn(0x7f89880fcb50 msgr2=0x7f89881038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.602+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 shutdown_connections 2024-05-20T17:33:19.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.602+0000 7f898ec99640 1 -- 172.21.15.135:0/4098845780 wait complete. 2024-05-20T17:33:19.613 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:19.535+0000 7f2718b1b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:33:19.615 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:33:19.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:33:19.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1395886891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8108750 msgr2=0x7f5db810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1395886891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8108750 0x7f5db810ac60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009ca0 tx=0x7f5db002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1395886891 shutdown_connections 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1395886891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8108750 0x7f5db810ac60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1395886891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8105be0 0x7f5db81080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1395886891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8100e00 0x7f5db8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1395886891 >> 172.21.15.135:0/1395886891 conn(0x7f5db80fc330 msgr2=0x7f5db80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1395886891 shutdown_connections 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1395886891 wait complete. 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 Processor -- start 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.730+0000 7f5dbf7ea640 1 -- start start 2024-05-20T17:33:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8105be0 0x7f5db8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8108750 0x7f5db81a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e710 con 0x7f5db8100e00 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e590 con 0x7f5db8108750 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbf7ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5db810e890 con 0x7f5db8105be0 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51112/0 (socket says 172.21.15.135:51112) 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 -- 172.21.15.135:0/1000351594 learned_addr learned my addr 172.21.15.135:0/1000351594 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbdd87640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8108750 0x7f5db81a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbcd85640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8105be0 0x7f5db8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 -- 172.21.15.135:0/1000351594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8105be0 msgr2=0x7f5db8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8105be0 0x7f5db8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 -- 172.21.15.135:0/1000351594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8108750 msgr2=0x7f5db81a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8108750 0x7f5db81a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 -- 172.21.15.135:0/1000351594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db81a0d70 con 0x7f5db8100e00 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dbd586640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5db400e9c0 tx=0x7f5db400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.731+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db400cd80 con 0x7f5db8100e00 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.732+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db81a1060 con 0x7f5db8100e00 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.732+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db4005500 con 0x7f5db8100e00 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.732+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4010690 con 0x7f5db8100e00 2024-05-20T17:33:19.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.732+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db81a1600 con 0x7f5db8100e00 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.733+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db80fde50 con 0x7f5db8100e00 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.734+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f5db40046c0 con 0x7f5db8100e00 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.735+0000 7f5dae7fc640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 0x7f5da40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.735+0000 7f5dbcd85640 1 -- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 msgr2=0x7f5da40a50f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3106262554 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.735+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5db40cf510 con 0x7f5db8100e00 2024-05-20T17:33:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.735+0000 7f5dbcd85640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 0x7f5da40a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:33:19.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.744+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5db409c450 con 0x7f5db8100e00 2024-05-20T17:33:19.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.794+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f5db40983c0 con 0x7f5db8100e00 2024-05-20T17:33:19.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.795+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 msgr2=0x7f5da40a50f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:33:19.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.795+0000 7f5dae7fc640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 0x7f5da40a50f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.930 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:19.778+0000 7f2718b1b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:33:19.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.963+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5db8062750 con 0x7f5db8100e00 2024-05-20T17:33:19.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.964+0000 7f5dae7fc640 1 -- 172.21.15.135:0/1000351594 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f5db4050fa0 con 0x7f5db8100e00 2024-05-20T17:33:19.965 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 msgr2=0x7f5db8199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5db400e9c0 tx=0x7f5db400ee80 comp rx=0 tx=0).stop 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 shutdown_connections 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:6800/3106262554,v1:172.21.15.135:6801/3106262554] conn(0x7f5da40a2be0 0x7f5da40a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5db8108750 0x7f5db81a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8105be0 0x7f5db8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 --2- 172.21.15.135:0/1000351594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5db8100e00 0x7f5db8199230 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:19.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.966+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 >> 172.21.15.135:0/1000351594 conn(0x7f5db80fc330 msgr2=0x7f5db8106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:19.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.967+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 shutdown_connections 2024-05-20T17:33:19.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:19.967+0000 7f5dbf7ea640 1 -- 172.21.15.135:0/1000351594 wait complete. 2024-05-20T17:33:19.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:33:20.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 -- 172.21.15.135:0/1182198649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c0102bd0 msgr2=0x7f11c0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1182198649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c0102bd0 0x7f11c0102fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009900 tx=0x7f11b402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 -- 172.21.15.135:0/1182198649 shutdown_connections 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1182198649 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c01078d0 0x7f11c0109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1182198649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c0102bd0 0x7f11c0102fe0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1182198649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c0102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 -- 172.21.15.135:0/1182198649 >> 172.21.15.135:0/1182198649 conn(0x7f11c00fcb80 msgr2=0x7f11c00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 -- 172.21.15.135:0/1182198649 shutdown_connections 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.126+0000 7f11c7a75640 1 -- 172.21.15.135:0/1182198649 wait complete. 2024-05-20T17:33:20.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 Processor -- start 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 -- start start 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c0102bd0 0x7f11c0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010d600 con 0x7f11c01078d0 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010d480 con 0x7f11c0102bd0 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c7a75640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11c010d780 con 0x7f11c0101990 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51214/0 (socket says 172.21.15.135:51214) 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 -- 172.21.15.135:0/1213258150 learned_addr learned my addr 172.21.15.135:0/1213258150 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c5010640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c0102bd0 0x7f11c0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c5811640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 -- 172.21.15.135:0/1213258150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 msgr2=0x7f11c01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 -- 172.21.15.135:0/1213258150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c0102bd0 msgr2=0x7f11c0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c0102bd0 0x7f11c0198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.127+0000 7f11c6012640 1 -- 172.21.15.135:0/1213258150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c01a0010 con 0x7f11c01078d0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11c5811640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11c6012640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11b800e9b0 tx=0x7f11b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b800cd80 con 0x7f11c01078d0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11b80035f0 con 0x7f11c01078d0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c01a0300 con 0x7f11c01078d0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8010670 con 0x7f11c01078d0 2024-05-20T17:33:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.128+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01a0850 con 0x7f11c01078d0 2024-05-20T17:33:20.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.129+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c01066e0 con 0x7f11c01078d0 2024-05-20T17:33:20.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.130+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f11b80037a0 con 0x7f11c01078d0 2024-05-20T17:33:20.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.131+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f11b80cef10 con 0x7f11c01078d0 2024-05-20T17:33:20.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.137+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f11b809c150 con 0x7f11c01078d0 2024-05-20T17:33:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4187239867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Standby manager daemon z restarted 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Standby manager daemon z started 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Standby manager daemon y restarted 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Standby manager daemon y started 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4098845780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Active manager daemon x restarted 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Activating manager daemon x 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: mgrmap e20: x(active, starting, since 0.015835s), standbys: z, y 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:33:20.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267aa94700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267aa94700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267aa94700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267aa94700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267aa94700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.207 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.051+0000 7f267828f700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.052+0000 7f267828f700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.052+0000 7f267828f700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.052+0000 7f267828f700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:33:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:33:20.052+0000 7f267828f700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:33:20.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:33:20.209 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: Manager daemon x is now available 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.210 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.211 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.211 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.211 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:19 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1000351594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4187239867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Standby manager daemon z restarted 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Standby manager daemon z started 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Standby manager daemon y restarted 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Standby manager daemon y started 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4098845780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Active manager daemon x restarted 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Activating manager daemon x 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:33:20.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: mgrmap e20: x(active, starting, since 0.015835s), standbys: z, y 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:33:20.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:33:20.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: Manager daemon x is now available 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:19 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1000351594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4187239867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Standby manager daemon z restarted 2024-05-20T17:33:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Standby manager daemon z started 2024-05-20T17:33:20.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.172:0/1139751469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Standby manager daemon y restarted 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Standby manager daemon y started 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.? 172.21.15.160:0/175935551' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4098845780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Active manager daemon x restarted 2024-05-20T17:33:20.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Activating manager daemon x 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: mgrmap e20: x(active, starting, since 0.015835s), standbys: z, y 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:33:20.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:33:20.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: Manager daemon x is now available 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:20.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T17:33:20.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T17:33:20.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:19 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1000351594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.354+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f11c002d3a0 con 0x7f11c01078d0 2024-05-20T17:33:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.355+0000 7f11beffd640 1 -- 172.21.15.135:0/1213258150 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f11b809ba50 con 0x7f11c01078d0 2024-05-20T17:33:20.356 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:33:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 msgr2=0x7f11c019f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11b800e9b0 tx=0x7f11b800ee70 comp rx=0 tx=0).stop 2024-05-20T17:33:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 shutdown_connections 2024-05-20T17:33:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11c01078d0 0x7f11c019f9a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11c0102bd0 0x7f11c0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 --2- 172.21.15.135:0/1213258150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c0101990 0x7f11c01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 >> 172.21.15.135:0/1213258150 conn(0x7f11c00fcb80 msgr2=0x7f11c01038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 shutdown_connections 2024-05-20T17:33:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.357+0000 7f11c7a75640 1 -- 172.21.15.135:0/1213258150 wait complete. 2024-05-20T17:33:20.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:33:20.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 -- 172.21.15.135:0/1338433891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14103400 msgr2=0x7feb14109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/1338433891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14103400 0x7feb14109b40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009ca0 tx=0x7feb0c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 -- 172.21.15.135:0/1338433891 shutdown_connections 2024-05-20T17:33:20.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/1338433891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14103400 0x7feb14109b40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/1338433891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb141028c0 0x7feb14102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/1338433891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb14101ee0 0x7feb141022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 -- 172.21.15.135:0/1338433891 >> 172.21.15.135:0/1338433891 conn(0x7feb140fc300 msgr2=0x7feb140fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 -- 172.21.15.135:0/1338433891 shutdown_connections 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 -- 172.21.15.135:0/1338433891 wait complete. 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.486+0000 7feb1b7f5640 1 Processor -- start 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 -- start start 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb141028c0 0x7feb14198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb14103400 0x7feb1419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410d620 con 0x7feb14101ee0 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410d4a0 con 0x7feb141028c0 2024-05-20T17:33:20.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb1b7f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410d7a0 con 0x7feb14103400 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51222/0 (socket says 172.21.15.135:51222) 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 -- 172.21.15.135:0/3629680443 learned_addr learned my addr 172.21.15.135:0/3629680443 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb18d90640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb141028c0 0x7feb14198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19d92640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb14103400 0x7feb1419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 -- 172.21.15.135:0/3629680443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb14103400 msgr2=0x7feb1419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb14103400 0x7feb1419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 -- 172.21.15.135:0/3629680443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb141028c0 msgr2=0x7feb14198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb141028c0 0x7feb14198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 -- 172.21.15.135:0/3629680443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1419fc40 con 0x7feb14101ee0 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.487+0000 7feb19591640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feb0400d950 tx=0x7feb0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:20.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.488+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04017070 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.488+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb04009c30 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.488+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1419ff30 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.488+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040047a0 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.488+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb141a0390 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.489+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb14108890 con 0x7feb14101ee0 2024-05-20T17:33:20.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.490+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7feb04004020 con 0x7feb14101ee0 2024-05-20T17:33:20.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.491+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7feb040cebb0 con 0x7feb14101ee0 2024-05-20T17:33:20.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.494+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feb04020020 con 0x7feb14101ee0 2024-05-20T17:33:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.676+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feb1402d4f0 con 0x7feb14101ee0 2024-05-20T17:33:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.676+0000 7feb0a7fc640 1 -- 172.21.15.135:0/3629680443 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7feb0409bdf0 con 0x7feb14101ee0 2024-05-20T17:33:20.678 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 msgr2=0x7feb14198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feb0400d950 tx=0x7feb0400de10 comp rx=0 tx=0).stop 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 shutdown_connections 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb14103400 0x7feb1419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb141028c0 0x7feb14198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 --2- 172.21.15.135:0/3629680443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb14101ee0 0x7feb14198100 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 >> 172.21.15.135:0/3629680443 conn(0x7feb140fc300 msgr2=0x7feb14105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.678+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 shutdown_connections 2024-05-20T17:33:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.679+0000 7feb1b7f5640 1 -- 172.21.15.135:0/3629680443 wait complete. 2024-05-20T17:33:20.691 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-20T17:33:20.691 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:33:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3157550283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 msgr2=0x7fb6b8100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3157550283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b8100b50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009900 tx=0x7fb6a402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3157550283 shutdown_connections 2024-05-20T17:33:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3157550283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b81011e0 0x7fb6b810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3157550283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b8100b50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3157550283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b8104030 0x7fb6b8104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3157550283 >> 172.21.15.135:0/3157550283 conn(0x7fb6b80fc2e0 msgr2=0x7fb6b80fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3157550283 shutdown_connections 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.820+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3157550283 wait complete. 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 Processor -- start 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 -- start start 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b81011e0 0x7fb6b8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b8104030 0x7fb6b81a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b810e710 con 0x7fb6b81006e0 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b810e590 con 0x7fb6b8104030 2024-05-20T17:33:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bed8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b810e890 con 0x7fb6b81011e0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bcb2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bcb2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51226/0 (socket says 172.21.15.135:51226) 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bcb2b640 1 -- 172.21.15.135:0/3053770508 learned_addr learned my addr 172.21.15.135:0/3053770508 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6b7fff640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b81011e0 0x7fb6b8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.821+0000 7fb6bd32c640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b8104030 0x7fb6b81a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 -- 172.21.15.135:0/3053770508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b81011e0 msgr2=0x7fb6b8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b81011e0 0x7fb6b8199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 -- 172.21.15.135:0/3053770508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b8104030 msgr2=0x7fb6b81a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b8104030 0x7fb6b81a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 -- 172.21.15.135:0/3053770508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b81a0e00 con 0x7fb6b81006e0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bcb2b640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e9f0 tx=0x7fb6ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:20.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00ccc0 con 0x7fb6b81006e0 2024-05-20T17:33:20.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b81a10f0 con 0x7fb6b81006e0 2024-05-20T17:33:20.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6ac0035f0 con 0x7fb6b81006e0 2024-05-20T17:33:20.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00ce60 con 0x7fb6b81006e0 2024-05-20T17:33:20.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.822+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b81a1640 con 0x7fb6b81006e0 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.823+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b81079c0 con 0x7fb6b81006e0 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.825+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fb6ac0037a0 con 0x7fb6b81006e0 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.825+0000 7fb6b5ffb640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 0x7fb6a80a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.825+0000 7fb6b7fff640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 0x7fb6a80a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.825+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb6ac0cf370 con 0x7fb6b81006e0 2024-05-20T17:33:20.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.826+0000 7fb6b7fff640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 0x7fb6a80a4ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009230 tx=0x7fb6a4031400 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:20.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:20.831+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb6ac09c4a0 con 0x7fb6b81006e0 2024-05-20T17:33:21.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.056+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6b802d2a0 con 0x7fb6b81006e0 2024-05-20T17:33:21.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.057+0000 7fb6b5ffb640 1 -- 172.21.15.135:0/3053770508 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7fb6ac09bda0 con 0x7fb6b81006e0 2024-05-20T17:33:21.058 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:21.058 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:33:17.908712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24523]},"id":1}]} 2024-05-20T17:33:21.059 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 22 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 msgr2=0x7fb6a80a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 0x7fb6a80a4ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009230 tx=0x7fb6a4031400 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 msgr2=0x7fb6b81992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e9f0 tx=0x7fb6ac00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 shutdown_connections 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb6a80a2990 0x7fb6a80a4ea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b8104030 0x7fb6b81a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b81011e0 0x7fb6b8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 --2- 172.21.15.135:0/3053770508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6b81006e0 0x7fb6b81992c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 >> 172.21.15.135:0/3053770508 conn(0x7fb6b80fc2e0 msgr2=0x7fb6b8104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 shutdown_connections 2024-05-20T17:33:21.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.059+0000 7fb6bed8f640 1 -- 172.21.15.135:0/3053770508 wait complete. 2024-05-20T17:33:21.072 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-20T17:33:21.072 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-20T17:33:21.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:33:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 -- 172.21.15.135:0/2587342904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 msgr2=0x7fb5081024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 --2- 172.21.15.135:0/2587342904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb5081024e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009900 tx=0x7fb4f802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 -- 172.21.15.135:0/2587342904 shutdown_connections 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 --2- 172.21.15.135:0/2587342904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 0x7fb508109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 --2- 172.21.15.135:0/2587342904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 0x7fb508102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 --2- 172.21.15.135:0/2587342904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb5081024e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 -- 172.21.15.135:0/2587342904 >> 172.21.15.135:0/2587342904 conn(0x7fb5080fc9d0 msgr2=0x7fb5080fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 -- 172.21.15.135:0/2587342904 shutdown_connections 2024-05-20T17:33:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.184+0000 7fb507fff640 1 -- 172.21.15.135:0/2587342904 wait complete. 2024-05-20T17:33:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 Processor -- start 2024-05-20T17:33:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 -- start start 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 0x7fb5081985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 0x7fb50819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb50810d480 con 0x7fb5081017e0 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb50810d300 con 0x7fb508107720 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb507fff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb50810d600 con 0x7fb508102a20 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb506ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb506ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51248/0 (socket says 172.21.15.135:51248) 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb506ffd640 1 -- 172.21.15.135:0/631992371 learned_addr learned my addr 172.21.15.135:0/631992371 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb5077fe640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 0x7fb50819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.185+0000 7fb4fffff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 0x7fb5081985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 -- 172.21.15.135:0/631992371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 msgr2=0x7fb5081985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 0x7fb5081985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 -- 172.21.15.135:0/631992371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 msgr2=0x7fb50819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 0x7fb50819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 -- 172.21.15.135:0/631992371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50819fb30 con 0x7fb5081017e0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb506ffd640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8031440 tx=0x7fb4f8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.186+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f803f030 con 0x7fb5081017e0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.187+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50819fdc0 con 0x7fb5081017e0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.187+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f8003ce0 con 0x7fb5081017e0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.187+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8035070 con 0x7fb5081017e0 2024-05-20T17:33:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.187+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081a0210 con 0x7fb5081017e0 2024-05-20T17:33:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.188+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb508106530 con 0x7fb5081017e0 2024-05-20T17:33:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.189+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fb4f8042030 con 0x7fb5081017e0 2024-05-20T17:33:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.189+0000 7fb504ff9640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 0x7fb4f40a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.190+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb4f80ef080 con 0x7fb5081017e0 2024-05-20T17:33:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.190+0000 7fb4fffff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 0x7fb4f40a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.190+0000 7fb4fffff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 0x7fb4f40a4e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb508199100 tx=0x7fb4f0005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.194+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb4f80bbb60 con 0x7fb5081017e0 2024-05-20T17:33:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:20 smithi160 ceph-mon[36261]: [20/May/2024:17:33:20] ENGINE Bus STARTING 2024-05-20T17:33:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:20 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1213258150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:20 smithi160 ceph-mon[36261]: [20/May/2024:17:33:20] ENGINE Serving on http://172.21.15.135:8765 2024-05-20T17:33:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:20 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3629680443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:20 smithi160 ceph-mon[36261]: mgrmap e21: x(active, since 1.02029s), standbys: z, y 2024-05-20T17:33:21.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:20 smithi135 ceph-mon[32027]: [20/May/2024:17:33:20] ENGINE Bus STARTING 2024-05-20T17:33:21.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1213258150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:20 smithi135 ceph-mon[32027]: [20/May/2024:17:33:20] ENGINE Serving on http://172.21.15.135:8765 2024-05-20T17:33:21.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:20 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3629680443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:20 smithi135 ceph-mon[32027]: mgrmap e21: x(active, since 1.02029s), standbys: z, y 2024-05-20T17:33:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:20 smithi172 ceph-mon[36511]: [20/May/2024:17:33:20] ENGINE Bus STARTING 2024-05-20T17:33:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:20 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1213258150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:20 smithi172 ceph-mon[36511]: [20/May/2024:17:33:20] ENGINE Serving on http://172.21.15.135:8765 2024-05-20T17:33:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:20 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3629680443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:20 smithi172 ceph-mon[36511]: mgrmap e21: x(active, since 1.02029s), standbys: z, y 2024-05-20T17:33:21.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.376+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb508061f90 con 0x7fb4f40a2970 2024-05-20T17:33:21.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.383+0000 7fb504ff9640 1 -- 172.21.15.135:0/631992371 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258051 (secure 0 0 0) 0x7fb508061f90 con 0x7fb4f40a2970 2024-05-20T17:33:21.387 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:21.389 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:33:21.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 msgr2=0x7fb4f40a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 0x7fb4f40a4e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb508199100 tx=0x7fb4f0005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 msgr2=0x7fb508198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8031440 tx=0x7fb4f8032ce0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 shutdown_connections 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb4f40a2970 0x7fb4f40a4e80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb508107720 0x7fb50819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb508102a20 0x7fb5081985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 --2- 172.21.15.135:0/631992371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081017e0 0x7fb508198060 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.386+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 >> 172.21.15.135:0/631992371 conn(0x7fb5080fc9d0 msgr2=0x7fb508103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.387+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 shutdown_connections 2024-05-20T17:33:21.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.387+0000 7fb507fff640 1 -- 172.21.15.135:0/631992371 wait complete. 2024-05-20T17:33:21.399 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2024-05-20T17:33:20.810595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189414,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":989,"num_read_kb":657,"num_write":470,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1183030,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348528,"kb_used_data":11820,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593296,"statfs":{"total":1151940427776,"available":1151583535104,"internally_reserved":0,"allocated":12103680,"data_stored":8938037,"data_compressed":280967,"data_compressed_allocated":376832,"data_compressed_original":3440640,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787061+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:33:19.787061+0000","last_peered":"2024-05-20T17:33:19.787061+0000","last_clean":"2024-05-20T17:33:19.787061+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:33:19.787061+0000","last_undegraded":"2024-05-20T17:33:19.787061+0000","last_fullsized":"2024-05-20T17:33:19.787061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059694+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:33:20.059694+0000","last_peered":"2024-05-20T17:33:20.059694+0000","last_clean":"2024-05-20T17:33:20.059694+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:33:20.059694+0000","last_undegraded":"2024-05-20T17:33:20.059694+0000","last_fullsized":"2024-05-20T17:33:20.059694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059569+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:33:20.059569+0000","last_peered":"2024-05-20T17:33:20.059569+0000","last_clean":"2024-05-20T17:33:20.059569+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:33:20.059569+0000","last_undegraded":"2024-05-20T17:33:20.059569+0000","last_fullsized":"2024-05-20T17:33:20.059569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058589+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:33:20.058589+0000","last_peered":"2024-05-20T17:33:20.058589+0000","last_clean":"2024-05-20T17:33:20.058589+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:33:20.058589+0000","last_undegraded":"2024-05-20T17:33:20.058589+0000","last_fullsized":"2024-05-20T17:33:20.058589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886316+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:33:19.886316+0000","last_peered":"2024-05-20T17:33:19.886316+0000","last_clean":"2024-05-20T17:33:19.886316+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:33:19.886316+0000","last_undegraded":"2024-05-20T17:33:19.886316+0000","last_fullsized":"2024-05-20T17:33:19.886316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:42.560376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786447+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:33:19.786447+0000","last_peered":"2024-05-20T17:33:19.786447+0000","last_clean":"2024-05-20T17:33:19.786447+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:33:19.786447+0000","last_undegraded":"2024-05-20T17:33:19.786447+0000","last_fullsized":"2024-05-20T17:33:19.786447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:04.966944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886133+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:33:19.886133+0000","last_peered":"2024-05-20T17:33:19.886133+0000","last_clean":"2024-05-20T17:33:19.886133+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:33:19.886133+0000","last_undegraded":"2024-05-20T17:33:19.886133+0000","last_fullsized":"2024-05-20T17:33:19.886133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.064066+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:33:20.064066+0000","last_peered":"2024-05-20T17:33:20.064066+0000","last_clean":"2024-05-20T17:33:20.064066+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:33:20.064066+0000","last_undegraded":"2024-05-20T17:33:20.064066+0000","last_fullsized":"2024-05-20T17:33:20.064066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896714+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:33:19.896714+0000","last_peered":"2024-05-20T17:33:19.896714+0000","last_clean":"2024-05-20T17:33:19.896714+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:33:19.896714+0000","last_undegraded":"2024-05-20T17:33:19.896714+0000","last_fullsized":"2024-05-20T17:33:19.896714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786867+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:33:19.786867+0000","last_peered":"2024-05-20T17:33:19.786867+0000","last_clean":"2024-05-20T17:33:19.786867+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:33:19.786867+0000","last_undegraded":"2024-05-20T17:33:19.786867+0000","last_fullsized":"2024-05-20T17:33:19.786867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:16.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058372+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:33:20.058372+0000","last_peered":"2024-05-20T17:33:20.058372+0000","last_clean":"2024-05-20T17:33:20.058372+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:33:20.058372+0000","last_undegraded":"2024-05-20T17:33:20.058372+0000","last_fullsized":"2024-05-20T17:33:20.058372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019386+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:33:20.019386+0000","last_peered":"2024-05-20T17:33:20.019386+0000","last_clean":"2024-05-20T17:33:20.019386+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:33:20.019386+0000","last_undegraded":"2024-05-20T17:33:20.019386+0000","last_fullsized":"2024-05-20T17:33:20.019386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059296+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:33:20.059296+0000","last_peered":"2024-05-20T17:33:20.059296+0000","last_clean":"2024-05-20T17:33:20.059296+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:33:20.059296+0000","last_undegraded":"2024-05-20T17:33:20.059296+0000","last_fullsized":"2024-05-20T17:33:20.059296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059133+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:33:20.059133+0000","last_peered":"2024-05-20T17:33:20.059133+0000","last_clean":"2024-05-20T17:33:20.059133+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:33:20.059133+0000","last_undegraded":"2024-05-20T17:33:20.059133+0000","last_fullsized":"2024-05-20T17:33:20.059133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063580+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:33:20.063580+0000","last_peered":"2024-05-20T17:33:20.063580+0000","last_clean":"2024-05-20T17:33:20.063580+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:33:20.063580+0000","last_undegraded":"2024-05-20T17:33:20.063580+0000","last_fullsized":"2024-05-20T17:33:20.063580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786719+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:33:19.786719+0000","last_peered":"2024-05-20T17:33:19.786719+0000","last_clean":"2024-05-20T17:33:19.786719+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:33:19.786719+0000","last_undegraded":"2024-05-20T17:33:19.786719+0000","last_fullsized":"2024-05-20T17:33:19.786719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787901+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:33:19.787901+0000","last_peered":"2024-05-20T17:33:19.787901+0000","last_clean":"2024-05-20T17:33:19.787901+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:33:19.787901+0000","last_undegraded":"2024-05-20T17:33:19.787901+0000","last_fullsized":"2024-05-20T17:33:19.787901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063600+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:33:20.063600+0000","last_peered":"2024-05-20T17:33:20.063600+0000","last_clean":"2024-05-20T17:33:20.063600+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:33:20.063600+0000","last_undegraded":"2024-05-20T17:33:20.063600+0000","last_fullsized":"2024-05-20T17:33:20.063600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787970+0000","last_change":"2024-05-20T17:32:07.744385+0000","last_active":"2024-05-20T17:33:19.787970+0000","last_peered":"2024-05-20T17:33:19.787970+0000","last_clean":"2024-05-20T17:33:19.787970+0000","last_became_active":"2024-05-20T17:32:07.734114+0000","last_became_peered":"2024-05-20T17:32:07.734114+0000","last_unstale":"2024-05-20T17:33:19.787970+0000","last_undegraded":"2024-05-20T17:33:19.787970+0000","last_fullsized":"2024-05-20T17:33:19.787970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:57.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887241+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:33:19.887241+0000","last_peered":"2024-05-20T17:33:19.887241+0000","last_clean":"2024-05-20T17:33:19.887241+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:33:19.887241+0000","last_undegraded":"2024-05-20T17:33:19.887241+0000","last_fullsized":"2024-05-20T17:33:19.887241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887442+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:33:19.887442+0000","last_peered":"2024-05-20T17:33:19.887442+0000","last_clean":"2024-05-20T17:33:19.887442+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:33:19.887442+0000","last_undegraded":"2024-05-20T17:33:19.887442+0000","last_fullsized":"2024-05-20T17:33:19.887442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059790+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:33:20.059790+0000","last_peered":"2024-05-20T17:33:20.059790+0000","last_clean":"2024-05-20T17:33:20.059790+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:33:20.059790+0000","last_undegraded":"2024-05-20T17:33:20.059790+0000","last_fullsized":"2024-05-20T17:33:20.059790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786890+0000","last_change":"2024-05-20T17:32:07.741590+0000","last_active":"2024-05-20T17:33:19.786890+0000","last_peered":"2024-05-20T17:33:19.786890+0000","last_clean":"2024-05-20T17:33:19.786890+0000","last_became_active":"2024-05-20T17:32:07.736058+0000","last_became_peered":"2024-05-20T17:32:07.736058+0000","last_unstale":"2024-05-20T17:33:19.786890+0000","last_undegraded":"2024-05-20T17:33:19.786890+0000","last_fullsized":"2024-05-20T17:33:19.786890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:11.041568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063629+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:33:20.063629+0000","last_peered":"2024-05-20T17:33:20.063629+0000","last_clean":"2024-05-20T17:33:20.063629+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:33:20.063629+0000","last_undegraded":"2024-05-20T17:33:20.063629+0000","last_fullsized":"2024-05-20T17:33:20.063629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886565+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:33:19.886565+0000","last_peered":"2024-05-20T17:33:19.886565+0000","last_clean":"2024-05-20T17:33:19.886565+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:33:19.886565+0000","last_undegraded":"2024-05-20T17:33:19.886565+0000","last_fullsized":"2024-05-20T17:33:19.886565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893453+0000","last_change":"2024-05-20T17:32:07.908641+0000","last_active":"2024-05-20T17:33:19.893453+0000","last_peered":"2024-05-20T17:33:19.893453+0000","last_clean":"2024-05-20T17:33:19.893453+0000","last_became_active":"2024-05-20T17:32:07.908317+0000","last_became_peered":"2024-05-20T17:32:07.908317+0000","last_unstale":"2024-05-20T17:33:19.893453+0000","last_undegraded":"2024-05-20T17:33:19.893453+0000","last_fullsized":"2024-05-20T17:33:19.893453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:40.232683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063844+0000","last_change":"2024-05-20T17:32:07.913292+0000","last_active":"2024-05-20T17:33:20.063844+0000","last_peered":"2024-05-20T17:33:20.063844+0000","last_clean":"2024-05-20T17:33:20.063844+0000","last_became_active":"2024-05-20T17:32:07.908905+0000","last_became_peered":"2024-05-20T17:32:07.908905+0000","last_unstale":"2024-05-20T17:33:20.063844+0000","last_undegraded":"2024-05-20T17:33:20.063844+0000","last_fullsized":"2024-05-20T17:33:20.063844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:15.236246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1936,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886361+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:33:19.886361+0000","last_peered":"2024-05-20T17:33:19.886361+0000","last_clean":"2024-05-20T17:33:19.886361+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:33:19.886361+0000","last_undegraded":"2024-05-20T17:33:19.886361+0000","last_fullsized":"2024-05-20T17:33:19.886361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:00.930437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893523+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:33:19.893523+0000","last_peered":"2024-05-20T17:33:19.893523+0000","last_clean":"2024-05-20T17:33:19.893523+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:33:19.893523+0000","last_undegraded":"2024-05-20T17:33:19.893523+0000","last_fullsized":"2024-05-20T17:33:19.893523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018693+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:33:20.018693+0000","last_peered":"2024-05-20T17:33:20.018693+0000","last_clean":"2024-05-20T17:33:20.018693+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:33:20.018693+0000","last_undegraded":"2024-05-20T17:33:20.018693+0000","last_fullsized":"2024-05-20T17:33:20.018693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886082+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:33:19.886082+0000","last_peered":"2024-05-20T17:33:19.886082+0000","last_clean":"2024-05-20T17:33:19.886082+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:33:19.886082+0000","last_undegraded":"2024-05-20T17:33:19.886082+0000","last_fullsized":"2024-05-20T17:33:19.886082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893303+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:33:19.893303+0000","last_peered":"2024-05-20T17:33:19.893303+0000","last_clean":"2024-05-20T17:33:19.893303+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:33:19.893303+0000","last_undegraded":"2024-05-20T17:33:19.893303+0000","last_fullsized":"2024-05-20T17:33:19.893303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787701+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:33:19.787701+0000","last_peered":"2024-05-20T17:33:19.787701+0000","last_clean":"2024-05-20T17:33:19.787701+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:33:19.787701+0000","last_undegraded":"2024-05-20T17:33:19.787701+0000","last_fullsized":"2024-05-20T17:33:19.787701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.021195+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:33:20.021195+0000","last_peered":"2024-05-20T17:33:20.021195+0000","last_clean":"2024-05-20T17:33:20.021195+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:33:20.021195+0000","last_undegraded":"2024-05-20T17:33:20.021195+0000","last_fullsized":"2024-05-20T17:33:20.021195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063912+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:33:20.063912+0000","last_peered":"2024-05-20T17:33:20.063912+0000","last_clean":"2024-05-20T17:33:20.063912+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:33:20.063912+0000","last_undegraded":"2024-05-20T17:33:20.063912+0000","last_fullsized":"2024-05-20T17:33:20.063912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787108+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:33:19.787108+0000","last_peered":"2024-05-20T17:33:19.787108+0000","last_clean":"2024-05-20T17:33:19.787108+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:33:19.787108+0000","last_undegraded":"2024-05-20T17:33:19.787108+0000","last_fullsized":"2024-05-20T17:33:19.787108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059931+0000","last_change":"2024-05-20T17:32:07.735120+0000","last_active":"2024-05-20T17:33:20.059931+0000","last_peered":"2024-05-20T17:33:20.059931+0000","last_clean":"2024-05-20T17:33:20.059931+0000","last_became_active":"2024-05-20T17:32:07.734652+0000","last_became_peered":"2024-05-20T17:32:07.734652+0000","last_unstale":"2024-05-20T17:33:20.059931+0000","last_undegraded":"2024-05-20T17:33:20.059931+0000","last_fullsized":"2024-05-20T17:33:20.059931+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:28.611313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893568+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:33:19.893568+0000","last_peered":"2024-05-20T17:33:19.893568+0000","last_clean":"2024-05-20T17:33:19.893568+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:33:19.893568+0000","last_undegraded":"2024-05-20T17:33:19.893568+0000","last_fullsized":"2024-05-20T17:33:19.893568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063767+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:33:20.063767+0000","last_peered":"2024-05-20T17:33:20.063767+0000","last_clean":"2024-05-20T17:33:20.063767+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:33:20.063767+0000","last_undegraded":"2024-05-20T17:33:20.063767+0000","last_fullsized":"2024-05-20T17:33:20.063767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":311,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063119+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:33:20.063119+0000","last_peered":"2024-05-20T17:33:20.063119+0000","last_clean":"2024-05-20T17:33:20.063119+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:33:20.063119+0000","last_undegraded":"2024-05-20T17:33:20.063119+0000","last_fullsized":"2024-05-20T17:33:20.063119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":192,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886472+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:33:19.886472+0000","last_peered":"2024-05-20T17:33:19.886472+0000","last_clean":"2024-05-20T17:33:19.886472+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:33:19.886472+0000","last_undegraded":"2024-05-20T17:33:19.886472+0000","last_fullsized":"2024-05-20T17:33:19.886472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:10.914985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063337+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:33:20.063337+0000","last_peered":"2024-05-20T17:33:20.063337+0000","last_clean":"2024-05-20T17:33:20.063337+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:33:20.063337+0000","last_undegraded":"2024-05-20T17:33:20.063337+0000","last_fullsized":"2024-05-20T17:33:20.063337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018896+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:33:20.018896+0000","last_peered":"2024-05-20T17:33:20.018896+0000","last_clean":"2024-05-20T17:33:20.018896+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:33:20.018896+0000","last_undegraded":"2024-05-20T17:33:20.018896+0000","last_fullsized":"2024-05-20T17:33:20.018896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893372+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:33:19.893372+0000","last_peered":"2024-05-20T17:33:19.893372+0000","last_clean":"2024-05-20T17:33:19.893372+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:33:19.893372+0000","last_undegraded":"2024-05-20T17:33:19.893372+0000","last_fullsized":"2024-05-20T17:33:19.893372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786838+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:33:19.786838+0000","last_peered":"2024-05-20T17:33:19.786838+0000","last_clean":"2024-05-20T17:33:19.786838+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:33:19.786838+0000","last_undegraded":"2024-05-20T17:33:19.786838+0000","last_fullsized":"2024-05-20T17:33:19.786838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:28:49.912347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":156,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.246275+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:33:20.246275+0000","last_peered":"2024-05-20T17:33:20.246275+0000","last_clean":"2024-05-20T17:33:20.246275+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:33:20.246275+0000","last_undegraded":"2024-05-20T17:33:20.246275+0000","last_fullsized":"2024-05-20T17:33:20.246275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786425+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:33:19.786425+0000","last_peered":"2024-05-20T17:33:19.786425+0000","last_clean":"2024-05-20T17:33:19.786425+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:33:19.786425+0000","last_undegraded":"2024-05-20T17:33:19.786425+0000","last_fullsized":"2024-05-20T17:33:19.786425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:42:44.041243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886227+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:33:19.886227+0000","last_peered":"2024-05-20T17:33:19.886227+0000","last_clean":"2024-05-20T17:33:19.886227+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:33:19.886227+0000","last_undegraded":"2024-05-20T17:33:19.886227+0000","last_fullsized":"2024-05-20T17:33:19.886227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893248+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:33:19.893248+0000","last_peered":"2024-05-20T17:33:19.893248+0000","last_clean":"2024-05-20T17:33:19.893248+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:33:19.893248+0000","last_undegraded":"2024-05-20T17:33:19.893248+0000","last_fullsized":"2024-05-20T17:33:19.893248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886577+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:33:19.886577+0000","last_peered":"2024-05-20T17:33:19.886577+0000","last_clean":"2024-05-20T17:33:19.886577+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:33:19.886577+0000","last_undegraded":"2024-05-20T17:33:19.886577+0000","last_fullsized":"2024-05-20T17:33:19.886577+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786760+0000","last_change":"2024-05-20T17:32:07.733408+0000","last_active":"2024-05-20T17:33:19.786760+0000","last_peered":"2024-05-20T17:33:19.786760+0000","last_clean":"2024-05-20T17:33:19.786760+0000","last_became_active":"2024-05-20T17:32:07.732989+0000","last_became_peered":"2024-05-20T17:32:07.732989+0000","last_unstale":"2024-05-20T17:33:19.786760+0000","last_undegraded":"2024-05-20T17:33:19.786760+0000","last_fullsized":"2024-05-20T17:33:19.786760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:48.103948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787799+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:33:19.787799+0000","last_peered":"2024-05-20T17:33:19.787799+0000","last_clean":"2024-05-20T17:33:19.787799+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:33:19.787799+0000","last_undegraded":"2024-05-20T17:33:19.787799+0000","last_fullsized":"2024-05-20T17:33:19.787799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896692+0000","last_change":"2024-05-20T17:32:07.738327+0000","last_active":"2024-05-20T17:33:19.896692+0000","last_peered":"2024-05-20T17:33:19.896692+0000","last_clean":"2024-05-20T17:33:19.896692+0000","last_became_active":"2024-05-20T17:32:07.734897+0000","last_became_peered":"2024-05-20T17:32:07.734897+0000","last_unstale":"2024-05-20T17:33:19.896692+0000","last_undegraded":"2024-05-20T17:33:19.896692+0000","last_fullsized":"2024-05-20T17:33:19.896692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.308883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786701+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:33:19.786701+0000","last_peered":"2024-05-20T17:33:19.786701+0000","last_clean":"2024-05-20T17:33:19.786701+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:33:19.786701+0000","last_undegraded":"2024-05-20T17:33:19.786701+0000","last_fullsized":"2024-05-20T17:33:19.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896486+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:33:19.896486+0000","last_peered":"2024-05-20T17:33:19.896486+0000","last_clean":"2024-05-20T17:33:19.896486+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:33:19.896486+0000","last_undegraded":"2024-05-20T17:33:19.896486+0000","last_fullsized":"2024-05-20T17:33:19.896486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893694+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:33:19.893694+0000","last_peered":"2024-05-20T17:33:19.893694+0000","last_clean":"2024-05-20T17:33:19.893694+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:33:19.893694+0000","last_undegraded":"2024-05-20T17:33:19.893694+0000","last_fullsized":"2024-05-20T17:33:19.893694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.245543+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:33:20.245543+0000","last_peered":"2024-05-20T17:33:20.245543+0000","last_clean":"2024-05-20T17:33:20.245543+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:33:20.245543+0000","last_undegraded":"2024-05-20T17:33:20.245543+0000","last_fullsized":"2024-05-20T17:33:20.245543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886718+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:33:19.886718+0000","last_peered":"2024-05-20T17:33:19.886718+0000","last_clean":"2024-05-20T17:33:19.886718+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:33:19.886718+0000","last_undegraded":"2024-05-20T17:33:19.886718+0000","last_fullsized":"2024-05-20T17:33:19.886718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058262+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:33:20.058262+0000","last_peered":"2024-05-20T17:33:20.058262+0000","last_clean":"2024-05-20T17:33:20.058262+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:33:20.058262+0000","last_undegraded":"2024-05-20T17:33:20.058262+0000","last_fullsized":"2024-05-20T17:33:20.058262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786503+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:33:19.786503+0000","last_peered":"2024-05-20T17:33:19.786503+0000","last_clean":"2024-05-20T17:33:19.786503+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:33:19.786503+0000","last_undegraded":"2024-05-20T17:33:19.786503+0000","last_fullsized":"2024-05-20T17:33:19.786503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018519+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:33:20.018519+0000","last_peered":"2024-05-20T17:33:20.018519+0000","last_clean":"2024-05-20T17:33:20.018519+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:33:20.018519+0000","last_undegraded":"2024-05-20T17:33:20.018519+0000","last_fullsized":"2024-05-20T17:33:20.018519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786674+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:33:19.786674+0000","last_peered":"2024-05-20T17:33:19.786674+0000","last_clean":"2024-05-20T17:33:19.786674+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:33:19.786674+0000","last_undegraded":"2024-05-20T17:33:19.786674+0000","last_fullsized":"2024-05-20T17:33:19.786674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886536+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:33:19.886536+0000","last_peered":"2024-05-20T17:33:19.886536+0000","last_clean":"2024-05-20T17:33:19.886536+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:33:19.886536+0000","last_undegraded":"2024-05-20T17:33:19.886536+0000","last_fullsized":"2024-05-20T17:33:19.886536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020001+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:33:20.020001+0000","last_peered":"2024-05-20T17:33:20.020001+0000","last_clean":"2024-05-20T17:33:20.020001+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:33:20.020001+0000","last_undegraded":"2024-05-20T17:33:20.020001+0000","last_fullsized":"2024-05-20T17:33:20.020001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'44","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.016135+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:33:20.016135+0000","last_peered":"2024-05-20T17:33:20.016135+0000","last_clean":"2024-05-20T17:33:20.016135+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:33:20.016135+0000","last_undegraded":"2024-05-20T17:33:20.016135+0000","last_fullsized":"2024-05-20T17:33:20.016135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887016+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:33:19.887016+0000","last_peered":"2024-05-20T17:33:19.887016+0000","last_clean":"2024-05-20T17:33:19.887016+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:33:19.887016+0000","last_undegraded":"2024-05-20T17:33:19.887016+0000","last_fullsized":"2024-05-20T17:33:19.887016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058446+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:33:20.058446+0000","last_peered":"2024-05-20T17:33:20.058446+0000","last_clean":"2024-05-20T17:33:20.058446+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:33:20.058446+0000","last_undegraded":"2024-05-20T17:33:20.058446+0000","last_fullsized":"2024-05-20T17:33:20.058446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059838+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:33:20.059838+0000","last_peered":"2024-05-20T17:33:20.059838+0000","last_clean":"2024-05-20T17:33:20.059838+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:33:20.059838+0000","last_undegraded":"2024-05-20T17:33:20.059838+0000","last_fullsized":"2024-05-20T17:33:20.059838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063698+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:33:20.063698+0000","last_peered":"2024-05-20T17:33:20.063698+0000","last_clean":"2024-05-20T17:33:20.063698+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:33:20.063698+0000","last_undegraded":"2024-05-20T17:33:20.063698+0000","last_fullsized":"2024-05-20T17:33:20.063698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886232+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:33:19.886232+0000","last_peered":"2024-05-20T17:33:19.886232+0000","last_clean":"2024-05-20T17:33:19.886232+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:33:19.886232+0000","last_undegraded":"2024-05-20T17:33:19.886232+0000","last_fullsized":"2024-05-20T17:33:19.886232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:06.122038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886323+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:33:19.886323+0000","last_peered":"2024-05-20T17:33:19.886323+0000","last_clean":"2024-05-20T17:33:19.886323+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:33:19.886323+0000","last_undegraded":"2024-05-20T17:33:19.886323+0000","last_fullsized":"2024-05-20T17:33:19.886323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786529+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:33:19.786529+0000","last_peered":"2024-05-20T17:33:19.786529+0000","last_clean":"2024-05-20T17:33:19.786529+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:33:19.786529+0000","last_undegraded":"2024-05-20T17:33:19.786529+0000","last_fullsized":"2024-05-20T17:33:19.786529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063339+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:33:20.063339+0000","last_peered":"2024-05-20T17:33:20.063339+0000","last_clean":"2024-05-20T17:33:20.063339+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:33:20.063339+0000","last_undegraded":"2024-05-20T17:33:20.063339+0000","last_fullsized":"2024-05-20T17:33:20.063339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886598+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:33:19.886598+0000","last_peered":"2024-05-20T17:33:19.886598+0000","last_clean":"2024-05-20T17:33:19.886598+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:33:19.886598+0000","last_undegraded":"2024-05-20T17:33:19.886598+0000","last_fullsized":"2024-05-20T17:33:19.886598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886314+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:33:19.886314+0000","last_peered":"2024-05-20T17:33:19.886314+0000","last_clean":"2024-05-20T17:33:19.886314+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:33:19.886314+0000","last_undegraded":"2024-05-20T17:33:19.886314+0000","last_fullsized":"2024-05-20T17:33:19.886314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786736+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:33:19.786736+0000","last_peered":"2024-05-20T17:33:19.786736+0000","last_clean":"2024-05-20T17:33:19.786736+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:33:19.786736+0000","last_undegraded":"2024-05-20T17:33:19.786736+0000","last_fullsized":"2024-05-20T17:33:19.786736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:43.253987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058382+0000","last_change":"2024-05-20T17:32:07.738590+0000","last_active":"2024-05-20T17:33:20.058382+0000","last_peered":"2024-05-20T17:33:20.058382+0000","last_clean":"2024-05-20T17:33:20.058382+0000","last_became_active":"2024-05-20T17:32:07.731009+0000","last_became_peered":"2024-05-20T17:32:07.731009+0000","last_unstale":"2024-05-20T17:33:20.058382+0000","last_undegraded":"2024-05-20T17:33:20.058382+0000","last_fullsized":"2024-05-20T17:33:20.058382+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:25.383889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787095+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:33:19.787095+0000","last_peered":"2024-05-20T17:33:19.787095+0000","last_clean":"2024-05-20T17:33:19.787095+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:33:19.787095+0000","last_undegraded":"2024-05-20T17:33:19.787095+0000","last_fullsized":"2024-05-20T17:33:19.787095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:12:10.454896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.013045+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:33:20.013045+0000","last_peered":"2024-05-20T17:33:20.013045+0000","last_clean":"2024-05-20T17:33:20.013045+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:33:20.013045+0000","last_undegraded":"2024-05-20T17:33:20.013045+0000","last_fullsized":"2024-05-20T17:33:20.013045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786737+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:33:19.786737+0000","last_peered":"2024-05-20T17:33:19.786737+0000","last_clean":"2024-05-20T17:33:19.786737+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:33:19.786737+0000","last_undegraded":"2024-05-20T17:33:19.786737+0000","last_fullsized":"2024-05-20T17:33:19.786737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:06.119241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020281+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:33:20.020281+0000","last_peered":"2024-05-20T17:33:20.020281+0000","last_clean":"2024-05-20T17:33:20.020281+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:33:20.020281+0000","last_undegraded":"2024-05-20T17:33:20.020281+0000","last_fullsized":"2024-05-20T17:33:20.020281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787347+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:33:19.787347+0000","last_peered":"2024-05-20T17:33:19.787347+0000","last_clean":"2024-05-20T17:33:19.787347+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:33:19.787347+0000","last_undegraded":"2024-05-20T17:33:19.787347+0000","last_fullsized":"2024-05-20T17:33:19.787347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:49.546477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786754+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:33:19.786754+0000","last_peered":"2024-05-20T17:33:19.786754+0000","last_clean":"2024-05-20T17:33:19.786754+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:33:19.786754+0000","last_undegraded":"2024-05-20T17:33:19.786754+0000","last_fullsized":"2024-05-20T17:33:19.786754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063416+0000","last_change":"2024-05-20T17:32:07.736717+0000","last_active":"2024-05-20T17:33:20.063416+0000","last_peered":"2024-05-20T17:33:20.063416+0000","last_clean":"2024-05-20T17:33:20.063416+0000","last_became_active":"2024-05-20T17:32:07.736321+0000","last_became_peered":"2024-05-20T17:32:07.736321+0000","last_unstale":"2024-05-20T17:33:20.063416+0000","last_undegraded":"2024-05-20T17:33:20.063416+0000","last_fullsized":"2024-05-20T17:33:20.063416+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:59:32.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063299+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:33:20.063299+0000","last_peered":"2024-05-20T17:33:20.063299+0000","last_clean":"2024-05-20T17:33:20.063299+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:33:20.063299+0000","last_undegraded":"2024-05-20T17:33:20.063299+0000","last_fullsized":"2024-05-20T17:33:20.063299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059508+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:33:20.059508+0000","last_peered":"2024-05-20T17:33:20.059508+0000","last_clean":"2024-05-20T17:33:20.059508+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:33:20.059508+0000","last_undegraded":"2024-05-20T17:33:20.059508+0000","last_fullsized":"2024-05-20T17:33:20.059508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019860+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:33:20.019860+0000","last_peered":"2024-05-20T17:33:20.019860+0000","last_clean":"2024-05-20T17:33:20.019860+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:33:20.019860+0000","last_undegraded":"2024-05-20T17:33:20.019860+0000","last_fullsized":"2024-05-20T17:33:20.019860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786892+0000","last_change":"2024-05-20T17:32:07.735868+0000","last_active":"2024-05-20T17:33:19.786892+0000","last_peered":"2024-05-20T17:33:19.786892+0000","last_clean":"2024-05-20T17:33:19.786892+0000","last_became_active":"2024-05-20T17:32:07.735314+0000","last_became_peered":"2024-05-20T17:32:07.735314+0000","last_unstale":"2024-05-20T17:33:19.786892+0000","last_undegraded":"2024-05-20T17:33:19.786892+0000","last_fullsized":"2024-05-20T17:33:19.786892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:33:52.756227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063716+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:33:20.063716+0000","last_peered":"2024-05-20T17:33:20.063716+0000","last_clean":"2024-05-20T17:33:20.063716+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:33:20.063716+0000","last_undegraded":"2024-05-20T17:33:20.063716+0000","last_fullsized":"2024-05-20T17:33:20.063716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886886+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:33:19.886886+0000","last_peered":"2024-05-20T17:33:19.886886+0000","last_clean":"2024-05-20T17:33:19.886886+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:33:19.886886+0000","last_undegraded":"2024-05-20T17:33:19.886886+0000","last_fullsized":"2024-05-20T17:33:19.886886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893335+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:33:19.893335+0000","last_peered":"2024-05-20T17:33:19.893335+0000","last_clean":"2024-05-20T17:33:19.893335+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:33:19.893335+0000","last_undegraded":"2024-05-20T17:33:19.893335+0000","last_fullsized":"2024-05-20T17:33:19.893335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886282+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:33:19.886282+0000","last_peered":"2024-05-20T17:33:19.886282+0000","last_clean":"2024-05-20T17:33:19.886282+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:33:19.886282+0000","last_undegraded":"2024-05-20T17:33:19.886282+0000","last_fullsized":"2024-05-20T17:33:19.886282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063613+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:33:20.063613+0000","last_peered":"2024-05-20T17:33:20.063613+0000","last_clean":"2024-05-20T17:33:20.063613+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:33:20.063613+0000","last_undegraded":"2024-05-20T17:33:20.063613+0000","last_fullsized":"2024-05-20T17:33:20.063613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019549+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:33:20.019549+0000","last_peered":"2024-05-20T17:33:20.019549+0000","last_clean":"2024-05-20T17:33:20.019549+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:33:20.019549+0000","last_undegraded":"2024-05-20T17:33:20.019549+0000","last_fullsized":"2024-05-20T17:33:20.019549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786579+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:33:19.786579+0000","last_peered":"2024-05-20T17:33:19.786579+0000","last_clean":"2024-05-20T17:33:19.786579+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:33:19.786579+0000","last_undegraded":"2024-05-20T17:33:19.786579+0000","last_fullsized":"2024-05-20T17:33:19.786579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107100,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":598812,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":853,"num_read_kb":538,"num_write":287,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2177,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1796436,"data_compressed":81528,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":465954,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1110016,"data_stored":1124361,"data_compressed":46295,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":999424,"data_stored":858941,"data_compressed":27867,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":793208,"data_compressed":24626,"data_compressed_allocated":32768,"data_compressed_original":352256,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1059113,"data_compressed":44421,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495680,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464997,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":534484,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":457283,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":532694,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":990007,"data_compressed":34023,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":966656,"data_stored":467330,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":1189665,"data_compressed":50577,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69694,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67904,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134390,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8030,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:33:21.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 -- 172.21.15.135:0/3107958086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181078f0 msgr2=0x7faa18109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 --2- 172.21.15.135:0/3107958086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181078f0 0x7faa18109d10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa00009900 tx=0x7faa0002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 -- 172.21.15.135:0/3107958086 shutdown_connections 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 --2- 172.21.15.135:0/3107958086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181078f0 0x7faa18109d10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 --2- 172.21.15.135:0/3107958086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 0x7faa18103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 --2- 172.21.15.135:0/3107958086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181019b0 0x7faa181026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 -- 172.21.15.135:0/3107958086 >> 172.21.15.135:0/3107958086 conn(0x7faa180fcba0 msgr2=0x7faa180ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 -- 172.21.15.135:0/3107958086 shutdown_connections 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.550+0000 7faa1f131640 1 -- 172.21.15.135:0/3107958086 wait complete. 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 Processor -- start 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 -- start start 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 0x7faa18198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 0x7faa1819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810d630 con 0x7faa181019b0 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810d4b0 con 0x7faa181078f0 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1f131640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810d7b0 con 0x7faa18102bf0 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1cecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa17fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 0x7faa18198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1cecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51276/0 (socket says 172.21.15.135:51276) 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1cecd640 1 -- 172.21.15.135:0/777849251 learned_addr learned my addr 172.21.15.135:0/777849251 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.551+0000 7faa1d6ce640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 0x7faa1819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 -- 172.21.15.135:0/777849251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 msgr2=0x7faa18198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 0x7faa18198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 -- 172.21.15.135:0/777849251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 msgr2=0x7faa1819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 0x7faa1819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 -- 172.21.15.135:0/777849251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1819fc50 con 0x7faa181019b0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1d6ce640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 0x7faa1819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1cecd640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e9f0 tx=0x7faa1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1000dad0 con 0x7faa181019b0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa18073de0 con 0x7faa181019b0 2024-05-20T17:33:21.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1000dc70 con 0x7faa181019b0 2024-05-20T17:33:21.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10016410 con 0x7faa181019b0 2024-05-20T17:33:21.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.552+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa18074330 con 0x7faa181019b0 2024-05-20T17:33:21.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.553+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa18069140 con 0x7faa181019b0 2024-05-20T17:33:21.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.554+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7faa1001d020 con 0x7faa181019b0 2024-05-20T17:33:21.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.555+0000 7faa15ffb640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 0x7faa040a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.555+0000 7faa17fff640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 0x7faa040a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.555+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7faa100ce3d0 con 0x7faa181019b0 2024-05-20T17:33:21.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.556+0000 7faa17fff640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 0x7faa040a4ea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa181991b0 tx=0x7faa08009680 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.560+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faa1009b500 con 0x7faa181019b0 2024-05-20T17:33:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.758+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa18074590 con 0x7faa040a2990 2024-05-20T17:33:21.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.767+0000 7faa15ffb640 1 -- 172.21.15.135:0/777849251 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258051 (secure 0 0 0) 0x7faa18074590 con 0x7faa040a2990 2024-05-20T17:33:21.771 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:21.772 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 msgr2=0x7faa040a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 0x7faa040a4ea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa181991b0 tx=0x7faa08009680 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 msgr2=0x7faa18198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e9f0 tx=0x7faa1000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 shutdown_connections 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7faa040a2990 0x7faa040a4ea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa181078f0 0x7faa1819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa18102bf0 0x7faa18198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 --2- 172.21.15.135:0/777849251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa181019b0 0x7faa18198110 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.770+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 >> 172.21.15.135:0/777849251 conn(0x7faa180fcba0 msgr2=0x7faa181038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.771+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 shutdown_connections 2024-05-20T17:33:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.771+0000 7faa1f131640 1 -- 172.21.15.135:0/777849251 wait complete. 2024-05-20T17:33:21.784 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2024-05-20T17:33:20.810595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189414,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":989,"num_read_kb":657,"num_write":470,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1183030,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348528,"kb_used_data":11820,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593296,"statfs":{"total":1151940427776,"available":1151583535104,"internally_reserved":0,"allocated":12103680,"data_stored":8938037,"data_compressed":280967,"data_compressed_allocated":376832,"data_compressed_original":3440640,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787061+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:33:19.787061+0000","last_peered":"2024-05-20T17:33:19.787061+0000","last_clean":"2024-05-20T17:33:19.787061+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:33:19.787061+0000","last_undegraded":"2024-05-20T17:33:19.787061+0000","last_fullsized":"2024-05-20T17:33:19.787061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059694+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:33:20.059694+0000","last_peered":"2024-05-20T17:33:20.059694+0000","last_clean":"2024-05-20T17:33:20.059694+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:33:20.059694+0000","last_undegraded":"2024-05-20T17:33:20.059694+0000","last_fullsized":"2024-05-20T17:33:20.059694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059569+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:33:20.059569+0000","last_peered":"2024-05-20T17:33:20.059569+0000","last_clean":"2024-05-20T17:33:20.059569+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:33:20.059569+0000","last_undegraded":"2024-05-20T17:33:20.059569+0000","last_fullsized":"2024-05-20T17:33:20.059569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058589+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:33:20.058589+0000","last_peered":"2024-05-20T17:33:20.058589+0000","last_clean":"2024-05-20T17:33:20.058589+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:33:20.058589+0000","last_undegraded":"2024-05-20T17:33:20.058589+0000","last_fullsized":"2024-05-20T17:33:20.058589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886316+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:33:19.886316+0000","last_peered":"2024-05-20T17:33:19.886316+0000","last_clean":"2024-05-20T17:33:19.886316+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:33:19.886316+0000","last_undegraded":"2024-05-20T17:33:19.886316+0000","last_fullsized":"2024-05-20T17:33:19.886316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:42.560376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786447+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:33:19.786447+0000","last_peered":"2024-05-20T17:33:19.786447+0000","last_clean":"2024-05-20T17:33:19.786447+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:33:19.786447+0000","last_undegraded":"2024-05-20T17:33:19.786447+0000","last_fullsized":"2024-05-20T17:33:19.786447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:04.966944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886133+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:33:19.886133+0000","last_peered":"2024-05-20T17:33:19.886133+0000","last_clean":"2024-05-20T17:33:19.886133+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:33:19.886133+0000","last_undegraded":"2024-05-20T17:33:19.886133+0000","last_fullsized":"2024-05-20T17:33:19.886133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.064066+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:33:20.064066+0000","last_peered":"2024-05-20T17:33:20.064066+0000","last_clean":"2024-05-20T17:33:20.064066+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:33:20.064066+0000","last_undegraded":"2024-05-20T17:33:20.064066+0000","last_fullsized":"2024-05-20T17:33:20.064066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896714+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:33:19.896714+0000","last_peered":"2024-05-20T17:33:19.896714+0000","last_clean":"2024-05-20T17:33:19.896714+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:33:19.896714+0000","last_undegraded":"2024-05-20T17:33:19.896714+0000","last_fullsized":"2024-05-20T17:33:19.896714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786867+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:33:19.786867+0000","last_peered":"2024-05-20T17:33:19.786867+0000","last_clean":"2024-05-20T17:33:19.786867+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:33:19.786867+0000","last_undegraded":"2024-05-20T17:33:19.786867+0000","last_fullsized":"2024-05-20T17:33:19.786867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:16.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058372+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:33:20.058372+0000","last_peered":"2024-05-20T17:33:20.058372+0000","last_clean":"2024-05-20T17:33:20.058372+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:33:20.058372+0000","last_undegraded":"2024-05-20T17:33:20.058372+0000","last_fullsized":"2024-05-20T17:33:20.058372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019386+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:33:20.019386+0000","last_peered":"2024-05-20T17:33:20.019386+0000","last_clean":"2024-05-20T17:33:20.019386+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:33:20.019386+0000","last_undegraded":"2024-05-20T17:33:20.019386+0000","last_fullsized":"2024-05-20T17:33:20.019386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059296+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:33:20.059296+0000","last_peered":"2024-05-20T17:33:20.059296+0000","last_clean":"2024-05-20T17:33:20.059296+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:33:20.059296+0000","last_undegraded":"2024-05-20T17:33:20.059296+0000","last_fullsized":"2024-05-20T17:33:20.059296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059133+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:33:20.059133+0000","last_peered":"2024-05-20T17:33:20.059133+0000","last_clean":"2024-05-20T17:33:20.059133+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:33:20.059133+0000","last_undegraded":"2024-05-20T17:33:20.059133+0000","last_fullsized":"2024-05-20T17:33:20.059133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063580+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:33:20.063580+0000","last_peered":"2024-05-20T17:33:20.063580+0000","last_clean":"2024-05-20T17:33:20.063580+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:33:20.063580+0000","last_undegraded":"2024-05-20T17:33:20.063580+0000","last_fullsized":"2024-05-20T17:33:20.063580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786719+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:33:19.786719+0000","last_peered":"2024-05-20T17:33:19.786719+0000","last_clean":"2024-05-20T17:33:19.786719+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:33:19.786719+0000","last_undegraded":"2024-05-20T17:33:19.786719+0000","last_fullsized":"2024-05-20T17:33:19.786719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787901+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:33:19.787901+0000","last_peered":"2024-05-20T17:33:19.787901+0000","last_clean":"2024-05-20T17:33:19.787901+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:33:19.787901+0000","last_undegraded":"2024-05-20T17:33:19.787901+0000","last_fullsized":"2024-05-20T17:33:19.787901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063600+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:33:20.063600+0000","last_peered":"2024-05-20T17:33:20.063600+0000","last_clean":"2024-05-20T17:33:20.063600+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:33:20.063600+0000","last_undegraded":"2024-05-20T17:33:20.063600+0000","last_fullsized":"2024-05-20T17:33:20.063600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787970+0000","last_change":"2024-05-20T17:32:07.744385+0000","last_active":"2024-05-20T17:33:19.787970+0000","last_peered":"2024-05-20T17:33:19.787970+0000","last_clean":"2024-05-20T17:33:19.787970+0000","last_became_active":"2024-05-20T17:32:07.734114+0000","last_became_peered":"2024-05-20T17:32:07.734114+0000","last_unstale":"2024-05-20T17:33:19.787970+0000","last_undegraded":"2024-05-20T17:33:19.787970+0000","last_fullsized":"2024-05-20T17:33:19.787970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:57.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887241+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:33:19.887241+0000","last_peered":"2024-05-20T17:33:19.887241+0000","last_clean":"2024-05-20T17:33:19.887241+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:33:19.887241+0000","last_undegraded":"2024-05-20T17:33:19.887241+0000","last_fullsized":"2024-05-20T17:33:19.887241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887442+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:33:19.887442+0000","last_peered":"2024-05-20T17:33:19.887442+0000","last_clean":"2024-05-20T17:33:19.887442+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:33:19.887442+0000","last_undegraded":"2024-05-20T17:33:19.887442+0000","last_fullsized":"2024-05-20T17:33:19.887442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059790+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:33:20.059790+0000","last_peered":"2024-05-20T17:33:20.059790+0000","last_clean":"2024-05-20T17:33:20.059790+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:33:20.059790+0000","last_undegraded":"2024-05-20T17:33:20.059790+0000","last_fullsized":"2024-05-20T17:33:20.059790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786890+0000","last_change":"2024-05-20T17:32:07.741590+0000","last_active":"2024-05-20T17:33:19.786890+0000","last_peered":"2024-05-20T17:33:19.786890+0000","last_clean":"2024-05-20T17:33:19.786890+0000","last_became_active":"2024-05-20T17:32:07.736058+0000","last_became_peered":"2024-05-20T17:32:07.736058+0000","last_unstale":"2024-05-20T17:33:19.786890+0000","last_undegraded":"2024-05-20T17:33:19.786890+0000","last_fullsized":"2024-05-20T17:33:19.786890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:11.041568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063629+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:33:20.063629+0000","last_peered":"2024-05-20T17:33:20.063629+0000","last_clean":"2024-05-20T17:33:20.063629+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:33:20.063629+0000","last_undegraded":"2024-05-20T17:33:20.063629+0000","last_fullsized":"2024-05-20T17:33:20.063629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886565+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:33:19.886565+0000","last_peered":"2024-05-20T17:33:19.886565+0000","last_clean":"2024-05-20T17:33:19.886565+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:33:19.886565+0000","last_undegraded":"2024-05-20T17:33:19.886565+0000","last_fullsized":"2024-05-20T17:33:19.886565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893453+0000","last_change":"2024-05-20T17:32:07.908641+0000","last_active":"2024-05-20T17:33:19.893453+0000","last_peered":"2024-05-20T17:33:19.893453+0000","last_clean":"2024-05-20T17:33:19.893453+0000","last_became_active":"2024-05-20T17:32:07.908317+0000","last_became_peered":"2024-05-20T17:32:07.908317+0000","last_unstale":"2024-05-20T17:33:19.893453+0000","last_undegraded":"2024-05-20T17:33:19.893453+0000","last_fullsized":"2024-05-20T17:33:19.893453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:40.232683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063844+0000","last_change":"2024-05-20T17:32:07.913292+0000","last_active":"2024-05-20T17:33:20.063844+0000","last_peered":"2024-05-20T17:33:20.063844+0000","last_clean":"2024-05-20T17:33:20.063844+0000","last_became_active":"2024-05-20T17:32:07.908905+0000","last_became_peered":"2024-05-20T17:32:07.908905+0000","last_unstale":"2024-05-20T17:33:20.063844+0000","last_undegraded":"2024-05-20T17:33:20.063844+0000","last_fullsized":"2024-05-20T17:33:20.063844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:15.236246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1936,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886361+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:33:19.886361+0000","last_peered":"2024-05-20T17:33:19.886361+0000","last_clean":"2024-05-20T17:33:19.886361+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:33:19.886361+0000","last_undegraded":"2024-05-20T17:33:19.886361+0000","last_fullsized":"2024-05-20T17:33:19.886361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:00.930437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893523+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:33:19.893523+0000","last_peered":"2024-05-20T17:33:19.893523+0000","last_clean":"2024-05-20T17:33:19.893523+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:33:19.893523+0000","last_undegraded":"2024-05-20T17:33:19.893523+0000","last_fullsized":"2024-05-20T17:33:19.893523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018693+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:33:20.018693+0000","last_peered":"2024-05-20T17:33:20.018693+0000","last_clean":"2024-05-20T17:33:20.018693+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:33:20.018693+0000","last_undegraded":"2024-05-20T17:33:20.018693+0000","last_fullsized":"2024-05-20T17:33:20.018693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886082+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:33:19.886082+0000","last_peered":"2024-05-20T17:33:19.886082+0000","last_clean":"2024-05-20T17:33:19.886082+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:33:19.886082+0000","last_undegraded":"2024-05-20T17:33:19.886082+0000","last_fullsized":"2024-05-20T17:33:19.886082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893303+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:33:19.893303+0000","last_peered":"2024-05-20T17:33:19.893303+0000","last_clean":"2024-05-20T17:33:19.893303+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:33:19.893303+0000","last_undegraded":"2024-05-20T17:33:19.893303+0000","last_fullsized":"2024-05-20T17:33:19.893303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787701+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:33:19.787701+0000","last_peered":"2024-05-20T17:33:19.787701+0000","last_clean":"2024-05-20T17:33:19.787701+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:33:19.787701+0000","last_undegraded":"2024-05-20T17:33:19.787701+0000","last_fullsized":"2024-05-20T17:33:19.787701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.021195+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:33:20.021195+0000","last_peered":"2024-05-20T17:33:20.021195+0000","last_clean":"2024-05-20T17:33:20.021195+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:33:20.021195+0000","last_undegraded":"2024-05-20T17:33:20.021195+0000","last_fullsized":"2024-05-20T17:33:20.021195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063912+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:33:20.063912+0000","last_peered":"2024-05-20T17:33:20.063912+0000","last_clean":"2024-05-20T17:33:20.063912+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:33:20.063912+0000","last_undegraded":"2024-05-20T17:33:20.063912+0000","last_fullsized":"2024-05-20T17:33:20.063912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787108+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:33:19.787108+0000","last_peered":"2024-05-20T17:33:19.787108+0000","last_clean":"2024-05-20T17:33:19.787108+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:33:19.787108+0000","last_undegraded":"2024-05-20T17:33:19.787108+0000","last_fullsized":"2024-05-20T17:33:19.787108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059931+0000","last_change":"2024-05-20T17:32:07.735120+0000","last_active":"2024-05-20T17:33:20.059931+0000","last_peered":"2024-05-20T17:33:20.059931+0000","last_clean":"2024-05-20T17:33:20.059931+0000","last_became_active":"2024-05-20T17:32:07.734652+0000","last_became_peered":"2024-05-20T17:32:07.734652+0000","last_unstale":"2024-05-20T17:33:20.059931+0000","last_undegraded":"2024-05-20T17:33:20.059931+0000","last_fullsized":"2024-05-20T17:33:20.059931+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:28.611313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893568+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:33:19.893568+0000","last_peered":"2024-05-20T17:33:19.893568+0000","last_clean":"2024-05-20T17:33:19.893568+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:33:19.893568+0000","last_undegraded":"2024-05-20T17:33:19.893568+0000","last_fullsized":"2024-05-20T17:33:19.893568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063767+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:33:20.063767+0000","last_peered":"2024-05-20T17:33:20.063767+0000","last_clean":"2024-05-20T17:33:20.063767+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:33:20.063767+0000","last_undegraded":"2024-05-20T17:33:20.063767+0000","last_fullsized":"2024-05-20T17:33:20.063767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":311,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063119+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:33:20.063119+0000","last_peered":"2024-05-20T17:33:20.063119+0000","last_clean":"2024-05-20T17:33:20.063119+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:33:20.063119+0000","last_undegraded":"2024-05-20T17:33:20.063119+0000","last_fullsized":"2024-05-20T17:33:20.063119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":192,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886472+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:33:19.886472+0000","last_peered":"2024-05-20T17:33:19.886472+0000","last_clean":"2024-05-20T17:33:19.886472+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:33:19.886472+0000","last_undegraded":"2024-05-20T17:33:19.886472+0000","last_fullsized":"2024-05-20T17:33:19.886472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:10.914985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063337+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:33:20.063337+0000","last_peered":"2024-05-20T17:33:20.063337+0000","last_clean":"2024-05-20T17:33:20.063337+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:33:20.063337+0000","last_undegraded":"2024-05-20T17:33:20.063337+0000","last_fullsized":"2024-05-20T17:33:20.063337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018896+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:33:20.018896+0000","last_peered":"2024-05-20T17:33:20.018896+0000","last_clean":"2024-05-20T17:33:20.018896+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:33:20.018896+0000","last_undegraded":"2024-05-20T17:33:20.018896+0000","last_fullsized":"2024-05-20T17:33:20.018896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893372+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:33:19.893372+0000","last_peered":"2024-05-20T17:33:19.893372+0000","last_clean":"2024-05-20T17:33:19.893372+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:33:19.893372+0000","last_undegraded":"2024-05-20T17:33:19.893372+0000","last_fullsized":"2024-05-20T17:33:19.893372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786838+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:33:19.786838+0000","last_peered":"2024-05-20T17:33:19.786838+0000","last_clean":"2024-05-20T17:33:19.786838+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:33:19.786838+0000","last_undegraded":"2024-05-20T17:33:19.786838+0000","last_fullsized":"2024-05-20T17:33:19.786838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:28:49.912347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":156,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.246275+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:33:20.246275+0000","last_peered":"2024-05-20T17:33:20.246275+0000","last_clean":"2024-05-20T17:33:20.246275+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:33:20.246275+0000","last_undegraded":"2024-05-20T17:33:20.246275+0000","last_fullsized":"2024-05-20T17:33:20.246275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786425+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:33:19.786425+0000","last_peered":"2024-05-20T17:33:19.786425+0000","last_clean":"2024-05-20T17:33:19.786425+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:33:19.786425+0000","last_undegraded":"2024-05-20T17:33:19.786425+0000","last_fullsized":"2024-05-20T17:33:19.786425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:42:44.041243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886227+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:33:19.886227+0000","last_peered":"2024-05-20T17:33:19.886227+0000","last_clean":"2024-05-20T17:33:19.886227+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:33:19.886227+0000","last_undegraded":"2024-05-20T17:33:19.886227+0000","last_fullsized":"2024-05-20T17:33:19.886227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893248+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:33:19.893248+0000","last_peered":"2024-05-20T17:33:19.893248+0000","last_clean":"2024-05-20T17:33:19.893248+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:33:19.893248+0000","last_undegraded":"2024-05-20T17:33:19.893248+0000","last_fullsized":"2024-05-20T17:33:19.893248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886577+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:33:19.886577+0000","last_peered":"2024-05-20T17:33:19.886577+0000","last_clean":"2024-05-20T17:33:19.886577+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:33:19.886577+0000","last_undegraded":"2024-05-20T17:33:19.886577+0000","last_fullsized":"2024-05-20T17:33:19.886577+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786760+0000","last_change":"2024-05-20T17:32:07.733408+0000","last_active":"2024-05-20T17:33:19.786760+0000","last_peered":"2024-05-20T17:33:19.786760+0000","last_clean":"2024-05-20T17:33:19.786760+0000","last_became_active":"2024-05-20T17:32:07.732989+0000","last_became_peered":"2024-05-20T17:32:07.732989+0000","last_unstale":"2024-05-20T17:33:19.786760+0000","last_undegraded":"2024-05-20T17:33:19.786760+0000","last_fullsized":"2024-05-20T17:33:19.786760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:48.103948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787799+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:33:19.787799+0000","last_peered":"2024-05-20T17:33:19.787799+0000","last_clean":"2024-05-20T17:33:19.787799+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:33:19.787799+0000","last_undegraded":"2024-05-20T17:33:19.787799+0000","last_fullsized":"2024-05-20T17:33:19.787799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896692+0000","last_change":"2024-05-20T17:32:07.738327+0000","last_active":"2024-05-20T17:33:19.896692+0000","last_peered":"2024-05-20T17:33:19.896692+0000","last_clean":"2024-05-20T17:33:19.896692+0000","last_became_active":"2024-05-20T17:32:07.734897+0000","last_became_peered":"2024-05-20T17:32:07.734897+0000","last_unstale":"2024-05-20T17:33:19.896692+0000","last_undegraded":"2024-05-20T17:33:19.896692+0000","last_fullsized":"2024-05-20T17:33:19.896692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.308883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786701+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:33:19.786701+0000","last_peered":"2024-05-20T17:33:19.786701+0000","last_clean":"2024-05-20T17:33:19.786701+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:33:19.786701+0000","last_undegraded":"2024-05-20T17:33:19.786701+0000","last_fullsized":"2024-05-20T17:33:19.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896486+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:33:19.896486+0000","last_peered":"2024-05-20T17:33:19.896486+0000","last_clean":"2024-05-20T17:33:19.896486+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:33:19.896486+0000","last_undegraded":"2024-05-20T17:33:19.896486+0000","last_fullsized":"2024-05-20T17:33:19.896486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893694+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:33:19.893694+0000","last_peered":"2024-05-20T17:33:19.893694+0000","last_clean":"2024-05-20T17:33:19.893694+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:33:19.893694+0000","last_undegraded":"2024-05-20T17:33:19.893694+0000","last_fullsized":"2024-05-20T17:33:19.893694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.245543+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:33:20.245543+0000","last_peered":"2024-05-20T17:33:20.245543+0000","last_clean":"2024-05-20T17:33:20.245543+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:33:20.245543+0000","last_undegraded":"2024-05-20T17:33:20.245543+0000","last_fullsized":"2024-05-20T17:33:20.245543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886718+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:33:19.886718+0000","last_peered":"2024-05-20T17:33:19.886718+0000","last_clean":"2024-05-20T17:33:19.886718+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:33:19.886718+0000","last_undegraded":"2024-05-20T17:33:19.886718+0000","last_fullsized":"2024-05-20T17:33:19.886718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058262+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:33:20.058262+0000","last_peered":"2024-05-20T17:33:20.058262+0000","last_clean":"2024-05-20T17:33:20.058262+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:33:20.058262+0000","last_undegraded":"2024-05-20T17:33:20.058262+0000","last_fullsized":"2024-05-20T17:33:20.058262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786503+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:33:19.786503+0000","last_peered":"2024-05-20T17:33:19.786503+0000","last_clean":"2024-05-20T17:33:19.786503+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:33:19.786503+0000","last_undegraded":"2024-05-20T17:33:19.786503+0000","last_fullsized":"2024-05-20T17:33:19.786503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018519+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:33:20.018519+0000","last_peered":"2024-05-20T17:33:20.018519+0000","last_clean":"2024-05-20T17:33:20.018519+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:33:20.018519+0000","last_undegraded":"2024-05-20T17:33:20.018519+0000","last_fullsized":"2024-05-20T17:33:20.018519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786674+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:33:19.786674+0000","last_peered":"2024-05-20T17:33:19.786674+0000","last_clean":"2024-05-20T17:33:19.786674+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:33:19.786674+0000","last_undegraded":"2024-05-20T17:33:19.786674+0000","last_fullsized":"2024-05-20T17:33:19.786674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886536+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:33:19.886536+0000","last_peered":"2024-05-20T17:33:19.886536+0000","last_clean":"2024-05-20T17:33:19.886536+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:33:19.886536+0000","last_undegraded":"2024-05-20T17:33:19.886536+0000","last_fullsized":"2024-05-20T17:33:19.886536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020001+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:33:20.020001+0000","last_peered":"2024-05-20T17:33:20.020001+0000","last_clean":"2024-05-20T17:33:20.020001+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:33:20.020001+0000","last_undegraded":"2024-05-20T17:33:20.020001+0000","last_fullsized":"2024-05-20T17:33:20.020001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'44","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.016135+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:33:20.016135+0000","last_peered":"2024-05-20T17:33:20.016135+0000","last_clean":"2024-05-20T17:33:20.016135+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:33:20.016135+0000","last_undegraded":"2024-05-20T17:33:20.016135+0000","last_fullsized":"2024-05-20T17:33:20.016135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887016+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:33:19.887016+0000","last_peered":"2024-05-20T17:33:19.887016+0000","last_clean":"2024-05-20T17:33:19.887016+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:33:19.887016+0000","last_undegraded":"2024-05-20T17:33:19.887016+0000","last_fullsized":"2024-05-20T17:33:19.887016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058446+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:33:20.058446+0000","last_peered":"2024-05-20T17:33:20.058446+0000","last_clean":"2024-05-20T17:33:20.058446+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:33:20.058446+0000","last_undegraded":"2024-05-20T17:33:20.058446+0000","last_fullsized":"2024-05-20T17:33:20.058446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059838+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:33:20.059838+0000","last_peered":"2024-05-20T17:33:20.059838+0000","last_clean":"2024-05-20T17:33:20.059838+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:33:20.059838+0000","last_undegraded":"2024-05-20T17:33:20.059838+0000","last_fullsized":"2024-05-20T17:33:20.059838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063698+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:33:20.063698+0000","last_peered":"2024-05-20T17:33:20.063698+0000","last_clean":"2024-05-20T17:33:20.063698+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:33:20.063698+0000","last_undegraded":"2024-05-20T17:33:20.063698+0000","last_fullsized":"2024-05-20T17:33:20.063698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886232+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:33:19.886232+0000","last_peered":"2024-05-20T17:33:19.886232+0000","last_clean":"2024-05-20T17:33:19.886232+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:33:19.886232+0000","last_undegraded":"2024-05-20T17:33:19.886232+0000","last_fullsized":"2024-05-20T17:33:19.886232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:06.122038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886323+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:33:19.886323+0000","last_peered":"2024-05-20T17:33:19.886323+0000","last_clean":"2024-05-20T17:33:19.886323+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:33:19.886323+0000","last_undegraded":"2024-05-20T17:33:19.886323+0000","last_fullsized":"2024-05-20T17:33:19.886323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786529+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:33:19.786529+0000","last_peered":"2024-05-20T17:33:19.786529+0000","last_clean":"2024-05-20T17:33:19.786529+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:33:19.786529+0000","last_undegraded":"2024-05-20T17:33:19.786529+0000","last_fullsized":"2024-05-20T17:33:19.786529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063339+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:33:20.063339+0000","last_peered":"2024-05-20T17:33:20.063339+0000","last_clean":"2024-05-20T17:33:20.063339+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:33:20.063339+0000","last_undegraded":"2024-05-20T17:33:20.063339+0000","last_fullsized":"2024-05-20T17:33:20.063339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886598+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:33:19.886598+0000","last_peered":"2024-05-20T17:33:19.886598+0000","last_clean":"2024-05-20T17:33:19.886598+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:33:19.886598+0000","last_undegraded":"2024-05-20T17:33:19.886598+0000","last_fullsized":"2024-05-20T17:33:19.886598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886314+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:33:19.886314+0000","last_peered":"2024-05-20T17:33:19.886314+0000","last_clean":"2024-05-20T17:33:19.886314+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:33:19.886314+0000","last_undegraded":"2024-05-20T17:33:19.886314+0000","last_fullsized":"2024-05-20T17:33:19.886314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786736+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:33:19.786736+0000","last_peered":"2024-05-20T17:33:19.786736+0000","last_clean":"2024-05-20T17:33:19.786736+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:33:19.786736+0000","last_undegraded":"2024-05-20T17:33:19.786736+0000","last_fullsized":"2024-05-20T17:33:19.786736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:43.253987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058382+0000","last_change":"2024-05-20T17:32:07.738590+0000","last_active":"2024-05-20T17:33:20.058382+0000","last_peered":"2024-05-20T17:33:20.058382+0000","last_clean":"2024-05-20T17:33:20.058382+0000","last_became_active":"2024-05-20T17:32:07.731009+0000","last_became_peered":"2024-05-20T17:32:07.731009+0000","last_unstale":"2024-05-20T17:33:20.058382+0000","last_undegraded":"2024-05-20T17:33:20.058382+0000","last_fullsized":"2024-05-20T17:33:20.058382+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:25.383889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787095+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:33:19.787095+0000","last_peered":"2024-05-20T17:33:19.787095+0000","last_clean":"2024-05-20T17:33:19.787095+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:33:19.787095+0000","last_undegraded":"2024-05-20T17:33:19.787095+0000","last_fullsized":"2024-05-20T17:33:19.787095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:12:10.454896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.013045+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:33:20.013045+0000","last_peered":"2024-05-20T17:33:20.013045+0000","last_clean":"2024-05-20T17:33:20.013045+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:33:20.013045+0000","last_undegraded":"2024-05-20T17:33:20.013045+0000","last_fullsized":"2024-05-20T17:33:20.013045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786737+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:33:19.786737+0000","last_peered":"2024-05-20T17:33:19.786737+0000","last_clean":"2024-05-20T17:33:19.786737+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:33:19.786737+0000","last_undegraded":"2024-05-20T17:33:19.786737+0000","last_fullsized":"2024-05-20T17:33:19.786737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:06.119241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020281+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:33:20.020281+0000","last_peered":"2024-05-20T17:33:20.020281+0000","last_clean":"2024-05-20T17:33:20.020281+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:33:20.020281+0000","last_undegraded":"2024-05-20T17:33:20.020281+0000","last_fullsized":"2024-05-20T17:33:20.020281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787347+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:33:19.787347+0000","last_peered":"2024-05-20T17:33:19.787347+0000","last_clean":"2024-05-20T17:33:19.787347+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:33:19.787347+0000","last_undegraded":"2024-05-20T17:33:19.787347+0000","last_fullsized":"2024-05-20T17:33:19.787347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:49.546477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786754+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:33:19.786754+0000","last_peered":"2024-05-20T17:33:19.786754+0000","last_clean":"2024-05-20T17:33:19.786754+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:33:19.786754+0000","last_undegraded":"2024-05-20T17:33:19.786754+0000","last_fullsized":"2024-05-20T17:33:19.786754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063416+0000","last_change":"2024-05-20T17:32:07.736717+0000","last_active":"2024-05-20T17:33:20.063416+0000","last_peered":"2024-05-20T17:33:20.063416+0000","last_clean":"2024-05-20T17:33:20.063416+0000","last_became_active":"2024-05-20T17:32:07.736321+0000","last_became_peered":"2024-05-20T17:32:07.736321+0000","last_unstale":"2024-05-20T17:33:20.063416+0000","last_undegraded":"2024-05-20T17:33:20.063416+0000","last_fullsized":"2024-05-20T17:33:20.063416+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:59:32.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063299+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:33:20.063299+0000","last_peered":"2024-05-20T17:33:20.063299+0000","last_clean":"2024-05-20T17:33:20.063299+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:33:20.063299+0000","last_undegraded":"2024-05-20T17:33:20.063299+0000","last_fullsized":"2024-05-20T17:33:20.063299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059508+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:33:20.059508+0000","last_peered":"2024-05-20T17:33:20.059508+0000","last_clean":"2024-05-20T17:33:20.059508+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:33:20.059508+0000","last_undegraded":"2024-05-20T17:33:20.059508+0000","last_fullsized":"2024-05-20T17:33:20.059508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019860+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:33:20.019860+0000","last_peered":"2024-05-20T17:33:20.019860+0000","last_clean":"2024-05-20T17:33:20.019860+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:33:20.019860+0000","last_undegraded":"2024-05-20T17:33:20.019860+0000","last_fullsized":"2024-05-20T17:33:20.019860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786892+0000","last_change":"2024-05-20T17:32:07.735868+0000","last_active":"2024-05-20T17:33:19.786892+0000","last_peered":"2024-05-20T17:33:19.786892+0000","last_clean":"2024-05-20T17:33:19.786892+0000","last_became_active":"2024-05-20T17:32:07.735314+0000","last_became_peered":"2024-05-20T17:32:07.735314+0000","last_unstale":"2024-05-20T17:33:19.786892+0000","last_undegraded":"2024-05-20T17:33:19.786892+0000","last_fullsized":"2024-05-20T17:33:19.786892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:33:52.756227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063716+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:33:20.063716+0000","last_peered":"2024-05-20T17:33:20.063716+0000","last_clean":"2024-05-20T17:33:20.063716+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:33:20.063716+0000","last_undegraded":"2024-05-20T17:33:20.063716+0000","last_fullsized":"2024-05-20T17:33:20.063716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886886+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:33:19.886886+0000","last_peered":"2024-05-20T17:33:19.886886+0000","last_clean":"2024-05-20T17:33:19.886886+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:33:19.886886+0000","last_undegraded":"2024-05-20T17:33:19.886886+0000","last_fullsized":"2024-05-20T17:33:19.886886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893335+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:33:19.893335+0000","last_peered":"2024-05-20T17:33:19.893335+0000","last_clean":"2024-05-20T17:33:19.893335+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:33:19.893335+0000","last_undegraded":"2024-05-20T17:33:19.893335+0000","last_fullsized":"2024-05-20T17:33:19.893335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886282+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:33:19.886282+0000","last_peered":"2024-05-20T17:33:19.886282+0000","last_clean":"2024-05-20T17:33:19.886282+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:33:19.886282+0000","last_undegraded":"2024-05-20T17:33:19.886282+0000","last_fullsized":"2024-05-20T17:33:19.886282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063613+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:33:20.063613+0000","last_peered":"2024-05-20T17:33:20.063613+0000","last_clean":"2024-05-20T17:33:20.063613+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:33:20.063613+0000","last_undegraded":"2024-05-20T17:33:20.063613+0000","last_fullsized":"2024-05-20T17:33:20.063613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019549+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:33:20.019549+0000","last_peered":"2024-05-20T17:33:20.019549+0000","last_clean":"2024-05-20T17:33:20.019549+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:33:20.019549+0000","last_undegraded":"2024-05-20T17:33:20.019549+0000","last_fullsized":"2024-05-20T17:33:20.019549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786579+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:33:19.786579+0000","last_peered":"2024-05-20T17:33:19.786579+0000","last_clean":"2024-05-20T17:33:19.786579+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:33:19.786579+0000","last_undegraded":"2024-05-20T17:33:19.786579+0000","last_fullsized":"2024-05-20T17:33:19.786579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107100,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":598812,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":853,"num_read_kb":538,"num_write":287,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2177,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1796436,"data_compressed":81528,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":465954,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1110016,"data_stored":1124361,"data_compressed":46295,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":999424,"data_stored":858941,"data_compressed":27867,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":793208,"data_compressed":24626,"data_compressed_allocated":32768,"data_compressed_original":352256,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1059113,"data_compressed":44421,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495680,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464997,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":534484,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":457283,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":532694,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":990007,"data_compressed":34023,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":966656,"data_stored":467330,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":1189665,"data_compressed":50577,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69694,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67904,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134390,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8030,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:33:21.788 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-20T17:33:21.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:33:21.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- 172.21.15.135:0/1066909187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054102bb0 msgr2=0x7f7054102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 --2- 172.21.15.135:0/1066909187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054102bb0 0x7f7054102fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7044009860 tx=0x7f704402a340 comp rx=0 tx=0).stop 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- 172.21.15.135:0/1066909187 shutdown_connections 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 --2- 172.21.15.135:0/1066909187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541078b0 0x7f7054109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 --2- 172.21.15.135:0/1066909187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054102bb0 0x7f7054102fc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 --2- 172.21.15.135:0/1066909187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7054101970 0x7f7054102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- 172.21.15.135:0/1066909187 >> 172.21.15.135:0/1066909187 conn(0x7f70540fcb80 msgr2=0x7f70540ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- 172.21.15.135:0/1066909187 shutdown_connections 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- 172.21.15.135:0/1066909187 wait complete. 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 Processor -- start 2024-05-20T17:33:21.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.955+0000 7f705c0e9640 1 -- start start 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7054102bb0 0x7f705419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f705410d5c0 con 0x7f7054102bb0 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f705410d440 con 0x7f70541078b0 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705c0e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f705410d740 con 0x7f7054101970 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f7059e85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f7059684640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7054102bb0 0x7f705419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57746/0 (socket says 172.21.15.135:57746) 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f7059e85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:34882/0 (socket says 172.21.15.135:34882) 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 -- 172.21.15.135:0/4099142765 learned_addr learned my addr 172.21.15.135:0/4099142765 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 -- 172.21.15.135:0/4099142765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 msgr2=0x7f70540698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 -- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7054102bb0 msgr2=0x7f705419e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7054102bb0 0x7f705419e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 -- 172.21.15.135:0/4099142765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70541a0db0 con 0x7f70541078b0 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f7059e85640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.956+0000 7f705a686640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f704c009fd0 tx=0x7f704c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.957+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c004b20 con 0x7f70541078b0 2024-05-20T17:33:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.957+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f704c003e50 con 0x7f70541078b0 2024-05-20T17:33:21.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.957+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70541a10a0 con 0x7f70541078b0 2024-05-20T17:33:21.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.957+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c00b630 con 0x7f70541078b0 2024-05-20T17:33:21.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.957+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541a15a0 con 0x7f70541078b0 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.958+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70541066c0 con 0x7f70541078b0 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.959+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f704c01d020 con 0x7f70541078b0 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.960+0000 7f704affd640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 0x7f70400a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.960+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f704c0ced90 con 0x7f70541078b0 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.960+0000 7f7059e85640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 0x7f70400a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:21.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.960+0000 7f7059e85640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 0x7f70400a4ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7054102570 tx=0x7f705000b390 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:21.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.965+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f704c09be80 con 0x7f70541078b0 2024-05-20T17:33:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:21.992+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f704c097df0 con 0x7f70541078b0 2024-05-20T17:33:22.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.171+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7054061f90 con 0x7f70400a2990 2024-05-20T17:33:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.185+0000 7f704affd640 1 -- 172.21.15.135:0/4099142765 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258051 (secure 0 0 0) 0x7f7054061f90 con 0x7f70400a2990 2024-05-20T17:33:22.190 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-20T17:33:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 msgr2=0x7f70400a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 0x7f70400a4ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7054102570 tx=0x7f705000b390 comp rx=0 tx=0).stop 2024-05-20T17:33:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 msgr2=0x7f70541a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f704c009fd0 tx=0x7f704c00c800 comp rx=0 tx=0).stop 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 shutdown_connections 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f70400a2990 0x7f70400a4ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70541078b0 0x7f70541a0590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7054102bb0 0x7f705419e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 --2- 172.21.15.135:0/4099142765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054101970 0x7f70540698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 >> 172.21.15.135:0/4099142765 conn(0x7f70540fcb80 msgr2=0x7f7054103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 shutdown_connections 2024-05-20T17:33:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.189+0000 7f705c0e9640 1 -- 172.21.15.135:0/4099142765 wait complete. 2024-05-20T17:33:22.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: [20/May/2024:17:33:20] ENGINE Serving on https://172.21.15.135:7150 2024-05-20T17:33:22.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: [20/May/2024:17:33:20] ENGINE Bus STARTED 2024-05-20T17:33:22.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:22.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3053770508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:22.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:22.202 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.202 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.202 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.202 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:21 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.203 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-05-20T17:33:21.801653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189414,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":989,"num_read_kb":657,"num_write":470,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1183030,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348528,"kb_used_data":11820,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593296,"statfs":{"total":1151940427776,"available":1151583535104,"internally_reserved":0,"allocated":12103680,"data_stored":8938037,"data_compressed":280967,"data_compressed_allocated":376832,"data_compressed_original":3440640,"omap_allocated":19142,"internal_metadata":344634682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991058"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787061+0000","last_change":"2024-05-20T17:31:14.799586+0000","last_active":"2024-05-20T17:33:19.787061+0000","last_peered":"2024-05-20T17:33:19.787061+0000","last_clean":"2024-05-20T17:33:19.787061+0000","last_became_active":"2024-05-20T17:31:14.798845+0000","last_became_peered":"2024-05-20T17:31:14.798845+0000","last_unstale":"2024-05-20T17:33:19.787061+0000","last_undegraded":"2024-05-20T17:33:19.787061+0000","last_fullsized":"2024-05-20T17:33:19.787061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:35.232083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059694+0000","last_change":"2024-05-20T17:31:14.798167+0000","last_active":"2024-05-20T17:33:20.059694+0000","last_peered":"2024-05-20T17:33:20.059694+0000","last_clean":"2024-05-20T17:33:20.059694+0000","last_became_active":"2024-05-20T17:31:14.797740+0000","last_became_peered":"2024-05-20T17:31:14.797740+0000","last_unstale":"2024-05-20T17:33:20.059694+0000","last_undegraded":"2024-05-20T17:33:20.059694+0000","last_fullsized":"2024-05-20T17:33:20.059694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:51.287157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059569+0000","last_change":"2024-05-20T17:31:14.805671+0000","last_active":"2024-05-20T17:33:20.059569+0000","last_peered":"2024-05-20T17:33:20.059569+0000","last_clean":"2024-05-20T17:33:20.059569+0000","last_became_active":"2024-05-20T17:31:14.803092+0000","last_became_peered":"2024-05-20T17:31:14.803092+0000","last_unstale":"2024-05-20T17:33:20.059569+0000","last_undegraded":"2024-05-20T17:33:20.059569+0000","last_fullsized":"2024-05-20T17:33:20.059569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.817993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058589+0000","last_change":"2024-05-20T17:31:14.800472+0000","last_active":"2024-05-20T17:33:20.058589+0000","last_peered":"2024-05-20T17:33:20.058589+0000","last_clean":"2024-05-20T17:33:20.058589+0000","last_became_active":"2024-05-20T17:31:14.800089+0000","last_became_peered":"2024-05-20T17:31:14.800089+0000","last_unstale":"2024-05-20T17:33:20.058589+0000","last_undegraded":"2024-05-20T17:33:20.058589+0000","last_fullsized":"2024-05-20T17:33:20.058589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:20.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886316+0000","last_change":"2024-05-20T17:31:14.791849+0000","last_active":"2024-05-20T17:33:19.886316+0000","last_peered":"2024-05-20T17:33:19.886316+0000","last_clean":"2024-05-20T17:33:19.886316+0000","last_became_active":"2024-05-20T17:31:14.791434+0000","last_became_peered":"2024-05-20T17:31:14.791434+0000","last_unstale":"2024-05-20T17:33:19.886316+0000","last_undegraded":"2024-05-20T17:33:19.886316+0000","last_fullsized":"2024-05-20T17:33:19.886316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:42.560376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:14.797107+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:14.796719+0000","last_became_peered":"2024-05-20T17:31:14.796719+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:33.269943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786447+0000","last_change":"2024-05-20T17:31:14.790189+0000","last_active":"2024-05-20T17:33:19.786447+0000","last_peered":"2024-05-20T17:33:19.786447+0000","last_clean":"2024-05-20T17:33:19.786447+0000","last_became_active":"2024-05-20T17:31:14.789819+0000","last_became_peered":"2024-05-20T17:31:14.789819+0000","last_unstale":"2024-05-20T17:33:19.786447+0000","last_undegraded":"2024-05-20T17:33:19.786447+0000","last_fullsized":"2024-05-20T17:33:19.786447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:04.966944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886133+0000","last_change":"2024-05-20T17:31:14.796711+0000","last_active":"2024-05-20T17:33:19.886133+0000","last_peered":"2024-05-20T17:33:19.886133+0000","last_clean":"2024-05-20T17:33:19.886133+0000","last_became_active":"2024-05-20T17:31:14.796356+0000","last_became_peered":"2024-05-20T17:31:14.796356+0000","last_unstale":"2024-05-20T17:33:19.886133+0000","last_undegraded":"2024-05-20T17:33:19.886133+0000","last_fullsized":"2024-05-20T17:33:19.886133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.286568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.064066+0000","last_change":"2024-05-20T17:31:14.797623+0000","last_active":"2024-05-20T17:33:20.064066+0000","last_peered":"2024-05-20T17:33:20.064066+0000","last_clean":"2024-05-20T17:33:20.064066+0000","last_became_active":"2024-05-20T17:31:14.797270+0000","last_became_peered":"2024-05-20T17:31:14.797270+0000","last_unstale":"2024-05-20T17:33:20.064066+0000","last_undegraded":"2024-05-20T17:33:20.064066+0000","last_fullsized":"2024-05-20T17:33:20.064066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:24:34.227815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896714+0000","last_change":"2024-05-20T17:31:14.802584+0000","last_active":"2024-05-20T17:33:19.896714+0000","last_peered":"2024-05-20T17:33:19.896714+0000","last_clean":"2024-05-20T17:33:19.896714+0000","last_became_active":"2024-05-20T17:31:14.802227+0000","last_became_peered":"2024-05-20T17:31:14.802227+0000","last_unstale":"2024-05-20T17:33:19.896714+0000","last_undegraded":"2024-05-20T17:33:19.896714+0000","last_fullsized":"2024-05-20T17:33:19.896714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:19:25.799491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786867+0000","last_change":"2024-05-20T17:31:14.797689+0000","last_active":"2024-05-20T17:33:19.786867+0000","last_peered":"2024-05-20T17:33:19.786867+0000","last_clean":"2024-05-20T17:33:19.786867+0000","last_became_active":"2024-05-20T17:31:14.797213+0000","last_became_peered":"2024-05-20T17:31:14.797213+0000","last_unstale":"2024-05-20T17:33:19.786867+0000","last_undegraded":"2024-05-20T17:33:19.786867+0000","last_fullsized":"2024-05-20T17:33:19.786867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:16.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058372+0000","last_change":"2024-05-20T17:31:14.793089+0000","last_active":"2024-05-20T17:33:20.058372+0000","last_peered":"2024-05-20T17:33:20.058372+0000","last_clean":"2024-05-20T17:33:20.058372+0000","last_became_active":"2024-05-20T17:31:14.792464+0000","last_became_peered":"2024-05-20T17:31:14.792464+0000","last_unstale":"2024-05-20T17:33:20.058372+0000","last_undegraded":"2024-05-20T17:33:20.058372+0000","last_fullsized":"2024-05-20T17:33:20.058372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:51:52.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019386+0000","last_change":"2024-05-20T17:31:14.798328+0000","last_active":"2024-05-20T17:33:20.019386+0000","last_peered":"2024-05-20T17:33:20.019386+0000","last_clean":"2024-05-20T17:33:20.019386+0000","last_became_active":"2024-05-20T17:31:14.797929+0000","last_became_peered":"2024-05-20T17:31:14.797929+0000","last_unstale":"2024-05-20T17:33:20.019386+0000","last_undegraded":"2024-05-20T17:33:20.019386+0000","last_fullsized":"2024-05-20T17:33:20.019386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:02:18.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059296+0000","last_change":"2024-05-20T17:31:14.798975+0000","last_active":"2024-05-20T17:33:20.059296+0000","last_peered":"2024-05-20T17:33:20.059296+0000","last_clean":"2024-05-20T17:33:20.059296+0000","last_became_active":"2024-05-20T17:31:14.798491+0000","last_became_peered":"2024-05-20T17:31:14.798491+0000","last_unstale":"2024-05-20T17:33:20.059296+0000","last_undegraded":"2024-05-20T17:33:20.059296+0000","last_fullsized":"2024-05-20T17:33:20.059296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:10.846827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059133+0000","last_change":"2024-05-20T17:31:14.805023+0000","last_active":"2024-05-20T17:33:20.059133+0000","last_peered":"2024-05-20T17:33:20.059133+0000","last_clean":"2024-05-20T17:33:20.059133+0000","last_became_active":"2024-05-20T17:31:14.802122+0000","last_became_peered":"2024-05-20T17:31:14.802122+0000","last_unstale":"2024-05-20T17:33:20.059133+0000","last_undegraded":"2024-05-20T17:33:20.059133+0000","last_fullsized":"2024-05-20T17:33:20.059133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:39.988089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063580+0000","last_change":"2024-05-20T17:31:14.811209+0000","last_active":"2024-05-20T17:33:20.063580+0000","last_peered":"2024-05-20T17:33:20.063580+0000","last_clean":"2024-05-20T17:33:20.063580+0000","last_became_active":"2024-05-20T17:31:14.810845+0000","last_became_peered":"2024-05-20T17:31:14.810845+0000","last_unstale":"2024-05-20T17:33:20.063580+0000","last_undegraded":"2024-05-20T17:33:20.063580+0000","last_fullsized":"2024-05-20T17:33:20.063580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:12:33.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786719+0000","last_change":"2024-05-20T17:31:14.799854+0000","last_active":"2024-05-20T17:33:19.786719+0000","last_peered":"2024-05-20T17:33:19.786719+0000","last_clean":"2024-05-20T17:33:19.786719+0000","last_became_active":"2024-05-20T17:31:14.798916+0000","last_became_peered":"2024-05-20T17:31:14.798916+0000","last_unstale":"2024-05-20T17:33:19.786719+0000","last_undegraded":"2024-05-20T17:33:19.786719+0000","last_fullsized":"2024-05-20T17:33:19.786719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:00.784504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787901+0000","last_change":"2024-05-20T17:31:14.796276+0000","last_active":"2024-05-20T17:33:19.787901+0000","last_peered":"2024-05-20T17:33:19.787901+0000","last_clean":"2024-05-20T17:33:19.787901+0000","last_became_active":"2024-05-20T17:31:14.795930+0000","last_became_peered":"2024-05-20T17:31:14.795930+0000","last_unstale":"2024-05-20T17:33:19.787901+0000","last_undegraded":"2024-05-20T17:33:19.787901+0000","last_fullsized":"2024-05-20T17:33:19.787901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:18.046348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063600+0000","last_change":"2024-05-20T17:31:14.797167+0000","last_active":"2024-05-20T17:33:20.063600+0000","last_peered":"2024-05-20T17:33:20.063600+0000","last_clean":"2024-05-20T17:33:20.063600+0000","last_became_active":"2024-05-20T17:31:14.796623+0000","last_became_peered":"2024-05-20T17:31:14.796623+0000","last_unstale":"2024-05-20T17:33:20.063600+0000","last_undegraded":"2024-05-20T17:33:20.063600+0000","last_fullsized":"2024-05-20T17:33:20.063600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:43:41.639043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787970+0000","last_change":"2024-05-20T17:32:07.744385+0000","last_active":"2024-05-20T17:33:19.787970+0000","last_peered":"2024-05-20T17:33:19.787970+0000","last_clean":"2024-05-20T17:33:19.787970+0000","last_became_active":"2024-05-20T17:32:07.734114+0000","last_became_peered":"2024-05-20T17:32:07.734114+0000","last_unstale":"2024-05-20T17:33:19.787970+0000","last_undegraded":"2024-05-20T17:33:19.787970+0000","last_fullsized":"2024-05-20T17:33:19.787970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:57.865089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887241+0000","last_change":"2024-05-20T17:31:14.802673+0000","last_active":"2024-05-20T17:33:19.887241+0000","last_peered":"2024-05-20T17:33:19.887241+0000","last_clean":"2024-05-20T17:33:19.887241+0000","last_became_active":"2024-05-20T17:31:14.801845+0000","last_became_peered":"2024-05-20T17:31:14.801845+0000","last_unstale":"2024-05-20T17:33:19.887241+0000","last_undegraded":"2024-05-20T17:33:19.887241+0000","last_fullsized":"2024-05-20T17:33:19.887241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:36.115798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887442+0000","last_change":"2024-05-20T17:31:13.794544+0000","last_active":"2024-05-20T17:33:19.887442+0000","last_peered":"2024-05-20T17:33:19.887442+0000","last_clean":"2024-05-20T17:33:19.887442+0000","last_became_active":"2024-05-20T17:31:13.794231+0000","last_became_peered":"2024-05-20T17:31:13.794231+0000","last_unstale":"2024-05-20T17:33:19.887442+0000","last_undegraded":"2024-05-20T17:33:19.887442+0000","last_fullsized":"2024-05-20T17:33:19.887442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:55.759085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059790+0000","last_change":"2024-05-20T17:31:14.804618+0000","last_active":"2024-05-20T17:33:20.059790+0000","last_peered":"2024-05-20T17:33:20.059790+0000","last_clean":"2024-05-20T17:33:20.059790+0000","last_became_active":"2024-05-20T17:31:14.800278+0000","last_became_peered":"2024-05-20T17:31:14.800278+0000","last_unstale":"2024-05-20T17:33:20.059790+0000","last_undegraded":"2024-05-20T17:33:20.059790+0000","last_fullsized":"2024-05-20T17:33:20.059790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:01.413998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786890+0000","last_change":"2024-05-20T17:32:07.741590+0000","last_active":"2024-05-20T17:33:19.786890+0000","last_peered":"2024-05-20T17:33:19.786890+0000","last_clean":"2024-05-20T17:33:19.786890+0000","last_became_active":"2024-05-20T17:32:07.736058+0000","last_became_peered":"2024-05-20T17:32:07.736058+0000","last_unstale":"2024-05-20T17:33:19.786890+0000","last_undegraded":"2024-05-20T17:33:19.786890+0000","last_fullsized":"2024-05-20T17:33:19.786890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:22:11.041568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063629+0000","last_change":"2024-05-20T17:31:14.800603+0000","last_active":"2024-05-20T17:33:20.063629+0000","last_peered":"2024-05-20T17:33:20.063629+0000","last_clean":"2024-05-20T17:33:20.063629+0000","last_became_active":"2024-05-20T17:31:14.800225+0000","last_became_peered":"2024-05-20T17:31:14.800225+0000","last_unstale":"2024-05-20T17:33:20.063629+0000","last_undegraded":"2024-05-20T17:33:20.063629+0000","last_fullsized":"2024-05-20T17:33:20.063629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:06:54.776675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886565+0000","last_change":"2024-05-20T17:31:13.791388+0000","last_active":"2024-05-20T17:33:19.886565+0000","last_peered":"2024-05-20T17:33:19.886565+0000","last_clean":"2024-05-20T17:33:19.886565+0000","last_became_active":"2024-05-20T17:31:13.790962+0000","last_became_peered":"2024-05-20T17:31:13.790962+0000","last_unstale":"2024-05-20T17:33:19.886565+0000","last_undegraded":"2024-05-20T17:33:19.886565+0000","last_fullsized":"2024-05-20T17:33:19.886565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:23.587279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893453+0000","last_change":"2024-05-20T17:32:07.908641+0000","last_active":"2024-05-20T17:33:19.893453+0000","last_peered":"2024-05-20T17:33:19.893453+0000","last_clean":"2024-05-20T17:33:19.893453+0000","last_became_active":"2024-05-20T17:32:07.908317+0000","last_became_peered":"2024-05-20T17:32:07.908317+0000","last_unstale":"2024-05-20T17:33:19.893453+0000","last_undegraded":"2024-05-20T17:33:19.893453+0000","last_fullsized":"2024-05-20T17:33:19.893453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:50:40.232683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063844+0000","last_change":"2024-05-20T17:32:07.913292+0000","last_active":"2024-05-20T17:33:20.063844+0000","last_peered":"2024-05-20T17:33:20.063844+0000","last_clean":"2024-05-20T17:33:20.063844+0000","last_became_active":"2024-05-20T17:32:07.908905+0000","last_became_peered":"2024-05-20T17:32:07.908905+0000","last_unstale":"2024-05-20T17:33:20.063844+0000","last_undegraded":"2024-05-20T17:33:20.063844+0000","last_fullsized":"2024-05-20T17:33:20.063844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:15.236246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1936,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886361+0000","last_change":"2024-05-20T17:31:14.798056+0000","last_active":"2024-05-20T17:33:19.886361+0000","last_peered":"2024-05-20T17:33:19.886361+0000","last_clean":"2024-05-20T17:33:19.886361+0000","last_became_active":"2024-05-20T17:31:14.797071+0000","last_became_peered":"2024-05-20T17:31:14.797071+0000","last_unstale":"2024-05-20T17:33:19.886361+0000","last_undegraded":"2024-05-20T17:33:19.886361+0000","last_fullsized":"2024-05-20T17:33:19.886361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:00.930437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896414+0000","last_change":"2024-05-20T17:31:13.791012+0000","last_active":"2024-05-20T17:33:19.896414+0000","last_peered":"2024-05-20T17:33:19.896414+0000","last_clean":"2024-05-20T17:33:19.896414+0000","last_became_active":"2024-05-20T17:31:13.790606+0000","last_became_peered":"2024-05-20T17:31:13.790606+0000","last_unstale":"2024-05-20T17:33:19.896414+0000","last_undegraded":"2024-05-20T17:33:19.896414+0000","last_fullsized":"2024-05-20T17:33:19.896414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:03:33.252505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893523+0000","last_change":"2024-05-20T17:31:14.784509+0000","last_active":"2024-05-20T17:33:19.893523+0000","last_peered":"2024-05-20T17:33:19.893523+0000","last_clean":"2024-05-20T17:33:19.893523+0000","last_became_active":"2024-05-20T17:31:14.784110+0000","last_became_peered":"2024-05-20T17:31:14.784110+0000","last_unstale":"2024-05-20T17:33:19.893523+0000","last_undegraded":"2024-05-20T17:33:19.893523+0000","last_fullsized":"2024-05-20T17:33:19.893523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:58:38.686311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018693+0000","last_change":"2024-05-20T17:31:13.784631+0000","last_active":"2024-05-20T17:33:20.018693+0000","last_peered":"2024-05-20T17:33:20.018693+0000","last_clean":"2024-05-20T17:33:20.018693+0000","last_became_active":"2024-05-20T17:31:13.784259+0000","last_became_peered":"2024-05-20T17:31:13.784259+0000","last_unstale":"2024-05-20T17:33:20.018693+0000","last_undegraded":"2024-05-20T17:33:20.018693+0000","last_fullsized":"2024-05-20T17:33:20.018693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:16:09.438414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886082+0000","last_change":"2024-05-20T17:31:14.792205+0000","last_active":"2024-05-20T17:33:19.886082+0000","last_peered":"2024-05-20T17:33:19.886082+0000","last_clean":"2024-05-20T17:33:19.886082+0000","last_became_active":"2024-05-20T17:31:14.791790+0000","last_became_peered":"2024-05-20T17:31:14.791790+0000","last_unstale":"2024-05-20T17:33:19.886082+0000","last_undegraded":"2024-05-20T17:33:19.886082+0000","last_fullsized":"2024-05-20T17:33:19.886082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:55.228776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893303+0000","last_change":"2024-05-20T17:31:13.794612+0000","last_active":"2024-05-20T17:33:19.893303+0000","last_peered":"2024-05-20T17:33:19.893303+0000","last_clean":"2024-05-20T17:33:19.893303+0000","last_became_active":"2024-05-20T17:31:13.793990+0000","last_became_peered":"2024-05-20T17:31:13.793990+0000","last_unstale":"2024-05-20T17:33:19.893303+0000","last_undegraded":"2024-05-20T17:33:19.893303+0000","last_fullsized":"2024-05-20T17:33:19.893303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:46.652617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787701+0000","last_change":"2024-05-20T17:31:14.792141+0000","last_active":"2024-05-20T17:33:19.787701+0000","last_peered":"2024-05-20T17:33:19.787701+0000","last_clean":"2024-05-20T17:33:19.787701+0000","last_became_active":"2024-05-20T17:31:14.791699+0000","last_became_peered":"2024-05-20T17:31:14.791699+0000","last_unstale":"2024-05-20T17:33:19.787701+0000","last_undegraded":"2024-05-20T17:33:19.787701+0000","last_fullsized":"2024-05-20T17:33:19.787701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:48:35.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.021195+0000","last_change":"2024-05-20T17:31:13.795471+0000","last_active":"2024-05-20T17:33:20.021195+0000","last_peered":"2024-05-20T17:33:20.021195+0000","last_clean":"2024-05-20T17:33:20.021195+0000","last_became_active":"2024-05-20T17:31:13.795050+0000","last_became_peered":"2024-05-20T17:31:13.795050+0000","last_unstale":"2024-05-20T17:33:20.021195+0000","last_undegraded":"2024-05-20T17:33:20.021195+0000","last_fullsized":"2024-05-20T17:33:20.021195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:05.968257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063912+0000","last_change":"2024-05-20T17:31:14.805159+0000","last_active":"2024-05-20T17:33:20.063912+0000","last_peered":"2024-05-20T17:33:20.063912+0000","last_clean":"2024-05-20T17:33:20.063912+0000","last_became_active":"2024-05-20T17:31:14.801394+0000","last_became_peered":"2024-05-20T17:31:14.801394+0000","last_unstale":"2024-05-20T17:33:20.063912+0000","last_undegraded":"2024-05-20T17:33:20.063912+0000","last_fullsized":"2024-05-20T17:33:20.063912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:33.118686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787108+0000","last_change":"2024-05-20T17:31:13.792247+0000","last_active":"2024-05-20T17:33:19.787108+0000","last_peered":"2024-05-20T17:33:19.787108+0000","last_clean":"2024-05-20T17:33:19.787108+0000","last_became_active":"2024-05-20T17:31:13.791784+0000","last_became_peered":"2024-05-20T17:31:13.791784+0000","last_unstale":"2024-05-20T17:33:19.787108+0000","last_undegraded":"2024-05-20T17:33:19.787108+0000","last_fullsized":"2024-05-20T17:33:19.787108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:58.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059931+0000","last_change":"2024-05-20T17:32:07.735120+0000","last_active":"2024-05-20T17:33:20.059931+0000","last_peered":"2024-05-20T17:33:20.059931+0000","last_clean":"2024-05-20T17:33:20.059931+0000","last_became_active":"2024-05-20T17:32:07.734652+0000","last_became_peered":"2024-05-20T17:32:07.734652+0000","last_unstale":"2024-05-20T17:33:20.059931+0000","last_undegraded":"2024-05-20T17:33:20.059931+0000","last_fullsized":"2024-05-20T17:33:20.059931+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:28.611313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893568+0000","last_change":"2024-05-20T17:31:13.790699+0000","last_active":"2024-05-20T17:33:19.893568+0000","last_peered":"2024-05-20T17:33:19.893568+0000","last_clean":"2024-05-20T17:33:19.893568+0000","last_became_active":"2024-05-20T17:31:13.790324+0000","last_became_peered":"2024-05-20T17:31:13.790324+0000","last_unstale":"2024-05-20T17:33:19.893568+0000","last_undegraded":"2024-05-20T17:33:19.893568+0000","last_fullsized":"2024-05-20T17:33:19.893568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:48.884748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063767+0000","last_change":"2024-05-20T17:31:14.791558+0000","last_active":"2024-05-20T17:33:20.063767+0000","last_peered":"2024-05-20T17:33:20.063767+0000","last_clean":"2024-05-20T17:33:20.063767+0000","last_became_active":"2024-05-20T17:31:14.791134+0000","last_became_peered":"2024-05-20T17:31:14.791134+0000","last_unstale":"2024-05-20T17:33:20.063767+0000","last_undegraded":"2024-05-20T17:33:20.063767+0000","last_fullsized":"2024-05-20T17:33:20.063767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:18:42.255722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":311,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063119+0000","last_change":"2024-05-20T17:31:13.788677+0000","last_active":"2024-05-20T17:33:20.063119+0000","last_peered":"2024-05-20T17:33:20.063119+0000","last_clean":"2024-05-20T17:33:20.063119+0000","last_became_active":"2024-05-20T17:31:13.788175+0000","last_became_peered":"2024-05-20T17:31:13.788175+0000","last_unstale":"2024-05-20T17:33:20.063119+0000","last_undegraded":"2024-05-20T17:33:20.063119+0000","last_fullsized":"2024-05-20T17:33:20.063119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:31:43.429163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":192,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886472+0000","last_change":"2024-05-20T17:31:14.800920+0000","last_active":"2024-05-20T17:33:19.886472+0000","last_peered":"2024-05-20T17:33:19.886472+0000","last_clean":"2024-05-20T17:33:19.886472+0000","last_became_active":"2024-05-20T17:31:14.800583+0000","last_became_peered":"2024-05-20T17:31:14.800583+0000","last_unstale":"2024-05-20T17:33:19.886472+0000","last_undegraded":"2024-05-20T17:33:19.886472+0000","last_fullsized":"2024-05-20T17:33:19.886472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:10.914985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063337+0000","last_change":"2024-05-20T17:31:13.786145+0000","last_active":"2024-05-20T17:33:20.063337+0000","last_peered":"2024-05-20T17:33:20.063337+0000","last_clean":"2024-05-20T17:33:20.063337+0000","last_became_active":"2024-05-20T17:31:13.785749+0000","last_became_peered":"2024-05-20T17:31:13.785749+0000","last_unstale":"2024-05-20T17:33:20.063337+0000","last_undegraded":"2024-05-20T17:33:20.063337+0000","last_fullsized":"2024-05-20T17:33:20.063337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:23:32.019788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018896+0000","last_change":"2024-05-20T17:31:14.807933+0000","last_active":"2024-05-20T17:33:20.018896+0000","last_peered":"2024-05-20T17:33:20.018896+0000","last_clean":"2024-05-20T17:33:20.018896+0000","last_became_active":"2024-05-20T17:31:14.807501+0000","last_became_peered":"2024-05-20T17:31:14.807501+0000","last_unstale":"2024-05-20T17:33:20.018896+0000","last_undegraded":"2024-05-20T17:33:20.018896+0000","last_fullsized":"2024-05-20T17:33:20.018896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:27:27.136252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893372+0000","last_change":"2024-05-20T17:31:13.795646+0000","last_active":"2024-05-20T17:33:19.893372+0000","last_peered":"2024-05-20T17:33:19.893372+0000","last_clean":"2024-05-20T17:33:19.893372+0000","last_became_active":"2024-05-20T17:31:13.795291+0000","last_became_peered":"2024-05-20T17:31:13.795291+0000","last_unstale":"2024-05-20T17:33:19.893372+0000","last_undegraded":"2024-05-20T17:33:19.893372+0000","last_fullsized":"2024-05-20T17:33:19.893372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:17:01.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786838+0000","last_change":"2024-05-20T17:31:14.802625+0000","last_active":"2024-05-20T17:33:19.786838+0000","last_peered":"2024-05-20T17:33:19.786838+0000","last_clean":"2024-05-20T17:33:19.786838+0000","last_became_active":"2024-05-20T17:31:14.802173+0000","last_became_peered":"2024-05-20T17:31:14.802173+0000","last_unstale":"2024-05-20T17:33:19.786838+0000","last_undegraded":"2024-05-20T17:33:19.786838+0000","last_fullsized":"2024-05-20T17:33:19.786838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:28:49.912347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":156,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.246275+0000","last_change":"2024-05-20T17:31:13.791568+0000","last_active":"2024-05-20T17:33:20.246275+0000","last_peered":"2024-05-20T17:33:20.246275+0000","last_clean":"2024-05-20T17:33:20.246275+0000","last_became_active":"2024-05-20T17:31:13.791186+0000","last_became_peered":"2024-05-20T17:31:13.791186+0000","last_unstale":"2024-05-20T17:33:20.246275+0000","last_undegraded":"2024-05-20T17:33:20.246275+0000","last_fullsized":"2024-05-20T17:33:20.246275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:40.833123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786425+0000","last_change":"2024-05-20T17:31:14.792842+0000","last_active":"2024-05-20T17:33:19.786425+0000","last_peered":"2024-05-20T17:33:19.786425+0000","last_clean":"2024-05-20T17:33:19.786425+0000","last_became_active":"2024-05-20T17:31:14.792454+0000","last_became_peered":"2024-05-20T17:31:14.792454+0000","last_unstale":"2024-05-20T17:33:19.786425+0000","last_undegraded":"2024-05-20T17:33:19.786425+0000","last_fullsized":"2024-05-20T17:33:19.786425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:42:44.041243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886227+0000","last_change":"2024-05-20T17:31:13.796515+0000","last_active":"2024-05-20T17:33:19.886227+0000","last_peered":"2024-05-20T17:33:19.886227+0000","last_clean":"2024-05-20T17:33:19.886227+0000","last_became_active":"2024-05-20T17:31:13.796116+0000","last_became_peered":"2024-05-20T17:31:13.796116+0000","last_unstale":"2024-05-20T17:33:19.886227+0000","last_undegraded":"2024-05-20T17:33:19.886227+0000","last_fullsized":"2024-05-20T17:33:19.886227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:10:12.807647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893248+0000","last_change":"2024-05-20T17:31:14.794703+0000","last_active":"2024-05-20T17:33:19.893248+0000","last_peered":"2024-05-20T17:33:19.893248+0000","last_clean":"2024-05-20T17:33:19.893248+0000","last_became_active":"2024-05-20T17:31:14.793860+0000","last_became_peered":"2024-05-20T17:31:14.793860+0000","last_unstale":"2024-05-20T17:33:19.893248+0000","last_undegraded":"2024-05-20T17:33:19.893248+0000","last_fullsized":"2024-05-20T17:33:19.893248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:12.871244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886577+0000","last_change":"2024-05-20T17:31:13.789725+0000","last_active":"2024-05-20T17:33:19.886577+0000","last_peered":"2024-05-20T17:33:19.886577+0000","last_clean":"2024-05-20T17:33:19.886577+0000","last_became_active":"2024-05-20T17:31:13.789312+0000","last_became_peered":"2024-05-20T17:31:13.789312+0000","last_unstale":"2024-05-20T17:33:19.886577+0000","last_undegraded":"2024-05-20T17:33:19.886577+0000","last_fullsized":"2024-05-20T17:33:19.886577+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:18.763343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786760+0000","last_change":"2024-05-20T17:32:07.733408+0000","last_active":"2024-05-20T17:33:19.786760+0000","last_peered":"2024-05-20T17:33:19.786760+0000","last_clean":"2024-05-20T17:33:19.786760+0000","last_became_active":"2024-05-20T17:32:07.732989+0000","last_became_peered":"2024-05-20T17:32:07.732989+0000","last_unstale":"2024-05-20T17:33:19.786760+0000","last_undegraded":"2024-05-20T17:33:19.786760+0000","last_fullsized":"2024-05-20T17:33:19.786760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:48.103948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787799+0000","last_change":"2024-05-20T17:31:13.793967+0000","last_active":"2024-05-20T17:33:19.787799+0000","last_peered":"2024-05-20T17:33:19.787799+0000","last_clean":"2024-05-20T17:33:19.787799+0000","last_became_active":"2024-05-20T17:31:13.793599+0000","last_became_peered":"2024-05-20T17:31:13.793599+0000","last_unstale":"2024-05-20T17:33:19.787799+0000","last_undegraded":"2024-05-20T17:33:19.787799+0000","last_fullsized":"2024-05-20T17:33:19.787799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:19.269434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896692+0000","last_change":"2024-05-20T17:32:07.738327+0000","last_active":"2024-05-20T17:33:19.896692+0000","last_peered":"2024-05-20T17:33:19.896692+0000","last_clean":"2024-05-20T17:33:19.896692+0000","last_became_active":"2024-05-20T17:32:07.734897+0000","last_became_peered":"2024-05-20T17:32:07.734897+0000","last_unstale":"2024-05-20T17:33:19.896692+0000","last_undegraded":"2024-05-20T17:33:19.896692+0000","last_fullsized":"2024-05-20T17:33:19.896692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.308883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786701+0000","last_change":"2024-05-20T17:31:13.795050+0000","last_active":"2024-05-20T17:33:19.786701+0000","last_peered":"2024-05-20T17:33:19.786701+0000","last_clean":"2024-05-20T17:33:19.786701+0000","last_became_active":"2024-05-20T17:31:13.794580+0000","last_became_peered":"2024-05-20T17:31:13.794580+0000","last_unstale":"2024-05-20T17:33:19.786701+0000","last_undegraded":"2024-05-20T17:33:19.786701+0000","last_fullsized":"2024-05-20T17:33:19.786701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:44.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.896486+0000","last_change":"2024-05-20T17:31:14.807416+0000","last_active":"2024-05-20T17:33:19.896486+0000","last_peered":"2024-05-20T17:33:19.896486+0000","last_clean":"2024-05-20T17:33:19.896486+0000","last_became_active":"2024-05-20T17:31:14.807043+0000","last_became_peered":"2024-05-20T17:31:14.807043+0000","last_unstale":"2024-05-20T17:33:19.896486+0000","last_undegraded":"2024-05-20T17:33:19.896486+0000","last_fullsized":"2024-05-20T17:33:19.896486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:51.043558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893694+0000","last_change":"2024-05-20T17:31:14.802542+0000","last_active":"2024-05-20T17:33:19.893694+0000","last_peered":"2024-05-20T17:33:19.893694+0000","last_clean":"2024-05-20T17:33:19.893694+0000","last_became_active":"2024-05-20T17:31:14.802167+0000","last_became_peered":"2024-05-20T17:31:14.802167+0000","last_unstale":"2024-05-20T17:33:19.893694+0000","last_undegraded":"2024-05-20T17:33:19.893694+0000","last_fullsized":"2024-05-20T17:33:19.893694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:36:42.627156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.245543+0000","last_change":"2024-05-20T17:31:13.793990+0000","last_active":"2024-05-20T17:33:20.245543+0000","last_peered":"2024-05-20T17:33:20.245543+0000","last_clean":"2024-05-20T17:33:20.245543+0000","last_became_active":"2024-05-20T17:31:13.793638+0000","last_became_peered":"2024-05-20T17:31:13.793638+0000","last_unstale":"2024-05-20T17:33:20.245543+0000","last_undegraded":"2024-05-20T17:33:20.245543+0000","last_fullsized":"2024-05-20T17:33:20.245543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:13:15.654955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886718+0000","last_change":"2024-05-20T17:31:14.788137+0000","last_active":"2024-05-20T17:33:19.886718+0000","last_peered":"2024-05-20T17:33:19.886718+0000","last_clean":"2024-05-20T17:33:19.886718+0000","last_became_active":"2024-05-20T17:31:14.787752+0000","last_became_peered":"2024-05-20T17:31:14.787752+0000","last_unstale":"2024-05-20T17:33:19.886718+0000","last_undegraded":"2024-05-20T17:33:19.886718+0000","last_fullsized":"2024-05-20T17:33:19.886718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:52:15.963544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058262+0000","last_change":"2024-05-20T17:31:13.784721+0000","last_active":"2024-05-20T17:33:20.058262+0000","last_peered":"2024-05-20T17:33:20.058262+0000","last_clean":"2024-05-20T17:33:20.058262+0000","last_became_active":"2024-05-20T17:31:13.784318+0000","last_became_peered":"2024-05-20T17:31:13.784318+0000","last_unstale":"2024-05-20T17:33:20.058262+0000","last_undegraded":"2024-05-20T17:33:20.058262+0000","last_fullsized":"2024-05-20T17:33:20.058262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:16.284464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786503+0000","last_change":"2024-05-20T17:30:01.021333+0000","last_active":"2024-05-20T17:33:19.786503+0000","last_peered":"2024-05-20T17:33:19.786503+0000","last_clean":"2024-05-20T17:33:19.786503+0000","last_became_active":"2024-05-20T17:30:01.020797+0000","last_became_peered":"2024-05-20T17:30:01.020797+0000","last_unstale":"2024-05-20T17:33:19.786503+0000","last_undegraded":"2024-05-20T17:33:19.786503+0000","last_fullsized":"2024-05-20T17:33:19.786503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:26:33.197114+0000","last_clean_scrub_stamp":"2024-05-20T17:26:33.197114+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:24.378214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.018519+0000","last_change":"2024-05-20T17:31:14.801640+0000","last_active":"2024-05-20T17:33:20.018519+0000","last_peered":"2024-05-20T17:33:20.018519+0000","last_clean":"2024-05-20T17:33:20.018519+0000","last_became_active":"2024-05-20T17:31:14.801271+0000","last_became_peered":"2024-05-20T17:31:14.801271+0000","last_unstale":"2024-05-20T17:33:20.018519+0000","last_undegraded":"2024-05-20T17:33:20.018519+0000","last_fullsized":"2024-05-20T17:33:20.018519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:35.469383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786674+0000","last_change":"2024-05-20T17:31:13.790902+0000","last_active":"2024-05-20T17:33:19.786674+0000","last_peered":"2024-05-20T17:33:19.786674+0000","last_clean":"2024-05-20T17:33:19.786674+0000","last_became_active":"2024-05-20T17:31:13.790423+0000","last_became_peered":"2024-05-20T17:31:13.790423+0000","last_unstale":"2024-05-20T17:33:19.786674+0000","last_undegraded":"2024-05-20T17:33:19.786674+0000","last_fullsized":"2024-05-20T17:33:19.786674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:07:52.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886536+0000","last_change":"2024-05-20T17:31:13.797345+0000","last_active":"2024-05-20T17:33:19.886536+0000","last_peered":"2024-05-20T17:33:19.886536+0000","last_clean":"2024-05-20T17:33:19.886536+0000","last_became_active":"2024-05-20T17:31:13.797002+0000","last_became_peered":"2024-05-20T17:31:13.797002+0000","last_unstale":"2024-05-20T17:33:19.886536+0000","last_undegraded":"2024-05-20T17:33:19.886536+0000","last_fullsized":"2024-05-20T17:33:19.886536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:58:41.010682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020001+0000","last_change":"2024-05-20T17:31:14.795722+0000","last_active":"2024-05-20T17:33:20.020001+0000","last_peered":"2024-05-20T17:33:20.020001+0000","last_clean":"2024-05-20T17:33:20.020001+0000","last_became_active":"2024-05-20T17:31:14.795375+0000","last_became_peered":"2024-05-20T17:31:14.795375+0000","last_unstale":"2024-05-20T17:33:20.020001+0000","last_undegraded":"2024-05-20T17:33:20.020001+0000","last_fullsized":"2024-05-20T17:33:20.020001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:30.799908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'44","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.016135+0000","last_change":"2024-05-20T17:31:13.780366+0000","last_active":"2024-05-20T17:33:20.016135+0000","last_peered":"2024-05-20T17:33:20.016135+0000","last_clean":"2024-05-20T17:33:20.016135+0000","last_became_active":"2024-05-20T17:31:13.780006+0000","last_became_peered":"2024-05-20T17:31:13.780006+0000","last_unstale":"2024-05-20T17:33:20.016135+0000","last_undegraded":"2024-05-20T17:33:20.016135+0000","last_fullsized":"2024-05-20T17:33:20.016135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:49.627129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.887016+0000","last_change":"2024-05-20T17:31:14.800930+0000","last_active":"2024-05-20T17:33:19.887016+0000","last_peered":"2024-05-20T17:33:19.887016+0000","last_clean":"2024-05-20T17:33:19.887016+0000","last_became_active":"2024-05-20T17:31:14.800557+0000","last_became_peered":"2024-05-20T17:31:14.800557+0000","last_unstale":"2024-05-20T17:33:19.887016+0000","last_undegraded":"2024-05-20T17:33:19.887016+0000","last_fullsized":"2024-05-20T17:33:19.887016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:56:06.752747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058446+0000","last_change":"2024-05-20T17:31:13.792130+0000","last_active":"2024-05-20T17:33:20.058446+0000","last_peered":"2024-05-20T17:33:20.058446+0000","last_clean":"2024-05-20T17:33:20.058446+0000","last_became_active":"2024-05-20T17:31:13.791766+0000","last_became_peered":"2024-05-20T17:31:13.791766+0000","last_unstale":"2024-05-20T17:33:20.058446+0000","last_undegraded":"2024-05-20T17:33:20.058446+0000","last_fullsized":"2024-05-20T17:33:20.058446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:43.914317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059838+0000","last_change":"2024-05-20T17:31:14.805386+0000","last_active":"2024-05-20T17:33:20.059838+0000","last_peered":"2024-05-20T17:33:20.059838+0000","last_clean":"2024-05-20T17:33:20.059838+0000","last_became_active":"2024-05-20T17:31:14.803619+0000","last_became_peered":"2024-05-20T17:31:14.803619+0000","last_unstale":"2024-05-20T17:33:20.059838+0000","last_undegraded":"2024-05-20T17:33:20.059838+0000","last_fullsized":"2024-05-20T17:33:20.059838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:07.996185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063698+0000","last_change":"2024-05-20T17:31:13.794059+0000","last_active":"2024-05-20T17:33:20.063698+0000","last_peered":"2024-05-20T17:33:20.063698+0000","last_clean":"2024-05-20T17:33:20.063698+0000","last_became_active":"2024-05-20T17:31:13.793538+0000","last_became_peered":"2024-05-20T17:31:13.793538+0000","last_unstale":"2024-05-20T17:33:20.063698+0000","last_undegraded":"2024-05-20T17:33:20.063698+0000","last_fullsized":"2024-05-20T17:33:20.063698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:35.302147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886232+0000","last_change":"2024-05-20T17:31:14.798098+0000","last_active":"2024-05-20T17:33:19.886232+0000","last_peered":"2024-05-20T17:33:19.886232+0000","last_clean":"2024-05-20T17:33:19.886232+0000","last_became_active":"2024-05-20T17:31:14.797149+0000","last_became_peered":"2024-05-20T17:31:14.797149+0000","last_unstale":"2024-05-20T17:33:19.886232+0000","last_undegraded":"2024-05-20T17:33:19.886232+0000","last_fullsized":"2024-05-20T17:33:19.886232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:35:06.122038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886323+0000","last_change":"2024-05-20T17:31:13.789867+0000","last_active":"2024-05-20T17:33:19.886323+0000","last_peered":"2024-05-20T17:33:19.886323+0000","last_clean":"2024-05-20T17:33:19.886323+0000","last_became_active":"2024-05-20T17:31:13.789230+0000","last_became_peered":"2024-05-20T17:31:13.789230+0000","last_unstale":"2024-05-20T17:33:19.886323+0000","last_undegraded":"2024-05-20T17:33:19.886323+0000","last_fullsized":"2024-05-20T17:33:19.886323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:58.278329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786529+0000","last_change":"2024-05-20T17:31:14.800367+0000","last_active":"2024-05-20T17:33:19.786529+0000","last_peered":"2024-05-20T17:33:19.786529+0000","last_clean":"2024-05-20T17:33:19.786529+0000","last_became_active":"2024-05-20T17:31:14.799984+0000","last_became_peered":"2024-05-20T17:31:14.799984+0000","last_unstale":"2024-05-20T17:33:19.786529+0000","last_undegraded":"2024-05-20T17:33:19.786529+0000","last_fullsized":"2024-05-20T17:33:19.786529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:41.518754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063339+0000","last_change":"2024-05-20T17:31:13.785307+0000","last_active":"2024-05-20T17:33:20.063339+0000","last_peered":"2024-05-20T17:33:20.063339+0000","last_clean":"2024-05-20T17:33:20.063339+0000","last_became_active":"2024-05-20T17:31:13.784913+0000","last_became_peered":"2024-05-20T17:31:13.784913+0000","last_unstale":"2024-05-20T17:33:20.063339+0000","last_undegraded":"2024-05-20T17:33:20.063339+0000","last_fullsized":"2024-05-20T17:33:20.063339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:32:24.435689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886598+0000","last_change":"2024-05-20T17:31:14.810820+0000","last_active":"2024-05-20T17:33:19.886598+0000","last_peered":"2024-05-20T17:33:19.886598+0000","last_clean":"2024-05-20T17:33:19.886598+0000","last_became_active":"2024-05-20T17:31:14.810473+0000","last_became_peered":"2024-05-20T17:31:14.810473+0000","last_unstale":"2024-05-20T17:33:19.886598+0000","last_undegraded":"2024-05-20T17:33:19.886598+0000","last_fullsized":"2024-05-20T17:33:19.886598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:40.349297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886314+0000","last_change":"2024-05-20T17:31:13.793294+0000","last_active":"2024-05-20T17:33:19.886314+0000","last_peered":"2024-05-20T17:33:19.886314+0000","last_clean":"2024-05-20T17:33:19.886314+0000","last_became_active":"2024-05-20T17:31:13.792854+0000","last_became_peered":"2024-05-20T17:31:13.792854+0000","last_unstale":"2024-05-20T17:33:19.886314+0000","last_undegraded":"2024-05-20T17:33:19.886314+0000","last_fullsized":"2024-05-20T17:33:19.886314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:04:42.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786736+0000","last_change":"2024-05-20T17:31:14.803530+0000","last_active":"2024-05-20T17:33:19.786736+0000","last_peered":"2024-05-20T17:33:19.786736+0000","last_clean":"2024-05-20T17:33:19.786736+0000","last_became_active":"2024-05-20T17:31:14.803065+0000","last_became_peered":"2024-05-20T17:31:14.803065+0000","last_unstale":"2024-05-20T17:33:19.786736+0000","last_undegraded":"2024-05-20T17:33:19.786736+0000","last_fullsized":"2024-05-20T17:33:19.786736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:43.253987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.058382+0000","last_change":"2024-05-20T17:32:07.738590+0000","last_active":"2024-05-20T17:33:20.058382+0000","last_peered":"2024-05-20T17:33:20.058382+0000","last_clean":"2024-05-20T17:33:20.058382+0000","last_became_active":"2024-05-20T17:32:07.731009+0000","last_became_peered":"2024-05-20T17:32:07.731009+0000","last_unstale":"2024-05-20T17:33:20.058382+0000","last_undegraded":"2024-05-20T17:33:20.058382+0000","last_fullsized":"2024-05-20T17:33:20.058382+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:25.383889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787095+0000","last_change":"2024-05-20T17:31:14.801196+0000","last_active":"2024-05-20T17:33:19.787095+0000","last_peered":"2024-05-20T17:33:19.787095+0000","last_clean":"2024-05-20T17:33:19.787095+0000","last_became_active":"2024-05-20T17:31:14.800838+0000","last_became_peered":"2024-05-20T17:31:14.800838+0000","last_unstale":"2024-05-20T17:33:19.787095+0000","last_undegraded":"2024-05-20T17:33:19.787095+0000","last_fullsized":"2024-05-20T17:33:19.787095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:12:10.454896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.013045+0000","last_change":"2024-05-20T17:31:13.796445+0000","last_active":"2024-05-20T17:33:20.013045+0000","last_peered":"2024-05-20T17:33:20.013045+0000","last_clean":"2024-05-20T17:33:20.013045+0000","last_became_active":"2024-05-20T17:31:13.796110+0000","last_became_peered":"2024-05-20T17:31:13.796110+0000","last_unstale":"2024-05-20T17:33:20.013045+0000","last_undegraded":"2024-05-20T17:33:20.013045+0000","last_fullsized":"2024-05-20T17:33:20.013045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:15.245805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786737+0000","last_change":"2024-05-20T17:31:14.790780+0000","last_active":"2024-05-20T17:33:19.786737+0000","last_peered":"2024-05-20T17:33:19.786737+0000","last_clean":"2024-05-20T17:33:19.786737+0000","last_became_active":"2024-05-20T17:31:14.790229+0000","last_became_peered":"2024-05-20T17:31:14.790229+0000","last_unstale":"2024-05-20T17:33:19.786737+0000","last_undegraded":"2024-05-20T17:33:19.786737+0000","last_fullsized":"2024-05-20T17:33:19.786737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:06.119241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.020281+0000","last_change":"2024-05-20T17:31:13.786607+0000","last_active":"2024-05-20T17:33:20.020281+0000","last_peered":"2024-05-20T17:33:20.020281+0000","last_clean":"2024-05-20T17:33:20.020281+0000","last_became_active":"2024-05-20T17:31:13.786273+0000","last_became_peered":"2024-05-20T17:31:13.786273+0000","last_unstale":"2024-05-20T17:33:20.020281+0000","last_undegraded":"2024-05-20T17:33:20.020281+0000","last_fullsized":"2024-05-20T17:33:20.020281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:12.757211+0000","last_clean_scrub_stamp":"2024-05-20T17:31:12.757211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:20.681960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.787347+0000","last_change":"2024-05-20T17:31:14.792320+0000","last_active":"2024-05-20T17:33:19.787347+0000","last_peered":"2024-05-20T17:33:19.787347+0000","last_clean":"2024-05-20T17:33:19.787347+0000","last_became_active":"2024-05-20T17:31:14.790889+0000","last_became_peered":"2024-05-20T17:31:14.790889+0000","last_unstale":"2024-05-20T17:33:19.787347+0000","last_undegraded":"2024-05-20T17:33:19.787347+0000","last_fullsized":"2024-05-20T17:33:19.787347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:49.546477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786754+0000","last_change":"2024-05-20T17:31:14.802220+0000","last_active":"2024-05-20T17:33:19.786754+0000","last_peered":"2024-05-20T17:33:19.786754+0000","last_clean":"2024-05-20T17:33:19.786754+0000","last_became_active":"2024-05-20T17:31:14.801843+0000","last_became_peered":"2024-05-20T17:31:14.801843+0000","last_unstale":"2024-05-20T17:33:19.786754+0000","last_undegraded":"2024-05-20T17:33:19.786754+0000","last_fullsized":"2024-05-20T17:33:19.786754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:40.551876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063416+0000","last_change":"2024-05-20T17:32:07.736717+0000","last_active":"2024-05-20T17:33:20.063416+0000","last_peered":"2024-05-20T17:33:20.063416+0000","last_clean":"2024-05-20T17:33:20.063416+0000","last_became_active":"2024-05-20T17:32:07.736321+0000","last_became_peered":"2024-05-20T17:32:07.736321+0000","last_unstale":"2024-05-20T17:33:20.063416+0000","last_undegraded":"2024-05-20T17:33:20.063416+0000","last_fullsized":"2024-05-20T17:33:20.063416+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:59:32.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063299+0000","last_change":"2024-05-20T17:31:14.800848+0000","last_active":"2024-05-20T17:33:20.063299+0000","last_peered":"2024-05-20T17:33:20.063299+0000","last_clean":"2024-05-20T17:33:20.063299+0000","last_became_active":"2024-05-20T17:31:14.800488+0000","last_became_peered":"2024-05-20T17:31:14.800488+0000","last_unstale":"2024-05-20T17:33:20.063299+0000","last_undegraded":"2024-05-20T17:33:20.063299+0000","last_fullsized":"2024-05-20T17:33:20.063299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:41:49.848794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.059508+0000","last_change":"2024-05-20T17:31:14.804570+0000","last_active":"2024-05-20T17:33:20.059508+0000","last_peered":"2024-05-20T17:33:20.059508+0000","last_clean":"2024-05-20T17:33:20.059508+0000","last_became_active":"2024-05-20T17:31:14.801211+0000","last_became_peered":"2024-05-20T17:31:14.801211+0000","last_unstale":"2024-05-20T17:33:20.059508+0000","last_undegraded":"2024-05-20T17:33:20.059508+0000","last_fullsized":"2024-05-20T17:33:20.059508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:39:46.595691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019860+0000","last_change":"2024-05-20T17:31:14.795438+0000","last_active":"2024-05-20T17:33:20.019860+0000","last_peered":"2024-05-20T17:33:20.019860+0000","last_clean":"2024-05-20T17:33:20.019860+0000","last_became_active":"2024-05-20T17:31:14.795051+0000","last_became_peered":"2024-05-20T17:31:14.795051+0000","last_unstale":"2024-05-20T17:33:20.019860+0000","last_undegraded":"2024-05-20T17:33:20.019860+0000","last_fullsized":"2024-05-20T17:33:20.019860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:12.642006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786892+0000","last_change":"2024-05-20T17:32:07.735868+0000","last_active":"2024-05-20T17:33:19.786892+0000","last_peered":"2024-05-20T17:33:19.786892+0000","last_clean":"2024-05-20T17:33:19.786892+0000","last_became_active":"2024-05-20T17:32:07.735314+0000","last_became_peered":"2024-05-20T17:32:07.735314+0000","last_unstale":"2024-05-20T17:33:19.786892+0000","last_undegraded":"2024-05-20T17:33:19.786892+0000","last_fullsized":"2024-05-20T17:33:19.786892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:33:52.756227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063716+0000","last_change":"2024-05-20T17:31:14.796437+0000","last_active":"2024-05-20T17:33:20.063716+0000","last_peered":"2024-05-20T17:33:20.063716+0000","last_clean":"2024-05-20T17:33:20.063716+0000","last_became_active":"2024-05-20T17:31:14.795994+0000","last_became_peered":"2024-05-20T17:31:14.795994+0000","last_unstale":"2024-05-20T17:33:20.063716+0000","last_undegraded":"2024-05-20T17:33:20.063716+0000","last_fullsized":"2024-05-20T17:33:20.063716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:28:38.690045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886886+0000","last_change":"2024-05-20T17:31:14.802819+0000","last_active":"2024-05-20T17:33:19.886886+0000","last_peered":"2024-05-20T17:33:19.886886+0000","last_clean":"2024-05-20T17:33:19.886886+0000","last_became_active":"2024-05-20T17:31:14.802425+0000","last_became_peered":"2024-05-20T17:31:14.802425+0000","last_unstale":"2024-05-20T17:33:19.886886+0000","last_undegraded":"2024-05-20T17:33:19.886886+0000","last_fullsized":"2024-05-20T17:33:19.886886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:38:52.034448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.893335+0000","last_change":"2024-05-20T17:31:14.784658+0000","last_active":"2024-05-20T17:33:19.893335+0000","last_peered":"2024-05-20T17:33:19.893335+0000","last_clean":"2024-05-20T17:33:19.893335+0000","last_became_active":"2024-05-20T17:31:14.784273+0000","last_became_peered":"2024-05-20T17:31:14.784273+0000","last_unstale":"2024-05-20T17:33:19.893335+0000","last_undegraded":"2024-05-20T17:33:19.893335+0000","last_fullsized":"2024-05-20T17:33:19.893335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:35:08.076884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.886282+0000","last_change":"2024-05-20T17:31:14.802918+0000","last_active":"2024-05-20T17:33:19.886282+0000","last_peered":"2024-05-20T17:33:19.886282+0000","last_clean":"2024-05-20T17:33:19.886282+0000","last_became_active":"2024-05-20T17:31:14.802020+0000","last_became_peered":"2024-05-20T17:31:14.802020+0000","last_unstale":"2024-05-20T17:33:19.886282+0000","last_undegraded":"2024-05-20T17:33:19.886282+0000","last_fullsized":"2024-05-20T17:33:19.886282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.063613+0000","last_change":"2024-05-20T17:31:14.812540+0000","last_active":"2024-05-20T17:33:20.063613+0000","last_peered":"2024-05-20T17:33:20.063613+0000","last_clean":"2024-05-20T17:33:20.063613+0000","last_became_active":"2024-05-20T17:31:14.812083+0000","last_became_peered":"2024-05-20T17:31:14.812083+0000","last_unstale":"2024-05-20T17:33:20.063613+0000","last_undegraded":"2024-05-20T17:33:20.063613+0000","last_fullsized":"2024-05-20T17:33:20.063613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:20:25.839179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:20.019549+0000","last_change":"2024-05-20T17:31:14.807082+0000","last_active":"2024-05-20T17:33:20.019549+0000","last_peered":"2024-05-20T17:33:20.019549+0000","last_clean":"2024-05-20T17:33:20.019549+0000","last_became_active":"2024-05-20T17:31:14.806533+0000","last_became_peered":"2024-05-20T17:31:14.806533+0000","last_unstale":"2024-05-20T17:33:20.019549+0000","last_undegraded":"2024-05-20T17:33:20.019549+0000","last_fullsized":"2024-05-20T17:33:20.019549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:59.982329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-20T17:33:19.786579+0000","last_change":"2024-05-20T17:31:14.804003+0000","last_active":"2024-05-20T17:33:19.786579+0000","last_peered":"2024-05-20T17:33:19.786579+0000","last_clean":"2024-05-20T17:33:19.786579+0000","last_became_active":"2024-05-20T17:31:14.803585+0000","last_became_peered":"2024-05-20T17:31:14.803585+0000","last_unstale":"2024-05-20T17:33:19.786579+0000","last_undegraded":"2024-05-20T17:33:19.786579+0000","last_fullsized":"2024-05-20T17:33:19.786579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:31:13.765964+0000","last_clean_scrub_stamp":"2024-05-20T17:31:13.765964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:29.313641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107100,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":598812,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":853,"num_read_kb":538,"num_write":287,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2177,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1796436,"data_compressed":81528,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":465954,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1110016,"data_stored":1124361,"data_compressed":46295,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":999424,"data_stored":858941,"data_compressed":27867,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":793208,"data_compressed":24626,"data_compressed_allocated":32768,"data_compressed_original":352256,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1059113,"data_compressed":44421,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495680,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":464997,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":534484,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":457283,"data_compressed":5805,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":532694,"data_compressed":10595,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":990007,"data_compressed":34023,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":966656,"data_stored":467330,"data_compressed":8721,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":1189665,"data_compressed":50577,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35700,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69694,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67904,"data_compressed":1874,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134390,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8030,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:33:22.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:22.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: [20/May/2024:17:33:20] ENGINE Serving on https://172.21.15.135:7150 2024-05-20T17:33:22.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: [20/May/2024:17:33:20] ENGINE Bus STARTED 2024-05-20T17:33:22.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:22.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3053770508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:22.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:22.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:21 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: [20/May/2024:17:33:20] ENGINE Serving on https://172.21.15.135:7150 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: [20/May/2024:17:33:20] ENGINE Bus STARTED 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3053770508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:21 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 -- 172.21.15.135:0/2275852397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c1089d0 msgr2=0x7fcb3c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 --2- 172.21.15.135:0/2275852397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c10adf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009ca0 tx=0x7fcb3402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 -- 172.21.15.135:0/2275852397 shutdown_connections 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 --2- 172.21.15.135:0/2275852397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c10adf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 --2- 172.21.15.135:0/2275852397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 0x7fcb3c1040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 --2- 172.21.15.135:0/2275852397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c102a90 0x7fcb3c103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 -- 172.21.15.135:0/2275852397 >> 172.21.15.135:0/2275852397 conn(0x7fcb3c0fdc80 msgr2=0x7fcb3c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 -- 172.21.15.135:0/2275852397 shutdown_connections 2024-05-20T17:33:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.354+0000 7fcb42538640 1 -- 172.21.15.135:0/2275852397 wait complete. 2024-05-20T17:33:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 Processor -- start 2024-05-20T17:33:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 -- start start 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 0x7fcb3c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10e710 con 0x7fcb3c102a90 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10e590 con 0x7fcb3c1089d0 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb42538640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10e890 con 0x7fcb3c103cd0 2024-05-20T17:33:22.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51318/0 (socket says 172.21.15.135:51318) 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.355+0000 7fcb3bfff640 1 -- 172.21.15.135:0/937822661 learned_addr learned my addr 172.21.15.135:0/937822661 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb40ad5640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3b7fe640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 0x7fcb3c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 -- 172.21.15.135:0/937822661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 msgr2=0x7fcb3c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 0x7fcb3c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 -- 172.21.15.135:0/937822661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c1089d0 msgr2=0x7fcb3c1a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c1a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 -- 172.21.15.135:0/937822661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c1a0df0 con 0x7fcb3c102a90 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb3bfff640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e9f0 tx=0x7fcb2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c00ccc0 con 0x7fcb3c102a90 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb2c0035f0 con 0x7fcb3c102a90 2024-05-20T17:33:22.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c1a10e0 con 0x7fcb3c102a90 2024-05-20T17:33:22.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c00ce60 con 0x7fcb3c102a90 2024-05-20T17:33:22.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.356+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c1a1630 con 0x7fcb3c102a90 2024-05-20T17:33:22.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.358+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb3c1077e0 con 0x7fcb3c102a90 2024-05-20T17:33:22.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.358+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7fcb2c010750 con 0x7fcb3c102a90 2024-05-20T17:33:22.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.359+0000 7fcb397fa640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 0x7fcb240a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.360+0000 7fcb3b7fe640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 0x7fcb240a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.360+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcb2c0cf740 con 0x7fcb3c102a90 2024-05-20T17:33:22.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.360+0000 7fcb3b7fe640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 0x7fcb240a5210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c19a350 tx=0x7fcb30005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:22.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.364+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcb2c09c360 con 0x7fcb3c102a90 2024-05-20T17:33:22.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.555+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb3c062750 con 0x7fcb3c102a90 2024-05-20T17:33:22.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.557+0000 7fcb397fa640 1 -- 172.21.15.135:0/937822661 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23197 (secure 0 0 0) 0x7fcb2c09bc60 con 0x7fcb3c102a90 2024-05-20T17:33:22.559 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:22.559 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":88,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:33:19.780369+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2340719003":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2366951991":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6801/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6800/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3892403253":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3665782068":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 msgr2=0x7fcb240a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 0x7fcb240a5210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c19a350 tx=0x7fcb30005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 msgr2=0x7fcb3c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e9f0 tx=0x7fcb2c00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 shutdown_connections 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fcb240a2d00 0x7fcb240a5210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb3c1089d0 0x7fcb3c1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c103cd0 0x7fcb3c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 --2- 172.21.15.135:0/937822661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3c102a90 0x7fcb3c1992b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 >> 172.21.15.135:0/937822661 conn(0x7fcb3c0fdc80 msgr2=0x7fcb3c1049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:22.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 shutdown_connections 2024-05-20T17:33:22.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.559+0000 7fcb42538640 1 -- 172.21.15.135:0/937822661 wait complete. 2024-05-20T17:33:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:33:22.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1188734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4102c40 msgr2=0x7f72b4103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1188734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4102c40 0x7f72b4103050 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009900 tx=0x7f72a402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1188734481 shutdown_connections 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1188734481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 0x7f72b4109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1188734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4102c40 0x7f72b4103050 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1188734481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4101a00 0x7f72b4102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1188734481 >> 172.21.15.135:0/1188734481 conn(0x7f72b40fcbf0 msgr2=0x7f72b40ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1188734481 shutdown_connections 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.692+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1188734481 wait complete. 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 Processor -- start 2024-05-20T17:33:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 -- start start 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4102c40 0x7f72b41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 0x7f72b41a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72b410e700 con 0x7f72b4101a00 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72b410e580 con 0x7f72b4107940 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72bc0c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72b410e880 con 0x7f72b4102c40 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51336/0 (socket says 172.21.15.135:51336) 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 -- 172.21.15.135:0/1594128642 learned_addr learned my addr 172.21.15.135:0/1594128642 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b965e640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4102c40 0x7f72b41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72ba660640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 0x7f72b41a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 -- 172.21.15.135:0/1594128642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4102c40 msgr2=0x7f72b41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4102c40 0x7f72b41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 -- 172.21.15.135:0/1594128642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 msgr2=0x7f72b41a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 0x7f72b41a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.693+0000 7f72b9e5f640 1 -- 172.21.15.135:0/1594128642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b41a0dc0 con 0x7f72b4101a00 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72b9e5f640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9f0 tx=0x7f72b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ccc0 con 0x7f72b4101a00 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b00035f0 con 0x7f72b4101a00 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b41a10b0 con 0x7f72b4101a00 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ce60 con 0x7f72b4101a00 2024-05-20T17:33:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.694+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b41a15b0 con 0x7f72b4101a00 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.695+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b4106750 con 0x7f72b4101a00 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.696+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f72b00037a0 con 0x7f72b4101a00 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.697+0000 7f72aaffd640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 0x7f72a00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.697+0000 7f72b965e640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 0x7f72a00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.697+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f72b00cfc80 con 0x7f72b4101a00 2024-05-20T17:33:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.697+0000 7f72b965e640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 0x7f72a00a5210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a4031400 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.700+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f72b009c8a0 con 0x7f72b4101a00 2024-05-20T17:33:22.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.889+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72b4062750 con 0x7f72b4101a00 2024-05-20T17:33:22.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.889+0000 7f72aaffd640 1 -- 172.21.15.135:0/1594128642 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f72b009c1a0 con 0x7f72b4101a00 2024-05-20T17:33:22.891 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:33:22.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 msgr2=0x7f72a00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 0x7f72a00a5210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a4031400 comp rx=0 tx=0).stop 2024-05-20T17:33:22.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 msgr2=0x7f72b4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:22.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9f0 tx=0x7f72b000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 shutdown_connections 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72a00a2d00 0x7f72a00a5210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.891+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72b4107940 0x7f72b41a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.892+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72b4102c40 0x7f72b41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.892+0000 7f72bc0c3640 1 --2- 172.21.15.135:0/1594128642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b4101a00 0x7f72b4199280 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.892+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 >> 172.21.15.135:0/1594128642 conn(0x7f72b40fcbf0 msgr2=0x7f72b4103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.892+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 shutdown_connections 2024-05-20T17:33:22.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:22.892+0000 7f72bc0c3640 1 -- 172.21.15.135:0/1594128642 wait complete. 2024-05-20T17:33:22.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.021+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/2280573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4102a90 msgr2=0x7fd6a4103790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.021+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/2280573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4102a90 0x7fd6a4103790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009860 tx=0x7fd6a002a340 comp rx=0 tx=0).stop 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/2280573992 shutdown_connections 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/2280573992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a41089d0 0x7fd6a410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/2280573992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a4103cd0 0x7fd6a41040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/2280573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4102a90 0x7fd6a4103790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/2280573992 >> 172.21.15.135:0/2280573992 conn(0x7fd6a40fdc80 msgr2=0x7fd6a4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/2280573992 shutdown_connections 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/2280573992 wait complete. 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 Processor -- start 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 -- start start 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.022+0000 7fd6ab8d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 0x7fd6a4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4103cd0 0x7fd6a4073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 0x7fd6a40743e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410e6e0 con 0x7fd6a41089d0 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410e560 con 0x7fd6a4103cd0 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410e860 con 0x7fd6a4102a90 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9e74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 0x7fd6a40743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 0x7fd6a4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9e74640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 0x7fd6a40743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51350/0 (socket says 172.21.15.135:51350) 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9e74640 1 -- 172.21.15.135:0/4237288440 learned_addr learned my addr 172.21.15.135:0/4237288440 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a8e72640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4103cd0 0x7fd6a4073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 -- 172.21.15.135:0/4237288440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4103cd0 msgr2=0x7fd6a4073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4103cd0 0x7fd6a4073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 -- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 msgr2=0x7fd6a40743e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 0x7fd6a40743e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 -- 172.21.15.135:0/4237288440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a4074b10 con 0x7fd6a4102a90 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6a9673640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 0x7fd6a4075800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6a002a860 tx=0x7fd6a0033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0037040 con 0x7fd6a4102a90 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a0004040 con 0x7fd6a4102a90 2024-05-20T17:33:23.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a41a3370 con 0x7fd6a4102a90 2024-05-20T17:33:23.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0005580 con 0x7fd6a4102a90 2024-05-20T17:33:23.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.023+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a3770 con 0x7fd6a4102a90 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.024+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a4068290 con 0x7fd6a4102a90 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.026+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7fd6a0042020 con 0x7fd6a4102a90 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.026+0000 7fd69a7fc640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 0x7fd6900a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.027+0000 7fd6a8e72640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 0x7fd6900a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.027+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6a00ef0a0 con 0x7fd6a4102a90 2024-05-20T17:33:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.027+0000 7fd6a8e72640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 0x7fd6900a5210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6940096c0 tx=0x7fd694009260 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.030+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd6a0049020 con 0x7fd6a4102a90 2024-05-20T17:33:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-20T17:33:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='client.25145 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/937822661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:23.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:22 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1594128642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:23.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.219+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd6a4062750 con 0x7fd6a4102a90 2024-05-20T17:33:23.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.220+0000 7fd69a7fc640 1 -- 172.21.15.135:0/4237288440 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fd6a00bbdb0 con 0x7fd6a4102a90 2024-05-20T17:33:23.221 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:33:23.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 msgr2=0x7fd6900a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 0x7fd6900a5210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6940096c0 tx=0x7fd694009260 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 msgr2=0x7fd6a4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 0x7fd6a4075800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6a002a860 tx=0x7fd6a0033d90 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 shutdown_connections 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6900a2d00 0x7fd6900a5210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a41089d0 0x7fd6a40743e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6a4103cd0 0x7fd6a4073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 --2- 172.21.15.135:0/4237288440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6a4102a90 0x7fd6a4075800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 >> 172.21.15.135:0/4237288440 conn(0x7fd6a40fdc80 msgr2=0x7fd6a41049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 shutdown_connections 2024-05-20T17:33:23.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.222+0000 7fd6ab8d7640 1 -- 172.21.15.135:0/4237288440 wait complete. 2024-05-20T17:33:23.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='client.25145 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/937822661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:22 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1594128642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:23.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='client.25145 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/937822661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:22 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1594128642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:33:23.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- 172.21.15.135:0/3274525235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60781031a0 msgr2=0x7f60781055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 --2- 172.21.15.135:0/3274525235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60781031a0 0x7f60781055c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f606c009860 tx=0x7f606c02a340 comp rx=0 tx=0).stop 2024-05-20T17:33:23.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- 172.21.15.135:0/3274525235 shutdown_connections 2024-05-20T17:33:23.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 --2- 172.21.15.135:0/3274525235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 0x7f607810ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 --2- 172.21.15.135:0/3274525235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6078105bb0 0x7f6078108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 --2- 172.21.15.135:0/3274525235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60781031a0 0x7f60781055c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- 172.21.15.135:0/3274525235 >> 172.21.15.135:0/3274525235 conn(0x7f60780fcb80 msgr2=0x7f60780ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- 172.21.15.135:0/3274525235 shutdown_connections 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- 172.21.15.135:0/3274525235 wait complete. 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 Processor -- start 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.353+0000 7f607ece9640 1 -- start start 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 0x7f6078199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 0x7f60781a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f607810e6d0 con 0x7f60781031a0 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f607810e550 con 0x7f6078105bb0 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f607810e850 con 0x7f6078108720 2024-05-20T17:33:23.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51364/0 (socket says 172.21.15.135:51364) 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 -- 172.21.15.135:0/1394720591 learned_addr learned my addr 172.21.15.135:0/1394720591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607d286640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 0x7f60781a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f6077fff640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 0x7f6078199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 -- 172.21.15.135:0/1394720591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 msgr2=0x7f60781a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 0x7f60781a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 -- 172.21.15.135:0/1394720591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 msgr2=0x7f6078199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 0x7f6078199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 -- 172.21.15.135:0/1394720591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781a1120 con 0x7f60781031a0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f6077fff640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 0x7f6078199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ca85640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f606c000c00 tx=0x7f606c033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c037040 con 0x7f60781031a0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f606c040070 con 0x7f60781031a0 2024-05-20T17:33:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.354+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781a13b0 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.355+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0046c0 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.355+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60781a18a0 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.356+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607806b250 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.357+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f606c004040 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.358+0000 7f6075ffb640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 0x7f60680a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.358+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f606c0ef350 con 0x7f60781031a0 2024-05-20T17:33:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.358+0000 7f6077fff640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 0x7f60680a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.359+0000 7f6077fff640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 0x7f60680a5210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f607819a680 tx=0x7f6064009260 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.363+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f606c0bc080 con 0x7f60781031a0 2024-05-20T17:33:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.551+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f60781a1df0 con 0x7f60781031a0 2024-05-20T17:33:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.551+0000 7f6075ffb640 1 -- 172.21.15.135:0/1394720591 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f606c0bb980 con 0x7f60781031a0 2024-05-20T17:33:23.552 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 msgr2=0x7f60680a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 0x7f60680a5210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f607819a680 tx=0x7f6064009260 comp rx=0 tx=0).stop 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 msgr2=0x7f60781995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f606c000c00 tx=0x7f606c033b60 comp rx=0 tx=0).stop 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 shutdown_connections 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f60680a2d00 0x7f60680a5210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6078108720 0x7f60781a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078105bb0 0x7f6078199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 --2- 172.21.15.135:0/1394720591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60781031a0 0x7f60781995e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 >> 172.21.15.135:0/1394720591 conn(0x7f60780fcb80 msgr2=0x7f6078104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 shutdown_connections 2024-05-20T17:33:23.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.553+0000 7f607ece9640 1 -- 172.21.15.135:0/1394720591 wait complete. 2024-05-20T17:33:23.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/2455773134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc41078b0 msgr2=0x7f2dc4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/2455773134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc41078b0 0x7f2dc4109cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009ca0 tx=0x7f2dbc02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/2455773134 shutdown_connections 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/2455773134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc41078b0 0x7f2dc4109cd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/2455773134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/2455773134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc4101970 0x7f2dc4102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/2455773134 >> 172.21.15.135:0/2455773134 conn(0x7f2dc40fcb80 msgr2=0x7f2dc40ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/2455773134 shutdown_connections 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.681+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/2455773134 wait complete. 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 Processor -- start 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 -- start start 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 0x7f2dc4198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 0x7f2dc419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc410d5d0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc410d450 con 0x7f2dc41078b0 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dcc2c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc410d750 con 0x7f2dc4101970 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dc985e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dc985e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51390/0 (socket says 172.21.15.135:51390) 2024-05-20T17:33:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dc985e640 1 -- 172.21.15.135:0/234363344 learned_addr learned my addr 172.21.15.135:0/234363344 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dca860640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 0x7f2dc419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.682+0000 7f2dca05f640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 0x7f2dc4198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 -- 172.21.15.135:0/234363344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 msgr2=0x7f2dc4198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 0x7f2dc4198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 -- 172.21.15.135:0/234363344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 msgr2=0x7f2dc419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 0x7f2dc419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 -- 172.21.15.135:0/234363344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc419fc50 con 0x7f2dc4102bb0 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dca860640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 0x7f2dc419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dca05f640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 0x7f2dc4198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dc985e640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000ea60 tx=0x7f2dc000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000cde0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc419ff40 con 0x7f2dc4102bb0 2024-05-20T17:33:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc00035f0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0010670 con 0x7f2dc4102bb0 2024-05-20T17:33:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.683+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41a03b0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.684+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc41066c0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.686+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7f2dc00037a0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.686+0000 7f2db77fe640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 0x7f2db00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.686+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2dc00cf720 con 0x7f2dc4102bb0 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.686+0000 7f2dca05f640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 0x7f2db00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.687+0000 7f2dca05f640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 0x7f2db00a5210 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4102570 tx=0x7f2db8005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.691+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2dc009c340 con 0x7f2dc4102bb0 2024-05-20T17:33:23.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.916+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dc402d2a0 con 0x7f2dc4102bb0 2024-05-20T17:33:23.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.917+0000 7f2db77fe640 1 -- 172.21.15.135:0/234363344 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f2dc009bc40 con 0x7f2dc4102bb0 2024-05-20T17:33:23.918 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:23.918 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:33:17.908712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24523]},"id":1}]} 2024-05-20T17:33:23.919 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 22 2024-05-20T17:33:23.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 msgr2=0x7f2db00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 0x7f2db00a5210 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4102570 tx=0x7f2db8005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:23.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 msgr2=0x7f2dc4198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000ea60 tx=0x7f2dc000ef20 comp rx=0 tx=0).stop 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 shutdown_connections 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2db00a2d00 0x7f2db00a5210 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2dc41078b0 0x7f2dc419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc4102bb0 0x7f2dc4198650 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 --2- 172.21.15.135:0/234363344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc4101970 0x7f2dc4198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 >> 172.21.15.135:0/234363344 conn(0x7f2dc40fcb80 msgr2=0x7f2dc4103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 shutdown_connections 2024-05-20T17:33:23.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:23.919+0000 7f2dcc2c3640 1 -- 172.21.15.135:0/234363344 wait complete. 2024-05-20T17:33:23.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:33:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 -- 172.21.15.135:0/892930924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe601078f0 msgr2=0x7fbe60109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 --2- 172.21.15.135:0/892930924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe601078f0 0x7fbe60109d10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009ca0 tx=0x7fbe5802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 -- 172.21.15.135:0/892930924 shutdown_connections 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 --2- 172.21.15.135:0/892930924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe601078f0 0x7fbe60109d10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 --2- 172.21.15.135:0/892930924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe60102bf0 0x7fbe60103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 --2- 172.21.15.135:0/892930924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601019b0 0x7fbe601026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 -- 172.21.15.135:0/892930924 >> 172.21.15.135:0/892930924 conn(0x7fbe600fcba0 msgr2=0x7fbe600ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 -- 172.21.15.135:0/892930924 shutdown_connections 2024-05-20T17:33:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.051+0000 7fbe667ce640 1 -- 172.21.15.135:0/892930924 wait complete. 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.052+0000 7fbe667ce640 1 Processor -- start 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.052+0000 7fbe667ce640 1 -- start start 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 0x7fbe6019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601078f0 0x7fbe601a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6010d630 con 0x7fbe60102bf0 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6010d4b0 con 0x7fbe601078f0 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe667ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6010d7b0 con 0x7fbe601019b0 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 0x7fbe6019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:34990/0 (socket says 172.21.15.135:34990) 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 -- 172.21.15.135:0/821997064 learned_addr learned my addr 172.21.15.135:0/821997064 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe64d6b640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601078f0 0x7fbe601a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 -- 172.21.15.135:0/821997064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601078f0 msgr2=0x7fbe601a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601078f0 0x7fbe601a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 -- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 msgr2=0x7fbe6019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 0x7fbe6019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 -- 172.21.15.135:0/821997064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe601a1090 con 0x7fbe601019b0 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5f7fe640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 0x7fbe6019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.053+0000 7fbe5ffff640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000e9f0 tx=0x7fbe5000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.054+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000ccc0 con 0x7fbe601019b0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.054+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe500035f0 con 0x7fbe601019b0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.054+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe601a1380 con 0x7fbe601019b0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.054+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000ce60 con 0x7fbe601019b0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.054+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe601a1920 con 0x7fbe601019b0 2024-05-20T17:33:24.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.055+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe60106700 con 0x7fbe601019b0 2024-05-20T17:33:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.056+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 22) ==== 137954+0+0 (secure 0 0 0) 0x7fbe500037a0 con 0x7fbe601019b0 2024-05-20T17:33:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.057+0000 7fbe5d7fa640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 0x7fbe480a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.057+0000 7fbe5f7fe640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 0x7fbe480a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.057+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbe500cf720 con 0x7fbe601019b0 2024-05-20T17:33:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.057+0000 7fbe5f7fe640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 0x7fbe480a5290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe540058c0 tx=0x7fbe5400a250 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.060+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbe5009c2e0 con 0x7fbe601019b0 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4237288440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1394720591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:24 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/234363344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.241+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7fbe50098250 con 0x7fbe601019b0 2024-05-20T17:33:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.255+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe6002d4a0 con 0x7fbe601019b0 2024-05-20T17:33:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.257+0000 7fbe5d7fa640 1 -- 172.21.15.135:0/821997064 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23197 (secure 0 0 0) 0x7fbe5000ce60 con 0x7fbe601019b0 2024-05-20T17:33:24.258 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:24.259 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":88,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:33:19.780369+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2340719003":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2366951991":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6801/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6800/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3892403253":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3665782068":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 msgr2=0x7fbe480a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 0x7fbe480a5290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe540058c0 tx=0x7fbe5400a250 comp rx=0 tx=0).stop 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 msgr2=0x7fbe6006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000e9f0 tx=0x7fbe5000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 shutdown_connections 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbe480a2d80 0x7fbe480a5290 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe601078f0 0x7fbe601a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe60102bf0 0x7fbe6019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 --2- 172.21.15.135:0/821997064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe601019b0 0x7fbe6006acb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 >> 172.21.15.135:0/821997064 conn(0x7fbe600fcba0 msgr2=0x7fbe601038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 shutdown_connections 2024-05-20T17:33:24.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.259+0000 7fbe667ce640 1 -- 172.21.15.135:0/821997064 wait complete. 2024-05-20T17:33:24.275 DEBUG:tasks.fwd_scrub:Yielding 2024-05-20T17:33:24.275 INFO:teuthology.run_tasks:Running task exec... 2024-05-20T17:33:24.286 INFO:teuthology.task.exec:Executing custom commands... 2024-05-20T17:33:24.286 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:33:24.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-05-20T17:33:24.287 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-20T17:33:24.287 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-20T17:33:24.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:24.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-20T17:33:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4237288440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:33:24.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1394720591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:24 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/234363344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 -- 172.21.15.135:0/3251914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 msgr2=0x7f7f90101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/3251914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f90101eb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009900 tx=0x7f7f8402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 -- 172.21.15.135:0/3251914628 shutdown_connections 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/3251914628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f9010c330 0x7f7f9010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/3251914628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f90101eb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/3251914628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f901079d0 0x7f7f90101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 -- 172.21.15.135:0/3251914628 >> 172.21.15.135:0/3251914628 conn(0x7f7f900770b0 msgr2=0x7f7f900774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 -- 172.21.15.135:0/3251914628 shutdown_connections 2024-05-20T17:33:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.410+0000 7f7f95ab6640 1 -- 172.21.15.135:0/3251914628 wait complete. 2024-05-20T17:33:24.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 Processor -- start 2024-05-20T17:33:24.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 -- start start 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f901079d0 0x7f7f9019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f9010c330 0x7f7f9019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90111ce0 con 0x7f7f90101aa0 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90111b60 con 0x7f7f9010c330 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f95ab6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90111e60 con 0x7f7f901079d0 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.411+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51420/0 (socket says 172.21.15.135:51420) 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/2043211218 learned_addr learned my addr 172.21.15.135:0/2043211218 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f9010c330 0x7f7f9019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8effd640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f901079d0 0x7f7f9019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/2043211218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f901079d0 msgr2=0x7f7f9019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f901079d0 0x7f7f9019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/2043211218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f9010c330 msgr2=0x7f7f9019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f9010c330 0x7f7f9019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/2043211218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f901a5910 con 0x7f7f90101aa0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005fd0 tx=0x7f7f8000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8cff9640 1 -- 172.21.15.135:0/2043211218 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80017070 con 0x7f7f90101aa0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8cff9640 1 -- 172.21.15.135:0/2043211218 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f80009c30 con 0x7f7f90101aa0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f901a5c00 con 0x7f7f90101aa0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f8cff9640 1 -- 172.21.15.135:0/2043211218 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80010460 con 0x7f7f90101aa0 2024-05-20T17:33:24.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.412+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f901a6170 con 0x7f7f90101aa0 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.415+0000 7f7f8cff9640 1 -- 172.21.15.135:0/2043211218 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f7f80010600 con 0x7f7f90101aa0 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.415+0000 7f7f8cff9640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 0x7f7f780a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.415+0000 7f7f8effd640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 0x7f7f780a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f8cff9640 1 -- 172.21.15.135:0/2043211218 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7f800cf110 con 0x7f7f90101aa0 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 Processor -- start 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 -- start start 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f8effd640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 0x7f7f780a5320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f84005940 tx=0x7f7f840058d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 0x55ba503dc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ba50341990 con 0x55ba5001c730 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ba502e95b0 con 0x55ba50014550 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ba5033d950 con 0x55ba5003d410 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.416+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51426/0 (socket says 172.21.15.135:51426) 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 -- 172.21.15.135:0/894557192 learned_addr learned my addr 172.21.15.135:0/894557192 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 0x55ba503dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8effd640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 -- 172.21.15.135:0/894557192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 msgr2=0x55ba503dc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 0x55ba503dc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 -- 172.21.15.135:0/894557192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 msgr2=0x55ba503dcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 -- 172.21.15.135:0/894557192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5011d7e0 con 0x55ba5001c730 2024-05-20T17:33:24.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 0x55ba503dc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009f40 tx=0x7f7f88010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e112a2db18bcdd4f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f75ffb640 1 -- 172.21.15.135:0/894557192 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88016070 con 0x55ba5001c730 2024-05-20T17:33:24.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f75ffb640 1 -- 172.21.15.135:0/894557192 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f88004d20 con 0x55ba5001c730 2024-05-20T17:33:24.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.417+0000 7f7f75ffb640 1 -- 172.21.15.135:0/894557192 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f880128b0 con 0x55ba5001c730 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/894557192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 msgr2=0x55ba503dd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009f40 tx=0x7f7f88010800 comp rx=0 tx=0).stop 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/894557192 shutdown_connections 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503dd0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/894557192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5003d410 0x55ba503dc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/894557192 >> 172.21.15.135:0/894557192 conn(0x55ba50031560 msgr2=0x55ba503d8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/894557192 shutdown_connections 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.418+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/894557192 wait complete. 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 -- start start 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 Processor -- start 2024-05-20T17:33:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba5003d410 0x55ba503ece60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ba503e9970 con 0x55ba5001c730 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ba502fcb40 con 0x55ba5003d410 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ba503e9af0 con 0x55ba50014550 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.419+0000 7f7f9ca3a740 10 client.0 _ll_register_callbacks cb 0x55ba502f10f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:35050/0 (socket says 172.21.15.135:35050) 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51448/0 (socket says 172.21.15.135:51448) 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1768437693 learned_addr learned my addr 172.21.15.135:0/1768437693 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba5003d410 0x55ba503ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba5003d410 msgr2=0x55ba503ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba5003d410 0x55ba503ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1768437693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 msgr2=0x55ba503e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1768437693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5017df70 con 0x55ba50014550 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f80098f00 tx=0x7f7f80009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a4d2dbd98c41eb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f800cccf0 con 0x55ba50014550 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f88004d20 con 0x55ba50014550 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.420+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7f8009b980 con 0x55ba50014550 2024-05-20T17:33:24.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7f800a08e0 con 0x55ba50014550 2024-05-20T17:33:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 10 client.25138 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba50015170 con 0x55ba50014550 2024-05-20T17:33:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 -- 172.21.15.135:0/623401781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c103cc0 msgr2=0x7f677c1040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 --2- 172.21.15.135:0/623401781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c103cc0 0x7f677c1040d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f676c009900 tx=0x7f676c02a480 comp rx=0 tx=0).stop 2024-05-20T17:33:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f88004d20 con 0x55ba50014550 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 -- 172.21.15.135:0/623401781 shutdown_connections 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 --2- 172.21.15.135:0/623401781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10d080 0x7f677c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 --2- 172.21.15.135:0/623401781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c10a720 0x7f677c10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 --2- 172.21.15.135:0/623401781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c103cc0 0x7f677c1040d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 -- 172.21.15.135:0/623401781 >> 172.21.15.135:0/623401781 conn(0x7f677c077160 msgr2=0x7f677c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7f8009b510 con 0x55ba50014550 2024-05-20T17:33:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 -- 172.21.15.135:0/623401781 shutdown_connections 2024-05-20T17:33:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f67825f5640 1 -- 172.21.15.135:0/623401781 wait complete. 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 10 client.25138 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 10 client.25138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 20 client.25138 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba4fffc1f0 0x55ba503f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 4 client.25138 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba5034f0c0 con 0x55ba4fffc1f0 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.421+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba4fffc1f0 0x55ba503f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.422+0000 7f7f6effd640 10 client.25138 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.422+0000 7f67825f5640 1 Processor -- start 2024-05-20T17:33:24.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.422+0000 7f67825f5640 1 -- start start 2024-05-20T17:33:24.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.422+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba4fffc1f0 0x55ba503f91a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4ea69de3ffc3ce server_cookie=5f7cf4880b41f181 in_seq=0 out_seq=0 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 0x7f677c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 0x7f677c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c10d080 0x7f677c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f677c112e80 con 0x7f677c103cc0 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f677c112d00 con 0x7f677c10d080 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67825f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f677c113000 con 0x7f677c10a720 2024-05-20T17:33:24.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 0x7f677c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 0x7f677c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 0x7f677c199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51460/0 (socket says 172.21.15.135:51460) 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677bfff640 1 -- 172.21.15.135:0/3890029046 learned_addr learned my addr 172.21.15.135:0/3890029046 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f6effd640 1 -- 172.21.15.135:0/1768437693 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba5034f0c0 con 0x55ba4fffc1f0 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f6effd640 10 client.25138 handle_command_reply: tid=0 2024-05-20T17:33:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f6780b92640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c10d080 0x7f677c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 client.25138 shutdown 2024-05-20T17:33:24.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 -- 172.21.15.135:0/3890029046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c10d080 msgr2=0x7f677c19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c10d080 0x7f677c19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 -- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 msgr2=0x7f677c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 0x7f677c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 -- 172.21.15.135:0/3890029046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c19e660 con 0x7f677c10a720 2024-05-20T17:33:24.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 msgr2=0x55ba503e6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f80098f00 tx=0x7f7f80009f20 comp rx=0 tx=0).stop 2024-05-20T17:33:24.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 shutdown_connections 2024-05-20T17:33:24.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba4fffc1f0 0x55ba503f91a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba5003d410 0x55ba503ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f6effd640 0 client.25138 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba5001c730 0x55ba503e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1768437693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba50014550 0x55ba503e6ce0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 >> 172.21.15.135:0/1768437693 conn(0x55ba50031560 msgr2=0x55ba503de340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 shutdown_connections 2024-05-20T17:33:24.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f677b7fe640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 0x7f677c199d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f677000e9f0 tx=0x7f677000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1768437693 wait complete. 2024-05-20T17:33:24.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f7f9ca3a740 20 client.25138 trim_cache size 0 max 16384 2024-05-20T17:33:24.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.423+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677000ccc0 con 0x7f677c10a720 2024-05-20T17:33:24.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.424+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6770010910 con 0x7f677c10a720 2024-05-20T17:33:24.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.424+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770018960 con 0x7f677c10a720 2024-05-20T17:33:24.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.424+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c19e950 con 0x7f677c10a720 2024-05-20T17:33:24.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.424+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c19ee50 con 0x7f677c10a720 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.425+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c0690c0 con 0x7f677c10a720 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.426+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f6770018b00 con 0x7f677c10a720 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.426+0000 7f67797fa640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 0x7f67640a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.427+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f67700cf940 con 0x7f677c10a720 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.427+0000 7f677bfff640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 0x7f67640a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.427+0000 7f677bfff640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 0x7f67640a5310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f676c000c00 tx=0x7f676c0046c0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.431+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f677c19ee50 con 0x7f677c10a720 2024-05-20T17:33:24.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.442+0000 7f7f9ca3a740 1 Processor -- start 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 -- start start 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba503dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901b1360 con 0x55ba4fffc1f0 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901aec30 con 0x55ba50014550 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901aca80 con 0x55ba5001c730 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51468/0 (socket says 172.21.15.135:51468) 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1099230312 learned_addr learned my addr 172.21.15.135:0/1099230312 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba503dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 -- 172.21.15.135:0/1099230312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 msgr2=0x55ba503dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba503dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 -- 172.21.15.135:0/1099230312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 msgr2=0x55ba503de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8effd640 1 -- 172.21.15.135:0/1099230312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba503e23b0 con 0x55ba50014550 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.443+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.444+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f8402a930 tx=0x7f7f8403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680bf3b6312c4794 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.444+0000 7f7f757fa640 1 -- 172.21.15.135:0/1099230312 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84035040 con 0x55ba50014550 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.444+0000 7f7f757fa640 1 -- 172.21.15.135:0/1099230312 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84052340 con 0x55ba50014550 2024-05-20T17:33:24.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.444+0000 7f7f757fa640 1 -- 172.21.15.135:0/1099230312 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84003850 con 0x55ba50014550 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1099230312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 msgr2=0x55ba503dcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f8402a930 tx=0x7f7f8403d000 comp rx=0 tx=0).stop 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1099230312 shutdown_connections 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba503dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503dcac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1099230312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1099230312 >> 172.21.15.135:0/1099230312 conn(0x55ba50031560 msgr2=0x55ba503dc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1099230312 shutdown_connections 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1099230312 wait complete. 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 -- start start 2024-05-20T17:33:24.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.445+0000 7f7f9ca3a740 1 Processor -- start 2024-05-20T17:33:24.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba50460550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ad0f0 con 0x55ba4fffc1f0 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ae560 con 0x55ba50014550 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ad7c0 con 0x55ba5001c730 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51478/0 (socket says 172.21.15.135:51478) 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57944/0 (socket says 172.21.15.135:57944) 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8f7fe640 1 -- 172.21.15.135:0/1714746222 learned_addr learned my addr 172.21.15.135:0/1714746222 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 10 client.0 _ll_register_callbacks cb 0x7f7f8009c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba50460550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 -- 172.21.15.135:0/1714746222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 msgr2=0x55ba50460550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba50460550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 -- 172.21.15.135:0/1714746222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 msgr2=0x55ba503ef3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 -- 172.21.15.135:0/1714746222 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba503f0180 con 0x55ba50014550 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8ffff640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba50460550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:24.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f8effd640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ba503e18b0 tx=0x7f7f84009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1a02cf58f5b00b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84035050 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7f840043c0 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.446+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f84052340 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7f840524f0 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 10 client.25205 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba50461ae0 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8405f070 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7f8406c480 con 0x55ba50014550 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 10 client.25205 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:24.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 20 client.25205 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba5003d410 0x55ba50464110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 4 client.25205 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f7f84052340 con 0x55ba5003d410 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.447+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba5003d410 0x55ba50464110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.448+0000 7f7f6effd640 10 client.25205 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.448+0000 7f7f8f7fe640 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba5003d410 0x55ba50464110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d35afab6aa8bd9 server_cookie=6c6094633fdb4507 in_seq=0 out_seq=0 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f6effd640 1 -- 172.21.15.135:0/1714746222 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f7f84052340 con 0x55ba5003d410 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f6effd640 10 client.25205 handle_command_reply: tid=0 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 client.25205 shutdown 2024-05-20T17:33:24.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 msgr2=0x55ba503ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ba503e18b0 tx=0x7f7f84009680 comp rx=0 tx=0).stop 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 shutdown_connections 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ba5003d410 0x55ba50464110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ba5001c730 0x55ba50460550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ba50014550 0x55ba503ef930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 --2- 172.21.15.135:0/1714746222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba4fffc1f0 0x55ba503ef3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f6effd640 0 client.25205 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 >> 172.21.15.135:0/1714746222 conn(0x55ba50031560 msgr2=0x55ba503dcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 shutdown_connections 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 1 -- 172.21.15.135:0/1714746222 wait complete. 2024-05-20T17:33:24.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.449+0000 7f7f9ca3a740 20 client.25205 trim_cache size 0 max 16384 2024-05-20T17:33:24.459 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:24.459 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-05-20T17:33:24.459 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "d66c7de0-7eef-40b4-954c-3c3502ff5c94", 2024-05-20T17:33:24.459 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-05-20T17:33:24.459 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:24.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 msgr2=0x7f7f780a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 0x7f7f780a5320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f84005940 tx=0x7f7f840058d0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 msgr2=0x7f7f9019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005fd0 tx=0x7f7f8000dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 shutdown_connections 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7f780a2e10 0x7f7f780a5320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f9010c330 0x7f7f9019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f901079d0 0x7f7f9019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 --2- 172.21.15.135:0/2043211218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f90101aa0 0x7f7f9019a600 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 >> 172.21.15.135:0/2043211218 conn(0x7f7f900770b0 msgr2=0x7f7f90103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 shutdown_connections 2024-05-20T17:33:24.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.450+0000 7f7f95ab6640 1 -- 172.21.15.135:0/2043211218 wait complete. 2024-05-20T17:33:24.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:33:24.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:33:24.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4237288440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1394720591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:33:24.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:24 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/234363344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:24.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 -- 172.21.15.135:0/4126406426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab4105930 msgr2=0x7fbab4105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 --2- 172.21.15.135:0/4126406426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab4105930 0x7fbab4105d60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009900 tx=0x7fbaa802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 -- 172.21.15.135:0/4126406426 shutdown_connections 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 --2- 172.21.15.135:0/4126406426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41063f0 0x7fbab410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 --2- 172.21.15.135:0/4126406426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab4105930 0x7fbab4105d60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 --2- 172.21.15.135:0/4126406426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab41013f0 0x7fbab4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 -- 172.21.15.135:0/4126406426 >> 172.21.15.135:0/4126406426 conn(0x7fbab4076830 msgr2=0x7fbab4076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 -- 172.21.15.135:0/4126406426 shutdown_connections 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 -- 172.21.15.135:0/4126406426 wait complete. 2024-05-20T17:33:24.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.582+0000 7fbab9b65640 1 Processor -- start 2024-05-20T17:33:24.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 -- start start 2024-05-20T17:33:24.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41013f0 0x7fbab40fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab4105930 0x7fbab40fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4111ce0 con 0x7fbab41063f0 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4111b60 con 0x7fbab41013f0 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab9b65640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4111e60 con 0x7fbab4105930 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51494/0 (socket says 172.21.15.135:51494) 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 -- 172.21.15.135:0/2105699974 learned_addr learned my addr 172.21.15.135:0/2105699974 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41013f0 0x7fbab40fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab4105930 0x7fbab40fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 -- 172.21.15.135:0/2105699974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab4105930 msgr2=0x7fbab40fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab4105930 0x7fbab40fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 -- 172.21.15.135:0/2105699974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41013f0 msgr2=0x7fbab40fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.583+0000 7fbab3fff640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41013f0 0x7fbab40fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab3fff640 1 -- 172.21.15.135:0/2105699974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41a7b70 con 0x7fbab41063f0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab3fff640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00eaa0 tx=0x7fbaac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab0ff9640 1 -- 172.21.15.135:0/2105699974 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00cdb0 con 0x7fbab41063f0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab0ff9640 1 -- 172.21.15.135:0/2105699974 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaac005020 con 0x7fbab41063f0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab0ff9640 1 -- 172.21.15.135:0/2105699974 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0116b0 con 0x7fbab41063f0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41a7e60 con 0x7fbab41063f0 2024-05-20T17:33:24.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.584+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41a8240 con 0x7fbab41063f0 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbab0ff9640 1 -- 172.21.15.135:0/2105699974 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7fbaac011850 con 0x7fbab41063f0 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 Processor -- start 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 -- start start 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f67fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f680270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b05f5e5d00 con 0x55b05f2c06b0 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b05f58d4c0 con 0x55b05f2e1390 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.587+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b05f5e1cc0 con 0x55b05f2b84d0 2024-05-20T17:33:24.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f680270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51502/0 (socket says 172.21.15.135:51502) 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab2ffd640 1 -- 172.21.15.135:0/3366424162 learned_addr learned my addr 172.21.15.135:0/3366424162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab0ff9640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 0x7fba9c0a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f67fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab3fff640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 0x7fba9c0a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 -- 172.21.15.135:0/3366424162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 msgr2=0x55b05f67fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f67fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab0ff9640 1 -- 172.21.15.135:0/2105699974 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbaac0cf670 con 0x7fbab41063f0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 -- 172.21.15.135:0/3366424162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 msgr2=0x55b05f6807b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 -- 172.21.15.135:0/3366424162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05f3c37d0 con 0x55b05f2b84d0 2024-05-20T17:33:24.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab37fe640 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f680270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009c00 tx=0x7fbaa4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b3d1c334518ef64 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fbab3fff640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 0x7fba9c0a5320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0ccd60 tx=0x7fbaac01c040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fba99ffb640 1 -- 172.21.15.135:0/3366424162 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4004050 con 0x55b05f2b84d0 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fba99ffb640 1 -- 172.21.15.135:0/3366424162 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa4005500 con 0x55b05f2b84d0 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.588+0000 7fba99ffb640 1 -- 172.21.15.135:0/3366424162 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4004df0 con 0x55b05f2b84d0 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 -- 172.21.15.135:0/3366424162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 msgr2=0x55b05f680270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f680270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009c00 tx=0x7fbaa4011810 comp rx=0 tx=0).stop 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 -- 172.21.15.135:0/3366424162 shutdown_connections 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f6807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f680270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/3366424162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f67fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 -- 172.21.15.135:0/3366424162 >> 172.21.15.135:0/3366424162 conn(0x55b05f2d54e0 msgr2=0x55b05f67c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 -- 172.21.15.135:0/3366424162 shutdown_connections 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.589+0000 7fbac0a0e740 1 -- 172.21.15.135:0/3366424162 wait complete. 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 -- start start 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 Processor -- start 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f68bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f68a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b05f68d020 con 0x55b05f2c06b0 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b05f5a0b90 con 0x55b05f2e1390 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b05f68d1a0 con 0x55b05f2b84d0 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbac0a0e740 10 client.0 _ll_register_callbacks cb 0x55b05f5dcda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbab37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbab37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51510/0 (socket says 172.21.15.135:51510) 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.590+0000 7fbab37fe640 1 -- 172.21.15.135:0/2757191801 learned_addr learned my addr 172.21.15.135:0/2757191801 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f68a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f68bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 -- 172.21.15.135:0/2757191801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 msgr2=0x55b05f68bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f68bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 -- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 msgr2=0x55b05f68a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f68a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 -- 172.21.15.135:0/2757191801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05f2f93f0 con 0x55b05f2c06b0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbaa401b040 tx=0x7fbaa4005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f471ff88febac57a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fba92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4029070 con 0x55b05f2c06b0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbaa40037f0 con 0x55b05f2c06b0 2024-05-20T17:33:24.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa4005500 con 0x55b05f2c06b0 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbaa4035050 con 0x55b05f2c06b0 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbac0a0e740 10 client.15504 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.591+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b05f2b90f0 con 0x55b05f2c06b0 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa4005500 con 0x55b05f2c06b0 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fbaa4004f60 con 0x55b05f2c06b0 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 10 client.15504 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 20 client.15504 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f29ff60 0x55b05f69cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 4 client.15504 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b05f5f3430 con 0x55b05f29ff60 2024-05-20T17:33:24.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f29ff60 0x55b05f69cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fba92ffd640 10 client.15504 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.592+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f29ff60 0x55b05f69cb00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6bc84666a421579 server_cookie=b8046fbe76799283 in_seq=0 out_seq=0 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fba92ffd640 1 -- 172.21.15.135:0/2757191801 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b05f5f3430 con 0x55b05f29ff60 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fba92ffd640 10 client.15504 handle_command_reply: tid=0 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 client.15504 shutdown 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 msgr2=0x55b05f68c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbaa401b040 tx=0x7fbaa4005750 comp rx=0 tx=0).stop 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 shutdown_connections 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f29ff60 0x55b05f69cb00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f68a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fba92ffd640 0 client.15504 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2c06b0 0x55b05f68c440 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2757191801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2b84d0 0x55b05f68bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 >> 172.21.15.135:0/2757191801 conn(0x55b05f2d54e0 msgr2=0x55b05f681a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 shutdown_connections 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2757191801 wait complete. 2024-05-20T17:33:24.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.593+0000 7fbac0a0e740 20 client.15504 trim_cache size 0 max 16384 2024-05-20T17:33:24.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 Processor -- start 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 -- start start 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f68a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f688f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b34c0 con 0x55b05f2b84d0 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b0d90 con 0x55b05f2e1390 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41aebe0 con 0x55b05f2c06b0 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51512/0 (socket says 172.21.15.135:51512) 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.611+0000 7fbab2ffd640 1 -- 172.21.15.135:0/1748114200 learned_addr learned my addr 172.21.15.135:0/1748114200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab37fe640 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f68a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 -- 172.21.15.135:0/1748114200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 msgr2=0x55b05f68a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f68a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 -- 172.21.15.135:0/1748114200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 msgr2=0x55b05f688f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f688f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 -- 172.21.15.135:0/1748114200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05f67ced0 con 0x55b05f2b84d0 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8000c00 tx=0x7fbaa8041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c6efe5cc468220 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fba997fa640 1 -- 172.21.15.135:0/1748114200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa804f020 con 0x55b05f2b84d0 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fba997fa640 1 -- 172.21.15.135:0/1748114200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa80043b0 con 0x55b05f2b84d0 2024-05-20T17:33:24.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.612+0000 7fba997fa640 1 -- 172.21.15.135:0/1748114200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8035040 con 0x55b05f2b84d0 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- 172.21.15.135:0/1748114200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 msgr2=0x55b05f6856d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8000c00 tx=0x7fbaa8041040 comp rx=0 tx=0).stop 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- 172.21.15.135:0/1748114200 shutdown_connections 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2e1390 0x55b05f688f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f68a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/1748114200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2b84d0 0x55b05f6856d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- 172.21.15.135:0/1748114200 >> 172.21.15.135:0/1748114200 conn(0x55b05f2d54e0 msgr2=0x55b05f688880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- 172.21.15.135:0/1748114200 shutdown_connections 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- 172.21.15.135:0/1748114200 wait complete. 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.613+0000 7fbac0a0e740 1 -- start start 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 Processor -- start 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 0x55b05f692260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f6927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 0x55b05f68f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41af250 con 0x55b05f2e1390 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b06c0 con 0x55b05f2b84d0 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41af920 con 0x55b05f2c06b0 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbac0a0e740 10 client.0 _ll_register_callbacks cb 0x7fbaa8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:24.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 0x55b05f68f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f6927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 0x55b05f68f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51522/0 (socket says 172.21.15.135:51522) 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab2ffd640 1 -- 172.21.15.135:0/2175517356 learned_addr learned my addr 172.21.15.135:0/2175517356 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 0x55b05f692260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 -- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 msgr2=0x55b05f692260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 0x55b05f692260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 -- 172.21.15.135:0/2175517356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 msgr2=0x55b05f68f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 0x55b05f68f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab37fe640 1 -- 172.21.15.135:0/2175517356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05f68fd80 con 0x55b05f2c06b0 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.614+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 0x55b05f692260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbab37fe640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f6927a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4005300 tx=0x7fbaa4011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1118e274ad462cd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4029070 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbaa40234b0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa80043b0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbaa40236d0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 10 client.25162 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b05f7046b0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa80043b0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fbaa4004eb0 con 0x55b05f2c06b0 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 10 client.25162 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 10 client.25162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:24.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 20 client.25162 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f2753a0 0x55b05f706da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 4 client.25162 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.615+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b05f5ed780 con 0x55b05f2753a0 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f2753a0 0x55b05f706da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fba92ffd640 10 client.25162 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbab2ffd640 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f2753a0 0x55b05f706da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74969f5d4718a95d server_cookie=d5ee4c80480b4a93 in_seq=0 out_seq=0 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fba92ffd640 1 -- 172.21.15.135:0/2175517356 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b05f5ed780 con 0x55b05f2753a0 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fba92ffd640 10 client.25162 handle_command_reply: tid=0 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 client.25162 shutdown 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 msgr2=0x55b05f6927a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f6927a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4005300 tx=0x7fbaa4011d40 comp rx=0 tx=0).stop 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 shutdown_connections 2024-05-20T17:33:24.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b05f2753a0 0x55b05f706da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b05f2e1390 0x55b05f68f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b05f2c06b0 0x55b05f6927a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 --2- 172.21.15.135:0/2175517356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b05f2b84d0 0x55b05f692260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fba92ffd640 0 client.25162 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.616+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 >> 172.21.15.135:0/2175517356 conn(0x55b05f2d54e0 msgr2=0x55b05f681f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 shutdown_connections 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbac0a0e740 1 -- 172.21.15.135:0/2175517356 wait complete. 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbac0a0e740 20 client.25162 trim_cache size 0 max 16384 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:24.625 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: "d66c7de0-7eef-40b4-954c-3c3502ff5c94": { 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "d66c7de0-7eef-40b4-954c-3c3502ff5c94", 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:33:24.626 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 msgr2=0x7fba9c0a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 0x7fba9c0a5320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0ccd60 tx=0x7fbaac01c040 comp rx=0 tx=0).stop 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 msgr2=0x7fbab40fe470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00eaa0 tx=0x7fbaac00ef60 comp rx=0 tx=0).stop 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 shutdown_connections 2024-05-20T17:33:24.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba9c0a2e10 0x7fba9c0a5320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab41063f0 0x7fbab40fe470 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab4105930 0x7fbab40fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 --2- 172.21.15.135:0/2105699974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab41013f0 0x7fbab40fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 >> 172.21.15.135:0/2105699974 conn(0x7fbab4076830 msgr2=0x7fbab4104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 shutdown_connections 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.617+0000 7fbab9b65640 1 -- 172.21.15.135:0/2105699974 wait complete. 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.621+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f677c1a63f0 con 0x7f677c10a720 2024-05-20T17:33:24.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.626+0000 7f67797fa640 1 -- 172.21.15.135:0/3890029046 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v26)=0 v26) ==== 129+0+0 (secure 0 0 0) 0x7f677009bda0 con 0x7f677c10a720 2024-05-20T17:33:24.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 msgr2=0x7f67640a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 0x7f67640a5310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f676c000c00 tx=0x7f676c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 msgr2=0x7f677c199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 0x7f677c199d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f677000e9f0 tx=0x7f677000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 shutdown_connections 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f67640a2e00 0x7f67640a5310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f677c10d080 0x7f677c19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c10a720 0x7f677c199d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 --2- 172.21.15.135:0/3890029046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c103cc0 0x7f677c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 >> 172.21.15.135:0/3890029046 conn(0x7f677c077160 msgr2=0x7f677c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.629+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 shutdown_connections 2024-05-20T17:33:24.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.630+0000 7f67825f5640 1 -- 172.21.15.135:0/3890029046 wait complete. 2024-05-20T17:33:24.632 INFO:tasks.cephfs.filesystem:scrub status for tag:d66c7de0-7eef-40b4-954c-3c3502ff5c94 - {'path': '/', 'tag': 'd66c7de0-7eef-40b4-954c-3c3502ff5c94', 'options': 'recursive,force'} 2024-05-20T17:33:24.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-20T17:33:24.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- 172.21.15.135:0/757896868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54106250 msgr2=0x7f4b54106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 --2- 172.21.15.135:0/757896868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54106250 0x7f4b54106660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009900 tx=0x7f4b4002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- 172.21.15.135:0/757896868 shutdown_connections 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 --2- 172.21.15.135:0/757896868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106cd0 0x7f4b5410e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 --2- 172.21.15.135:0/757896868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54106250 0x7f4b54106660 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 --2- 172.21.15.135:0/757896868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54102390 0x7f4b541027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- 172.21.15.135:0/757896868 >> 172.21.15.135:0/757896868 conn(0x7f4b540fc850 msgr2=0x7f4b540feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- 172.21.15.135:0/757896868 shutdown_connections 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- 172.21.15.135:0/757896868 wait complete. 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 Processor -- start 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.799+0000 7f4b5af16640 1 -- start start 2024-05-20T17:33:24.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 0x7f4b54198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54106cd0 0x7f4b5419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54111d20 con 0x7f4b54102390 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54111ba0 con 0x7f4b54106250 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b5af16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54111ea0 con 0x7f4b54106cd0 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51540/0 (socket says 172.21.15.135:51540) 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 -- 172.21.15.135:0/816347111 learned_addr learned my addr 172.21.15.135:0/816347111 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b53fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 0x7f4b54198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b594b3640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54106cd0 0x7f4b5419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 -- 172.21.15.135:0/816347111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54106cd0 msgr2=0x7f4b5419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54106cd0 0x7f4b5419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 -- 172.21.15.135:0/816347111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 msgr2=0x7f4b54198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 0x7f4b54198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 -- 172.21.15.135:0/816347111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5419d580 con 0x7f4b54102390 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b53fff640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 0x7f4b54198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b58cb2640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b48005fd0 tx=0x7f4b4800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48017070 con 0x7f4b54102390 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.800+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b48009c30 con 0x7f4b54102390 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.801+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5419d870 con 0x7f4b54102390 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.801+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48010460 con 0x7f4b54102390 2024-05-20T17:33:24.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.801+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b541a51f0 con 0x7f4b54102390 2024-05-20T17:33:24.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.802+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b54102ef0 con 0x7f4b54102390 2024-05-20T17:33:24.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.803+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f4b48003e70 con 0x7f4b54102390 2024-05-20T17:33:24.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.803+0000 7f4b51ffb640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 0x7f4b440a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:24.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.804+0000 7f4b53fff640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 0x7f4b440a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:24.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.804+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4b480cf320 con 0x7f4b54102390 2024-05-20T17:33:24.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.804+0000 7f4b53fff640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 0x7f4b440a5290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005940 tx=0x7f4b400058d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:24.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.810+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4b48020030 con 0x7f4b54102390 2024-05-20T17:33:24.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.989+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f4b54109ae0 con 0x7f4b54102390 2024-05-20T17:33:24.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.993+0000 7f4b51ffb640 1 -- 172.21.15.135:0/816347111 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) ==== 138+0+0 (secure 0 0 0) 0x7f4b4809bdd0 con 0x7f4b54102390 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.995+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 msgr2=0x7f4b440a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.995+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 0x7f4b440a5290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b40005940 tx=0x7f4b400058d0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.995+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 msgr2=0x7f4b54198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.995+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b48005fd0 tx=0x7f4b4800dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 shutdown_connections 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4b440a2d80 0x7f4b440a5290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b54106cd0 0x7f4b5419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b54106250 0x7f4b54198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 --2- 172.21.15.135:0/816347111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b54102390 0x7f4b54198720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:24.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 >> 172.21.15.135:0/816347111 conn(0x7f4b540fc850 msgr2=0x7f4b541045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:24.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 shutdown_connections 2024-05-20T17:33:24.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:24.996+0000 7f4b5af16640 1 -- 172.21.15.135:0/816347111 wait complete. 2024-05-20T17:33:25.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-20T17:33:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- 172.21.15.135:0/686311540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107ed0 msgr2=0x7f7434101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 --2- 172.21.15.135:0/686311540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107ed0 0x7f7434101b20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7428009900 tx=0x7f742802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- 172.21.15.135:0/686311540 shutdown_connections 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 --2- 172.21.15.135:0/686311540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 --2- 172.21.15.135:0/686311540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107ed0 0x7f7434101b20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 --2- 172.21.15.135:0/686311540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107a30 0x7f74341015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- 172.21.15.135:0/686311540 >> 172.21.15.135:0/686311540 conn(0x7f74340fd210 msgr2=0x7f74340ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- 172.21.15.135:0/686311540 shutdown_connections 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- 172.21.15.135:0/686311540 wait complete. 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 Processor -- start 2024-05-20T17:33:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.122+0000 7f743a9c3640 1 -- start start 2024-05-20T17:33:25.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107ed0 0x7f743419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111df0 con 0x7f7434107a30 2024-05-20T17:33:25.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111c70 con 0x7f7434102190 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f743a9c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111f70 con 0x7f7434107ed0 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f7433fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f7433fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:58072/0 (socket says 172.21.15.135:58072) 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f7433fff640 1 -- 172.21.15.135:0/3810146023 learned_addr learned my addr 172.21.15.135:0/3810146023 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51562/0 (socket says 172.21.15.135:51562) 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f7438f60640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107ed0 0x7f743419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 -- 172.21.15.135:0/3810146023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107ed0 msgr2=0x7f743419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107ed0 0x7f743419b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 -- 172.21.15.135:0/3810146023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 msgr2=0x7f743419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 -- 172.21.15.135:0/3810146023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74341a59b0 con 0x7f7434107a30 2024-05-20T17:33:25.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f7433fff640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74337fe640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7428009230 tx=0x7f7428003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.123+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742803f070 con 0x7f7434107a30 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.124+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7428031c90 con 0x7f7434107a30 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.124+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74341a5c40 con 0x7f7434107a30 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.124+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428035030 con 0x7f7434107a30 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.124+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74341a6100 con 0x7f7434107a30 2024-05-20T17:33:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.125+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743404f720 con 0x7f7434107a30 2024-05-20T17:33:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.126+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f7428042070 con 0x7f7434107a30 2024-05-20T17:33:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.126+0000 7f74317fa640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 0x7f741c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.127+0000 7f7433fff640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 0x7f741c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.127+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f74280f03b0 con 0x7f7434107a30 2024-05-20T17:33:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.127+0000 7f7433fff640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 0x7f741c0a5290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7424004650 tx=0x7f7424005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.130+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f74280bc810 con 0x7f7434107a30 2024-05-20T17:33:25.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.312+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f74341a6340 con 0x7f7434107a30 2024-05-20T17:33:25.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.319+0000 7f74317fa640 1 -- 172.21.15.135:0/3810146023 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) ==== 133+0+0 (secure 0 0 0) 0x7f74280c0b10 con 0x7f7434107a30 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 msgr2=0x7f741c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 0x7f741c0a5290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7424004650 tx=0x7f7424005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 msgr2=0x7f743419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7428009230 tx=0x7f7428003b90 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 shutdown_connections 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f741c0a2d80 0x7f741c0a5290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7434107ed0 0x7f743419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7434107a30 0x7f743419abb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 --2- 172.21.15.135:0/3810146023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7434102190 0x7f743419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 >> 172.21.15.135:0/3810146023 conn(0x7f74340fd210 msgr2=0x7f74340fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 shutdown_connections 2024-05-20T17:33:25.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.321+0000 7f743a9c3640 1 -- 172.21.15.135:0/3810146023 wait complete. 2024-05-20T17:33:25.334 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.334 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.334 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/821997064' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: scrub queued for path: / 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='client.? ' entity='client.admin' 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/816347111' entity='client.admin' 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:25 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-20T17:33:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 -- 172.21.15.135:0/1725590730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a8410d060 msgr2=0x7f0a8410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 --2- 172.21.15.135:0/1725590730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a8410d060 0x7f0a8410f550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009ca0 tx=0x7f0a7c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 -- 172.21.15.135:0/1725590730 shutdown_connections 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 --2- 172.21.15.135:0/1725590730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a8410d060 0x7f0a8410f550 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 --2- 172.21.15.135:0/1725590730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 0x7f0a8410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 --2- 172.21.15.135:0/1725590730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a84103c10 0x7f0a84104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 -- 172.21.15.135:0/1725590730 >> 172.21.15.135:0/1725590730 conn(0x7f0a840fd210 msgr2=0x7f0a840ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 -- 172.21.15.135:0/1725590730 shutdown_connections 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.453+0000 7f0a8983d640 1 -- 172.21.15.135:0/1725590730 wait complete. 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 Processor -- start 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 -- start start 2024-05-20T17:33:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 0x7f0a84199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8410d060 0x7f0a8419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84112e20 con 0x7f0a84103c10 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84112ca0 con 0x7f0a8410a670 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a8983d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84112fa0 con 0x7f0a8410d060 2024-05-20T17:33:25.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a82ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a82ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51566/0 (socket says 172.21.15.135:51566) 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a82ffd640 1 -- 172.21.15.135:0/2018501654 learned_addr learned my addr 172.21.15.135:0/2018501654 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a827fc640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 0x7f0a84199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.454+0000 7f0a837fe640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8410d060 0x7f0a8419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 -- 172.21.15.135:0/2018501654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8410d060 msgr2=0x7f0a8419df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8410d060 0x7f0a8419df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 -- 172.21.15.135:0/2018501654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 msgr2=0x7f0a84199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 0x7f0a84199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 -- 172.21.15.135:0/2018501654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8419e5a0 con 0x7f0a84103c10 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a82ffd640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e9f0 tx=0x7f0a7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400ccc0 con 0x7f0a84103c10 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a7400ce60 con 0x7f0a84103c10 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8419e890 con 0x7f0a84103c10 2024-05-20T17:33:25.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74010690 con 0x7f0a84103c10 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.455+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8419ed90 con 0x7f0a84103c10 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.456+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8404f720 con 0x7f0a84103c10 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.457+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f0a740046c0 con 0x7f0a84103c10 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.458+0000 7f0a8883b640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 0x7f0a6c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.458+0000 7f0a827fc640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 0x7f0a6c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.458+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0a740cfa10 con 0x7f0a84103c10 2024-05-20T17:33:25.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.458+0000 7f0a827fc640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 0x7f0a6c0a5290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a8410eea0 tx=0x7f0a78005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.462+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0a8419ed90 con 0x7f0a84103c10 2024-05-20T17:33:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-20T17:33:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/821997064' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: scrub queued for path: / 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='client.? ' entity='client.admin' 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/816347111' entity='client.admin' 2024-05-20T17:33:25.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:25 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: Updating smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/821997064' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: scrub queued for path: / 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='client.? ' entity='client.admin' 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/816347111' entity='client.admin' 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:25.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:25 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.666+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0a8410db80 con 0x7f0a6c0a2d80 2024-05-20T17:33:25.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.729+0000 7f0a8883b640 1 -- 172.21.15.135:0/2018501654 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0a8410db80 con 0x7f0a6c0a2d80 2024-05-20T17:33:25.731 INFO:teuthology.orchestra.run.smithi135.stdout:Schedule set for path / 2024-05-20T17:33:25.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 msgr2=0x7f0a6c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 0x7f0a6c0a5290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a8410eea0 tx=0x7f0a78005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:25.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 msgr2=0x7f0a84199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e9f0 tx=0x7f0a7400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 shutdown_connections 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a6c0a2d80 0x7f0a6c0a5290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8410d060 0x7f0a8419df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a8410a670 0x7f0a84199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.732+0000 7f0a8983d640 1 --2- 172.21.15.135:0/2018501654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84103c10 0x7f0a84199740 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.733+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 >> 172.21.15.135:0/2018501654 conn(0x7f0a840fd210 msgr2=0x7f0a8410d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.733+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 shutdown_connections 2024-05-20T17:33:25.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.733+0000 7f0a8983d640 1 -- 172.21.15.135:0/2018501654 wait complete. 2024-05-20T17:33:25.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-20T17:33:25.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 -- 172.21.15.135:0/175782130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48102170 msgr2=0x7f5b4810e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/175782130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48102170 0x7f5b4810e4a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009900 tx=0x7f5b4002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:25.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 -- 172.21.15.135:0/175782130 shutdown_connections 2024-05-20T17:33:25.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/175782130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48102170 0x7f5b4810e4a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/175782130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48107eb0 0x7f5b48101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/175782130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 0x7f5b481015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 -- 172.21.15.135:0/175782130 >> 172.21.15.135:0/175782130 conn(0x7f5b48077160 msgr2=0x7f5b480775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 -- 172.21.15.135:0/175782130 shutdown_connections 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 -- 172.21.15.135:0/175782130 wait complete. 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.861+0000 7f5b4dc51640 1 Processor -- start 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 -- start start 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48102170 0x7f5b4819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 0x7f5b4819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111da0 con 0x7f5b48107eb0 2024-05-20T17:33:25.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111c20 con 0x7f5b48102170 2024-05-20T17:33:25.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b4dc51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111f20 con 0x7f5b48107a10 2024-05-20T17:33:25.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51590/0 (socket says 172.21.15.135:51590) 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 -- 172.21.15.135:0/2998541535 learned_addr learned my addr 172.21.15.135:0/2998541535 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b477fe640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48102170 0x7f5b4819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b46ffd640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 0x7f5b4819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 -- 172.21.15.135:0/2998541535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 msgr2=0x7f5b4819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 0x7f5b4819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 -- 172.21.15.135:0/2998541535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48102170 msgr2=0x7f5b4819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48102170 0x7f5b4819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.862+0000 7f5b47fff640 1 -- 172.21.15.135:0/2998541535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b481a58c0 con 0x7f5b48107eb0 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b47fff640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b40005ab0 tx=0x7f5b40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4003f030 con 0x7f5b48107eb0 2024-05-20T17:33:25.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b40003ad0 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b481a5b50 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40035070 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.863+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b481a6040 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.864+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b480690c0 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.865+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f5b40042030 con 0x7f5b48107eb0 2024-05-20T17:33:25.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.866+0000 7f5b44ff9640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 0x7f5b300a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:25.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.866+0000 7f5b477fe640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 0x7f5b300a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:25.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.866+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5b400f0260 con 0x7f5b48107eb0 2024-05-20T17:33:25.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.867+0000 7f5b477fe640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 0x7f5b300a5290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b4806b540 tx=0x7f5b38005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:25.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:25.870+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b400bccb0 con 0x7f5b48107eb0 2024-05-20T17:33:26.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.069+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f5b48061f90 con 0x7f5b300a2d80 2024-05-20T17:33:26.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.128+0000 7f5b44ff9640 1 -- 172.21.15.135:0/2998541535 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f5b48061f90 con 0x7f5b300a2d80 2024-05-20T17:33:26.130 INFO:teuthology.orchestra.run.smithi135.stdout:Retention added to path / 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 msgr2=0x7f5b300a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 0x7f5b300a5290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b4806b540 tx=0x7f5b38005f90 comp rx=0 tx=0).stop 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 msgr2=0x7f5b4819b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b40005ab0 tx=0x7f5b40004270 comp rx=0 tx=0).stop 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 shutdown_connections 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5b300a2d80 0x7f5b300a5290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b48107eb0 0x7f5b4819b0c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b48107a10 0x7f5b4819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 --2- 172.21.15.135:0/2998541535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b48102170 0x7f5b4819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 >> 172.21.15.135:0/2998541535 conn(0x7f5b48077160 msgr2=0x7f5b480ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:26.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.130+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 shutdown_connections 2024-05-20T17:33:26.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.131+0000 7f5b4dc51640 1 -- 172.21.15.135:0/2998541535 wait complete. 2024-05-20T17:33:26.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-20T17:33:26.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 -- 172.21.15.135:0/4265160981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664101060 msgr2=0x7f4664101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4265160981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664101060 0x7f4664101470 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4658009900 tx=0x7f465802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 -- 172.21.15.135:0/4265160981 shutdown_connections 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4265160981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f466410d560 0x7f466410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4265160981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664101060 0x7f4664101470 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4265160981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4664108bb0 0x7f4664100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 -- 172.21.15.135:0/4265160981 >> 172.21.15.135:0/4265160981 conn(0x7f46640fc850 msgr2=0x7f46640feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 -- 172.21.15.135:0/4265160981 shutdown_connections 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 -- 172.21.15.135:0/4265160981 wait complete. 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.254+0000 7f4669d5e640 1 Processor -- start 2024-05-20T17:33:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 -- start start 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4664101060 0x7f46641997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f466410d560 0x7f466419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4664112e70 con 0x7f4664108bb0 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4664112cf0 con 0x7f4664101060 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4669d5e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4664112ff0 con 0x7f466410d560 2024-05-20T17:33:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51612/0 (socket says 172.21.15.135:51612) 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 -- 172.21.15.135:0/4239216514 learned_addr learned my addr 172.21.15.135:0/4239216514 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f46637fe640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4664101060 0x7f46641997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4663fff640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f466410d560 0x7f466419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 -- 172.21.15.135:0/4239216514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f466410d560 msgr2=0x7f466419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f466410d560 0x7f466419e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 -- 172.21.15.135:0/4239216514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4664101060 msgr2=0x7f46641997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4664101060 0x7f46641997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 -- 172.21.15.135:0/4239216514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466419e5d0 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.255+0000 7f4662ffd640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4658006010 tx=0x7f46580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.256+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465803f030 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.256+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466419e860 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.256+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4658003ce0 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.256+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658035070 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.256+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466419eda0 con 0x7f4664108bb0 2024-05-20T17:33:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.257+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466404f720 con 0x7f4664108bb0 2024-05-20T17:33:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.258+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f4658042030 con 0x7f4664108bb0 2024-05-20T17:33:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.259+0000 7f4660ff9640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 0x7f464c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.259+0000 7f46637fe640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 0x7f464c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.259+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f46580efdf0 con 0x7f4664108bb0 2024-05-20T17:33:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.259+0000 7f46637fe640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 0x7f464c0a5290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4654005fd0 tx=0x7f465400b410 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.262+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f46580bc8a0 con 0x7f4664108bb0 2024-05-20T17:33:26.359 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:26 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3810146023' entity='client.admin' 2024-05-20T17:33:26.359 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:26 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:26.360 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:26 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:26.360 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:26 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:26.360 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:26 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:26.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.465+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f46640fd370 con 0x7f464c0a2d80 2024-05-20T17:33:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.473+0000 7f4660ff9640 1 -- 172.21.15.135:0/4239216514 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f46640fd370 con 0x7f464c0a2d80 2024-05-20T17:33:26.474 INFO:teuthology.orchestra.run.smithi135.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-20T00:00:00", "created": "2024-05-20T17:33:25", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-20T17:33:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 msgr2=0x7f464c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 0x7f464c0a5290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4654005fd0 tx=0x7f465400b410 comp rx=0 tx=0).stop 2024-05-20T17:33:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 msgr2=0x7f4664199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4658006010 tx=0x7f46580042f0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 shutdown_connections 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f464c0a2d80 0x7f464c0a5290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f466410d560 0x7f466419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4664108bb0 0x7f4664199d50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 --2- 172.21.15.135:0/4239216514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4664101060 0x7f46641997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 >> 172.21.15.135:0/4239216514 conn(0x7f46640fc850 msgr2=0x7f46640fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 shutdown_connections 2024-05-20T17:33:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.475+0000 7f4669d5e640 1 -- 172.21.15.135:0/4239216514 wait complete. 2024-05-20T17:33:26.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-20T17:33:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:26 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3810146023' entity='client.admin' 2024-05-20T17:33:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:26 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:26 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:26 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:26.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:26 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 -- 172.21.15.135:0/1197236239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08501017a0 msgr2=0x7f085010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 --2- 172.21.15.135:0/1197236239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08501017a0 0x7f085010f640 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0848009900 tx=0x7f084802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 -- 172.21.15.135:0/1197236239 shutdown_connections 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 --2- 172.21.15.135:0/1197236239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08501017a0 0x7f085010f640 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 --2- 172.21.15.135:0/1197236239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108fc0 0x7f0850101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 --2- 172.21.15.135:0/1197236239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850108b20 0x7f0850100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 -- 172.21.15.135:0/1197236239 >> 172.21.15.135:0/1197236239 conn(0x7f0850076860 msgr2=0x7f0850076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:26.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 -- 172.21.15.135:0/1197236239 shutdown_connections 2024-05-20T17:33:26.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.600+0000 7f08559ea640 1 -- 172.21.15.135:0/1197236239 wait complete. 2024-05-20T17:33:26.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 Processor -- start 2024-05-20T17:33:26.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 -- start start 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08501017a0 0x7f08501997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 0x7f0850199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0850112e80 con 0x7f0850108fc0 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0850112d00 con 0x7f08501017a0 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f08559ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0850113000 con 0x7f0850108b20 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51620/0 (socket says 172.21.15.135:51620) 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f084f7fe640 1 -- 172.21.15.135:0/671554451 learned_addr learned my addr 172.21.15.135:0/671554451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f084e7fc640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 0x7f0850199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.601+0000 7f084effd640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08501017a0 0x7f08501997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 -- 172.21.15.135:0/671554451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08501017a0 msgr2=0x7f08501997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08501017a0 0x7f08501997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 -- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 msgr2=0x7f085019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 -- 172.21.15.135:0/671554451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085019e600 con 0x7f0850108b20 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084f7fe640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f084e7fc640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 0x7f0850199d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0850074450 tx=0x7f084400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084400cc40 con 0x7f0850108b20 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085019e8f0 con 0x7f0850108b20 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f084400cde0 con 0x7f0850108b20 2024-05-20T17:33:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844010690 con 0x7f0850108b20 2024-05-20T17:33:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.602+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085019edf0 con 0x7f0850108b20 2024-05-20T17:33:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.603+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085004f720 con 0x7f0850108b20 2024-05-20T17:33:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.604+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f0844010830 con 0x7f0850108b20 2024-05-20T17:33:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.605+0000 7f08549e8640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 0x7f08380a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.605+0000 7f084effd640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 0x7f08380a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.605+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f08440cf970 con 0x7f0850108b20 2024-05-20T17:33:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.605+0000 7f084effd640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 0x7f08380a5290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0850068ca0 tx=0x7f0840009500 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.609+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f085019edf0 con 0x7f0850108b20 2024-05-20T17:33:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:26 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3810146023' entity='client.admin' 2024-05-20T17:33:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:26 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:33:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:26 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:33:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:26 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:33:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:26 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:33:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.805+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f085010ac90 con 0x7f08380a2d80 2024-05-20T17:33:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.811+0000 7f08549e8640 1 -- 172.21.15.135:0/671554451 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f085010ac90 con 0x7f08380a2d80 2024-05-20T17:33:26.813 INFO:teuthology.orchestra.run.smithi135.stdout:/ 1m 6m3h 2024-05-20T17:33:26.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 msgr2=0x7f08380a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 0x7f08380a5290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0850068ca0 tx=0x7f0840009500 comp rx=0 tx=0).stop 2024-05-20T17:33:26.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 msgr2=0x7f0850199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:26.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 0x7f0850199d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0850074450 tx=0x7f084400ee50 comp rx=0 tx=0).stop 2024-05-20T17:33:26.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 shutdown_connections 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f08380a2d80 0x7f08380a5290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850108fc0 0x7f085019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0850108b20 0x7f0850199d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 --2- 172.21.15.135:0/671554451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08501017a0 0x7f08501997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 >> 172.21.15.135:0/671554451 conn(0x7f0850076860 msgr2=0x7f08500ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 shutdown_connections 2024-05-20T17:33:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:26.814+0000 7f08559ea640 1 -- 172.21.15.135:0/671554451 wait complete. 2024-05-20T17:33:26.827 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-20T17:33:26.853 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-20T17:33:26.866 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-20T17:33:26.884 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:33:26.884 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-20T17:33:26.896 INFO:teuthology.run_tasks:Running task workunit... 2024-05-20T17:33:26.910 INFO:tasks.workunit:Pulling workunits from ref d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:33:26.911 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-20T17:33:26.911 INFO:tasks.workunit:timeout=3h 2024-05-20T17:33:26.911 INFO:tasks.workunit:cleanup=True 2024-05-20T17:33:26.911 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-20 17:31:20.501121330 +0000 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-20 17:31:20.501121330 +0000 2024-05-20T17:33:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-20 17:33:17.151588933 +0000 2024-05-20T17:33:26.928 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-20 17:31:20.501121330 +0000 2024-05-20T17:33:26.928 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-20T17:33:26.928 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-20T17:33:27.001 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:33:27.058 INFO:tasks.workunit.client.0.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-20T17:33:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:27 smithi135 ceph-mon[32027]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:27 smithi135 ceph-mon[32027]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:27 smithi135 ceph-mon[32027]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:27 smithi135 ceph-mon[32027]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:27 smithi160 ceph-mon[36261]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:27 smithi160 ceph-mon[36261]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:27 smithi160 ceph-mon[36261]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:27 smithi160 ceph-mon[36261]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:27 smithi172 ceph-mon[36511]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:27 smithi172 ceph-mon[36511]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:33:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:27 smithi172 ceph-mon[36511]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:27 smithi172 ceph-mon[36511]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:28.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:28 smithi135 ceph-mon[32027]: from='client.25198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:28.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:28 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:33:28.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:28 smithi160 ceph-mon[36261]: from='client.25198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:28.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:28 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:33:28.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:28 smithi172 ceph-mon[36511]: from='client.25198 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:33:28.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:28 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:33:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:29 smithi135 ceph-mon[32027]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 93 KiB/s wr, 47 op/s 2024-05-20T17:33:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:29 smithi160 ceph-mon[36261]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 93 KiB/s wr, 47 op/s 2024-05-20T17:33:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:29 smithi172 ceph-mon[36511]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 93 KiB/s wr, 47 op/s 2024-05-20T17:33:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:31 smithi135 ceph-mon[32027]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 73 KiB/s wr, 36 op/s 2024-05-20T17:33:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:31 smithi160 ceph-mon[36261]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 73 KiB/s wr, 36 op/s 2024-05-20T17:33:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:31 smithi172 ceph-mon[36511]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 73 KiB/s wr, 36 op/s 2024-05-20T17:33:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:33 smithi135 ceph-mon[32027]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 52 op/s 2024-05-20T17:33:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:33 smithi160 ceph-mon[36261]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 52 op/s 2024-05-20T17:33:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:33 smithi172 ceph-mon[36511]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 52 op/s 2024-05-20T17:33:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:35 smithi135 ceph-mon[32027]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-20T17:33:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:35 smithi160 ceph-mon[36261]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-20T17:33:35.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:35 smithi172 ceph-mon[36511]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-05-20T17:33:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:37 smithi135 ceph-mon[32027]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-20T17:33:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:37 smithi160 ceph-mon[36261]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-20T17:33:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:37 smithi172 ceph-mon[36511]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-20T17:33:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:39 smithi135 ceph-mon[32027]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-05-20T17:33:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:39 smithi160 ceph-mon[36261]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-05-20T17:33:39.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:39 smithi172 ceph-mon[36511]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 -- 172.21.15.135:0/2326272611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 msgr2=0x7f6de0102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 --2- 172.21.15.135:0/2326272611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0102c00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009900 tx=0x7f6dc802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 -- 172.21.15.135:0/2326272611 shutdown_connections 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 --2- 172.21.15.135:0/2326272611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 0x7f6de010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 --2- 172.21.15.135:0/2326272611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0102c00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 --2- 172.21.15.135:0/2326272611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 0x7f6de01026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 -- 172.21.15.135:0/2326272611 >> 172.21.15.135:0/2326272611 conn(0x7f6de0078220 msgr2=0x7f6de0078660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 -- 172.21.15.135:0/2326272611 shutdown_connections 2024-05-20T17:33:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.045+0000 7f6de593e640 1 -- 172.21.15.135:0/2326272611 wait complete. 2024-05-20T17:33:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 Processor -- start 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 -- start start 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 0x7f6de019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 0x7f6de019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6de0112e60 con 0x7f6de0108fc0 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6de0112ce0 con 0x7f6de0108b20 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6de593e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6de0112fe0 con 0x7f6de0103270 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6ddf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6ddf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44198/0 (socket says 172.21.15.135:44198) 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.046+0000 7f6ddf7fe640 1 -- 172.21.15.135:0/3036662929 learned_addr learned my addr 172.21.15.135:0/3036662929 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 0x7f6de019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 0x7f6de019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 -- 172.21.15.135:0/3036662929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 msgr2=0x7f6de019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 0x7f6de019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 -- 172.21.15.135:0/3036662929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 msgr2=0x7f6de019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 0x7f6de019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 -- 172.21.15.135:0/3036662929 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de0199db0 con 0x7f6de0108fc0 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6ddf7fe640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009fd0 tx=0x7f6dd800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6de493c640 1 -- 172.21.15.135:0/3036662929 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8017070 con 0x7f6de0108fc0 2024-05-20T17:33:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6de493c640 1 -- 172.21.15.135:0/3036662929 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd8003e50 con 0x7f6de0108fc0 2024-05-20T17:33:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de019a040 con 0x7f6de0108fc0 2024-05-20T17:33:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6de493c640 1 -- 172.21.15.135:0/3036662929 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80106c0 con 0x7f6de0108fc0 2024-05-20T17:33:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.047+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de01a62a0 con 0x7f6de0108fc0 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6de493c640 1 -- 172.21.15.135:0/3036662929 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f6dd8003970 con 0x7f6de0108fc0 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 Processor -- start 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 -- start start 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e0fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e0fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56510e062340 con 0x56510dd5e1b0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56510e00a290 con 0x56510dd3d4d0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56510e05e300 con 0x56510dd352f0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44202/0 (socket says 172.21.15.135:44202) 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.050+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1678263682 learned_addr learned my addr 172.21.15.135:0/1678263682 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e0fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e0fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6de493c640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 0x7f6dcc0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6ddf7fe640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 0x7f6dcc0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1678263682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 msgr2=0x56510e0fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e0fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1678263682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 msgr2=0x56510e0fdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e0fdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1678263682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510e02e8e0 con 0x56510dd5e1b0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e0fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6de493c640 1 -- 172.21.15.135:0/3036662929 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6dd80cf460 con 0x7f6de0108fc0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8031550 tx=0x7f6dc8031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6163f83b4eed9e32 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dd5ffb640 1 -- 172.21.15.135:0/1678263682 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8035070 con 0x56510dd5e1b0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6ddf7fe640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 0x7f6dcc0a5290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80ccb50 tx=0x7f6dd8086040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dd5ffb640 1 -- 172.21.15.135:0/1678263682 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc8005070 con 0x56510dd5e1b0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.051+0000 7f6dd5ffb640 1 -- 172.21.15.135:0/1678263682 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80049b0 con 0x56510dd5e1b0 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1678263682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 msgr2=0x56510e0fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8031550 tx=0x7f6dc8031900 comp rx=0 tx=0).stop 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1678263682 shutdown_connections 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e0fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e0fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1678263682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e0fd080 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1678263682 >> 172.21.15.135:0/1678263682 conn(0x56510dd52300 msgr2=0x56510e0f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1678263682 shutdown_connections 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.052+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1678263682 wait complete. 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 -- start start 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 Processor -- start 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e109180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 0x56510e107600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56510e10a150 con 0x56510dd3d4d0 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56510e01d790 con 0x56510dd5e1b0 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56510e10a2d0 con 0x56510dd352f0 2024-05-20T17:33:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dec7ed740 10 client.0 _ll_register_callbacks cb 0x56510e058a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44208/0 (socket says 172.21.15.135:44208) 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6ddeffd640 1 -- 172.21.15.135:0/3408825945 learned_addr learned my addr 172.21.15.135:0/3408825945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.053+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 0x56510e107600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 -- 172.21.15.135:0/3408825945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 msgr2=0x56510e109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 -- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 msgr2=0x56510e107600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 0x56510e107600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 -- 172.21.15.135:0/3408825945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510dd76210 con 0x56510dd3d4d0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 0x56510e107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000fe10 tx=0x7f6dd00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a602e3b77991e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0005220 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6dd00053c0 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc8005070 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6dd00055c0 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dec7ed740 10 client.15558 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56510de42620 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.054+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc8005070 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6dd0012aa0 con 0x56510dd3d4d0 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 10 client.15558 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 20 client.15558 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dd1cd80 0x56510e1199b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 4 client.15558 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56510e06fa70 con 0x56510dd1cd80 2024-05-20T17:33:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.055+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dd1cd80 0x56510e1199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.056+0000 7f6dbeffd640 10 client.15558 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.056+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dd1cd80 0x56510e1199b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0b65bc4e5e5344 server_cookie=577cc420226eb33c in_seq=0 out_seq=0 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.056+0000 7f6dbeffd640 1 -- 172.21.15.135:0/3408825945 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56510e06fa70 con 0x56510dd1cd80 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.056+0000 7f6dbeffd640 10 client.15558 handle_command_reply: tid=0 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.056+0000 7f6dec7ed740 1 client.15558 shutdown 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 msgr2=0x56510e1096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000fe10 tx=0x7f6dd00117b0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 shutdown_connections 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dd1cd80 0x56510e1199b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd5e1b0 0x56510e107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e1096c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dbeffd640 0 client.15558 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/3408825945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 >> 172.21.15.135:0/3408825945 conn(0x56510dd52300 msgr2=0x56510e0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 shutdown_connections 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 1 -- 172.21.15.135:0/3408825945 wait complete. 2024-05-20T17:33:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.057+0000 7f6dec7ed740 20 client.15558 trim_cache size 0 max 16384 2024-05-20T17:33:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 Processor -- start 2024-05-20T17:33:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 -- start start 2024-05-20T17:33:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd352f0 0x56510e0f9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 0x56510e11f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01b13c0 con 0x56510dd3d4d0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01aec90 con 0x56510dd352f0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01acae0 con 0x56510dd5e1b0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.072+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44224/0 (socket says 172.21.15.135:44224) 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 -- 172.21.15.135:0/406467900 learned_addr learned my addr 172.21.15.135:0/406467900 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd352f0 0x56510e0f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 0x56510e11f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 -- 172.21.15.135:0/406467900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 msgr2=0x56510e11f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 0x56510e11f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 -- 172.21.15.135:0/406467900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd352f0 msgr2=0x56510e0f9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd352f0 0x56510e0f9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 -- 172.21.15.135:0/406467900 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510e108f50 con 0x56510dd3d4d0 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 0x56510e11f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0006010 tx=0x7f6dd000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e23049e817ecea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dd57fa640 1 -- 172.21.15.135:0/406467900 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd002b040 con 0x56510dd3d4d0 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dd57fa640 1 -- 172.21.15.135:0/406467900 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd0025550 con 0x56510dd3d4d0 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.073+0000 7f6dd57fa640 1 -- 172.21.15.135:0/406467900 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd001c690 con 0x56510dd3d4d0 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- 172.21.15.135:0/406467900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 msgr2=0x56510e11f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0006010 tx=0x7f6dd000fa30 comp rx=0 tx=0).stop 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- 172.21.15.135:0/406467900 shutdown_connections 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd5e1b0 0x56510e11f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd3d4d0 0x56510e11f170 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/406467900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd352f0 0x56510e0f9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- 172.21.15.135:0/406467900 >> 172.21.15.135:0/406467900 conn(0x56510dd52300 msgr2=0x56510e0f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- 172.21.15.135:0/406467900 shutdown_connections 2024-05-20T17:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- 172.21.15.135:0/406467900 wait complete. 2024-05-20T17:33:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.074+0000 7f6dec7ed740 1 -- start start 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 Processor -- start 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e10f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e10ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01ad150 con 0x56510dd5e1b0 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01ae5c0 con 0x56510dd3d4d0 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01ad820 con 0x56510dd352f0 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dec7ed740 10 client.0 _ll_register_callbacks cb 0x7f6dd000f360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44234/0 (socket says 172.21.15.135:44234) 2024-05-20T17:33:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1543115958 learned_addr learned my addr 172.21.15.135:0/1543115958 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e10ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e10f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1543115958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 msgr2=0x56510e10f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e10f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 msgr2=0x56510e10ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e10ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 -- 172.21.15.135:0/1543115958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510e10d7f0 con 0x56510dd5e1b0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dde7fc640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8031bf0 tx=0x7f6dc8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32edb631dcf2f7fe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.075+0000 7f6dbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8059030 con 0x56510dd5e1b0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6dc8004040 con 0x56510dd5e1b0 2024-05-20T17:33:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dd0025550 con 0x56510dd5e1b0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6dc8063050 con 0x56510dd5e1b0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 10 client.15564 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56510e1819e0 con 0x56510dd5e1b0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd0025550 con 0x56510dd5e1b0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6dc803a040 con 0x56510dd5e1b0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 10 client.15564 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 20 client.15564 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dcf21c0 0x56510e183d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 4 client.15564 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.076+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56510e069dc0 con 0x56510dcf21c0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.077+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dcf21c0 0x56510e183d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.077+0000 7f6dbeffd640 10 client.15564 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.077+0000 7f6ddeffd640 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dcf21c0 0x56510e183d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d038d822c70bc931 server_cookie=234e0cdc2524f31b in_seq=0 out_seq=0 2024-05-20T17:33:40.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.089+0000 7f6dbeffd640 1 -- 172.21.15.135:0/1543115958 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56510e069dc0 con 0x56510dcf21c0 2024-05-20T17:33:40.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.089+0000 7f6dbeffd640 10 client.15564 handle_command_reply: tid=0 2024-05-20T17:33:40.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.089+0000 7f6dec7ed740 1 client.15564 shutdown 2024-05-20T17:33:40.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.089+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 msgr2=0x56510e10d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.089+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8031bf0 tx=0x7f6dc8005e70 comp rx=0 tx=0).stop 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 shutdown_connections 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56510dcf21c0 0x56510e183d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510dd5e1b0 0x56510e10d230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dbeffd640 0 client.15564 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56510dd3d4d0 0x56510e10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 --2- 172.21.15.135:0/1543115958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56510dd352f0 0x56510e10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 >> 172.21.15.135:0/1543115958 conn(0x56510dd52300 msgr2=0x56510e0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 shutdown_connections 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 1 -- 172.21.15.135:0/1543115958 wait complete. 2024-05-20T17:33:40.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6dec7ed740 20 client.15564 trim_cache size 0 max 16384 2024-05-20T17:33:40.093 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:33:40.093 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:33:40.093 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:33:40.093 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 msgr2=0x7f6dcc0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 0x7f6dcc0a5290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80ccb50 tx=0x7f6dd8086040 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 msgr2=0x7f6de0199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009fd0 tx=0x7f6dd800b260 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 shutdown_connections 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6dcc0a2d80 0x7f6dcc0a5290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6de0108fc0 0x7f6de0199680 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de0108b20 0x7f6de019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 --2- 172.21.15.135:0/3036662929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de0103270 0x7f6de019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.090+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 >> 172.21.15.135:0/3036662929 conn(0x7f6de0078220 msgr2=0x7f6de0101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.091+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 shutdown_connections 2024-05-20T17:33:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:40.091+0000 7f6de593e640 1 -- 172.21.15.135:0/3036662929 wait complete. 2024-05-20T17:33:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:41 smithi135 ceph-mon[32027]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-20T17:33:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:41 smithi160 ceph-mon[36261]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-20T17:33:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:41 smithi172 ceph-mon[36511]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-20T17:33:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:43 smithi135 ceph-mon[32027]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-20T17:33:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:43 smithi160 ceph-mon[36261]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-20T17:33:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:43 smithi172 ceph-mon[36511]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-05-20T17:33:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:45 smithi135 ceph-mon[32027]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:45 smithi160 ceph-mon[36261]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:45 smithi172 ceph-mon[36511]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:47 smithi135 ceph-mon[32027]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-20T17:33:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:47 smithi160 ceph-mon[36261]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-20T17:33:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:47 smithi172 ceph-mon[36511]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-20T17:33:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:49 smithi135 ceph-mon[32027]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:49 smithi160 ceph-mon[36261]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:49 smithi172 ceph-mon[36511]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:51 smithi135 ceph-mon[32027]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:51 smithi160 ceph-mon[36261]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:51 smithi172 ceph-mon[36511]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 -- 172.21.15.135:0/3224107579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838108b00 msgr2=0x7fc8381026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/3224107579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838108b00 0x7fc8381026a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc828009900 tx=0x7fc82802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 -- 172.21.15.135:0/3224107579 shutdown_connections 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/3224107579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838103250 0x7fc83810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/3224107579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108fa0 0x7fc838102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/3224107579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838108b00 0x7fc8381026a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 -- 172.21.15.135:0/3224107579 >> 172.21.15.135:0/3224107579 conn(0x7fc8380fe1e0 msgr2=0x7fc838100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 -- 172.21.15.135:0/3224107579 shutdown_connections 2024-05-20T17:33:53.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.200+0000 7fc83cd4b640 1 -- 172.21.15.135:0/3224107579 wait complete. 2024-05-20T17:33:53.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 Processor -- start 2024-05-20T17:33:53.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 -- start start 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108b00 0x7fc83819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838108fa0 0x7fc838199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc838112e90 con 0x7fc838103250 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc838112d10 con 0x7fc838108b00 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83cd4b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113010 con 0x7fc838108fa0 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42566/0 (socket says 172.21.15.135:42566) 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc83659c640 1 -- 172.21.15.135:0/2130214817 learned_addr learned my addr 172.21.15.135:0/2130214817 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:53.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108b00 0x7fc83819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.201+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838108fa0 0x7fc838199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 -- 172.21.15.135:0/2130214817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838108fa0 msgr2=0x7fc838199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838108fa0 0x7fc838199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 -- 172.21.15.135:0/2130214817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108b00 msgr2=0x7fc83819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108b00 0x7fc83819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 -- 172.21.15.135:0/2130214817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc838199da0 con 0x7fc838103250 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83659c640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc82802a930 tx=0x7fc828003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc8277fe640 1 -- 172.21.15.135:0/2130214817 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82803f070 con 0x7fc838103250 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc838199fd0 con 0x7fc838103250 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc8277fe640 1 -- 172.21.15.135:0/2130214817 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc828031c90 con 0x7fc838103250 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc8277fe640 1 -- 172.21.15.135:0/2130214817 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828035030 con 0x7fc838103250 2024-05-20T17:33:53.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.202+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381a6290 con 0x7fc838103250 2024-05-20T17:33:53.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 Processor -- start 2024-05-20T17:33:53.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc8277fe640 1 -- 172.21.15.135:0/2130214817 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7fc828042070 con 0x7fc838103250 2024-05-20T17:33:53.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 -- start start 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e617340 con 0x55bb9e2f24d0 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e5bf290 con 0x55bb9e3131b0 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.205+0000 7fc843bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e613300 con 0x55bb9e2ea2f0 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42580/0 (socket says 172.21.15.135:42580) 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 -- 172.21.15.135:0/2963806873 learned_addr learned my addr 172.21.15.135:0/2963806873 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:53.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc83659c640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc8277fe640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 0x7fc8200a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 0x7fc8200a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 -- 172.21.15.135:0/2963806873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 msgr2=0x55bb9e6b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 -- 172.21.15.135:0/2963806873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 msgr2=0x55bb9e6b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 -- 172.21.15.135:0/2963806873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9e5e38e0 con 0x55bb9e2f24d0 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc83659c640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc8277fe640 1 -- 172.21.15.135:0/2130214817 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc8280efd30 con 0x7fc838103250 2024-05-20T17:33:53.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00bb70 tx=0x7fc82c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39924e0c823bb377 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc824ff9640 1 -- 172.21.15.135:0/2963806873 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c004030 con 0x55bb9e2f24d0 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 0x7fc8200a5290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc830009fd0 tx=0x7fc830004ab0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc824ff9640 1 -- 172.21.15.135:0/2963806873 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82c005500 con 0x55bb9e2f24d0 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.206+0000 7fc824ff9640 1 -- 172.21.15.135:0/2963806873 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c004d00 con 0x55bb9e2f24d0 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 -- 172.21.15.135:0/2963806873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 msgr2=0x55bb9e6b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00bb70 tx=0x7fc82c0107a0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 -- 172.21.15.135:0/2963806873 shutdown_connections 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6b2b00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2963806873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.207+0000 7fc843bf1740 1 -- 172.21.15.135:0/2963806873 >> 172.21.15.135:0/2963806873 conn(0x55bb9e307300 msgr2=0x55bb9e6ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- 172.21.15.135:0/2963806873 shutdown_connections 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- 172.21.15.135:0/2963806873 wait complete. 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- start start 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 Processor -- start 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6bc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e6bf1b0 con 0x55bb9e2f24d0 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e5d2790 con 0x55bb9e3131b0 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb9e6bf330 con 0x55bb9e2ea2f0 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc843bf1740 10 client.0 _ll_register_callbacks cb 0x55bb9e60da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42596/0 (socket says 172.21.15.135:42596) 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.208+0000 7fc835d9b640 1 -- 172.21.15.135:0/1902402939 learned_addr learned my addr 172.21.15.135:0/1902402939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc83659c640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc836d9d640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 -- 172.21.15.135:0/1902402939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 msgr2=0x55bb9e6bc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6bc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 -- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 msgr2=0x55bb9e6c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 -- 172.21.15.135:0/1902402939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9e32b210 con 0x55bb9e2f24d0 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc83659c640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6bc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc836d9d640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc835d9b640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc82c004920 tx=0x7fc82c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4610bb9250d33cab server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc81dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c02a060 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc82c004250 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82c005500 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc82c004450 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc843bf1740 10 client.15576 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.209+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bb9e3f7620 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82c005500 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc82c004c90 con 0x55bb9e2f24d0 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 10 client.15576 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 20 client.15576 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e2d1d80 0x55bb9e6ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 4 client.15576 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb9e624a70 con 0x55bb9e2d1d80 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc83659c640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e2d1d80 0x55bb9e6ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc81dffb640 10 client.15576 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.210+0000 7fc83659c640 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e2d1d80 0x55bb9e6ce8b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fcdc8ab3f2c88d2 server_cookie=a75963db1df32a8 in_seq=0 out_seq=0 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc81dffb640 1 -- 172.21.15.135:0/1902402939 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb9e624a70 con 0x55bb9e2d1d80 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc81dffb640 10 client.15576 handle_command_reply: tid=0 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 client.15576 shutdown 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 msgr2=0x55bb9e6bcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc82c004920 tx=0x7fc82c00bf50 comp rx=0 tx=0).stop 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 shutdown_connections 2024-05-20T17:33:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e2d1d80 0x55bb9e6ce8b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e3131b0 0x55bb9e6c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6bcce0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc81dffb640 0 client.15576 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 --2- 172.21.15.135:0/1902402939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6bc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 >> 172.21.15.135:0/1902402939 conn(0x55bb9e307300 msgr2=0x55bb9e6b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 shutdown_connections 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.211+0000 7fc843bf1740 1 -- 172.21.15.135:0/1902402939 wait complete. 2024-05-20T17:33:53.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.212+0000 7fc843bf1740 20 client.15576 trim_cache size 0 max 16384 2024-05-20T17:33:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 Processor -- start 2024-05-20T17:33:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 -- start start 2024-05-20T17:33:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381b1430 con 0x55bb9e2f24d0 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381aed00 con 0x55bb9e2ea2f0 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc843bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381acb50 con 0x55bb9e2d1d80 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc836d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc836d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42602/0 (socket says 172.21.15.135:42602) 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc836d9d640 1 -- 172.21.15.135:0/2864299325 learned_addr learned my addr 172.21.15.135:0/2864299325 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.227+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc83659c640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 -- 172.21.15.135:0/2864299325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 msgr2=0x55bb9e6c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 -- 172.21.15.135:0/2864299325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2ea2f0 msgr2=0x55bb9e6c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 -- 172.21.15.135:0/2864299325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9e6bf200 con 0x55bb9e2f24d0 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc83659c640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc830010960 tx=0x7fc830014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c099ba1a56c583f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc81ffff640 1 -- 172.21.15.135:0/2864299325 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc830004d20 con 0x55bb9e2f24d0 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc81ffff640 1 -- 172.21.15.135:0/2864299325 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc83001e9c0 con 0x55bb9e2f24d0 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.228+0000 7fc81ffff640 1 -- 172.21.15.135:0/2864299325 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8300056b0 con 0x55bb9e2f24d0 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- 172.21.15.135:0/2864299325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 msgr2=0x55bb9e6c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc830010960 tx=0x7fc830014040 comp rx=0 tx=0).stop 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- 172.21.15.135:0/2864299325 shutdown_connections 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c25a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2864299325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- 172.21.15.135:0/2864299325 >> 172.21.15.135:0/2864299325 conn(0x55bb9e307300 msgr2=0x55bb9e6bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- 172.21.15.135:0/2864299325 shutdown_connections 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- 172.21.15.135:0/2864299325 wait complete. 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 -- start start 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 Processor -- start 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.229+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381ad1c0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381ae630 con 0x55bb9e2f24d0 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381ad890 con 0x55bb9e2ea2f0 2024-05-20T17:33:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 10 client.0 _ll_register_callbacks cb 0x7fc82c00b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42610/0 (socket says 172.21.15.135:42610) 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 -- 172.21.15.135:0/2807233371 learned_addr learned my addr 172.21.15.135:0/2807233371 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 -- 172.21.15.135:0/2807233371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 msgr2=0x55bb9e6c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 -- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 msgr2=0x55bb9e6c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 -- 172.21.15.135:0/2807233371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9e6c61b0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc836d9d640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc83659c640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc8280bbe90 tx=0x7fc82803b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ab1a5811f36cf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc81dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828049040 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc8280dc0b0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc83001e9c0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc8280c0490 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 10 client.15582 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bb9e73a890 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.230+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc83001e9c0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc8280c00b0 con 0x55bb9e2d1d80 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 10 client.15582 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 20 client.15582 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e3131b0 0x55bb9e73cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 4 client.15582 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:33:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb9e61edc0 con 0x55bb9e3131b0 2024-05-20T17:33:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e3131b0 0x55bb9e73cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc835d9b640 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e3131b0 0x55bb9e73cfa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19dfd2c103c6c48 server_cookie=1d8d254e44e45428 in_seq=0 out_seq=0 2024-05-20T17:33:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.231+0000 7fc81dffb640 10 client.15582 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc81dffb640 1 -- 172.21.15.135:0/2807233371 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb9e61edc0 con 0x55bb9e3131b0 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc81dffb640 10 client.15582 handle_command_reply: tid=0 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 client.15582 shutdown 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 msgr2=0x55bb9e6c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc8280bbe90 tx=0x7fc82803b990 comp rx=0 tx=0).stop 2024-05-20T17:33:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 shutdown_connections 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bb9e3131b0 0x55bb9e73cfa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bb9e2f24d0 0x55bb9e6c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb9e2ea2f0 0x55bb9e6c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc81dffb640 0 client.15582 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 --2- 172.21.15.135:0/2807233371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb9e2d1d80 0x55bb9e6c85a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 >> 172.21.15.135:0/2807233371 conn(0x55bb9e307300 msgr2=0x55bb9e6bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 shutdown_connections 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 1 -- 172.21.15.135:0/2807233371 wait complete. 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc843bf1740 20 client.15582 trim_cache size 0 max 16384 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:33:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:33:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:33:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:33:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 msgr2=0x7fc8200a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 0x7fc8200a5290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc830009fd0 tx=0x7fc830004ab0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 msgr2=0x7fc83819f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc82802a930 tx=0x7fc828003b90 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 shutdown_connections 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc8200a2d80 0x7fc8200a5290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc838108fa0 0x7fc838199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc838108b00 0x7fc83819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.236+0000 7fc83cd4b640 1 --2- 172.21.15.135:0/2130214817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc838103250 0x7fc83819f4f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.237+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 >> 172.21.15.135:0/2130214817 conn(0x7fc8380fe1e0 msgr2=0x7fc8380fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.237+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 shutdown_connections 2024-05-20T17:33:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:33:53.237+0000 7fc83cd4b640 1 -- 172.21.15.135:0/2130214817 wait complete. 2024-05-20T17:33:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:53 smithi135 ceph-mon[32027]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:53 smithi160 ceph-mon[36261]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:53.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:53 smithi172 ceph-mon[36511]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:33:54.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:33:54.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 -- 172.21.15.135:0/2862064340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0101ab0 msgr2=0x7f21c0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 --2- 172.21.15.135:0/2862064340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0101ab0 0x7f21c0101ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009900 tx=0x7f21b002a410 comp rx=0 tx=0).stop 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 -- 172.21.15.135:0/2862064340 shutdown_connections 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 --2- 172.21.15.135:0/2862064340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0106b00 0x7f21c010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 --2- 172.21.15.135:0/2862064340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 0x7f21c0106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 --2- 172.21.15.135:0/2862064340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0101ab0 0x7f21c0101ec0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 -- 172.21.15.135:0/2862064340 >> 172.21.15.135:0/2862064340 conn(0x7f21c0076fb0 msgr2=0x7f21c00773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 -- 172.21.15.135:0/2862064340 shutdown_connections 2024-05-20T17:33:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.761+0000 7f21c49fe640 1 -- 172.21.15.135:0/2862064340 wait complete. 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.762+0000 7f21c49fe640 1 Processor -- start 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.762+0000 7f21c49fe640 1 -- start start 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0101ab0 0x7f21c0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 0x7f21c0199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111bc0 con 0x7f21c0106b00 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111a40 con 0x7f21c0106040 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21c49fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111d40 con 0x7f21c0101ab0 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42636/0 (socket says 172.21.15.135:42636) 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 -- 172.21.15.135:0/1077605496 learned_addr learned my addr 172.21.15.135:0/1077605496 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bed9d640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0101ab0 0x7f21c0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21b7fff640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 0x7f21c0199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 -- 172.21.15.135:0/1077605496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0101ab0 msgr2=0x7f21c0199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0101ab0 0x7f21c0199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 -- 172.21.15.135:0/1077605496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 msgr2=0x7f21c0199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 0x7f21c0199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 -- 172.21.15.135:0/1077605496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c019e4d0 con 0x7f21c0106b00 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bf59e640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b970 tx=0x7f21b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.763+0000 7f21bcd99640 1 -- 172.21.15.135:0/1077605496 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8019070 con 0x7f21c0106b00 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.764+0000 7f21bcd99640 1 -- 172.21.15.135:0/1077605496 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21b800cb40 con 0x7f21c0106b00 2024-05-20T17:33:54.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.764+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c019e7c0 con 0x7f21c0106b00 2024-05-20T17:33:54.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.764+0000 7f21bcd99640 1 -- 172.21.15.135:0/1077605496 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8007650 con 0x7f21c0106b00 2024-05-20T17:33:54.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.764+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c01a6140 con 0x7f21c0106b00 2024-05-20T17:33:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.766+0000 7f21bcd99640 1 -- 172.21.15.135:0/1077605496 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f21b801c070 con 0x7f21c0106b00 2024-05-20T17:33:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.766+0000 7f21cc180740 1 Processor -- start 2024-05-20T17:33:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.766+0000 7f21cc180740 1 -- start start 2024-05-20T17:33:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d09360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638b1c6ed00 con 0x5638b196a390 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5638b1c164c0 con 0x5638b19414d0 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21cc180740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5638b1c6acc0 con 0x5638b19496b0 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42638/0 (socket says 172.21.15.135:42638) 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 -- 172.21.15.135:0/1015398260 learned_addr learned my addr 172.21.15.135:0/1015398260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21bcd99640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 0x7f21ac0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21bed9d640 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d09360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21bf59e640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 0x7f21ac0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 -- 172.21.15.135:0/1015398260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 msgr2=0x5638b1d098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 -- 172.21.15.135:0/1015398260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 msgr2=0x5638b1d09360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d09360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21b7fff640 1 -- 172.21.15.135:0/1015398260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b1a4c7d0 con 0x5638b196a390 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.767+0000 7f21bcd99640 1 -- 172.21.15.135:0/1077605496 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f21b80cea40 con 0x7f21c0106b00 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.768+0000 7f21b7fff640 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f21a800bd00 tx=0x7f21a8011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92815e8c8cfff97 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.768+0000 7f21b57fa640 1 -- 172.21.15.135:0/1015398260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a801a400 con 0x5638b196a390 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.768+0000 7f21b57fa640 1 -- 172.21.15.135:0/1015398260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a801aa80 con 0x5638b196a390 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.768+0000 7f21b57fa640 1 -- 172.21.15.135:0/1015398260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012ac0 con 0x5638b196a390 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- 172.21.15.135:0/1015398260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 msgr2=0x5638b1d08e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21bf59e640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 0x7f21ac0a5290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21b80cc240 tx=0x7f21b806cf70 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f21a800bd00 tx=0x7f21a8011750 comp rx=0 tx=0).stop 2024-05-20T17:33:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- 172.21.15.135:0/1015398260 shutdown_connections 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d09360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 --2- 172.21.15.135:0/1015398260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d08e20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- 172.21.15.135:0/1015398260 >> 172.21.15.135:0/1015398260 conn(0x5638b195e4e0 msgr2=0x5638b1d056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- 172.21.15.135:0/1015398260 shutdown_connections 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- 172.21.15.135:0/1015398260 wait complete. 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 -- start start 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.769+0000 7f21cc180740 1 Processor -- start 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d17a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d17f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638b1d1a690 con 0x5638b196a390 2024-05-20T17:33:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5638b1c29b90 con 0x5638b19414d0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5638b1d1a810 con 0x5638b19496b0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 10 client.0 _ll_register_callbacks cb 0x5638b1c65da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42642/0 (socket says 172.21.15.135:42642) 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 -- 172.21.15.135:0/149242148 learned_addr learned my addr 172.21.15.135:0/149242148 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21bed9d640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d17f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d17a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 -- 172.21.15.135:0/149242148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 msgr2=0x5638b1d17f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d17f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 -- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 msgr2=0x5638b1d17a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d17a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 -- 172.21.15.135:0/149242148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b19823f0 con 0x5638b196a390 2024-05-20T17:33:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21b7fff640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a80126a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1f04eade7ee0b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8004030 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f21a80041d0 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.770+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a801aa80 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f21a80043d0 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 10 client.15594 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5638b19420f0 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a801aa80 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f21a80035f0 con 0x5638b196a390 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 10 client.15594 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 20 client.15594 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b1928f60 0x5638b1d2a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 4 client.15594 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638b1c7c430 con 0x5638b1928f60 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.771+0000 7f21bed9d640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b1928f60 0x5638b1d2a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.772+0000 7f21a67fc640 10 client.15594 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.772+0000 7f21bed9d640 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b1928f60 0x5638b1d2a0d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94be846c7cff2b9 server_cookie=c382f79f089549ff in_seq=0 out_seq=0 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.772+0000 7f21a67fc640 1 -- 172.21.15.135:0/149242148 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5638b1c7c430 con 0x5638b1928f60 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.772+0000 7f21a67fc640 10 client.15594 handle_command_reply: tid=0 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.772+0000 7f21cc180740 1 client.15594 shutdown 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 msgr2=0x5638b1d1dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a80126a0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 shutdown_connections 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b1928f60 0x5638b1d2a0d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b196a390 0x5638b1d1dbf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d17f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21a67fc640 0 client.15594 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 --2- 172.21.15.135:0/149242148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19414d0 0x5638b1d17a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 >> 172.21.15.135:0/149242148 conn(0x5638b195e4e0 msgr2=0x5638b1d08cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 shutdown_connections 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 1 -- 172.21.15.135:0/149242148 wait complete. 2024-05-20T17:33:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.773+0000 7f21cc180740 20 client.15594 trim_cache size 0 max 16384 2024-05-20T17:33:54.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 Processor -- start 2024-05-20T17:33:54.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 -- start start 2024-05-20T17:33:54.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19414d0 0x5638b1d17ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19496b0 0x5638b1d1da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01af0e0 con 0x5638b1928f60 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01ac9b0 con 0x5638b19496b0 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21cc180740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01aa800 con 0x5638b19414d0 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42648/0 (socket says 172.21.15.135:42648) 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 -- 172.21.15.135:0/3273132168 learned_addr learned my addr 172.21.15.135:0/3273132168 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21bed9d640 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19414d0 0x5638b1d17ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 -- 172.21.15.135:0/3273132168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19414d0 msgr2=0x5638b1d17ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19414d0 0x5638b1d17ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 -- 172.21.15.135:0/3273132168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19496b0 msgr2=0x5638b1d1da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.791+0000 7f21b7fff640 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19496b0 0x5638b1d1da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.792+0000 7f21b7fff640 1 -- 172.21.15.135:0/3273132168 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b1d00ea0 con 0x5638b1928f60 2024-05-20T17:33:54.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.792+0000 7f21b7fff640 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21a80059f0 tx=0x7f21a8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae789f7828d272 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.792+0000 7f21b4ff9640 1 -- 172.21.15.135:0/3273132168 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a803c020 con 0x5638b1928f60 2024-05-20T17:33:54.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.792+0000 7f21b4ff9640 1 -- 172.21.15.135:0/3273132168 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a8011c50 con 0x5638b1928f60 2024-05-20T17:33:54.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.792+0000 7f21b4ff9640 1 -- 172.21.15.135:0/3273132168 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8003f60 con 0x5638b1928f60 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- 172.21.15.135:0/3273132168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 msgr2=0x5638b1d09330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21a80059f0 tx=0x7f21a8004570 comp rx=0 tx=0).stop 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- 172.21.15.135:0/3273132168 shutdown_connections 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b19496b0 0x5638b1d1da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19414d0 0x5638b1d17ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 --2- 172.21.15.135:0/3273132168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b1928f60 0x5638b1d09330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- 172.21.15.135:0/3273132168 >> 172.21.15.135:0/3273132168 conn(0x5638b195e4e0 msgr2=0x5638b1d177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- 172.21.15.135:0/3273132168 shutdown_connections 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- 172.21.15.135:0/3273132168 wait complete. 2024-05-20T17:33:54.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 -- start start 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.793+0000 7f21cc180740 1 Processor -- start 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b1928f60 0x5638b1d1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d1f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01aae70 con 0x5638b19414d0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01ac2e0 con 0x5638b1928f60 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01ab540 con 0x5638b19496b0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21cc180740 10 client.0 _ll_register_callbacks cb 0x7f21b0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d1f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b1928f60 0x5638b1d1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42652/0 (socket says 172.21.15.135:42652) 2024-05-20T17:33:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 -- 172.21.15.135:0/689994575 learned_addr learned my addr 172.21.15.135:0/689994575 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 -- 172.21.15.135:0/689994575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 msgr2=0x5638b1d1f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d1f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 -- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b1928f60 msgr2=0x5638b1d1eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b1928f60 0x5638b1d1eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 -- 172.21.15.135:0/689994575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b1d901e0 con 0x5638b19414d0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21bed9d640 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21b002a930 tx=0x7f21b00041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d21a01600daf9f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.794+0000 7f21a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0035040 con 0x5638b19414d0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f21b0005220 con 0x5638b19414d0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a8011c50 con 0x5638b19414d0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f21b0005420 con 0x5638b19414d0 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 10 client.15600 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5638b1d913a0 con 0x5638b19414d0 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a8011c50 con 0x5638b19414d0 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f21b0048510 con 0x5638b19414d0 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 10 client.15600 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 20 client.15600 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b196a390 0x5638b1d93b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 4 client.15600 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.795+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5638b1c76780 con 0x5638b196a390 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21b7fff640 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b196a390 0x5638b1d93b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21a67fc640 10 client.15600 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21b7fff640 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b196a390 0x5638b1d93b40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0d8f634c4e2b59 server_cookie=525ce0fed5fce1cb in_seq=0 out_seq=0 2024-05-20T17:33:54.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21a67fc640 1 -- 172.21.15.135:0/689994575 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5638b1c76780 con 0x5638b196a390 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21a67fc640 10 client.15600 handle_command_reply: tid=0 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 client.15600 shutdown 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 msgr2=0x5638b1d1f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21b002a930 tx=0x7f21b00041f0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 shutdown_connections 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5638b196a390 0x5638b1d93b40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638b19496b0 0x5638b1d1f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638b19414d0 0x5638b1d1f0c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21a67fc640 0 client.15600 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 --2- 172.21.15.135:0/689994575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638b1928f60 0x5638b1d1eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 >> 172.21.15.135:0/689994575 conn(0x5638b195e4e0 msgr2=0x5638b1d0ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 shutdown_connections 2024-05-20T17:33:54.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 1 -- 172.21.15.135:0/689994575 wait complete. 2024-05-20T17:33:54.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.796+0000 7f21cc180740 20 client.15600 trim_cache size 0 max 16384 2024-05-20T17:33:54.804 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:54.804 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-05-20T17:33:54.804 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-05-20T17:33:54.804 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 msgr2=0x7f21ac0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 0x7f21ac0a5290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21b80cc240 tx=0x7f21b806cf70 comp rx=0 tx=0).stop 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 msgr2=0x7f21c019de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b970 tx=0x7f21b800be30 comp rx=0 tx=0).stop 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 shutdown_connections 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f21ac0a2d80 0x7f21ac0a5290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21c0106b00 0x7f21c019de90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0106040 0x7f21c0199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 --2- 172.21.15.135:0/1077605496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c0101ab0 0x7f21c0199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 >> 172.21.15.135:0/1077605496 conn(0x7f21c0076fb0 msgr2=0x7f21c0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 shutdown_connections 2024-05-20T17:33:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.797+0000 7f21c49fe640 1 -- 172.21.15.135:0/1077605496 wait complete. 2024-05-20T17:33:54.811 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-20T17:33:54.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:33:54.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.919+0000 7f342072f640 1 -- 172.21.15.135:0/4170096513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 msgr2=0x7f3418106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.919+0000 7f342072f640 1 --2- 172.21.15.135:0/4170096513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f3418106620 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3408009900 tx=0x7f340802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- 172.21.15.135:0/4170096513 shutdown_connections 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- 172.21.15.135:0/4170096513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418106c90 0x7f341810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- 172.21.15.135:0/4170096513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f3418106620 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- 172.21.15.135:0/4170096513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418102350 0x7f3418102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- 172.21.15.135:0/4170096513 >> 172.21.15.135:0/4170096513 conn(0x7f34180fc810 msgr2=0x7f34180fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- 172.21.15.135:0/4170096513 shutdown_connections 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- 172.21.15.135:0/4170096513 wait complete. 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 Processor -- start 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- start start 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 0x7f341819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418106c90 0x7f341819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3418111d90 con 0x7f3418106210 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3418111c10 con 0x7f3418106c90 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.920+0000 7f342072f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3418111f10 con 0x7f3418102350 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42666/0 (socket says 172.21.15.135:42666) 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 -- 172.21.15.135:0/1100185 learned_addr learned my addr 172.21.15.135:0/1100185 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341e4cb640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 0x7f341819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341eccc640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418106c90 0x7f341819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 -- 172.21.15.135:0/1100185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 msgr2=0x7f341819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 0x7f341819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 -- 172.21.15.135:0/1100185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418106c90 msgr2=0x7f341819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:54.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418106c90 0x7f341819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 -- 172.21.15.135:0/1100185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34181a5a00 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341e4cb640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 0x7f341819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f341dcca640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f340802a930 tx=0x7f3408003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340803f070 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340803b460 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34181a5c90 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408035030 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.921+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34181a6180 con 0x7f3418106210 2024-05-20T17:33:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.922+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3418069140 con 0x7f3418106210 2024-05-20T17:33:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.924+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f3408042070 con 0x7f3418106210 2024-05-20T17:33:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.925+0000 7f340f7fe640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 0x7f34040a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.925+0000 7f341e4cb640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 0x7f34040a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.925+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f34080f0360 con 0x7f3418106210 2024-05-20T17:33:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.926+0000 7f341e4cb640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 0x7f34040a52a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34140058c0 tx=0x7f3414005ec0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:54.929+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f34080bce10 con 0x7f3418106210 2024-05-20T17:33:55.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.140+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3418109aa0 con 0x7f3418106210 2024-05-20T17:33:55.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.141+0000 7f340f7fe640 1 -- 172.21.15.135:0/1100185 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f34080bc710 con 0x7f3418106210 2024-05-20T17:33:55.143 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:33:55.143 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:33:17.908712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24523]},"id":1}]} 2024-05-20T17:33:55.143 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 22 2024-05-20T17:33:55.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 msgr2=0x7f34040a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 0x7f34040a52a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34140058c0 tx=0x7f3414005ec0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 msgr2=0x7f341819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f340802a930 tx=0x7f3408003c00 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 shutdown_connections 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f34040a2d90 0x7f34040a52a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3418106c90 0x7f341819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3418106210 0x7f341819ac30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 --2- 172.21.15.135:0/1100185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3418102350 0x7f341819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 >> 172.21.15.135:0/1100185 conn(0x7f34180fc810 msgr2=0x7f34181044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 shutdown_connections 2024-05-20T17:33:55.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.143+0000 7f342072f640 1 -- 172.21.15.135:0/1100185 wait complete. 2024-05-20T17:33:55.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-20T17:33:55.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 -- 172.21.15.135:0/1240796581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4103220 msgr2=0x7f79f410f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/1240796581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4103220 0x7f79f410f5f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009900 tx=0x7f79ec02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 -- 172.21.15.135:0/1240796581 shutdown_connections 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/1240796581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4103220 0x7f79f410f5f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/1240796581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f4102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/1240796581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4108ad0 0x7f79f4102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 -- 172.21.15.135:0/1240796581 >> 172.21.15.135:0/1240796581 conn(0x7f79f40fe190 msgr2=0x7f79f41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 -- 172.21.15.135:0/1240796581 shutdown_connections 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 -- 172.21.15.135:0/1240796581 wait complete. 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.268+0000 7f79fbfc3640 1 Processor -- start 2024-05-20T17:33:55.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 -- start start 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4103220 0x7f79f41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4112e30 con 0x7f79f4108ad0 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4112cb0 con 0x7f79f4103220 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fbfc3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4112fb0 con 0x7f79f4108f70 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42686/0 (socket says 172.21.15.135:42686) 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 -- 172.21.15.135:0/2310184295 learned_addr learned my addr 172.21.15.135:0/2310184295 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4103220 0x7f79f41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 -- 172.21.15.135:0/2310184295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 msgr2=0x7f79f419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fa560640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 -- 172.21.15.135:0/2310184295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4103220 msgr2=0x7f79f41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4103220 0x7f79f41997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 -- 172.21.15.135:0/2310184295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f419e610 con 0x7f79f4108ad0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79fa560640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.269+0000 7f79f955e640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f79e4005d00 tx=0x7f79e400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.270+0000 7f79eaffd640 1 -- 172.21.15.135:0/2310184295 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4017070 con 0x7f79f4108ad0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.270+0000 7f79eaffd640 1 -- 172.21.15.135:0/2310184295 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e4009c30 con 0x7f79f4108ad0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.270+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f419e900 con 0x7f79f4108ad0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.270+0000 7f79eaffd640 1 -- 172.21.15.135:0/2310184295 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e400f620 con 0x7f79f4108ad0 2024-05-20T17:33:55.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.270+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f419ee00 con 0x7f79f4108ad0 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.272+0000 7f79eaffd640 1 -- 172.21.15.135:0/2310184295 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f79e401a070 con 0x7f79f4108ad0 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.272+0000 7f7a02e6b740 1 Processor -- start 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 -- start start 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a3fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a40260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2f59a5c40 con 0x55f2f56a1390 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f2f594d580 con 0x55f2f56784d0 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f2f59a1c00 con 0x55f2f56806b0 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79fa560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a3fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79fa560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a3fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42696/0 (socket says 172.21.15.135:42696) 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79fa560640 1 -- 172.21.15.135:0/2121926181 learned_addr learned my addr 172.21.15.135:0/2121926181 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a40260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f955e640 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79eaffd640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 0x7f79e00a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 -- 172.21.15.135:0/2121926181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 msgr2=0x55f2f5a407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 -- 172.21.15.135:0/2121926181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 msgr2=0x55f2f5a3fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a3fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79f9d5f640 1 -- 172.21.15.135:0/2121926181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2f56b93f0 con 0x55f2f56784d0 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.273+0000 7f79fa560640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 0x7f79e00a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79eaffd640 1 -- 172.21.15.135:0/2310184295 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f79e40ceff0 con 0x7f79f4108ad0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a40260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79f0005fd0 tx=0x7f79f00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d43f4c61bf2b1a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79dffff640 1 -- 172.21.15.135:0/2121926181 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0003c30 con 0x55f2f56784d0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79fa560640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 0x7f79e00a52a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79ec02a930 tx=0x7f79ec009260 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79dffff640 1 -- 172.21.15.135:0/2121926181 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f0003dd0 con 0x55f2f56784d0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.274+0000 7f79dffff640 1 -- 172.21.15.135:0/2121926181 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f000fb00 con 0x55f2f56784d0 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- 172.21.15.135:0/2121926181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 msgr2=0x55f2f5a40260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a40260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79f0005fd0 tx=0x7f79f00118d0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- 172.21.15.135:0/2121926181 shutdown_connections 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a40260 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/2121926181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a3fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- 172.21.15.135:0/2121926181 >> 172.21.15.135:0/2121926181 conn(0x55f2f56954e0 msgr2=0x55f2f5a3c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- 172.21.15.135:0/2121926181 shutdown_connections 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- 172.21.15.135:0/2121926181 wait complete. 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 -- start start 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.275+0000 7f7a02e6b740 1 Processor -- start 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a4a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2f5a4cfb0 con 0x55f2f56784d0 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f2f5960c40 con 0x55f2f56a1390 2024-05-20T17:33:55.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f2f5a4d130 con 0x55f2f56806b0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f7a02e6b740 10 client.0 _ll_register_callbacks cb 0x55f2f56b8be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42712/0 (socket says 172.21.15.135:42712) 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 -- 172.21.15.135:0/241652413 learned_addr learned my addr 172.21.15.135:0/241652413 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79fa560640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a4a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f955e640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 -- 172.21.15.135:0/241652413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 msgr2=0x55f2f5a4c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 -- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 msgr2=0x55f2f5a4a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a4a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 -- 172.21.15.135:0/241652413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2f57837d0 con 0x55f2f56784d0 2024-05-20T17:33:55.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79f001a000 tx=0x7f79f0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851bb59fa7f572af server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.276+0000 7f79dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0028020 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f79f0004dd0 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79f0003dd0 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f79f0033050 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 10 client.15618 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f2f5a597d0 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f0003dd0 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f79f0018070 con 0x55f2f56784d0 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 10 client.15618 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 10 client.15618 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:33:55.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 20 client.15618 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f565ff60 0x55f2f5a5cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 4 client.15618 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.277+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2f59b3370 con 0x55f2f565ff60 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.278+0000 7f79f955e640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f565ff60 0x55f2f5a5cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.278+0000 7f79dd7fa640 10 client.15618 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.278+0000 7f79f955e640 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f565ff60 0x55f2f5a5cb80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edade124ae7c87fc server_cookie=1c5f811912abbca1 in_seq=0 out_seq=0 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f79dd7fa640 1 -- 172.21.15.135:0/241652413 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f2f59b3370 con 0x55f2f565ff60 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f79dd7fa640 10 client.15618 handle_command_reply: tid=0 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 client.15618 shutdown 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 msgr2=0x55f2f5a4bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79f001a000 tx=0x7f79f0009c80 comp rx=0 tx=0).stop 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 shutdown_connections 2024-05-20T17:33:55.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f565ff60 0x55f2f5a5cb80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a4a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f79dd7fa640 0 client.15618 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/241652413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56784d0 0x55f2f5a4bde0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 >> 172.21.15.135:0/241652413 conn(0x55f2f56954e0 msgr2=0x55f2f5a41a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 shutdown_connections 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 1 -- 172.21.15.135:0/241652413 wait complete. 2024-05-20T17:33:55.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.279+0000 7f7a02e6b740 20 client.15618 trim_cache size 0 max 16384 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 Processor -- start 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 -- start start 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56784d0 0x55f2f5a4c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41b1410 con 0x55f2f56806b0 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41aece0 con 0x55f2f56a1390 2024-05-20T17:33:55.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41acb30 con 0x55f2f56784d0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42728/0 (socket says 172.21.15.135:42728) 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 -- 172.21.15.135:0/3973790305 learned_addr learned my addr 172.21.15.135:0/3973790305 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79fa560640 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 -- 172.21.15.135:0/3973790305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56784d0 msgr2=0x55f2f5a4c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56784d0 0x55f2f5a4c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 -- 172.21.15.135:0/3973790305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 msgr2=0x55f2f5a627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 -- 172.21.15.135:0/3973790305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2f5a3d590 con 0x55f2f56806b0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.293+0000 7f79f955e640 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f79e4097d70 tx=0x7f79e40bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75c009154e60bf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f79df7fe640 1 -- 172.21.15.135:0/3973790305 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4080e60 con 0x55f2f56806b0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f79df7fe640 1 -- 172.21.15.135:0/3973790305 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e40a4010 con 0x55f2f56806b0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f79df7fe640 1 -- 172.21.15.135:0/3973790305 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4021040 con 0x55f2f56806b0 2024-05-20T17:33:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3973790305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 msgr2=0x55f2f5a622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f79e4097d70 tx=0x7f79e40bb040 comp rx=0 tx=0).stop 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3973790305 shutdown_connections 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56a1390 0x55f2f5a627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56806b0 0x55f2f5a622a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3973790305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56784d0 0x55f2f5a4c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3973790305 >> 172.21.15.135:0/3973790305 conn(0x55f2f56954e0 msgr2=0x55f2f5a4ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3973790305 shutdown_connections 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.294+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3973790305 wait complete. 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 -- start start 2024-05-20T17:33:55.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 Processor -- start 2024-05-20T17:33:55.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a52890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41ad1a0 con 0x55f2f56a1390 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41ae610 con 0x55f2f56784d0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41ad870 con 0x55f2f56806b0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f7a02e6b740 10 client.0 _ll_register_callbacks cb 0x7f79f00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f79fa560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f79fa560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42744/0 (socket says 172.21.15.135:42744) 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f79fa560640 1 -- 172.21.15.135:0/3029980296 learned_addr learned my addr 172.21.15.135:0/3029980296 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.295+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a52890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79f955e640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 -- 172.21.15.135:0/3029980296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 msgr2=0x55f2f5a4fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 -- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 msgr2=0x55f2f5a52890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a52890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 -- 172.21.15.135:0/3029980296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2f5a50800 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a52890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79fa560640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0042b0 tx=0x7f79ec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c468065801cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec035040 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f79ec005450 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79e40a4010 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f79ec005650 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f7a02e6b740 10 client.15624 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f2f5ac4cd0 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.296+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e40a4010 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f79ec003a60 con 0x55f2f56a1390 2024-05-20T17:33:55.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 10 client.15624 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 20 client.15624 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f56353a0 0x55f2f5ac74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 4 client.15624 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2f59ad6c0 con 0x55f2f56353a0 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f56353a0 0x55f2f5ac74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f79dd7fa640 10 client.15624 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.297+0000 7f79f9d5f640 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f56353a0 0x55f2f5ac74c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=620cbeb85d48f601 server_cookie=d6b83eb1d95aa231 in_seq=0 out_seq=0 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f79dd7fa640 1 -- 172.21.15.135:0/3029980296 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2f59ad6c0 con 0x55f2f56353a0 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f79dd7fa640 10 client.15624 handle_command_reply: tid=0 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 client.15624 shutdown 2024-05-20T17:33:55.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 msgr2=0x55f2f5a50140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0042b0 tx=0x7f79ec031400 comp rx=0 tx=0).stop 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 shutdown_connections 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55f2f56353a0 0x55f2f5ac74c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2f56a1390 0x55f2f5a50140 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f79dd7fa640 0 client.15624 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f2f56806b0 0x55f2f5a4fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 --2- 172.21.15.135:0/3029980296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f2f56784d0 0x55f2f5a52890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 >> 172.21.15.135:0/3029980296 conn(0x55f2f56954e0 msgr2=0x55f2f5a48a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 shutdown_connections 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 1 -- 172.21.15.135:0/3029980296 wait complete. 2024-05-20T17:33:55.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.298+0000 7f7a02e6b740 20 client.15624 trim_cache size 0 max 16384 2024-05-20T17:33:55.307 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 msgr2=0x7f79e00a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 0x7f79e00a52a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79ec02a930 tx=0x7f79ec009260 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 msgr2=0x7f79f4199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f79e4005d00 tx=0x7f79e400dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 shutdown_connections 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f79e00a2d90 0x7f79e00a52a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4108f70 0x7f79f419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79f4108ad0 0x7f79f4199d10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 --2- 172.21.15.135:0/2310184295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f4103220 0x7f79f41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 >> 172.21.15.135:0/2310184295 conn(0x7f79f40fe190 msgr2=0x7f79f41054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 shutdown_connections 2024-05-20T17:33:55.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.299+0000 7f79fbfc3640 1 -- 172.21.15.135:0/2310184295 wait complete. 2024-05-20T17:33:55.311 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- 172.21.15.135:0/4069002400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 msgr2=0x7f574410ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 --2- 172.21.15.135:0/4069002400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574410ca30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5734009900 tx=0x7f573402a410 comp rx=0 tx=0).stop 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- 172.21.15.135:0/4069002400 shutdown_connections 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 --2- 172.21.15.135:0/4069002400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 0x7f574410f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 --2- 172.21.15.135:0/4069002400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574410ca30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 --2- 172.21.15.135:0/4069002400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 0x7f5744103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- 172.21.15.135:0/4069002400 >> 172.21.15.135:0/4069002400 conn(0x7f57440fd210 msgr2=0x7f57440ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- 172.21.15.135:0/4069002400 shutdown_connections 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- 172.21.15.135:0/4069002400 wait complete. 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 Processor -- start 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.423+0000 7f574c385640 1 -- start start 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 0x7f574419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 0x7f5744199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5744112dd0 con 0x7f574410a610 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5744112c50 con 0x7f5744103bb0 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5744112f50 con 0x7f574410d000 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42754/0 (socket says 172.21.15.135:42754) 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 -- 172.21.15.135:0/2475414987 learned_addr learned my addr 172.21.15.135:0/2475414987 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574a121640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 0x7f574419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574a922640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 0x7f5744199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 -- 172.21.15.135:0/2475414987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 msgr2=0x7f5744199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 0x7f5744199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 -- 172.21.15.135:0/2475414987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 msgr2=0x7f574419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 0x7f574419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 -- 172.21.15.135:0/2475414987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5744199da0 con 0x7f574410a610 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f5749920640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5734006010 tx=0x7f57340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f573b7fe640 1 -- 172.21.15.135:0/2475414987 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573403f030 con 0x7f574410a610 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5744199fd0 con 0x7f574410a610 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f573b7fe640 1 -- 172.21.15.135:0/2475414987 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5734003ce0 con 0x7f574410a610 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f573b7fe640 1 -- 172.21.15.135:0/2475414987 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734035070 con 0x7f574410a610 2024-05-20T17:33:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.424+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574419a4c0 con 0x7f574410a610 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.427+0000 7f573b7fe640 1 -- 172.21.15.135:0/2475414987 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f5734042030 con 0x7f574410a610 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.427+0000 7f5753233740 1 Processor -- start 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 -- start start 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f573b7fe640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 0x7f57300a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c3f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c3f9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a22c35ec40 con 0x55a22c0314d0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a22c306580 con 0x55a22c05a390 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5753233740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a22c35ac00 con 0x55a22c0396b0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f574a922640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 0x7f57300a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f573b7fe640 1 -- 172.21.15.135:0/2475414987 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f57340efb30 con 0x7f574410a610 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42758/0 (socket says 172.21.15.135:42758) 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 -- 172.21.15.135:0/1289463700 learned_addr learned my addr 172.21.15.135:0/1289463700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f574a121640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c3f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f574a922640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c3f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 -- 172.21.15.135:0/1289463700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 msgr2=0x55a22c3f9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c3f9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 -- 172.21.15.135:0/1289463700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 msgr2=0x55a22c3f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c3f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f5749920640 1 -- 172.21.15.135:0/1289463700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22c0723f0 con 0x55a22c0314d0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f574a121640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c3f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.428+0000 7f574a922640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 0x7f57300a52a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f573c005fd0 tx=0x7f573c013830 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.429+0000 7f5749920640 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5734031550 tx=0x7f57340bbb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eb04e9e774e5b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.429+0000 7f5738bfe640 1 -- 172.21.15.135:0/1289463700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734049040 con 0x55a22c0314d0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.429+0000 7f5738bfe640 1 -- 172.21.15.135:0/1289463700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57340bbf90 con 0x55a22c0314d0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.429+0000 7f5738bfe640 1 -- 172.21.15.135:0/1289463700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57340b8760 con 0x55a22c0314d0 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- 172.21.15.135:0/1289463700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 msgr2=0x55a22c3f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5734031550 tx=0x7f57340bbb90 comp rx=0 tx=0).stop 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- 172.21.15.135:0/1289463700 shutdown_connections 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c3f9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0314d0 0x55a22c3f9110 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 --2- 172.21.15.135:0/1289463700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c3f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- 172.21.15.135:0/1289463700 >> 172.21.15.135:0/1289463700 conn(0x55a22c04e4e0 msgr2=0x55a22c3f54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- 172.21.15.135:0/1289463700 shutdown_connections 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- 172.21.15.135:0/1289463700 wait complete. 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 -- start start 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.430+0000 7f5753233740 1 Processor -- start 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0314d0 0x55a22c4077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c407d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a22c40a240 con 0x55a22c05a390 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a22c319c40 con 0x55a22c0314d0 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a22c40a3c0 con 0x55a22c0396b0 2024-05-20T17:33:55.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 10 client.0 _ll_register_callbacks cb 0x55a22c071be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42774/0 (socket says 172.21.15.135:42774) 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 -- 172.21.15.135:0/2117610061 learned_addr learned my addr 172.21.15.135:0/2117610061 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a121640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0314d0 0x55a22c4077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5749920640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c407d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 -- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 msgr2=0x55a22c407d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c407d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 -- 172.21.15.135:0/2117610061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0314d0 msgr2=0x55a22c4077f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0314d0 0x55a22c4077f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 -- 172.21.15.135:0/2117610061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22c13c7d0 con 0x55a22c05a390 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f574a922640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f573c011c10 tx=0x7f573c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddc1f6d65b9e446 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f572dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c00ee10 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f573c02a480 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57340bbf90 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f573c02a680 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.431+0000 7f5753233740 10 client.15636 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a22c416940 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57340bbf90 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f573c01faa0 con 0x55a22c05a390 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 10 client.15636 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 10 client.15636 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 20 client.15636 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22c018f60 0x55a22c419e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 4 client.15636 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:55.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a22c36c370 con 0x55a22c018f60 2024-05-20T17:33:55.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.432+0000 7f574a121640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22c018f60 0x55a22c419e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.433+0000 7f574a121640 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22c018f60 0x55a22c419e10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9637d829fff6e49 server_cookie=390132e617652641 in_seq=0 out_seq=0 2024-05-20T17:33:55.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.433+0000 7f572dffb640 10 client.15636 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.433+0000 7f572dffb640 1 -- 172.21.15.135:0/2117610061 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a22c36c370 con 0x55a22c018f60 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.433+0000 7f572dffb640 10 client.15636 handle_command_reply: tid=0 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 client.15636 shutdown 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 msgr2=0x55a22c40d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f573c011c10 tx=0x7f573c004730 comp rx=0 tx=0).stop 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 shutdown_connections 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22c018f60 0x55a22c419e10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c40d670 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0396b0 0x55a22c407d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 --2- 172.21.15.135:0/2117610061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0314d0 0x55a22c4077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f572dffb640 0 client.15636 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 >> 172.21.15.135:0/2117610061 conn(0x55a22c04e4e0 msgr2=0x55a22c3fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 shutdown_connections 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 1 -- 172.21.15.135:0/2117610061 wait complete. 2024-05-20T17:33:55.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.434+0000 7f5753233740 20 client.15636 trim_cache size 0 max 16384 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 Processor -- start 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 -- start start 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 0x55a22c3f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57441af1d0 con 0x55a22c05a390 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57441acaa0 con 0x55a22c0396b0 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.447+0000 7f5753233740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57441aa8f0 con 0x55a22c0314d0 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42778/0 (socket says 172.21.15.135:42778) 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 -- 172.21.15.135:0/244148331 learned_addr learned my addr 172.21.15.135:0/244148331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a121640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f5749920640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 0x55a22c3f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 -- 172.21.15.135:0/244148331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 msgr2=0x55a22c40d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 -- 172.21.15.135:0/244148331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 msgr2=0x55a22c3f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 0x55a22c3f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 -- 172.21.15.135:0/244148331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22c3fa050 con 0x55a22c05a390 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f5749920640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 0x55a22c3f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f574a922640 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f573c004700 tx=0x7f573c032400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2dac29904d33f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f572ffff640 1 -- 172.21.15.135:0/244148331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c037050 con 0x55a22c05a390 2024-05-20T17:33:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f572ffff640 1 -- 172.21.15.135:0/244148331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573c013db0 con 0x55a22c05a390 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.448+0000 7f572ffff640 1 -- 172.21.15.135:0/244148331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c02aa80 con 0x55a22c05a390 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- 172.21.15.135:0/244148331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 msgr2=0x55a22c41f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f573c004700 tx=0x7f573c032400 comp rx=0 tx=0).stop 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- 172.21.15.135:0/244148331 shutdown_connections 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c05a390 0x55a22c41f5b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c0396b0 0x55a22c3f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 --2- 172.21.15.135:0/244148331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- 172.21.15.135:0/244148331 >> 172.21.15.135:0/244148331 conn(0x55a22c04e4e0 msgr2=0x55a22c3f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- 172.21.15.135:0/244148331 shutdown_connections 2024-05-20T17:33:55.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- 172.21.15.135:0/244148331 wait complete. 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 -- start start 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.449+0000 7f5753233740 1 Processor -- start 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c480150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57441aaf60 con 0x55a22c0396b0 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57441ac3d0 con 0x55a22c05a390 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57441ab630 con 0x55a22c0314d0 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 10 client.0 _ll_register_callbacks cb 0x7f573c011890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42790/0 (socket says 172.21.15.135:42790) 2024-05-20T17:33:55.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 -- 172.21.15.135:0/1091322671 learned_addr learned my addr 172.21.15.135:0/1091322671 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f574a121640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f574a922640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c480150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 -- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 msgr2=0x55a22c40eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 -- 172.21.15.135:0/1091322671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 msgr2=0x55a22c480150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c480150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 -- 172.21.15.135:0/1091322671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22c40f8b0 con 0x55a22c0396b0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5749920640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5734000c00 tx=0x7f573403b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2983f4b8868b2b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f572dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57340a0020 con 0x55a22c0396b0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f573403bc80 con 0x55a22c0396b0 2024-05-20T17:33:55.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f573c013db0 con 0x55a22c0396b0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5734049040 con 0x55a22c0396b0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 10 client.15642 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.450+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a22c4816d0 con 0x55a22c0396b0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573c013db0 con 0x55a22c0396b0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f57340ed470 con 0x55a22c0396b0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 10 client.15642 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 10 client.15642 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 20 client.15642 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22bfee3a0 0x55a22c483cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 4 client.15642 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a22c3666c0 con 0x55a22bfee3a0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f574a121640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22bfee3a0 0x55a22c483cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f572dffb640 10 client.15642 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:55.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.451+0000 7f574a121640 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22bfee3a0 0x55a22c483cb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7de5013013cff2e7 server_cookie=4694c18586089016 in_seq=0 out_seq=0 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f572dffb640 1 -- 172.21.15.135:0/1091322671 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a22c3666c0 con 0x55a22bfee3a0 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f572dffb640 10 client.15642 handle_command_reply: tid=0 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 client.15642 shutdown 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 msgr2=0x55a22c40f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5734000c00 tx=0x7f573403b720 comp rx=0 tx=0).stop 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 shutdown_connections 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55a22bfee3a0 0x55a22c483cb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a22c05a390 0x55a22c480150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a22c0396b0 0x55a22c40f030 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f572dffb640 0 client.15642 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 --2- 172.21.15.135:0/1091322671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a22c0314d0 0x55a22c40eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 >> 172.21.15.135:0/1091322671 conn(0x55a22c04e4e0 msgr2=0x55a22c3f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 shutdown_connections 2024-05-20T17:33:55.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 1 -- 172.21.15.135:0/1091322671 wait complete. 2024-05-20T17:33:55.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f5753233740 20 client.15642 trim_cache size 0 max 16384 2024-05-20T17:33:55.461 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 msgr2=0x7f57300a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 0x7f57300a52a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f573c005fd0 tx=0x7f573c013830 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 msgr2=0x7f574419fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5734006010 tx=0x7f57340042f0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 shutdown_connections 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f57300a2d90 0x7f57300a52a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f574410d000 0x7f5744199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f574410a610 0x7f574419fa30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 --2- 172.21.15.135:0/2475414987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5744103bb0 0x7f574419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.452+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 >> 172.21.15.135:0/2475414987 conn(0x7f57440fd210 msgr2=0x7f574410d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.453+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 shutdown_connections 2024-05-20T17:33:55.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.453+0000 7f574c385640 1 -- 172.21.15.135:0/2475414987 wait complete. 2024-05-20T17:33:55.466 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 -- 172.21.15.135:0/1747603118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108f60 msgr2=0x7f5d70102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 --2- 172.21.15.135:0/1747603118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108f60 0x7f5d70102ba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009900 tx=0x7f5d5c02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 -- 172.21.15.135:0/1747603118 shutdown_connections 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 --2- 172.21.15.135:0/1747603118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70103210 0x7f5d7010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 --2- 172.21.15.135:0/1747603118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108f60 0x7f5d70102ba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 --2- 172.21.15.135:0/1747603118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108ac0 0x7f5d70102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.578+0000 7f5d77214640 1 -- 172.21.15.135:0/1747603118 >> 172.21.15.135:0/1747603118 conn(0x7f5d700fe180 msgr2=0x7f5d701005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- 172.21.15.135:0/1747603118 shutdown_connections 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- 172.21.15.135:0/1747603118 wait complete. 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 Processor -- start 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- start start 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70103210 0x7f5d7019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70108f60 0x7f5d701996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70112e00 con 0x7f5d70108ac0 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70112c80 con 0x7f5d70103210 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.579+0000 7f5d77214640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70112f80 con 0x7f5d70108f60 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42820/0 (socket says 172.21.15.135:42820) 2024-05-20T17:33:55.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 -- 172.21.15.135:0/3589414699 learned_addr learned my addr 172.21.15.135:0/3589414699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70103210 0x7f5d7019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70108f60 0x7f5d701996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 -- 172.21.15.135:0/3589414699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70108f60 msgr2=0x7f5d701996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70108f60 0x7f5d701996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 -- 172.21.15.135:0/3589414699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70103210 msgr2=0x7f5d7019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70103210 0x7f5d7019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 -- 172.21.15.135:0/3589414699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70199df0 con 0x7f5d70108ac0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005940 tx=0x7f5d5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6dffb640 1 -- 172.21.15.135:0/3589414699 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c03f030 con 0x7f5d70108ac0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6dffb640 1 -- 172.21.15.135:0/3589414699 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d5c003ce0 con 0x7f5d70108ac0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d6dffb640 1 -- 172.21.15.135:0/3589414699 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c035070 con 0x7f5d70108ac0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.580+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7019a020 con 0x7f5d70108ac0 2024-05-20T17:33:55.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.581+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d701a62e0 con 0x7f5d70108ac0 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.583+0000 7f5d6dffb640 1 -- 172.21.15.135:0/3589414699 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f5d5c042030 con 0x7f5d70108ac0 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.583+0000 7f5d7e197740 1 Processor -- start 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.583+0000 7f5d7e197740 1 -- start start 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b38792fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387930260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 0x55b3879307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b387895c40 con 0x55b3875706b0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b38783d580 con 0x55b387591390 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d7e197740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b387891c00 con 0x55b3875684d0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 0x55b3879307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 0x55b3879307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42834/0 (socket says 172.21.15.135:42834) 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387930260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d6ffff640 1 -- 172.21.15.135:0/1541709585 learned_addr learned my addr 172.21.15.135:0/1541709585 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d6dffb640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 0x7f5d600a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d757b1640 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b38792fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 0x7f5d600a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1541709585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 msgr2=0x55b38792fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b38792fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1541709585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 msgr2=0x55b3879307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d6dffb640 1 -- 172.21.15.135:0/3589414699 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5d5c0efa30 con 0x7f5d70108ac0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 0x55b3879307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1541709585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3875a93f0 con 0x55b3875684d0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387930260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005fd0 tx=0x7f5d640107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3759a730e0b4a1b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.584+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 0x7f5d600a5320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800afd0 tx=0x7f5d6800a4d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.585+0000 7f5d5affd640 1 -- 172.21.15.135:0/1541709585 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6401c480 con 0x55b3875684d0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.585+0000 7f5d5affd640 1 -- 172.21.15.135:0/1541709585 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d64011920 con 0x55b3875684d0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.585+0000 7f5d5affd640 1 -- 172.21.15.135:0/1541709585 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6401a7f0 con 0x55b3875684d0 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.585+0000 7f5d7e197740 1 -- 172.21.15.135:0/1541709585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 msgr2=0x55b387930260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.585+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387930260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005fd0 tx=0x7f5d640107a0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 -- 172.21.15.135:0/1541709585 shutdown_connections 2024-05-20T17:33:55.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875706b0 0x55b3879307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387930260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1541709585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b38792fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 -- 172.21.15.135:0/1541709585 >> 172.21.15.135:0/1541709585 conn(0x55b3875854e0 msgr2=0x55b38792c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 -- 172.21.15.135:0/1541709585 shutdown_connections 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 -- 172.21.15.135:0/1541709585 wait complete. 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 -- start start 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 Processor -- start 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b38793bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b38793c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.586+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b38793d010 con 0x55b387591390 2024-05-20T17:33:55.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b387850c40 con 0x55b3875706b0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b38793d190 con 0x55b3875684d0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 10 client.0 _ll_register_callbacks cb 0x55b3875a8be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d74fb0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b38793bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42848/0 (socket says 172.21.15.135:42848) 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 -- 172.21.15.135:0/4138349938 learned_addr learned my addr 172.21.15.135:0/4138349938 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b38793c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 -- 172.21.15.135:0/4138349938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 msgr2=0x55b38793bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b38793bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 -- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 msgr2=0x55b38793c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b38793c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 -- 172.21.15.135:0/4138349938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3876737d0 con 0x55b387591390 2024-05-20T17:33:55.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b38793bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d757b1640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5d68011fa0 tx=0x7f5d68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ccf5ee191b9fad server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68025030 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5d68004b20 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d64011920 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d68004d20 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 10 client.15654 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.587+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b387949860 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d64011920 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f5d68004020 con 0x55b387591390 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 10 client.15654 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:55.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 20 client.15654 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b38754ff60 0x55b38794cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 4 client.15654 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3878a3370 con 0x55b38754ff60 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.588+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b38754ff60 0x55b38794cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d4ffff640 10 client.15654 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b38754ff60 0x55b38794cdb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8d0e91a53b4a1e server_cookie=2dda3e9aef201c23 in_seq=0 out_seq=0 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d4ffff640 1 -- 172.21.15.135:0/4138349938 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b3878a3370 con 0x55b38754ff60 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d4ffff640 10 client.15654 handle_command_reply: tid=0 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 client.15654 shutdown 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 msgr2=0x55b38793a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5d68011fa0 tx=0x7f5d68004a40 comp rx=0 tx=0).stop 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 shutdown_connections 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b38754ff60 0x55b38794cdb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b38793a1e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b38793c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d7e197740 1 --2- 172.21.15.135:0/4138349938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b38793bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.589+0000 7f5d4ffff640 0 client.15654 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.590+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 >> 172.21.15.135:0/4138349938 conn(0x55b3875854e0 msgr2=0x55b387931a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.590+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 shutdown_connections 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.590+0000 7f5d7e197740 1 -- 172.21.15.135:0/4138349938 wait complete. 2024-05-20T17:33:55.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.590+0000 7f5d7e197740 20 client.15654 trim_cache size 0 max 16384 2024-05-20T17:33:55.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 Processor -- start 2024-05-20T17:33:55.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 -- start start 2024-05-20T17:33:55.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387938ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b387938ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701b14e0 con 0x55b387591390 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701aedb0 con 0x55b3875706b0 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d7e197740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701acc00 con 0x55b3875684d0 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d757b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d757b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42854/0 (socket says 172.21.15.135:42854) 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.603+0000 7f5d757b1640 1 -- 172.21.15.135:0/3263906564 learned_addr learned my addr 172.21.15.135:0/3263906564 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387938ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b387938ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 -- 172.21.15.135:0/3263906564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 msgr2=0x55b387938ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387938ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 -- 172.21.15.135:0/3263906564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 msgr2=0x55b387938ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b387938ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 -- 172.21.15.135:0/3263906564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b387931540 con 0x55b387591390 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387938ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b387938ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d757b1640 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f80 tx=0x7f5d68004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b6133c467d5537 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d5a7fc640 1 -- 172.21.15.135:0/3263906564 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68025070 con 0x55b387591390 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d5a7fc640 1 -- 172.21.15.135:0/3263906564 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d68038070 con 0x55b387591390 2024-05-20T17:33:55.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.604+0000 7f5d5a7fc640 1 -- 172.21.15.135:0/3263906564 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68003ea0 con 0x55b387591390 2024-05-20T17:33:55.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- 172.21.15.135:0/3263906564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 msgr2=0x55b3879339d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f80 tx=0x7f5d68004ab0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- 172.21.15.135:0/3263906564 shutdown_connections 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b387591390 0x55b3879339d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3875706b0 0x55b387938ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 --2- 172.21.15.135:0/3263906564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875684d0 0x55b387938ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- 172.21.15.135:0/3263906564 >> 172.21.15.135:0/3263906564 conn(0x55b3875854e0 msgr2=0x55b3879353f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- 172.21.15.135:0/3263906564 shutdown_connections 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- 172.21.15.135:0/3263906564 wait complete. 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 -- start start 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.605+0000 7f5d7e197740 1 Processor -- start 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875706b0 0x55b38793fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b3879b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701ad270 con 0x55b3875684d0 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701ae6e0 con 0x55b387591390 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d701ad940 con 0x55b3875706b0 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 10 client.0 _ll_register_callbacks cb 0x7f5d6800ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42870/0 (socket says 172.21.15.135:42870) 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1752386784 learned_addr learned my addr 172.21.15.135:0/1752386784 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d757b1640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b3879b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1752386784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875706b0 msgr2=0x55b38793fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875706b0 0x55b38793fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 msgr2=0x55b3879b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:55.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b3879b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 -- 172.21.15.135:0/1752386784 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3879b3660 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d757b1640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b3879b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d74fb0640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400baf0 tx=0x7f5d6400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d785a5c3b078a438 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6402e060 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5d64011440 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.606+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d68038070 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d64011640 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 10 client.15660 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b3879b46a0 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d68038070 con 0x55b3875684d0 2024-05-20T17:33:55.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f5d64004760 con 0x55b3875684d0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 10 client.15660 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 20 client.15660 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b3875253a0 0x55b3879b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 4 client.15660 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b38789d6c0 con 0x55b3875253a0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.607+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b3875253a0 0x55b3879b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d4ffff640 10 client.15660 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d6ffff640 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b3875253a0 0x55b3879b6b50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317c3a3fdfb84c8f server_cookie=cfdf0fbd3b8ba958 in_seq=0 out_seq=0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d4ffff640 1 -- 172.21.15.135:0/1752386784 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b38789d6c0 con 0x55b3875253a0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d4ffff640 10 client.15660 handle_command_reply: tid=0 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 client.15660 shutdown 2024-05-20T17:33:55.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 msgr2=0x55b38793f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400baf0 tx=0x7f5d6400be80 comp rx=0 tx=0).stop 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 shutdown_connections 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b3875253a0 0x55b3879b6b50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b387591390 0x55b3879b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d4ffff640 0 client.15660 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3875706b0 0x55b38793fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 --2- 172.21.15.135:0/1752386784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3875684d0 0x55b38793f6a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 >> 172.21.15.135:0/1752386784 conn(0x55b3875854e0 msgr2=0x55b38793bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 shutdown_connections 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 1 -- 172.21.15.135:0/1752386784 wait complete. 2024-05-20T17:33:55.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.608+0000 7f5d7e197740 20 client.15660 trim_cache size 0 max 16384 2024-05-20T17:33:55.617 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:33:55.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 msgr2=0x7f5d600a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 0x7f5d600a5320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800afd0 tx=0x7f5d6800a4d0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 msgr2=0x7f5d7019fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005940 tx=0x7f5d5c0042f0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 shutdown_connections 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f5d600a2e10 0x7f5d600a5320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70108f60 0x7f5d701996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d70108ac0 0x7f5d7019fa80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 --2- 172.21.15.135:0/3589414699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70103210 0x7f5d7019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 >> 172.21.15.135:0/3589414699 conn(0x7f5d700fe180 msgr2=0x7f5d7010e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 shutdown_connections 2024-05-20T17:33:55.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:55.609+0000 7f5d77214640 1 -- 172.21.15.135:0/3589414699 wait complete. 2024-05-20T17:33:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:55 smithi135 ceph-mon[32027]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-20T17:33:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:55 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1100185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:55 smithi160 ceph-mon[36261]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-20T17:33:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:55 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1100185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:55 smithi172 ceph-mon[36511]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-20T17:33:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:55 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1100185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:33:56.622 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-20T17:33:56.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:33:56.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-20T17:33:56.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- 172.21.15.135:0/4200117260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 msgr2=0x7f06d01015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 --2- 172.21.15.135:0/4200117260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d01015f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009900 tx=0x7f06cc02a410 comp rx=0 tx=0).stop 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- 172.21.15.135:0/4200117260 shutdown_connections 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 --2- 172.21.15.135:0/4200117260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d010c370 0x7f06d010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 --2- 172.21.15.135:0/4200117260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d0101b30 0x7f06d0101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 --2- 172.21.15.135:0/4200117260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d01015f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- 172.21.15.135:0/4200117260 >> 172.21.15.135:0/4200117260 conn(0x7f06d0077130 msgr2=0x7f06d0077570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- 172.21.15.135:0/4200117260 shutdown_connections 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- 172.21.15.135:0/4200117260 wait complete. 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 Processor -- start 2024-05-20T17:33:56.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.750+0000 7f06d852f640 1 -- start start 2024-05-20T17:33:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d0101b30 0x7f06d01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d010c370 0x7f06d019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0111d20 con 0x7f06d0107a10 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0111ba0 con 0x7f06d0101b30 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d852f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0111ea0 con 0x7f06d010c370 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42876/0 (socket says 172.21.15.135:42876) 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 -- 172.21.15.135:0/879469697 learned_addr learned my addr 172.21.15.135:0/879469697 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d62cb640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d0101b30 0x7f06d01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d6acc640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d010c370 0x7f06d019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 -- 172.21.15.135:0/879469697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d010c370 msgr2=0x7f06d019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d010c370 0x7f06d019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 -- 172.21.15.135:0/879469697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d0101b30 msgr2=0x7f06d01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d0101b30 0x7f06d01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 -- 172.21.15.135:0/879469697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d019e630 con 0x7f06d0107a10 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06d5aca640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005d00 tx=0x7f06c000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06c77fe640 1 -- 172.21.15.135:0/879469697 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06d0107a10 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.751+0000 7f06c77fe640 1 -- 172.21.15.135:0/879469697 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c0009c30 con 0x7f06d0107a10 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.752+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d019e920 con 0x7f06d0107a10 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.752+0000 7f06c77fe640 1 -- 172.21.15.135:0/879469697 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c000f620 con 0x7f06d0107a10 2024-05-20T17:33:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.752+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d019ee20 con 0x7f06d0107a10 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.754+0000 7f06c77fe640 1 -- 172.21.15.135:0/879469697 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f06c001a070 con 0x7f06d0107a10 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.754+0000 7f06df3d2740 1 Processor -- start 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06c77fe640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 0x7f06bc0a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 -- start start 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06c77fe640 1 -- 172.21.15.135:0/879469697 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06c00cf050 con 0x7f06d0107a10 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06d6acc640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 0x7f06bc0a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c64b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be43bc9990 con 0x55be438c5410 2024-05-20T17:33:56.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55be43b715b0 con 0x55be4389c550 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06df3d2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be43bc5950 con 0x55be438a4730 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42882/0 (socket says 172.21.15.135:42882) 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06d62cb640 1 -- 172.21.15.135:0/3847195938 learned_addr learned my addr 172.21.15.135:0/3847195938 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.755+0000 7f06d5aca640 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c64b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d6acc640 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d6acc640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 0x7f06bc0a52a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005fd0 tx=0x7f06c800f730 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 -- 172.21.15.135:0/3847195938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 msgr2=0x55be43c650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 -- 172.21.15.135:0/3847195938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 msgr2=0x55be43c64b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c64b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 -- 172.21.15.135:0/3847195938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be439a57e0 con 0x55be438c5410 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06d62cb640 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06d0102a10 tx=0x7f06cc005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939bcdc9e55a3d58 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06c4bfe640 1 -- 172.21.15.135:0/3847195938 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc040070 con 0x55be438c5410 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06c4bfe640 1 -- 172.21.15.135:0/3847195938 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc0318f0 con 0x55be438c5410 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.756+0000 7f06c4bfe640 1 -- 172.21.15.135:0/3847195938 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc035040 con 0x55be438c5410 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- 172.21.15.135:0/3847195938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 msgr2=0x55be43c64620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06d0102a10 tx=0x7f06cc005dd0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- 172.21.15.135:0/3847195938 shutdown_connections 2024-05-20T17:33:56.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c64b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 --2- 172.21.15.135:0/3847195938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c64620 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- 172.21.15.135:0/3847195938 >> 172.21.15.135:0/3847195938 conn(0x55be438b9560 msgr2=0x55be43c60dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- 172.21.15.135:0/3847195938 shutdown_connections 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- 172.21.15.135:0/3847195938 wait complete. 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.757+0000 7f06df3d2740 1 -- start start 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 Processor -- start 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c6ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c6f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be43c71910 con 0x55be438c5410 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55be43b84b40 con 0x55be4389c550 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be43c71a90 con 0x55be438a4730 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06df3d2740 10 client.0 _ll_register_callbacks cb 0x55be43b790f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42892/0 (socket says 172.21.15.135:42892) 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 -- 172.21.15.135:0/2604144357 learned_addr learned my addr 172.21.15.135:0/2604144357 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d5aca640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c6f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c6ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 -- 172.21.15.135:0/2604144357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 msgr2=0x55be43c6f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c6f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 -- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 msgr2=0x55be43c6ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c6ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 -- 172.21.15.135:0/2604144357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be43a05f70 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06d6acc640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06c80129e0 tx=0x7f06c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc05b63dc5ec3c92 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.758+0000 7f06b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8010510 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06c80106b0 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc0318f0 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f06c80108b0 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 10 client.15672 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55be4389d170 con 0x55be438c5410 2024-05-20T17:33:56.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc0318f0 con 0x55be438c5410 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f06c8011440 con 0x55be438c5410 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 10 client.15672 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 20 client.15672 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be438841f0 0x55be43c81100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 4 client.15672 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.759+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be43bd70c0 con 0x55be438841f0 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.760+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be438841f0 0x55be43c81100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.760+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be438841f0 0x55be43c81100 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74dab9ec345f83f9 server_cookie=b36a48dbc00468d2 in_seq=0 out_seq=0 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.760+0000 7f06b9ffb640 10 client.15672 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2604144357 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55be43bd70c0 con 0x55be438841f0 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06b9ffb640 10 client.15672 handle_command_reply: tid=0 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 client.15672 shutdown 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 msgr2=0x55be43c74e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06c80129e0 tx=0x7f06c8004ab0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 shutdown_connections 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be438841f0 0x55be43c81100 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be438c5410 0x55be43c74e70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438a4730 0x55be43c6f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2604144357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be4389c550 0x55be43c6ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06b9ffb640 0 client.15672 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 >> 172.21.15.135:0/2604144357 conn(0x55be438b9560 msgr2=0x55be43c643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 shutdown_connections 2024-05-20T17:33:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 1 -- 172.21.15.135:0/2604144357 wait complete. 2024-05-20T17:33:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.761+0000 7f06df3d2740 20 client.15672 trim_cache size 0 max 16384 2024-05-20T17:33:56.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 Processor -- start 2024-05-20T17:33:56.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 -- start start 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c75240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01b11f0 con 0x55be4389c550 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01aeac0 con 0x55be438a4730 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06df3d2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01ac910 con 0x55be438c5410 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42902/0 (socket says 172.21.15.135:42902) 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.779+0000 7f06d62cb640 1 -- 172.21.15.135:0/1292149703 learned_addr learned my addr 172.21.15.135:0/1292149703 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d5aca640 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 -- 172.21.15.135:0/1292149703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 msgr2=0x55be43c75240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c75240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 -- 172.21.15.135:0/1292149703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 msgr2=0x55be43c74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 -- 172.21.15.135:0/1292149703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be43c6f890 con 0x55be4389c550 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06d62cb640 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f06cc031bf0 tx=0x7f06cc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7406bde7fd225c52 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06bbfff640 1 -- 172.21.15.135:0/1292149703 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc035040 con 0x55be4389c550 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06bbfff640 1 -- 172.21.15.135:0/1292149703 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc04f3b0 con 0x55be4389c550 2024-05-20T17:33:56.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.780+0000 7f06bbfff640 1 -- 172.21.15.135:0/1292149703 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc040040 con 0x55be4389c550 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- 172.21.15.135:0/1292149703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 msgr2=0x55be43c6dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f06cc031bf0 tx=0x7f06cc005fd0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- 172.21.15.135:0/1292149703 shutdown_connections 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c75240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- 172.21.15.135:0/1292149703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c6dae0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- 172.21.15.135:0/1292149703 >> 172.21.15.135:0/1292149703 conn(0x55be438b9560 msgr2=0x55be43c6d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- 172.21.15.135:0/1292149703 shutdown_connections 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- 172.21.15.135:0/1292149703 wait complete. 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- start start 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 Processor -- start 2024-05-20T17:33:56.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c794b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01acf80 con 0x55be4389c550 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01ae3f0 con 0x55be438a4730 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.781+0000 7f06df3d2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01ad650 con 0x55be438c5410 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06df3d2740 10 client.0 _ll_register_callbacks cb 0x7f06c800ff60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42906/0 (socket says 172.21.15.135:42906) 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 -- 172.21.15.135:0/2321552201 learned_addr learned my addr 172.21.15.135:0/2321552201 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d5aca640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d6acc640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 -- 172.21.15.135:0/2321552201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 msgr2=0x55be43c799f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c799f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 -- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 msgr2=0x55be43c794b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c794b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 -- 172.21.15.135:0/2321552201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be43cec890 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06d62cb640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a930 tx=0x7f06cc031890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a1c01a2e1286f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc035070 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc04f3b0 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06cc04f560 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f06cc067050 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06df3d2740 10 client.15678 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.782+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55be43ced9b0 con 0x55be4389c550 2024-05-20T17:33:56.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc04f3b0 con 0x55be4389c550 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f06cc03c440 con 0x55be4389c550 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 10 client.15678 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 20 client.15678 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be43859630 0x55be43cefd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 4 client.15678 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55be43bd1410 con 0x55be43859630 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06d5aca640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be43859630 0x55be43cefd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06b9ffb640 10 client.15678 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.783+0000 7f06d5aca640 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be43859630 0x55be43cefd40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91eb8fd438b3b226 server_cookie=2887485e7123f3b0 in_seq=0 out_seq=0 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06b9ffb640 1 -- 172.21.15.135:0/2321552201 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55be43bd1410 con 0x55be43859630 2024-05-20T17:33:56.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06b9ffb640 10 client.15678 handle_command_reply: tid=0 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 client.15678 shutdown 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 msgr2=0x55be43c78f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a930 tx=0x7f06cc031890 comp rx=0 tx=0).stop 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 shutdown_connections 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55be43859630 0x55be43cefd40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be438c5410 0x55be43c799f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06b9ffb640 0 client.15678 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55be438a4730 0x55be43c794b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 --2- 172.21.15.135:0/2321552201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be4389c550 0x55be43c78f70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 >> 172.21.15.135:0/2321552201 conn(0x55be438b9560 msgr2=0x55be43c70190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 shutdown_connections 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 1 -- 172.21.15.135:0/2321552201 wait complete. 2024-05-20T17:33:56.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.785+0000 7f06df3d2740 20 client.15678 trim_cache size 0 max 16384 2024-05-20T17:33:56.793 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:56.793 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-05-20T17:33:56.793 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "a61aeeab-853e-48f0-ae21-9c8afc1c48e3", 2024-05-20T17:33:56.793 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-05-20T17:33:56.793 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 msgr2=0x7f06bc0a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 0x7f06bc0a52a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005fd0 tx=0x7f06c800f730 comp rx=0 tx=0).stop 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 msgr2=0x7f06d0199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005d00 tx=0x7f06c000dde0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 shutdown_connections 2024-05-20T17:33:56.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06bc0a2d90 0x7f06bc0a52a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d010c370 0x7f06d019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06d0107a10 0x7f06d0199d30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 --2- 172.21.15.135:0/879469697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06d0101b30 0x7f06d01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 >> 172.21.15.135:0/879469697 conn(0x7f06d0077130 msgr2=0x7f06d0073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 shutdown_connections 2024-05-20T17:33:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.786+0000 7f06d852f640 1 -- 172.21.15.135:0/879469697 wait complete. 2024-05-20T17:33:56.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:33:56.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:33:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 -- 172.21.15.135:0/3018003549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 msgr2=0x7f3108101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 --2- 172.21.15.135:0/3018003549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108101eb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009900 tx=0x7f30f802a410 comp rx=0 tx=0).stop 2024-05-20T17:33:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 -- 172.21.15.135:0/3018003549 shutdown_connections 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 --2- 172.21.15.135:0/3018003549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f310810c330 0x7f310810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 --2- 172.21.15.135:0/3018003549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108101eb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 --2- 172.21.15.135:0/3018003549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31081079d0 0x7f3108101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 -- 172.21.15.135:0/3018003549 >> 172.21.15.135:0/3018003549 conn(0x7f31080770b0 msgr2=0x7f31080774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 -- 172.21.15.135:0/3018003549 shutdown_connections 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.911+0000 7f31101b5640 1 -- 172.21.15.135:0/3018003549 wait complete. 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 Processor -- start 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 -- start start 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31081079d0 0x7f3108198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 0x7f310819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3108111ce0 con 0x7f3108101aa0 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3108111b60 con 0x7f31081079d0 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f31101b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3108111e60 con 0x7f310810c330 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42926/0 (socket says 172.21.15.135:42926) 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 -- 172.21.15.135:0/1109579266 learned_addr learned my addr 172.21.15.135:0/1109579266 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310e752640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 0x7f310819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 -- 172.21.15.135:0/1109579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 msgr2=0x7f310819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310d750640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31081079d0 0x7f3108198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 0x7f310819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 -- 172.21.15.135:0/1109579266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31081079d0 msgr2=0x7f3108198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31081079d0 0x7f3108198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310df51640 1 -- 172.21.15.135:0/1109579266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310819d4e0 con 0x7f3108101aa0 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.912+0000 7f310e752640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 0x7f310819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f310df51640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f310400ea50 tx=0x7f310400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f30feffd640 1 -- 172.21.15.135:0/1109579266 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310400cdc0 con 0x7f3108101aa0 2024-05-20T17:33:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310819d7d0 con 0x7f3108101aa0 2024-05-20T17:33:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f30feffd640 1 -- 172.21.15.135:0/1109579266 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3104005020 con 0x7f3108101aa0 2024-05-20T17:33:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f30feffd640 1 -- 172.21.15.135:0/1109579266 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104011690 con 0x7f3108101aa0 2024-05-20T17:33:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.913+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31081a5150 con 0x7f3108101aa0 2024-05-20T17:33:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.915+0000 7f30feffd640 1 -- 172.21.15.135:0/1109579266 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138010+0+0 (secure 0 0 0) 0x7f3104005540 con 0x7f3108101aa0 2024-05-20T17:33:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.915+0000 7f3117065740 1 Processor -- start 2024-05-20T17:33:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 -- start start 2024-05-20T17:33:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b188390 0x56069b528dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b529850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56069b48cd00 con 0x56069b15f4d0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56069b4344c0 con 0x56069b1676b0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f3117065740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56069b488cc0 con 0x56069b188390 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f30feffd640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 0x7f30f40a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42940/0 (socket says 172.21.15.135:42940) 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 -- 172.21.15.135:0/297868195 learned_addr learned my addr 172.21.15.135:0/297868195 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310d750640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b529850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310e752640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 0x7f30f40a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310e752640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b188390 0x56069b528dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f30feffd640 1 -- 172.21.15.135:0/1109579266 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f31040cf960 con 0x7f3108101aa0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 -- 172.21.15.135:0/297868195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b188390 msgr2=0x56069b528dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b188390 0x56069b528dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 -- 172.21.15.135:0/297868195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 msgr2=0x56069b529850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b529850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310df51640 1 -- 172.21.15.135:0/297868195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069b26a7d0 con 0x56069b15f4d0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.916+0000 7f310d750640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b529850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.917+0000 7f310e752640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 0x7f30f40a52a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3100014870 tx=0x7f3100009530 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.917+0000 7f310df51640 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f310400c700 tx=0x7f31040058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6fb7fc99738de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.917+0000 7f30f3fff640 1 -- 172.21.15.135:0/297868195 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310401f070 con 0x56069b15f4d0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.917+0000 7f30f3fff640 1 -- 172.21.15.135:0/297868195 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f310409c410 con 0x56069b15f4d0 2024-05-20T17:33:56.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.917+0000 7f30f3fff640 1 -- 172.21.15.135:0/297868195 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040cd2a0 con 0x56069b15f4d0 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- 172.21.15.135:0/297868195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 msgr2=0x56069b529310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f310400c700 tx=0x7f31040058b0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- 172.21.15.135:0/297868195 shutdown_connections 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b529850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b529310 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 --2- 172.21.15.135:0/297868195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b188390 0x56069b528dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- 172.21.15.135:0/297868195 >> 172.21.15.135:0/297868195 conn(0x56069b17c4e0 msgr2=0x56069b5256f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- 172.21.15.135:0/297868195 shutdown_connections 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- 172.21.15.135:0/297868195 wait complete. 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 -- start start 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.918+0000 7f3117065740 1 Processor -- start 2024-05-20T17:33:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b1676b0 0x56069b537910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 0x56069b535870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56069b538400 con 0x56069b15f4d0 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56069b447b90 con 0x56069b188390 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56069b538580 con 0x56069b1676b0 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 10 client.0 _ll_register_callbacks cb 0x56069b483da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42946/0 (socket says 172.21.15.135:42946) 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 -- 172.21.15.135:0/1501139748 learned_addr learned my addr 172.21.15.135:0/1501139748 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310d750640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b1676b0 0x56069b537910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310e752640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 0x56069b535870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 -- 172.21.15.135:0/1501139748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b1676b0 msgr2=0x56069b537910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b1676b0 0x56069b537910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 -- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 msgr2=0x56069b535870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 0x56069b535870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 -- 172.21.15.135:0/1501139748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069b1a03f0 con 0x56069b15f4d0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310e752640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 0x56069b535870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f310df51640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f31040cd6b0 tx=0x7f3104097fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5fd15739d4c93a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f30f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040b9060 con 0x56069b15f4d0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f31040983f0 con 0x56069b15f4d0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.919+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310409c410 con 0x56069b15f4d0 2024-05-20T17:33:56.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f310401f050 con 0x56069b15f4d0 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 10 client.15690 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56069b1600f0 con 0x56069b15f4d0 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f310409c410 con 0x56069b15f4d0 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f310400f040 con 0x56069b15f4d0 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 10 client.15690 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 20 client.15690 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b146f60 0x56069b547d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 4 client.15690 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56069b49a430 con 0x56069b146f60 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.920+0000 7f310d750640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b146f60 0x56069b547d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.921+0000 7f30f17fa640 10 client.15690 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.921+0000 7f310d750640 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b146f60 0x56069b547d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc53df9adbadc22c server_cookie=2a30a15e14a26dbf in_seq=0 out_seq=0 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.921+0000 7f30f17fa640 1 -- 172.21.15.135:0/1501139748 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56069b49a430 con 0x56069b146f60 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.921+0000 7f30f17fa640 10 client.15690 handle_command_reply: tid=0 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.921+0000 7f3117065740 1 client.15690 shutdown 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 msgr2=0x56069b5373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f31040cd6b0 tx=0x7f3104097fb0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 shutdown_connections 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b146f60 0x56069b547d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b188390 0x56069b535870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b1676b0 0x56069b537910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f30f17fa640 0 client.15690 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 --2- 172.21.15.135:0/1501139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b5373d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 >> 172.21.15.135:0/1501139748 conn(0x56069b17c4e0 msgr2=0x56069b52ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 shutdown_connections 2024-05-20T17:33:56.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 1 -- 172.21.15.135:0/1501139748 wait complete. 2024-05-20T17:33:56.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.922+0000 7f3117065740 20 client.15690 trim_cache size 0 max 16384 2024-05-20T17:33:56.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.939+0000 7f3117065740 1 Processor -- start 2024-05-20T17:33:56.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.939+0000 7f3117065740 1 -- start start 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b534720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 0x56069b532ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31081af040 con 0x56069b1676b0 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31081ac910 con 0x56069b15f4d0 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f3117065740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31081aa760 con 0x56069b146f60 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42948/0 (socket says 172.21.15.135:42948) 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 -- 172.21.15.135:0/2987703310 learned_addr learned my addr 172.21.15.135:0/2987703310 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310d750640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 0x56069b532ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 -- 172.21.15.135:0/2987703310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 msgr2=0x56069b534720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310df51640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b534720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b534720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 -- 172.21.15.135:0/2987703310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 msgr2=0x56069b532ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 0x56069b532ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 -- 172.21.15.135:0/2987703310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069b514990 con 0x56069b1676b0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310d750640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 0x56069b532ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310df51640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b534720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.940+0000 7f310e752640 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3100015010 tx=0x7f310001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca7d6fa0bab4e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f30f37fe640 1 -- 172.21.15.135:0/2987703310 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100004030 con 0x56069b1676b0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f30f37fe640 1 -- 172.21.15.135:0/2987703310 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3100005500 con 0x56069b1676b0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f30f37fe640 1 -- 172.21.15.135:0/2987703310 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100004d70 con 0x56069b1676b0 2024-05-20T17:33:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 -- 172.21.15.135:0/2987703310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 msgr2=0x56069b532ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3100015010 tx=0x7f310001d000 comp rx=0 tx=0).stop 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 -- 172.21.15.135:0/2987703310 shutdown_connections 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b1676b0 0x56069b532ff0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b15f4d0 0x56069b532ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 --2- 172.21.15.135:0/2987703310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b534720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 -- 172.21.15.135:0/2987703310 >> 172.21.15.135:0/2987703310 conn(0x56069b17c4e0 msgr2=0x56069b534010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 -- 172.21.15.135:0/2987703310 shutdown_connections 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.941+0000 7f3117065740 1 -- 172.21.15.135:0/2987703310 wait complete. 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 -- start start 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 Processor -- start 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b54a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b5a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31081aadd0 con 0x56069b15f4d0 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31081ac240 con 0x56069b1676b0 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31081ab4a0 con 0x56069b146f60 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f3117065740 10 client.0 _ll_register_callbacks cb 0x7f3100005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f310d750640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f310d750640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42962/0 (socket says 172.21.15.135:42962) 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.942+0000 7f310d750640 1 -- 172.21.15.135:0/1282568998 learned_addr learned my addr 172.21.15.135:0/1282568998 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310e752640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b5a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 -- 172.21.15.135:0/1282568998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 msgr2=0x56069b54a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b54a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 -- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 msgr2=0x56069b5a7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b5a7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 -- 172.21.15.135:0/1282568998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069b5a83b0 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310e752640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b5a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f310d750640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f30f8033000 tx=0x7f30f8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ea88f5b7e1d452 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8048060 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f30f8004310 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3100005500 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f30f8040070 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 10 client.15696 fetch_fsmap learned FSMap version 22 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56069b5af660 con 0x56069b15f4d0 2024-05-20T17:33:56.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3100005500 con 0x56069b15f4d0 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f30f8043ce0 con 0x56069b15f4d0 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 10 client.15696 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 20 client.15696 populate_metadata read hostname 'smithi135' 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b188390 0x56069b5b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 4 client.15696 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.943+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56069b494780 con 0x56069b188390 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f310df51640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b188390 0x56069b5b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f30f17fa640 10 client.15696 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f310df51640 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b188390 0x56069b5b1e00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55721ef518d5b010 server_cookie=4a6ea10ba064c2c5 in_seq=0 out_seq=0 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f30f17fa640 1 -- 172.21.15.135:0/1282568998 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56069b494780 con 0x56069b188390 2024-05-20T17:33:56.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f30f17fa640 10 client.15696 handle_command_reply: tid=0 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.944+0000 7f3117065740 1 client.15696 shutdown 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 msgr2=0x56069b54a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f30f8033000 tx=0x7f30f8009880 comp rx=0 tx=0).stop 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 shutdown_connections 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56069b188390 0x56069b5b1e00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56069b1676b0 0x56069b5a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56069b15f4d0 0x56069b54a710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f30f17fa640 0 client.15696 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 --2- 172.21.15.135:0/1282568998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56069b146f60 0x56069b54a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 >> 172.21.15.135:0/1282568998 conn(0x56069b17c4e0 msgr2=0x56069b528cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 shutdown_connections 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 1 -- 172.21.15.135:0/1282568998 wait complete. 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f3117065740 20 client.15696 trim_cache size 0 max 16384 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "a61aeeab-853e-48f0-ae21-9c8afc1c48e3": { 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "a61aeeab-853e-48f0-ae21-9c8afc1c48e3", 2024-05-20T17:33:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-05-20T17:33:56.956 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:33:56.956 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:33:56.956 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:33:56.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 msgr2=0x7f30f40a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 0x7f30f40a52a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3100014870 tx=0x7f3100009530 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 msgr2=0x7f3108198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.945+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f310400ea50 tx=0x7f310400ef10 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 shutdown_connections 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f30f40a2d90 0x7f30f40a52a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310810c330 0x7f310819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31081079d0 0x7f3108198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 --2- 172.21.15.135:0/1109579266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101aa0 0x7f3108198680 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 >> 172.21.15.135:0/1109579266 conn(0x7f31080770b0 msgr2=0x7f3108103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 shutdown_connections 2024-05-20T17:33:56.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:33:56.946+0000 7f31101b5640 1 -- 172.21.15.135:0/1109579266 wait complete. 2024-05-20T17:33:56.958 INFO:tasks.cephfs.filesystem:scrub status for tag:a61aeeab-853e-48f0-ae21-9c8afc1c48e3 - {'path': '/', 'tag': 'a61aeeab-853e-48f0-ae21-9c8afc1c48e3', 'options': 'recursive,force'} 2024-05-20T17:33:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:57 smithi135 ceph-mon[32027]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:33:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:57 smithi135 ceph-mon[32027]: scrub queued for path: / 2024-05-20T17:33:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:57 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:57 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:33:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:57 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:57 smithi160 ceph-mon[36261]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:33:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:57 smithi160 ceph-mon[36261]: scrub queued for path: / 2024-05-20T17:33:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:57 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:57 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:33:57.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:57 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:57 smithi172 ceph-mon[36511]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:33:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:57 smithi172 ceph-mon[36511]: scrub queued for path: / 2024-05-20T17:33:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:57 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:57 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:33:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:57 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:33:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:58 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:33:58.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:58 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:33:58.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:58 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:33:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:33:59 smithi135 ceph-mon[32027]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:33:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:33:59 smithi160 ceph-mon[36261]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:33:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:33:59 smithi172 ceph-mon[36511]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:00.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:34:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:34:00.139+0000 7f2654d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:34:00.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:34:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:34:00.139+0000 7f2654d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:34:00.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:34:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:34:00.139+0000 7f2654d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:34:00.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:34:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:34:00.139+0000 7f2654d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:34:00.455 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:34:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:34:00.139+0000 7f2654d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:34:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:01 smithi135 ceph-mon[32027]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:01 smithi160 ceph-mon[36261]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:01 smithi172 ceph-mon[36511]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:03 smithi135 ceph-mon[32027]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-20T17:34:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:03 smithi135 ceph-mon[32027]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-05-20T17:34:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:03 smithi160 ceph-mon[36261]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-20T17:34:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:03 smithi160 ceph-mon[36261]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-05-20T17:34:03.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:03 smithi172 ceph-mon[36511]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-05-20T17:34:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:03 smithi172 ceph-mon[36511]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-05-20T17:34:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:05 smithi135 ceph-mon[32027]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-05-20T17:34:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:05 smithi160 ceph-mon[36261]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-05-20T17:34:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:05 smithi172 ceph-mon[36511]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/674136263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107a30 msgr2=0x7f4dd81015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/674136263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107a30 0x7f4dd81015e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009900 tx=0x7f4dc802a410 comp rx=0 tx=0).stop 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/674136263 shutdown_connections 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/674136263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8102190 0x7f4dd810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/674136263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8107ed0 0x7f4dd8101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/674136263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107a30 0x7f4dd81015e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/674136263 >> 172.21.15.135:0/674136263 conn(0x7f4dd80fd210 msgr2=0x7f4dd80ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/674136263 shutdown_connections 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/674136263 wait complete. 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.347+0000 7f4ddd9fc640 1 Processor -- start 2024-05-20T17:34:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 -- start start 2024-05-20T17:34:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8102190 0x7f4dd819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8107a30 0x7f4dd819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8111d80 con 0x7f4dd8107ed0 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8111c00 con 0x7f4dd8102190 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4ddd9fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8111f00 con 0x7f4dd8107a30 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47040/0 (socket says 172.21.15.135:47040) 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 -- 172.21.15.135:0/1447057650 learned_addr learned my addr 172.21.15.135:0/1447057650 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8102190 0x7f4dd819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8107a30 0x7f4dd819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 -- 172.21.15.135:0/1447057650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8107a30 msgr2=0x7f4dd819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8107a30 0x7f4dd819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 -- 172.21.15.135:0/1447057650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8102190 msgr2=0x7f4dd819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8102190 0x7f4dd819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.348+0000 7f4dd77fe640 1 -- 172.21.15.135:0/1447057650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd8199de0 con 0x7f4dd8107ed0 2024-05-20T17:34:06.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4dd77fe640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000eb10 tx=0x7f4dd000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4ddc9fa640 1 -- 172.21.15.135:0/1447057650 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004b20 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4ddc9fa640 1 -- 172.21.15.135:0/1447057650 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dd0004cc0 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd819a070 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4ddc9fa640 1 -- 172.21.15.135:0/1447057650 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0010760 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.349+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd81a62d0 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.352+0000 7f4de4978740 1 Processor -- start 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.352+0000 7f4ddc9fa640 1 -- 172.21.15.135:0/1447057650 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7f4dd0005020 con 0x7f4dd8107ed0 2024-05-20T17:34:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.352+0000 7f4de4978740 1 -- start start 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f383440340 con 0x55f38313c1b0 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f3833e8290 con 0x55f3831132f0 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4de4978740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f38343c300 con 0x55f38311b4d0 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47046/0 (socket says 172.21.15.135:47046) 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 -- 172.21.15.135:0/1354946616 learned_addr learned my addr 172.21.15.135:0/1354946616 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4ddc9fa640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 0x7f4dc40a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 -- 172.21.15.135:0/1354946616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 msgr2=0x55f3834dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834dbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 -- 172.21.15.135:0/1354946616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 msgr2=0x55f3834db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 -- 172.21.15.135:0/1354946616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38340c8e0 con 0x55f38313c1b0 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dd77fe640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 0x7f4dc40a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4ddc9fa640 1 -- 172.21.15.135:0/1447057650 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4dd00cfe60 con 0x7f4dd8107ed0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0011380 tx=0x7f4dc000b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285fb77ba68fe8e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.353+0000 7f4dcdffb640 1 -- 172.21.15.135:0/1354946616 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004020 con 0x55f38313c1b0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4dcdffb640 1 -- 172.21.15.135:0/1354946616 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc0005500 con 0x55f38313c1b0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4dcdffb640 1 -- 172.21.15.135:0/1354946616 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004aa0 con 0x55f38313c1b0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 -- 172.21.15.135:0/1354946616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 msgr2=0x55f3834db080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0011380 tx=0x7f4dc000b5a0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4dd77fe640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 0x7f4dc40a5320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00cd490 tx=0x7f4dd00915c0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 -- 172.21.15.135:0/1354946616 shutdown_connections 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 --2- 172.21.15.135:0/1354946616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834db080 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 -- 172.21.15.135:0/1354946616 >> 172.21.15.135:0/1354946616 conn(0x55f383130300 msgr2=0x55f3834d7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 -- 172.21.15.135:0/1354946616 shutdown_connections 2024-05-20T17:34:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.354+0000 7f4de4978740 1 -- 172.21.15.135:0/1354946616 wait complete. 2024-05-20T17:34:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 -- start start 2024-05-20T17:34:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 Processor -- start 2024-05-20T17:34:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3834eb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f3834e81b0 con 0x55f3831132f0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f3833fb790 con 0x55f38313c1b0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f3834e8330 con 0x55f38311b4d0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4de4978740 10 client.0 _ll_register_callbacks cb 0x55f383436a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.355+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47048/0 (socket says 172.21.15.135:47048) 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 -- 172.21.15.135:0/3878608949 learned_addr learned my addr 172.21.15.135:0/3878608949 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3834eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 -- 172.21.15.135:0/3878608949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 msgr2=0x55f3834e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 -- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 msgr2=0x55f3834eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3834eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 -- 172.21.15.135:0/3878608949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f383154210 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000bfd0 tx=0x7f4dc0005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c977dfd2975b58 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004be0 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4dc0004d80 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc0005500 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4dc001e450 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4de4978740 10 client.15714 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.356+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f383220620 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc0005500 con 0x55f3831132f0 2024-05-20T17:34:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f4dc000e510 con 0x55f3831132f0 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 10 client.15714 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 20 client.15714 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830fad80 0x55f3834f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 4 client.15714 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f38344da70 con 0x55f3830fad80 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.357+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830fad80 0x55f3834f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.358+0000 7f4db6ffd640 10 client.15714 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.358+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830fad80 0x55f3834f78c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b50ceabf71dea0c2 server_cookie=6290b07f8825f0b4 in_seq=0 out_seq=0 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.358+0000 7f4db6ffd640 1 -- 172.21.15.135:0/3878608949 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f38344da70 con 0x55f3830fad80 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.358+0000 7f4db6ffd640 10 client.15714 handle_command_reply: tid=0 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.358+0000 7f4de4978740 1 client.15714 shutdown 2024-05-20T17:34:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 msgr2=0x55f3834e5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000bfd0 tx=0x7f4dc0005fb0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 shutdown_connections 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830fad80 0x55f3834f78c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3834eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4db6ffd640 0 client.15714 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 --2- 172.21.15.135:0/3878608949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834e5770 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 >> 172.21.15.135:0/3878608949 conn(0x55f383130300 msgr2=0x55f3834daeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 shutdown_connections 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 1 -- 172.21.15.135:0/3878608949 wait complete. 2024-05-20T17:34:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.359+0000 7f4de4978740 20 client.15714 trim_cache size 0 max 16384 2024-05-20T17:34:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 Processor -- start 2024-05-20T17:34:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 -- start start 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81b14d0 con 0x55f38313c1b0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81aeda0 con 0x55f3831132f0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4de4978740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81acbf0 con 0x55f38311b4d0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47060/0 (socket says 172.21.15.135:47060) 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4dce7fc640 1 -- 172.21.15.135:0/2670620053 learned_addr learned my addr 172.21.15.135:0/2670620053 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.374+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 -- 172.21.15.135:0/2670620053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 msgr2=0x55f3834f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 -- 172.21.15.135:0/2670620053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 msgr2=0x55f3834e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 -- 172.21.15.135:0/2670620053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3834f1e70 con 0x55f38313c1b0 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55f3834e8330 tx=0x7f4dc0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8cf7cd638e28d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dcd7fa640 1 -- 172.21.15.135:0/2670620053 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0000e60 con 0x55f38313c1b0 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dcd7fa640 1 -- 172.21.15.135:0/2670620053 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc00053a0 con 0x55f38313c1b0 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.375+0000 7f4dcd7fa640 1 -- 172.21.15.135:0/2670620053 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000e650 con 0x55f38313c1b0 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- 172.21.15.135:0/2670620053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 msgr2=0x55f3834f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55f3834e8330 tx=0x7f4dc0020040 comp rx=0 tx=0).stop 2024-05-20T17:34:06.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- 172.21.15.135:0/2670620053 shutdown_connections 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f38313c1b0 0x55f3834f1930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 --2- 172.21.15.135:0/2670620053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3831132f0 0x55f3834e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- 172.21.15.135:0/2670620053 >> 172.21.15.135:0/2670620053 conn(0x55f383130300 msgr2=0x55f3834e5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- 172.21.15.135:0/2670620053 shutdown_connections 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- 172.21.15.135:0/2670620053 wait complete. 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 -- start start 2024-05-20T17:34:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.376+0000 7f4de4978740 1 Processor -- start 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3835569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81ad260 con 0x55f3831132f0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81ae6d0 con 0x55f38313c1b0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81ad930 con 0x55f38311b4d0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 10 client.0 _ll_register_callbacks cb 0x7f4dc000beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47070/0 (socket says 172.21.15.135:47070) 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 -- 172.21.15.135:0/587340818 learned_addr learned my addr 172.21.15.135:0/587340818 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 -- 172.21.15.135:0/587340818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 msgr2=0x55f3834f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 -- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 msgr2=0x55f3835569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3835569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 -- 172.21.15.135:0/587340818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f383556f70 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4dce7fc640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00059b0 tx=0x7f4dc00055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ed64e5bb435341 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004df0 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4dc0028040 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.377+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc00053a0 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4dc000eb20 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 10 client.15720 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f38355f400 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc00053a0 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f4dc0038680 con 0x55f3831132f0 2024-05-20T17:34:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 10 client.15720 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 20 client.15720 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830d01c0 0x55f383561a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 4 client.15720 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f383447dc0 con 0x55f3830d01c0 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.378+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830d01c0 0x55f383561a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.379+0000 7f4db6ffd640 10 client.15720 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.379+0000 7f4dd6ffd640 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830d01c0 0x55f383561a70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03c56b891d4e0eb server_cookie=3aa4ea8857b06469 in_seq=0 out_seq=0 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4db6ffd640 1 -- 172.21.15.135:0/587340818 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f383447dc0 con 0x55f3830d01c0 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4db6ffd640 10 client.15720 handle_command_reply: tid=0 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 client.15720 shutdown 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 msgr2=0x55f3834f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00059b0 tx=0x7f4dc00055c0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 shutdown_connections 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f3830d01c0 0x55f383561a70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f38313c1b0 0x55f3835569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f38311b4d0 0x55f3834f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4db6ffd640 0 client.15720 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 --2- 172.21.15.135:0/587340818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3831132f0 0x55f3834f0850 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 >> 172.21.15.135:0/587340818 conn(0x55f383130300 msgr2=0x55f3834dae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 shutdown_connections 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 1 -- 172.21.15.135:0/587340818 wait complete. 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.387+0000 7f4de4978740 20 client.15720 trim_cache size 0 max 16384 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:34:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:34:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:34:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:34:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 msgr2=0x7f4dc40a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 0x7f4dc40a5320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00cd490 tx=0x7f4dd00915c0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 msgr2=0x7f4dd81996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000eb10 tx=0x7f4dd000c2d0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 shutdown_connections 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f4dc40a2e10 0x7f4dc40a5320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dd8107ed0 0x7f4dd81996b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dd8107a30 0x7f4dd819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 --2- 172.21.15.135:0/1447057650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd8102190 0x7f4dd819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 >> 172.21.15.135:0/1447057650 conn(0x7f4dd80fd210 msgr2=0x7f4dd8073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 shutdown_connections 2024-05-20T17:34:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:06.388+0000 7f4ddd9fc640 1 -- 172.21.15.135:0/1447057650 wait complete. 2024-05-20T17:34:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:07 smithi135 ceph-mon[32027]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-05-20T17:34:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:07 smithi160 ceph-mon[36261]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-05-20T17:34:07.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:07 smithi172 ceph-mon[36511]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-05-20T17:34:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:09 smithi135 ceph-mon[32027]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-05-20T17:34:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:09 smithi160 ceph-mon[36261]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-05-20T17:34:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:09 smithi172 ceph-mon[36511]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-05-20T17:34:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:11 smithi135 ceph-mon[32027]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-05-20T17:34:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:11 smithi160 ceph-mon[36261]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-05-20T17:34:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:11 smithi172 ceph-mon[36511]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-05-20T17:34:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:13 smithi135 ceph-mon[32027]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-20T17:34:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:13 smithi160 ceph-mon[36261]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-20T17:34:13.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:13 smithi172 ceph-mon[36511]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-20T17:34:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:15 smithi135 ceph-mon[32027]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-20T17:34:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:15 smithi160 ceph-mon[36261]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-20T17:34:15.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:15 smithi172 ceph-mon[36511]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-20T17:34:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:17 smithi160 ceph-mon[36261]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-20T17:34:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:17 smithi172 ceph-mon[36511]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-20T17:34:17.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:17 smithi135 ceph-mon[32027]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 -- 172.21.15.135:0/2032587276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48107a10 msgr2=0x7efd481015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 --2- 172.21.15.135:0/2032587276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48107a10 0x7efd481015c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efd38009900 tx=0x7efd3802a410 comp rx=0 tx=0).stop 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 -- 172.21.15.135:0/2032587276 shutdown_connections 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 --2- 172.21.15.135:0/2032587276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48102170 0x7efd4810e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 --2- 172.21.15.135:0/2032587276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd48101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 --2- 172.21.15.135:0/2032587276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48107a10 0x7efd481015c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 -- 172.21.15.135:0/2032587276 >> 172.21.15.135:0/2032587276 conn(0x7efd48077160 msgr2=0x7efd480775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 -- 172.21.15.135:0/2032587276 shutdown_connections 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.494+0000 7efd4ea32640 1 -- 172.21.15.135:0/2032587276 wait complete. 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 Processor -- start 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 -- start start 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a10 0x7efd48199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd4819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd48111d60 con 0x7efd48102170 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd48111be0 con 0x7efd48107eb0 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4ea32640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd48111ee0 con 0x7efd48107a10 2024-05-20T17:34:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58796/0 (socket says 172.21.15.135:58796) 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 -- 172.21.15.135:0/4280000236 learned_addr learned my addr 172.21.15.135:0/4280000236 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd3ffff640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a10 0x7efd48199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd4819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 -- 172.21.15.135:0/4280000236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a10 msgr2=0x7efd48199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a10 0x7efd48199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 -- 172.21.15.135:0/4280000236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 msgr2=0x7efd4819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd4819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd47fff640 1 -- 172.21.15.135:0/4280000236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4819e650 con 0x7efd48102170 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.495+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd4819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd47fff640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd38005940 tx=0x7efd38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd45ffb640 1 -- 172.21.15.135:0/4280000236 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3803f030 con 0x7efd48102170 2024-05-20T17:34:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd45ffb640 1 -- 172.21.15.135:0/4280000236 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd38003ad0 con 0x7efd48102170 2024-05-20T17:34:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4819e8e0 con 0x7efd48102170 2024-05-20T17:34:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd45ffb640 1 -- 172.21.15.135:0/4280000236 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38035070 con 0x7efd48102170 2024-05-20T17:34:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.496+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4819edd0 con 0x7efd48102170 2024-05-20T17:34:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.498+0000 7efd45ffb640 1 -- 172.21.15.135:0/4280000236 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7efd38042030 con 0x7efd48102170 2024-05-20T17:34:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 Processor -- start 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 -- start start 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb35080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb35b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55823ba9a340 con 0x55823b76d2f0 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55823ba42290 con 0x55823b7961b0 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd559bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55823ba96300 con 0x55823b7754d0 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd45ffb640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 0x7efd340a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd4cfcf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb35080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58800/0 (socket says 172.21.15.135:58800) 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd47fff640 1 -- 172.21.15.135:0/3424025761 learned_addr learned my addr 172.21.15.135:0/3424025761 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 0x7efd340a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb35b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.499+0000 7efd45ffb640 1 -- 172.21.15.135:0/4280000236 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efd380efbb0 con 0x7efd48102170 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 -- 172.21.15.135:0/3424025761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 msgr2=0x55823bb35b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb35b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 -- 172.21.15.135:0/3424025761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 msgr2=0x55823bb355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 -- 172.21.15.135:0/3424025761 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823ba668e0 con 0x55823b7961b0 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd47fff640 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 0x7efd340a5320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd40010c40 tx=0x7efd40015000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb35080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd40013e20 tx=0x7efd40010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b11267b39a6c007 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd3e7fc640 1 -- 172.21.15.135:0/3424025761 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40009c50 con 0x55823b7961b0 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd3e7fc640 1 -- 172.21.15.135:0/3424025761 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd40024070 con 0x55823b7961b0 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.500+0000 7efd3e7fc640 1 -- 172.21.15.135:0/3424025761 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4001fb80 con 0x55823b7961b0 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 -- 172.21.15.135:0/3424025761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 msgr2=0x55823bb35080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb35080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd40013e20 tx=0x7efd40010740 comp rx=0 tx=0).stop 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 -- 172.21.15.135:0/3424025761 shutdown_connections 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb35b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 --2- 172.21.15.135:0/3424025761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb35080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 -- 172.21.15.135:0/3424025761 >> 172.21.15.135:0/3424025761 conn(0x55823b78a300 msgr2=0x55823bb31830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 -- 172.21.15.135:0/3424025761 shutdown_connections 2024-05-20T17:34:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.501+0000 7efd559bb740 1 -- 172.21.15.135:0/3424025761 wait complete. 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 -- start start 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 Processor -- start 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7754d0 0x55823bb416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb3f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55823bb42150 con 0x55823b76d2f0 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55823ba55790 con 0x55823b7754d0 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.502+0000 7efd559bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55823bb422d0 con 0x55823b7961b0 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd559bb740 10 client.0 _ll_register_callbacks cb 0x55823ba90a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58808/0 (socket says 172.21.15.135:58808) 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 -- 172.21.15.135:0/3637031895 learned_addr learned my addr 172.21.15.135:0/3637031895 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7754d0 0x55823bb416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 -- 172.21.15.135:0/3637031895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 msgr2=0x55823bb3f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb3f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 -- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7754d0 msgr2=0x55823bb416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7754d0 0x55823bb416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 -- 172.21.15.135:0/3637031895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823b7ae210 con 0x55823b76d2f0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd47fff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efd380bbc50 tx=0x7efd380bbb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636b4b84a4aad36 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd277fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38049040 con 0x55823b76d2f0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efd380b85c0 con 0x55823b76d2f0 2024-05-20T17:34:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd40024070 con 0x55823b76d2f0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efd380bbf50 con 0x55823b76d2f0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd559bb740 10 client.15732 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.503+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55823b87a620 con 0x55823b76d2f0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd40024070 con 0x55823b76d2f0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efd3803bc70 con 0x55823b76d2f0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 10 client.15732 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 20 client.15732 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b754d80 0x55823bb51a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 4 client.15732 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55823baa7a70 con 0x55823b754d80 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.504+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b754d80 0x55823bb51a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.505+0000 7efd277fe640 10 client.15732 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.505+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b754d80 0x55823bb51a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74a5ddb0988fb81 server_cookie=27f9876c3e6e1585 in_seq=0 out_seq=0 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.505+0000 7efd277fe640 1 -- 172.21.15.135:0/3637031895 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55823baa7a70 con 0x55823b754d80 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.505+0000 7efd277fe640 10 client.15732 handle_command_reply: tid=0 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.505+0000 7efd559bb740 1 client.15732 shutdown 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 msgr2=0x55823bb41170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efd380bbc50 tx=0x7efd380bbb50 comp rx=0 tx=0).stop 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 shutdown_connections 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b754d80 0x55823bb51a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb3f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7754d0 0x55823bb416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd277fe640 0 client.15732 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 --2- 172.21.15.135:0/3637031895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb41170 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 >> 172.21.15.135:0/3637031895 conn(0x55823b78a300 msgr2=0x55823bb34e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 shutdown_connections 2024-05-20T17:34:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 1 -- 172.21.15.135:0/3637031895 wait complete. 2024-05-20T17:34:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.506+0000 7efd559bb740 20 client.15732 trim_cache size 0 max 16384 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.521+0000 7efd559bb740 1 Processor -- start 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.521+0000 7efd559bb740 1 -- start start 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb57240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb57780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd481b1390 con 0x55823b76d2f0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd481aec60 con 0x55823b7961b0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd559bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd481acab0 con 0x55823b7754d0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58824/0 (socket says 172.21.15.135:58824) 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 -- 172.21.15.135:0/2335577781 learned_addr learned my addr 172.21.15.135:0/2335577781 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd3ffff640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb57240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb57780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 -- 172.21.15.135:0/2335577781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 msgr2=0x55823bb57240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb57240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 -- 172.21.15.135:0/2335577781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 msgr2=0x55823bb57780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb57780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 -- 172.21.15.135:0/2335577781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823bb51dd0 con 0x55823b76d2f0 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb57780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd47fff640 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efd380ba200 tx=0x7efd380ba460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5199d6f151e909 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd3dffb640 1 -- 172.21.15.135:0/2335577781 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38049040 con 0x55823b76d2f0 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd3dffb640 1 -- 172.21.15.135:0/2335577781 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd38031bd0 con 0x55823b76d2f0 2024-05-20T17:34:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.522+0000 7efd3dffb640 1 -- 172.21.15.135:0/2335577781 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380b85c0 con 0x55823b76d2f0 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- 172.21.15.135:0/2335577781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 msgr2=0x55823bb39450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efd380ba200 tx=0x7efd380ba460 comp rx=0 tx=0).stop 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- 172.21.15.135:0/2335577781 shutdown_connections 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b7961b0 0x55823bb57780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7754d0 0x55823bb57240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 --2- 172.21.15.135:0/2335577781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b76d2f0 0x55823bb39450 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- 172.21.15.135:0/2335577781 >> 172.21.15.135:0/2335577781 conn(0x55823b78a300 msgr2=0x55823bb38d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- 172.21.15.135:0/2335577781 shutdown_connections 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- 172.21.15.135:0/2335577781 wait complete. 2024-05-20T17:34:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 -- start start 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.524+0000 7efd559bb740 1 Processor -- start 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b76d2f0 0x55823bbb1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb46f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd481ad120 con 0x55823b7754d0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd481ae590 con 0x55823b76d2f0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd481ad7f0 con 0x55823b7961b0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd559bb740 10 client.0 _ll_register_callbacks cb 0x7efd38005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58838/0 (socket says 172.21.15.135:58838) 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd47fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b76d2f0 0x55823bbb1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 -- 172.21.15.135:0/981936455 learned_addr learned my addr 172.21.15.135:0/981936455 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb46f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 -- 172.21.15.135:0/981936455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 msgr2=0x55823bb46f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb46f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 -- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b76d2f0 msgr2=0x55823bbb1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b76d2f0 0x55823bbb1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd3ffff640 1 -- 172.21.15.135:0/981936455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823bb47550 con 0x55823b7754d0 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.525+0000 7efd4cfcf640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb46f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd3ffff640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efd4810e6f0 tx=0x7efd30005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e1b4480080a06f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30023020 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efd30003a00 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd38031bd0 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efd3002e050 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd559bb740 10 client.15738 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55823bbb9dd0 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd38031bd0 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.526+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efd3001e410 con 0x55823b7754d0 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 10 client.15738 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 20 client.15738 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b72a1c0 0x55823bbbc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 4 client.15738 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55823baa1dc0 con 0x55823b72a1c0 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd47fff640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b72a1c0 0x55823bbbc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd277fe640 10 client.15738 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.527+0000 7efd47fff640 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b72a1c0 0x55823bbbc610 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f25ed85c99e7fa server_cookie=21aec7202c6b9519 in_seq=0 out_seq=0 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.531+0000 7efd277fe640 1 -- 172.21.15.135:0/981936455 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55823baa1dc0 con 0x55823b72a1c0 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.531+0000 7efd277fe640 10 client.15738 handle_command_reply: tid=0 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.531+0000 7efd559bb740 1 client.15738 shutdown 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.531+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 msgr2=0x55823bbb1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.531+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efd4810e6f0 tx=0x7efd30005bd0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 shutdown_connections 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55823b72a1c0 0x55823bbbc610 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55823b7961b0 0x55823bb46f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55823b7754d0 0x55823bbb1b50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 --2- 172.21.15.135:0/981936455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55823b76d2f0 0x55823bbb1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 >> 172.21.15.135:0/981936455 conn(0x55823b78a300 msgr2=0x55823bb3ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd277fe640 0 client.15738 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 shutdown_connections 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 1 -- 172.21.15.135:0/981936455 wait complete. 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd559bb740 20 client.15738 trim_cache size 0 max 16384 2024-05-20T17:34:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:34:19.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:34:19.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:34:19.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 msgr2=0x7efd340a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 0x7efd340a5320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd40010c40 tx=0x7efd40015000 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 msgr2=0x7efd481997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd38005940 tx=0x7efd38004270 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 shutdown_connections 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efd340a2e10 0x7efd340a5320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd48107eb0 0x7efd4819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a10 0x7efd48199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 --2- 172.21.15.135:0/4280000236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd48102170 0x7efd481997f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 >> 172.21.15.135:0/4280000236 conn(0x7efd48077160 msgr2=0x7efd48069370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 shutdown_connections 2024-05-20T17:34:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:19.532+0000 7efd4ea32640 1 -- 172.21.15.135:0/4280000236 wait complete. 2024-05-20T17:34:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:19 smithi160 ceph-mon[36261]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:19.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:19 smithi172 ceph-mon[36511]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:19 smithi135 ceph-mon[32027]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:21 smithi160 ceph-mon[36261]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:21.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:21 smithi172 ceph-mon[36511]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:21.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:21 smithi135 ceph-mon[32027]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-20T17:34:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:23 smithi160 ceph-mon[36261]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-20T17:34:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:23 smithi172 ceph-mon[36511]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-20T17:34:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:23 smithi135 ceph-mon[32027]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-20T17:34:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:25 smithi160 ceph-mon[36261]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:25.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:25 smithi172 ceph-mon[36511]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:25 smithi135 ceph-mon[32027]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:26 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:34:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:26 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:26 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:26 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:34:26.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:26 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:26 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:26 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:34:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:26 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:26 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:26.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:34:26.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:34:27.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 -- 172.21.15.135:0/2652531138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba010c330 msgr2=0x7f7ba010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/2652531138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba010c330 0x7f7ba010e750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009ca0 tx=0x7f7b9802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 -- 172.21.15.135:0/2652531138 shutdown_connections 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/2652531138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba010c330 0x7f7ba010e750 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/2652531138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba0101aa0 0x7f7ba0101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/2652531138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 0x7f7ba0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 -- 172.21.15.135:0/2652531138 >> 172.21.15.135:0/2652531138 conn(0x7f7ba00770b0 msgr2=0x7f7ba00774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 -- 172.21.15.135:0/2652531138 shutdown_connections 2024-05-20T17:34:27.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.098+0000 7f7ba6a73640 1 -- 172.21.15.135:0/2652531138 wait complete. 2024-05-20T17:34:27.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 Processor -- start 2024-05-20T17:34:27.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 -- start start 2024-05-20T17:34:27.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 0x7f7ba0198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba010c330 0x7f7ba019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba0111d00 con 0x7f7ba0101aa0 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba0111b80 con 0x7f7ba010c330 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba6a73640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba0111e80 con 0x7f7ba01079d0 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba480f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba480f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58860/0 (socket says 172.21.15.135:58860) 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.099+0000 7f7ba480f640 1 -- 172.21.15.135:0/3398121508 learned_addr learned my addr 172.21.15.135:0/3398121508 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 0x7f7ba0198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba010c330 0x7f7ba019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 -- 172.21.15.135:0/3398121508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 msgr2=0x7f7ba0198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 0x7f7ba0198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 -- 172.21.15.135:0/3398121508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba010c330 msgr2=0x7f7ba019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba010c330 0x7f7ba019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 -- 172.21.15.135:0/3398121508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba019d540 con 0x7f7ba0101aa0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba480f640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400e9f0 tx=0x7f7b9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7b9dffb640 1 -- 172.21.15.135:0/3398121508 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400ccc0 con 0x7f7ba0101aa0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7b9dffb640 1 -- 172.21.15.135:0/3398121508 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b94005500 con 0x7f7ba0101aa0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba019d830 con 0x7f7ba0101aa0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7b9dffb640 1 -- 172.21.15.135:0/3398121508 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94010690 con 0x7f7ba0101aa0 2024-05-20T17:34:27.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.100+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba019dd30 con 0x7f7ba0101aa0 2024-05-20T17:34:27.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 Processor -- start 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7b9dffb640 1 -- 172.21.15.135:0/3398121508 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7f7b94010830 con 0x7f7ba0101aa0 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 -- start start 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 0x5572030d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557203039d00 con 0x557202d0c4d0 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557202fe14c0 con 0x557202d35390 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557203035cc0 con 0x557202d146b0 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7ba480f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 0x5572030d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7ba480f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58866/0 (socket says 172.21.15.135:58866) 2024-05-20T17:34:27.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.104+0000 7f7ba480f640 1 -- 172.21.15.135:0/2617780929 learned_addr learned my addr 172.21.15.135:0/2617780929 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 -- 172.21.15.135:0/2617780929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 msgr2=0x5572030d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 -- 172.21.15.135:0/2617780929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 msgr2=0x5572030d4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 -- 172.21.15.135:0/2617780929 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557202e177d0 con 0x557202d35390 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba480f640 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b9dffb640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 0x7f7b900a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 0x5572030d3d30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b98006010 tx=0x7f7b98009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5634fdc3892dc409 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7ba480f640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 0x7f7b900a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b8affd640 1 -- 172.21.15.135:0/2617780929 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98031bb0 con 0x557202d35390 2024-05-20T17:34:27.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b9dffb640 1 -- 172.21.15.135:0/3398121508 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7b940cfb80 con 0x7f7ba0101aa0 2024-05-20T17:34:27.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b8affd640 1 -- 172.21.15.135:0/2617780929 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b98036050 con 0x557202d35390 2024-05-20T17:34:27.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.105+0000 7f7b8affd640 1 -- 172.21.15.135:0/2617780929 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98004040 con 0x557202d35390 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2617780929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 msgr2=0x5572030d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7ba480f640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 0x7f7b900a5330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cd8d0 tx=0x7f7b940d3690 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 0x5572030d3d30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b98006010 tx=0x7f7b98009470 comp rx=0 tx=0).stop 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2617780929 shutdown_connections 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d0c4d0 0x5572030d4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2617780929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d35390 0x5572030d3d30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2617780929 >> 172.21.15.135:0/2617780929 conn(0x557202d294e0 msgr2=0x5572030d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2617780929 shutdown_connections 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2617780929 wait complete. 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 -- start start 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.107+0000 7f7bad9fa740 1 Processor -- start 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d0c4d0 0x5572030dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 0x5572030e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572030e0fc0 con 0x557202d35390 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557202ff4b90 con 0x557202d146b0 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572030e1140 con 0x557202d0c4d0 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7bad9fa740 10 client.0 _ll_register_callbacks cb 0x557203030da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d0c4d0 0x5572030dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58878/0 (socket says 172.21.15.135:58878) 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 -- 172.21.15.135:0/2107540149 learned_addr learned my addr 172.21.15.135:0/2107540149 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 0x5572030e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 -- 172.21.15.135:0/2107540149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d0c4d0 msgr2=0x5572030dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d0c4d0 0x5572030dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 -- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 msgr2=0x5572030e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 0x5572030e03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7ba5010640 1 -- 172.21.15.135:0/2107540149 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557202d4d3f0 con 0x557202d35390 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.108+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 0x5572030e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7ba5010640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x5572030ddb70 tx=0x7f7b98031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e34bc253786fa92 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7b7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:27.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98003d80 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7b98004220 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b98036050 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7b98004b40 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7bad9fa740 10 client.15750 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557202d0d0f0 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.109+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b98036050 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7b98042070 con 0x557202d35390 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 10 client.15750 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 20 client.15750 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202cf3f60 0x5572030f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 4 client.15750 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:27.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557203047430 con 0x557202cf3f60 2024-05-20T17:34:27.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202cf3f60 0x5572030f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7b7ffff640 10 client.15750 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:27.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.110+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202cf3f60 0x5572030f4df0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=522997b508a8d432 server_cookie=4cfb61abe3a69548 in_seq=0 out_seq=0 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.111+0000 7f7b7ffff640 1 -- 172.21.15.135:0/2107540149 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557203047430 con 0x557202cf3f60 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.111+0000 7f7b7ffff640 10 client.15750 handle_command_reply: tid=0 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.111+0000 7f7bad9fa740 1 client.15750 shutdown 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 msgr2=0x5572030de310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x5572030ddb70 tx=0x7f7b98031700 comp rx=0 tx=0).stop 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 shutdown_connections 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202cf3f60 0x5572030f4df0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7b7ffff640 0 client.15750 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202d35390 0x5572030de310 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d146b0 0x5572030e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/2107540149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d0c4d0 0x5572030dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 >> 172.21.15.135:0/2107540149 conn(0x557202d294e0 msgr2=0x5572030d5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 shutdown_connections 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 1 -- 172.21.15.135:0/2107540149 wait complete. 2024-05-20T17:34:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.112+0000 7f7bad9fa740 20 client.15750 trim_cache size 0 max 16384 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.142+0000 7f7bad9fa740 1 Processor -- start 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.142+0000 7f7bad9fa740 1 -- start start 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01af0e0 con 0x557202cf3f60 2024-05-20T17:34:27.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01ac9b0 con 0x557202d0c4d0 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7bad9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01aa800 con 0x557202d146b0 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58888/0 (socket says 172.21.15.135:58888) 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 -- 172.21.15.135:0/3845029542 learned_addr learned my addr 172.21.15.135:0/3845029542 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 -- 172.21.15.135:0/3845029542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 msgr2=0x5572030d7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 -- 172.21.15.135:0/3845029542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 msgr2=0x5572030d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030d79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 -- 172.21.15.135:0/3845029542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572030e0f60 con 0x557202cf3f60 2024-05-20T17:34:27.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.143+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b9802ade0 tx=0x7f7b98000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73992ca4cc4851c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.144+0000 7f7b8a7fc640 1 -- 172.21.15.135:0/3845029542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98031de0 con 0x557202cf3f60 2024-05-20T17:34:27.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.144+0000 7f7b8a7fc640 1 -- 172.21.15.135:0/3845029542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b98061070 con 0x557202cf3f60 2024-05-20T17:34:27.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.144+0000 7f7b8a7fc640 1 -- 172.21.15.135:0/3845029542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b980041a0 con 0x557202cf3f60 2024-05-20T17:34:27.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3845029542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 msgr2=0x5572030d60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b9802ade0 tx=0x7f7b98000f40 comp rx=0 tx=0).stop 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3845029542 shutdown_connections 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x5572030d7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3845029542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030d60f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3845029542 >> 172.21.15.135:0/3845029542 conn(0x557202d294e0 msgr2=0x5572030d59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3845029542 shutdown_connections 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3845029542 wait complete. 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.145+0000 7f7bad9fa740 1 -- start start 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 Processor -- start 2024-05-20T17:34:27.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030e8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7ba5010640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58902/0 (socket says 172.21.15.135:58902) 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x55720315af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7ba5010640 1 -- 172.21.15.135:0/3148879830 learned_addr learned my addr 172.21.15.135:0/3148879830 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01aae70 con 0x557202cf3f60 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01ac2e0 con 0x557202d0c4d0 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.146+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01ab540 con 0x557202d146b0 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7bad9fa740 10 client.0 _ll_register_callbacks cb 0x7f7b940d3560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 -- 172.21.15.135:0/3148879830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 msgr2=0x55720315af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x55720315af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 -- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 msgr2=0x5572030e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030e8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55720315b450 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7ba5010640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b9802f840 tx=0x7f7b9802f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2914cf1485fc06dd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7b7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98069070 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7b98003d80 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b98061070 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7b9802af40 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7bad9fa740 10 client.15756 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.147+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55720315c5e0 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b98036040 con 0x557202cf3f60 2024-05-20T17:34:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7b98042050 con 0x557202cf3f60 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 10 client.15756 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 20 client.15756 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202d35390 0x55720315ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 4 client.15756 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7b98061070 con 0x557202d35390 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.148+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202d35390 0x55720315ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7b7ffff640 10 client.15756 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7b9ffff640 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202d35390 0x55720315ec60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff7dc88d3809f84 server_cookie=1dcc6ed8b9d175f2 in_seq=0 out_seq=0 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7b7ffff640 1 -- 172.21.15.135:0/3148879830 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7b98061070 con 0x557202d35390 2024-05-20T17:34:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7b7ffff640 10 client.15756 handle_command_reply: tid=0 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7bad9fa740 1 client.15756 shutdown 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.149+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 msgr2=0x5572030e7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b9802f840 tx=0x7f7b9802f3c0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 shutdown_connections 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557202d35390 0x55720315ec60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557202d146b0 0x55720315af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557202d0c4d0 0x5572030e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 --2- 172.21.15.135:0/3148879830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557202cf3f60 0x5572030e7ce0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 >> 172.21.15.135:0/3148879830 conn(0x557202d294e0 msgr2=0x5572030d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7b7ffff640 0 client.15756 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:27.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 shutdown_connections 2024-05-20T17:34:27.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 1 -- 172.21.15.135:0/3148879830 wait complete. 2024-05-20T17:34:27.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.150+0000 7f7bad9fa740 20 client.15756 trim_cache size 0 max 16384 2024-05-20T17:34:27.156 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:34:27.157 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-05-20T17:34:27.157 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-05-20T17:34:27.157 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:34:27.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 msgr2=0x7f7b900a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 0x7f7b900a5330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cd8d0 tx=0x7f7b940d3690 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 msgr2=0x7f7ba01986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400e9f0 tx=0x7f7b9400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 shutdown_connections 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f7b900a2e20 0x7f7b900a5330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ba010c330 0x7f7ba019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba01079d0 0x7f7ba0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 --2- 172.21.15.135:0/3398121508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0101aa0 0x7f7ba01986e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 >> 172.21.15.135:0/3398121508 conn(0x7f7ba00770b0 msgr2=0x7f7ba0103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 shutdown_connections 2024-05-20T17:34:27.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.151+0000 7f7ba6a73640 1 -- 172.21.15.135:0/3398121508 wait complete. 2024-05-20T17:34:27.164 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-20T17:34:27.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:34:27.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.277+0000 7f7874de0640 1 -- 172.21.15.135:0/1329658615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78701079d0 msgr2=0x7f7870101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 --2- 172.21.15.135:0/1329658615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78701079d0 0x7f7870101560 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7860009900 tx=0x7f786002a410 comp rx=0 tx=0).stop 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 -- 172.21.15.135:0/1329658615 shutdown_connections 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 --2- 172.21.15.135:0/1329658615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f787010c330 0x7f787010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 --2- 172.21.15.135:0/1329658615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 --2- 172.21.15.135:0/1329658615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78701079d0 0x7f7870101560 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 -- 172.21.15.135:0/1329658615 >> 172.21.15.135:0/1329658615 conn(0x7f78700770c0 msgr2=0x7f7870077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 -- 172.21.15.135:0/1329658615 shutdown_connections 2024-05-20T17:34:27.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.278+0000 7f7874de0640 1 -- 172.21.15.135:0/1329658615 wait complete. 2024-05-20T17:34:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 Processor -- start 2024-05-20T17:34:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 -- start start 2024-05-20T17:34:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701079d0 0x7f7870198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7870111ce0 con 0x7f787010c330 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7870111b60 con 0x7f7870101aa0 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f7874de0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7870111e60 con 0x7f78701079d0 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58916/0 (socket says 172.21.15.135:58916) 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 -- 172.21.15.135:0/2760526781 learned_addr learned my addr 172.21.15.135:0/2760526781 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786e59c640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786dd9b640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701079d0 0x7f7870198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 -- 172.21.15.135:0/2760526781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701079d0 msgr2=0x7f7870198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701079d0 0x7f7870198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 -- 172.21.15.135:0/2760526781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 msgr2=0x7f7870198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.279+0000 7f786ed9d640 1 -- 172.21.15.135:0/2760526781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787019d4c0 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f786e59c640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f786ed9d640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7868009fd0 tx=0x7f786800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868017070 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787019d7b0 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7868003e50 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a5130 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.280+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78680106c0 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.281+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7850005290 con 0x7f787010c330 2024-05-20T17:34:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.283+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7f7868003970 con 0x7f787010c330 2024-05-20T17:34:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.284+0000 7f785f7fe640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 0x7f78580a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.284+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f78680cf460 con 0x7f787010c330 2024-05-20T17:34:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.285+0000 7f786e59c640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 0x7f78580a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.285+0000 7f786e59c640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 0x7f78580a5330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f7860005a20 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.290+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f786809be30 con 0x7f787010c330 2024-05-20T17:34:27.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.562+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7850005580 con 0x7f787010c330 2024-05-20T17:34:27.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.563+0000 7f785f7fe640 1 -- 172.21.15.135:0/2760526781 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f786809b730 con 0x7f787010c330 2024-05-20T17:34:27.564 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:34:27.564 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:33:17.908712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24523]},"id":1}]} 2024-05-20T17:34:27.564 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 22 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 msgr2=0x7f78580a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 0x7f78580a5330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f7860005a20 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 msgr2=0x7f787019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7868009fd0 tx=0x7f786800b260 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 shutdown_connections 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f78580a2e20 0x7f78580a5330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f787010c330 0x7f787019ce80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78701079d0 0x7f7870198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 --2- 172.21.15.135:0/2760526781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7870101aa0 0x7f7870198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 >> 172.21.15.135:0/2760526781 conn(0x7f78700770c0 msgr2=0x7f7870103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 shutdown_connections 2024-05-20T17:34:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.565+0000 7f7874de0640 1 -- 172.21.15.135:0/2760526781 wait complete. 2024-05-20T17:34:27.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-20T17:34:27.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 -- 172.21.15.135:0/849999167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 msgr2=0x7fc49c10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 --2- 172.21.15.135:0/849999167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c10cad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc490009900 tx=0x7fc49002a480 comp rx=0 tx=0).stop 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 -- 172.21.15.135:0/849999167 shutdown_connections 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 --2- 172.21.15.135:0/849999167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c10d060 0x7fc49c10f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 --2- 172.21.15.135:0/849999167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c10cad0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 --2- 172.21.15.135:0/849999167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c103c50 0x7fc49c104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 -- 172.21.15.135:0/849999167 >> 172.21.15.135:0/849999167 conn(0x7fc49c077130 msgr2=0x7fc49c077570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 -- 172.21.15.135:0/849999167 shutdown_connections 2024-05-20T17:34:27.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.716+0000 7fc4a0979640 1 -- 172.21.15.135:0/849999167 wait complete. 2024-05-20T17:34:27.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 Processor -- start 2024-05-20T17:34:27.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 -- start start 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c103c50 0x7fc49c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c10d060 0x7fc49c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c112dd0 con 0x7fc49c10a6b0 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c112c50 con 0x7fc49c103c50 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.717+0000 7fc4a0979640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c112f50 con 0x7fc49c10d060 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58944/0 (socket says 172.21.15.135:58944) 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 -- 172.21.15.135:0/1960465581 learned_addr learned my addr 172.21.15.135:0/1960465581 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c10d060 0x7fc49c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc49a59c640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c103c50 0x7fc49c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 -- 172.21.15.135:0/1960465581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c10d060 msgr2=0x7fc49c19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c10d060 0x7fc49c19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 -- 172.21.15.135:0/1960465581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c103c50 msgr2=0x7fc49c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c103c50 0x7fc49c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 -- 172.21.15.135:0/1960465581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c19e630 con 0x7fc49c10a6b0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc490006010 tx=0x7fc4900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc48b7fe640 1 -- 172.21.15.135:0/1960465581 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49003f030 con 0x7fc49c10a6b0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49c19e8c0 con 0x7fc49c10a6b0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc48b7fe640 1 -- 172.21.15.135:0/1960465581 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc490003ce0 con 0x7fc49c10a6b0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.718+0000 7fc48b7fe640 1 -- 172.21.15.135:0/1960465581 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490035070 con 0x7fc49c10a6b0 2024-05-20T17:34:27.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.719+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49c19ee00 con 0x7fc49c10a6b0 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.721+0000 7fc4a781a740 1 Processor -- start 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.721+0000 7fc4a781a740 1 -- start start 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbe6390 0x55754ff84d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ff857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55754feeac40 con 0x55754fbbd4d0 2024-05-20T17:34:27.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55754fe92580 con 0x55754fbc56b0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc4a781a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55754fee6c00 con 0x55754fbe6390 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58956/0 (socket says 172.21.15.135:58956) 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 -- 172.21.15.135:0/3759689335 learned_addr learned my addr 172.21.15.135:0/3759689335 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbe6390 0x55754ff84d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc48b7fe640 1 -- 172.21.15.135:0/1960465581 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7fc490042030 con 0x7fc49c10a6b0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 -- 172.21.15.135:0/3759689335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbe6390 msgr2=0x55754ff84d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbe6390 0x55754ff84d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 -- 172.21.15.135:0/3759689335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 msgr2=0x55754ff857a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ff857a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.722+0000 7fc49a59c640 1 -- 172.21.15.135:0/3759689335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754fbfe3f0 con 0x55754fbbd4d0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00b760 tx=0x7fc48c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44888189aa061e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc488ff9640 1 -- 172.21.15.135:0/3759689335 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c003dd0 con 0x55754fbbd4d0 2024-05-20T17:34:27.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc488ff9640 1 -- 172.21.15.135:0/3759689335 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c015070 con 0x55754fbbd4d0 2024-05-20T17:34:27.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc488ff9640 1 -- 172.21.15.135:0/3759689335 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c011440 con 0x55754fbbd4d0 2024-05-20T17:34:27.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc48b7fe640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 0x7fc4840a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 0x7fc4840a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.723+0000 7fc48b7fe640 1 -- 172.21.15.135:0/1960465581 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc4900efb20 con 0x7fc49c10a6b0 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 -- 172.21.15.135:0/3759689335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 msgr2=0x55754ff85260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 0x7fc4840a5330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55754ff81e90 tx=0x7fc494009600 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00b760 tx=0x7fc48c00bc20 comp rx=0 tx=0).stop 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 -- 172.21.15.135:0/3759689335 shutdown_connections 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ff857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbbd4d0 0x55754ff85260 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3759689335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbe6390 0x55754ff84d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 -- 172.21.15.135:0/3759689335 >> 172.21.15.135:0/3759689335 conn(0x55754fbda4e0 msgr2=0x55754ff814d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 -- 172.21.15.135:0/3759689335 shutdown_connections 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.724+0000 7fc4a781a740 1 -- 172.21.15.135:0/3759689335 wait complete. 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 -- start start 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 Processor -- start 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbc56b0 0x55754ff91100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 0x55754ff8f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55754ff91fb0 con 0x55754fbe6390 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55754fea5c40 con 0x55754fba4f60 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55754ff92130 con 0x55754fbc56b0 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc4a781a740 10 client.0 _ll_register_callbacks cb 0x55754fbfdbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58958/0 (socket says 172.21.15.135:58958) 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.725+0000 7fc499d9b640 1 -- 172.21.15.135:0/1653244571 learned_addr learned my addr 172.21.15.135:0/1653244571 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 0x55754ff8f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc49a59c640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbc56b0 0x55754ff91100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 -- 172.21.15.135:0/1653244571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbc56b0 msgr2=0x55754ff91100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbc56b0 0x55754ff91100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 -- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 msgr2=0x55754ff8f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 0x55754ff8f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 -- 172.21.15.135:0/1653244571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754fcc87d0 con 0x55754fbe6390 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 0x55754ff8f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc499d9b640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc4900bbd30 tx=0x7fc4900bbe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6658de93114654 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:27.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490049040 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc4900c4960 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.726+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc48c015070 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc49003bcb0 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 10 client.15774 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55754ffa2e00 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c015070 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc4900ed3d0 con 0x55754fbe6390 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 10 client.15774 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 10 client.15774 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 20 client.15774 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55754fb7a3a0 0x55754ffa6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 4 client.15774 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:27.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.727+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55754fef8370 con 0x55754fb7a3a0 2024-05-20T17:34:27.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.728+0000 7fc49a59c640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55754fb7a3a0 0x55754ffa6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.728+0000 7fc49a59c640 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55754fb7a3a0 0x55754ffa6030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc7f3065528b6081 server_cookie=10277521dc58940d in_seq=0 out_seq=0 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.728+0000 7fc481ffb640 10 client.15774 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc481ffb640 1 -- 172.21.15.135:0/1653244571 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55754fef8370 con 0x55754fb7a3a0 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc481ffb640 10 client.15774 handle_command_reply: tid=0 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 client.15774 shutdown 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 msgr2=0x55754ff91660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc4900bbd30 tx=0x7fc4900bbe00 comp rx=0 tx=0).stop 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 shutdown_connections 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55754fb7a3a0 0x55754ffa6030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fba4f60 0x55754ff8f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc481ffb640 0 client.15774 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbe6390 0x55754ff91660 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 --2- 172.21.15.135:0/1653244571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fbc56b0 0x55754ff91100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 >> 172.21.15.135:0/1653244571 conn(0x55754fbda4e0 msgr2=0x55754ff86a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 shutdown_connections 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 1 -- 172.21.15.135:0/1653244571 wait complete. 2024-05-20T17:34:27.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.729+0000 7fc4a781a740 20 client.15774 trim_cache size 0 max 16384 2024-05-20T17:34:27.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 Processor -- start 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 -- start start 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ffab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ffabd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1af0b0 con 0x55754fb7a3a0 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1ac980 con 0x55754fbc56b0 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc4a781a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1aa7d0 con 0x55754fba4f60 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58966/0 (socket says 172.21.15.135:58966) 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc49a59c640 1 -- 172.21.15.135:0/276952801 learned_addr learned my addr 172.21.15.135:0/276952801 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.743+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ffabd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 -- 172.21.15.135:0/276952801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 msgr2=0x55754ffab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ffab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 -- 172.21.15.135:0/276952801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 msgr2=0x55754ffabd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ffabd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 -- 172.21.15.135:0/276952801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754ffa6590 con 0x55754fb7a3a0 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ffabd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc49a59c640 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004340 tx=0x7fc48c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5f259c79c355d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc483fff640 1 -- 172.21.15.135:0/276952801 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c02c070 con 0x55754fb7a3a0 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc483fff640 1 -- 172.21.15.135:0/276952801 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c015030 con 0x55754fb7a3a0 2024-05-20T17:34:27.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.744+0000 7fc483fff640 1 -- 172.21.15.135:0/276952801 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c000e60 con 0x55754fb7a3a0 2024-05-20T17:34:27.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- 172.21.15.135:0/276952801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 msgr2=0x55754ff870e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004340 tx=0x7fc48c00b390 comp rx=0 tx=0).stop 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- 172.21.15.135:0/276952801 shutdown_connections 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fbc56b0 0x55754ffabd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ffab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 --2- 172.21.15.135:0/276952801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fb7a3a0 0x55754ff870e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- 172.21.15.135:0/276952801 >> 172.21.15.135:0/276952801 conn(0x55754fbda4e0 msgr2=0x55754ff869d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- 172.21.15.135:0/276952801 shutdown_connections 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- 172.21.15.135:0/276952801 wait complete. 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 -- start start 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.745+0000 7fc4a781a740 1 Processor -- start 2024-05-20T17:34:27.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ff93840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1aae40 con 0x55754fbc56b0 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1ac2b0 con 0x55754fb7a3a0 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c1ab510 con 0x55754fba4f60 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc4a781a740 10 client.0 _ll_register_callbacks cb 0x7fc490005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:39402/0 (socket says 172.21.15.135:39402) 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 -- 172.21.15.135:0/3981321753 learned_addr learned my addr 172.21.15.135:0/3981321753 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58972/0 (socket says 172.21.15.135:58972) 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc499d9b640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ff93840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 -- 172.21.15.135:0/3981321753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 msgr2=0x55754ff93840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ff93840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 -- 172.21.15.135:0/3981321753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 msgr2=0x55755000d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 -- 172.21.15.135:0/3981321753 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754ff940e0 con 0x55754fb7a3a0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49ad9d640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc49a59c640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc48c013040 tx=0x7fc48c00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b1a17658f9b989 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.746+0000 7fc481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c02c040 con 0x55754fb7a3a0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc48c015030 con 0x55754fb7a3a0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc48c003af0 con 0x55754fb7a3a0 2024-05-20T17:34:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc48c03e050 con 0x55754fb7a3a0 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 10 client.25433 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55755000e910 con 0x55754fb7a3a0 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c015030 con 0x55754fb7a3a0 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc48c011560 con 0x55754fb7a3a0 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 10 client.25433 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 10 client.25433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 20 client.25433 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55755000ed80 0x5575500111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 4 client.25433 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.747+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55754fef26c0 con 0x55755000ed80 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc499d9b640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55755000ed80 0x5575500111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc481ffb640 10 client.25433 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:34:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc499d9b640 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55755000ed80 0x5575500111a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39131c2d46f2f08 server_cookie=c6fae17c65eb4015 in_seq=0 out_seq=0 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc481ffb640 1 -- 172.21.15.135:0/3981321753 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55754fef26c0 con 0x55755000ed80 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc481ffb640 10 client.25433 handle_command_reply: tid=0 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.748+0000 7fc4a781a740 1 client.25433 shutdown 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 msgr2=0x55754ff93300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc48c013040 tx=0x7fc48c00b670 comp rx=0 tx=0).stop 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 shutdown_connections 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55755000ed80 0x5575500111a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55754fbc56b0 0x55755000d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55754fba4f60 0x55754ff93840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 --2- 172.21.15.135:0/3981321753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55754fb7a3a0 0x55754ff93300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 >> 172.21.15.135:0/3981321753 conn(0x55754fbda4e0 msgr2=0x55754ff90a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc481ffb640 0 client.25433 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 shutdown_connections 2024-05-20T17:34:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 1 -- 172.21.15.135:0/3981321753 wait complete. 2024-05-20T17:34:27.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a781a740 20 client.25433 trim_cache size 0 max 16384 2024-05-20T17:34:27.758 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 msgr2=0x7fc4840a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 0x7fc4840a5330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55754ff81e90 tx=0x7fc494009600 comp rx=0 tx=0).stop 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 msgr2=0x7fc49c199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc490006010 tx=0x7fc4900042f0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 shutdown_connections 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc4840a2e20 0x7fc4840a5330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc49c10d060 0x7fc49c19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc49c10a6b0 0x7fc49c199d30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 --2- 172.21.15.135:0/1960465581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49c103c50 0x7fc49c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.749+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 >> 172.21.15.135:0/1960465581 conn(0x7fc49c077130 msgr2=0x7fc49c100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.750+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 shutdown_connections 2024-05-20T17:34:27.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.750+0000 7fc4a0979640 1 -- 172.21.15.135:0/1960465581 wait complete. 2024-05-20T17:34:27.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:27 smithi160 ceph-mon[36261]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:27.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:27 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:34:27.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:27 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:34:27.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:27 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:27.761 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:27 smithi135 ceph-mon[32027]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:27.761 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:27 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:34:27.761 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:27 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:34:27.761 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:27 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:27.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-20T17:34:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:27 smithi172 ceph-mon[36511]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:27 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:34:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:27 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:34:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:27 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 -- 172.21.15.135:0/2124301938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 msgr2=0x7fecb8101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2124301938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8101eb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fecac009900 tx=0x7fecac02a410 comp rx=0 tx=0).stop 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 -- 172.21.15.135:0/2124301938 shutdown_connections 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2124301938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb810c330 0x7fecb810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2124301938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8101eb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2124301938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb81079d0 0x7fecb8101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 -- 172.21.15.135:0/2124301938 >> 172.21.15.135:0/2124301938 conn(0x7fecb80770b0 msgr2=0x7fecb80774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 -- 172.21.15.135:0/2124301938 shutdown_connections 2024-05-20T17:34:27.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.900+0000 7fecbe08d640 1 -- 172.21.15.135:0/2124301938 wait complete. 2024-05-20T17:34:27.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.901+0000 7fecbe08d640 1 Processor -- start 2024-05-20T17:34:27.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.901+0000 7fecbe08d640 1 -- start start 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb81079d0 0x7fecb8199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb810c330 0x7fecb819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8069560 con 0x7fecb8101aa0 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fecb80693e0 con 0x7fecb810c330 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecbe08d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecb80696e0 con 0x7fecb81079d0 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58994/0 (socket says 172.21.15.135:58994) 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 -- 172.21.15.135:0/2126792546 learned_addr learned my addr 172.21.15.135:0/2126792546 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb7fff640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb810c330 0x7fecb819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb81079d0 0x7fecb8199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 -- 172.21.15.135:0/2126792546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb81079d0 msgr2=0x7fecb8199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb81079d0 0x7fecb8199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 -- 172.21.15.135:0/2126792546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb810c330 msgr2=0x7fecb819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb810c330 0x7fecb819dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 -- 172.21.15.135:0/2126792546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb819e5f0 con 0x7fecb8101aa0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.902+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9c0 tx=0x7feca800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.903+0000 7fecb4ff9640 1 -- 172.21.15.135:0/2126792546 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca800cd80 con 0x7fecb8101aa0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.903+0000 7fecb4ff9640 1 -- 172.21.15.135:0/2126792546 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca8005500 con 0x7fecb8101aa0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.903+0000 7fecb4ff9640 1 -- 172.21.15.135:0/2126792546 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8010690 con 0x7fecb8101aa0 2024-05-20T17:34:27.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.903+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb819e8e0 con 0x7fecb8101aa0 2024-05-20T17:34:27.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.903+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb819edb0 con 0x7fecb8101aa0 2024-05-20T17:34:27.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.905+0000 7fecc500c740 1 Processor -- start 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 -- start start 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5af390 0x55c62b94dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b94e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c62b8b3c40 con 0x55c62b58e6b0 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c62b85b580 con 0x55c62b5af390 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecc500c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c62b8afc00 con 0x55c62b5864d0 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59008/0 (socket says 172.21.15.135:59008) 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 -- 172.21.15.135:0/3760954435 learned_addr learned my addr 172.21.15.135:0/3760954435 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb7fff640 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5af390 0x55c62b94dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb4ff9640 1 -- 172.21.15.135:0/2126792546 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7feca80046c0 con 0x7fecb8101aa0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 -- 172.21.15.135:0/3760954435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 msgr2=0x55c62b94e260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b94e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 -- 172.21.15.135:0/3760954435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5af390 msgr2=0x55c62b94dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5af390 0x55c62b94dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.906+0000 7fecb6ffd640 1 -- 172.21.15.135:0/3760954435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62b5c73f0 con 0x55c62b58e6b0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fecac009900 tx=0x7fecac005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c404a90f8bdf2689 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fec9dffb640 1 -- 172.21.15.135:0/3760954435 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac035040 con 0x55c62b58e6b0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fec9dffb640 1 -- 172.21.15.135:0/3760954435 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecac031870 con 0x55c62b58e6b0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fec9dffb640 1 -- 172.21.15.135:0/3760954435 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac004950 con 0x55c62b58e6b0 2024-05-20T17:34:27.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fecb4ff9640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 0x7feca00a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fecb7fff640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 0x7feca00a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.907+0000 7fecb4ff9640 1 -- 172.21.15.135:0/2126792546 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7feca80cfaf0 con 0x7fecb8101aa0 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 -- 172.21.15.135:0/3760954435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 msgr2=0x55c62b94e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecb7fff640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 0x7feca00a5330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c62b94ae90 tx=0x7fecb0009600 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fecac009900 tx=0x7fecac005d50 comp rx=0 tx=0).stop 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 -- 172.21.15.135:0/3760954435 shutdown_connections 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b94e7a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b94e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 --2- 172.21.15.135:0/3760954435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5af390 0x55c62b94dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 -- 172.21.15.135:0/3760954435 >> 172.21.15.135:0/3760954435 conn(0x55c62b5a34e0 msgr2=0x55c62b94a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 -- 172.21.15.135:0/3760954435 shutdown_connections 2024-05-20T17:34:27.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.908+0000 7fecc500c740 1 -- 172.21.15.135:0/3760954435 wait complete. 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.909+0000 7fecc500c740 1 -- start start 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.909+0000 7fecc500c740 1 Processor -- start 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.909+0000 7fecc500c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5864d0 0x55c62b9582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 0x55c62b9688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c62b95f420 con 0x55c62b58e6b0 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c62b86ec40 con 0x55c62b5864d0 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c62b95f5a0 con 0x55c62b5af390 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59024/0 (socket says 172.21.15.135:59024) 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 -- 172.21.15.135:0/2374811672 learned_addr learned my addr 172.21.15.135:0/2374811672 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecc500c740 10 client.0 _ll_register_callbacks cb 0x55c62b5c6be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5864d0 0x55c62b9582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb7fff640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 0x55c62b9688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 -- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 msgr2=0x55c62b9688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 0x55c62b9688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 -- 172.21.15.135:0/2374811672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5864d0 msgr2=0x55c62b9582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5864d0 0x55c62b9582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 -- 172.21.15.135:0/2374811672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62b6917d0 con 0x55c62b58e6b0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb7fff640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 0x55c62b9688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fecac0096c0 tx=0x7fecac044620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b06113f2a96414b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.910+0000 7fec96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac035030 con 0x55c62b58e6b0 2024-05-20T17:34:27.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fecac031670 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecac031870 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fecac031a20 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 10 client.15792 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c62b96ba90 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecac031870 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fecac003710 con 0x55c62b58e6b0 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 10 client.15792 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 10 client.15792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 20 client.15792 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b56df60 0x55c62b96edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 4 client.15792 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.911+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c62b8c1370 con 0x55c62b56df60 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.912+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b56df60 0x55c62b96edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.912+0000 7fec96ffd640 10 client.15792 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.912+0000 7fecb77fe640 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b56df60 0x55c62b96edf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eafff77ae9a53dbe server_cookie=e3506ef6de0bf20e in_seq=0 out_seq=0 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fec96ffd640 1 -- 172.21.15.135:0/2374811672 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c62b8c1370 con 0x55c62b56df60 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fec96ffd640 10 client.15792 handle_command_reply: tid=0 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 client.15792 shutdown 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 msgr2=0x55c62b958820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fecac0096c0 tx=0x7fecac044620 comp rx=0 tx=0).stop 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 shutdown_connections 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b56df60 0x55c62b96edf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5af390 0x55c62b9688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fec96ffd640 0 client.15792 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b58e6b0 0x55c62b958820 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 --2- 172.21.15.135:0/2374811672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b5864d0 0x55c62b9582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 >> 172.21.15.135:0/2374811672 conn(0x55c62b5a34e0 msgr2=0x55c62b94fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 shutdown_connections 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.913+0000 7fecc500c740 1 -- 172.21.15.135:0/2374811672 wait complete. 2024-05-20T17:34:27.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.914+0000 7fecc500c740 20 client.15792 trim_cache size 0 max 16384 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 Processor -- start 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 -- start start 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b957880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81aef40 con 0x55c62b56df60 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ac810 con 0x55c62b58e6b0 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecc500c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81aa660 con 0x55c62b5864d0 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59030/0 (socket says 172.21.15.135:59030) 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 -- 172.21.15.135:0/515408402 learned_addr learned my addr 172.21.15.135:0/515408402 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb7fff640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b957880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 -- 172.21.15.135:0/515408402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 msgr2=0x55c62b9527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 -- 172.21.15.135:0/515408402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 msgr2=0x55c62b957880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b957880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb77fe640 1 -- 172.21.15.135:0/515408402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62b956620 con 0x55c62b56df60 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.939+0000 7fecb7fff640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b957880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.940+0000 7fecb77fe640 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feca809ba60 tx=0x7feca809b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f345d3050d429c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.940+0000 7fec9d7fa640 1 -- 172.21.15.135:0/515408402 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80a0110 con 0x55c62b56df60 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.940+0000 7fec9d7fa640 1 -- 172.21.15.135:0/515408402 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca80b9070 con 0x55c62b56df60 2024-05-20T17:34:27.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.940+0000 7fec9d7fa640 1 -- 172.21.15.135:0/515408402 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80cd340 con 0x55c62b56df60 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- 172.21.15.135:0/515408402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 msgr2=0x55c62b95a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feca809ba60 tx=0x7feca809b920 comp rx=0 tx=0).stop 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- 172.21.15.135:0/515408402 shutdown_connections 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b957880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 --2- 172.21.15.135:0/515408402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b95a2c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- 172.21.15.135:0/515408402 >> 172.21.15.135:0/515408402 conn(0x55c62b5a34e0 msgr2=0x55c62b94e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- 172.21.15.135:0/515408402 shutdown_connections 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- 172.21.15.135:0/515408402 wait complete. 2024-05-20T17:34:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 -- start start 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.941+0000 7fecc500c740 1 Processor -- start 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b96f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81aacd0 con 0x55c62b56df60 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ac140 con 0x55c62b58e6b0 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ab3a0 con 0x55c62b5864d0 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecc500c740 10 client.0 _ll_register_callbacks cb 0x7fecb0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59038/0 (socket says 172.21.15.135:59038) 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 -- 172.21.15.135:0/212996001 learned_addr learned my addr 172.21.15.135:0/212996001 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:27.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb7fff640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b96f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 -- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 msgr2=0x55c62b9724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 -- 172.21.15.135:0/212996001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 msgr2=0x55c62b96f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b96f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.942+0000 7fecb77fe640 1 -- 172.21.15.135:0/212996001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62b96fb30 con 0x55c62b56df60 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecb77fe640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feca809bcf0 tx=0x7feca809be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3094851e0b3507b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca807e070 con 0x55c62b56df60 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7feca80a45b0 con 0x55c62b56df60 2024-05-20T17:34:27.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca80b9070 con 0x55c62b56df60 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7feca80a47b0 con 0x55c62b56df60 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 10 client.15798 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c62b9d6950 con 0x55c62b56df60 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca807ab80 con 0x55c62b56df60 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7feca80b2070 con 0x55c62b56df60 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 10 client.15798 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 10 client.15798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 20 client.15798 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b5af390 0x55c62b9d90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 4 client.15798 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.943+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7feca80b9070 con 0x55c62b5af390 2024-05-20T17:34:27.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.944+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b5af390 0x55c62b9d90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.944+0000 7fec96ffd640 10 client.15798 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.944+0000 7fecb6ffd640 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b5af390 0x55c62b9d90e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1eb99df9ddb3082 server_cookie=bba5e6c8a3105ec6 in_seq=0 out_seq=0 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fec96ffd640 1 -- 172.21.15.135:0/212996001 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7feca80b9070 con 0x55c62b5af390 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fec96ffd640 10 client.15798 handle_command_reply: tid=0 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 client.15798 shutdown 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 msgr2=0x55c62b971f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feca809bcf0 tx=0x7feca809be80 comp rx=0 tx=0).stop 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 shutdown_connections 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c62b5af390 0x55c62b9d90e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fec96ffd640 0 client.15798 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62b58e6b0 0x55c62b96f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c62b5864d0 0x55c62b9724b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 --2- 172.21.15.135:0/212996001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c62b56df60 0x55c62b971f70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 >> 172.21.15.135:0/212996001 conn(0x55c62b5a34e0 msgr2=0x55c62b948b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 shutdown_connections 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 1 -- 172.21.15.135:0/212996001 wait complete. 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.945+0000 7fecc500c740 20 client.15798 trim_cache size 0 max 16384 2024-05-20T17:34:27.953 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:34:27.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 msgr2=0x7feca00a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 0x7feca00a5330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c62b94ae90 tx=0x7fecb0009600 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 msgr2=0x7fecb8199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9c0 tx=0x7feca800ee80 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 shutdown_connections 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feca00a2e20 0x7feca00a5330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecb810c330 0x7fecb819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb81079d0 0x7fecb8199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 --2- 172.21.15.135:0/2126792546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecb8101aa0 0x7fecb8199790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 >> 172.21.15.135:0/2126792546 conn(0x7fecb80770b0 msgr2=0x7fecb8103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 shutdown_connections 2024-05-20T17:34:27.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:27.946+0000 7fecbe08d640 1 -- 172.21.15.135:0/2126792546 wait complete. 2024-05-20T17:34:27.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-20T17:34:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.098+0000 7ff77b4e2640 1 -- 172.21.15.135:0/3756655678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff774101aa0 msgr2=0x7ff774101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.098+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/3756655678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff774101aa0 0x7ff774101eb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff764009900 tx=0x7ff76402a410 comp rx=0 tx=0).stop 2024-05-20T17:34:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 -- 172.21.15.135:0/3756655678 shutdown_connections 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/3756655678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 0x7ff77410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/3756655678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff774101aa0 0x7ff774101eb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/3756655678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7741079d0 0x7ff774101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 -- 172.21.15.135:0/3756655678 >> 172.21.15.135:0/3756655678 conn(0x7ff7740770b0 msgr2=0x7ff7740774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 -- 172.21.15.135:0/3756655678 shutdown_connections 2024-05-20T17:34:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.099+0000 7ff77b4e2640 1 -- 172.21.15.135:0/3756655678 wait complete. 2024-05-20T17:34:28.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 Processor -- start 2024-05-20T17:34:28.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 -- start start 2024-05-20T17:34:28.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774101aa0 0x7ff77419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 0x7ff774199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff774111ce0 con 0x7ff7741079d0 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff774111b60 con 0x7ff77410c330 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77b4e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff774111e60 con 0x7ff774101aa0 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff778a7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff778a7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59056/0 (socket says 172.21.15.135:59056) 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff778a7d640 1 -- 172.21.15.135:0/1886559709 learned_addr learned my addr 172.21.15.135:0/1886559709 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff779a7f640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 0x7ff774199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff77927e640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774101aa0 0x7ff77419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.100+0000 7ff778a7d640 1 -- 172.21.15.135:0/1886559709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774101aa0 msgr2=0x7ff77419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff778a7d640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774101aa0 0x7ff77419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff778a7d640 1 -- 172.21.15.135:0/1886559709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 msgr2=0x7ff774199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff778a7d640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 0x7ff774199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff778a7d640 1 -- 172.21.15.135:0/1886559709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff774199d80 con 0x7ff7741079d0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff778a7d640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff764005940 tx=0x7ff7640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff76a7fc640 1 -- 172.21.15.135:0/1886559709 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76403f030 con 0x7ff7741079d0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff774199fb0 con 0x7ff7741079d0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff76a7fc640 1 -- 172.21.15.135:0/1886559709 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff764003ce0 con 0x7ff7741079d0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.101+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7740fe130 con 0x7ff7741079d0 2024-05-20T17:34:28.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.102+0000 7ff76a7fc640 1 -- 172.21.15.135:0/1886559709 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764035070 con 0x7ff7741079d0 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 Processor -- start 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 -- start start 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff76a7fc640 1 -- 172.21.15.135:0/1886559709 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7ff764042030 con 0x7ff7741079d0 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb019b390 0x564cb0539d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb053a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cb049fc40 con 0x564cb01724d0 2024-05-20T17:34:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564cb0447580 con 0x564cb017a6b0 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff782386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cb049bc00 con 0x564cb019b390 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff77927e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff77927e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59066/0 (socket says 172.21.15.135:59066) 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff77927e640 1 -- 172.21.15.135:0/3643720812 learned_addr learned my addr 172.21.15.135:0/3643720812 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff779a7f640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb019b390 0x564cb0539d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.105+0000 7ff778a7d640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb053a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 -- 172.21.15.135:0/3643720812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb019b390 msgr2=0x564cb0539d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb019b390 0x564cb0539d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 -- 172.21.15.135:0/3643720812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 msgr2=0x564cb053a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb053a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 -- 172.21.15.135:0/3643720812 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb01b33f0 con 0x564cb01724d0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff778a7d640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb053a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff76a7fc640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 0x7ff7600a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff77927e640 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff77000bc90 tx=0x7ff77000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad31947f6f54ea33 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff779a7f640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 0x7ff7600a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff76a7fc640 1 -- 172.21.15.135:0/1886559709 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff7640ef7e0 con 0x7ff7741079d0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff75f7fe640 1 -- 172.21.15.135:0/3643720812 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770015070 con 0x564cb01724d0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff75f7fe640 1 -- 172.21.15.135:0/3643720812 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77001a940 con 0x564cb01724d0 2024-05-20T17:34:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.106+0000 7ff75f7fe640 1 -- 172.21.15.135:0/3643720812 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770011970 con 0x564cb01724d0 2024-05-20T17:34:28.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff779a7f640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 0x7ff7600a5210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x564cb0536e90 tx=0x7ff76c0096a0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 -- 172.21.15.135:0/3643720812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 msgr2=0x564cb053a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff77000bc90 tx=0x7ff77000f730 comp rx=0 tx=0).stop 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 -- 172.21.15.135:0/3643720812 shutdown_connections 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb053a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb053a260 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 --2- 172.21.15.135:0/3643720812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb019b390 0x564cb0539d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 -- 172.21.15.135:0/3643720812 >> 172.21.15.135:0/3643720812 conn(0x564cb018f4e0 msgr2=0x564cb05364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.107+0000 7ff782386740 1 -- 172.21.15.135:0/3643720812 shutdown_connections 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.108+0000 7ff782386740 1 -- 172.21.15.135:0/3643720812 wait complete. 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.108+0000 7ff782386740 1 -- start start 2024-05-20T17:34:28.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.108+0000 7ff782386740 1 Processor -- start 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb0546310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb019b390 0x564cb0544250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cb0547010 con 0x564cb01724d0 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564cb045ac40 con 0x564cb019b390 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cb0547190 con 0x564cb017a6b0 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff782386740 10 client.0 _ll_register_callbacks cb 0x564cb01b2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59076/0 (socket says 172.21.15.135:59076) 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 -- 172.21.15.135:0/2351850045 learned_addr learned my addr 172.21.15.135:0/2351850045 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff779a7f640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb019b390 0x564cb0544250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb0546310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 -- 172.21.15.135:0/2351850045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 msgr2=0x564cb0546310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb0546310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 -- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb019b390 msgr2=0x564cb0544250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb019b390 0x564cb0544250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 -- 172.21.15.135:0/2351850045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb027d7d0 con 0x564cb01724d0 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb0546310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff77927e640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff770006010 tx=0x7ff77000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919eb1f64cf2f5ab server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.109+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770015050 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff77001a460 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77001a940 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff770031050 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 10 client.15810 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564cb0553810 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77001a940 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7ff77002c030 con 0x564cb01724d0 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 10 client.15810 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 20 client.15810 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb0159f60 0x564cb0556c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 4 client.15810 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:28.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.110+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cb04ad370 con 0x564cb0159f60 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.111+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb0159f60 0x564cb0556c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.111+0000 7ff75cff9640 10 client.15810 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.111+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb0159f60 0x564cb0556c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47625ac1f70ae04 server_cookie=80c2ae0057529b9e in_seq=0 out_seq=0 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff75cff9640 1 -- 172.21.15.135:0/2351850045 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564cb04ad370 con 0x564cb0159f60 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff75cff9640 10 client.15810 handle_command_reply: tid=0 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 client.15810 shutdown 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 msgr2=0x564cb0545dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff770006010 tx=0x7ff77000b9d0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 shutdown_connections 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb0159f60 0x564cb0556c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb019b390 0x564cb0544250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb0546310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 --2- 172.21.15.135:0/2351850045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb01724d0 0x564cb0545dd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 >> 172.21.15.135:0/2351850045 conn(0x564cb018f4e0 msgr2=0x564cb053ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff75cff9640 0 client.15810 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:28.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 shutdown_connections 2024-05-20T17:34:28.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 1 -- 172.21.15.135:0/2351850045 wait complete. 2024-05-20T17:34:28.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.112+0000 7ff782386740 20 client.15810 trim_cache size 0 max 16384 2024-05-20T17:34:28.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.137+0000 7ff782386740 1 Processor -- start 2024-05-20T17:34:28.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.137+0000 7ff782386740 1 -- start start 2024-05-20T17:34:28.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb01724d0 0x564cb0543100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb0535b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741b32a0 con 0x564cb019b390 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741b0b70 con 0x564cb017a6b0 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff782386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741ae9e0 con 0x564cb01724d0 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59086/0 (socket says 172.21.15.135:59086) 2024-05-20T17:34:28.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 -- 172.21.15.135:0/967602825 learned_addr learned my addr 172.21.15.135:0/967602825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff778a7d640 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb0535b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 -- 172.21.15.135:0/967602825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb01724d0 msgr2=0x564cb0543100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb01724d0 0x564cb0543100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 -- 172.21.15.135:0/967602825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 msgr2=0x564cb0535b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb0535b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff779a7f640 1 -- 172.21.15.135:0/967602825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb05370a0 con 0x564cb019b390 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.138+0000 7ff778a7d640 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb0535b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.139+0000 7ff779a7f640 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0109f0 tx=0x7ff76c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a533cebf43e25f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.139+0000 7ff75effd640 1 -- 172.21.15.135:0/967602825 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c01e9a0 con 0x564cb019b390 2024-05-20T17:34:28.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.139+0000 7ff75effd640 1 -- 172.21.15.135:0/967602825 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76c02f030 con 0x564cb019b390 2024-05-20T17:34:28.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.139+0000 7ff75effd640 1 -- 172.21.15.135:0/967602825 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c02be60 con 0x564cb019b390 2024-05-20T17:34:28.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 -- 172.21.15.135:0/967602825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 msgr2=0x564cb0536090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0109f0 tx=0x7ff76c019000 comp rx=0 tx=0).stop 2024-05-20T17:34:28.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 -- 172.21.15.135:0/967602825 shutdown_connections 2024-05-20T17:34:28.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb0536090 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb017a6b0 0x564cb0535b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 --2- 172.21.15.135:0/967602825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb01724d0 0x564cb0543100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 -- 172.21.15.135:0/967602825 >> 172.21.15.135:0/967602825 conn(0x564cb018f4e0 msgr2=0x564cb05429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 -- 172.21.15.135:0/967602825 shutdown_connections 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.140+0000 7ff782386740 1 -- 172.21.15.135:0/967602825 wait complete. 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 -- start start 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 Processor -- start 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb05584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741af030 con 0x564cb019b390 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741b04a0 con 0x564cb01724d0 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7741af700 con 0x564cb017a6b0 2024-05-20T17:34:28.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.141+0000 7ff782386740 10 client.0 _ll_register_callbacks cb 0x7ff76c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff779a7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:39498/0 (socket says 172.21.15.135:39498) 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 -- 172.21.15.135:0/2420259216 learned_addr learned my addr 172.21.15.135:0/2420259216 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff779a7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59102/0 (socket says 172.21.15.135:59102) 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb05584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 -- 172.21.15.135:0/2420259216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 msgr2=0x564cb05584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb05584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 -- 172.21.15.135:0/2420259216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 msgr2=0x564cb05589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 -- 172.21.15.135:0/2420259216 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb0559020 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb05584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff779a7f640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff77927e640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff770025ee0 tx=0x7ff770025f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb48728e559369b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770015050 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.142+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff77001a460 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.143+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76c02f030 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.143+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff770024a30 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.143+0000 7ff782386740 10 client.25463 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.143+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564cb05bdb20 con 0x564cb01724d0 2024-05-20T17:34:28.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.143+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77000bae0 con 0x564cb01724d0 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7ff77002c040 con 0x564cb01724d0 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 10 client.25463 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 20 client.25463 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb012f3a0 0x564cb05c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 4 client.25463 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff76c02f030 con 0x564cb012f3a0 2024-05-20T17:34:28.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.144+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb012f3a0 0x564cb05c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff75cff9640 10 client.25463 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff778a7d640 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb012f3a0 0x564cb05c02a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7d69504924af96 server_cookie=47bb21acfe54932f in_seq=0 out_seq=0 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff75cff9640 1 -- 172.21.15.135:0/2420259216 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff76c02f030 con 0x564cb012f3a0 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff75cff9640 10 client.25463 handle_command_reply: tid=0 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 client.25463 shutdown 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 msgr2=0x564cb055a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff770025ee0 tx=0x7ff770025f10 comp rx=0 tx=0).stop 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 shutdown_connections 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564cb012f3a0 0x564cb05c02a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff75cff9640 0 client.25463 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cb019b390 0x564cb05589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb017a6b0 0x564cb05584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 --2- 172.21.15.135:0/2420259216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564cb01724d0 0x564cb055a0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 >> 172.21.15.135:0/2420259216 conn(0x564cb018f4e0 msgr2=0x564cb0539ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 shutdown_connections 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 1 -- 172.21.15.135:0/2420259216 wait complete. 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.145+0000 7ff782386740 20 client.25463 trim_cache size 0 max 16384 2024-05-20T17:34:28.151 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:34:28.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 msgr2=0x7ff7600a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 0x7ff7600a5210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x564cb0536e90 tx=0x7ff76c0096a0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 msgr2=0x7ff77419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff764005940 tx=0x7ff7640042f0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 shutdown_connections 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff7600a2d00 0x7ff7600a5210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff77410c330 0x7ff774199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7741079d0 0x7ff77419fa10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 --2- 172.21.15.135:0/1886559709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774101aa0 0x7ff77419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.146+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 >> 172.21.15.135:0/1886559709 conn(0x7ff7740770b0 msgr2=0x7ff774068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.147+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 shutdown_connections 2024-05-20T17:34:28.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:28.147+0000 7ff77b4e2640 1 -- 172.21.15.135:0/1886559709 wait complete. 2024-05-20T17:34:28.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:28 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2760526781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:34:28.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:28 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2760526781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:34:28.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:28 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2760526781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:34:29.163 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-20T17:34:29.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:34:29.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-20T17:34:29.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.298+0000 7fb578a91640 1 -- 172.21.15.135:0/784043163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57410cff0 msgr2=0x7fb57410f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.298+0000 7fb578a91640 1 --2- 172.21.15.135:0/784043163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57410cff0 0x7fb57410f4e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009ca0 tx=0x7fb56c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 -- 172.21.15.135:0/784043163 shutdown_connections 2024-05-20T17:34:29.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 --2- 172.21.15.135:0/784043163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57410cff0 0x7fb57410f4e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 --2- 172.21.15.135:0/784043163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 0x7fb57410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 --2- 172.21.15.135:0/784043163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb574103ba0 0x7fb574103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 -- 172.21.15.135:0/784043163 >> 172.21.15.135:0/784043163 conn(0x7fb5740770b0 msgr2=0x7fb5740774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 -- 172.21.15.135:0/784043163 shutdown_connections 2024-05-20T17:34:29.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.299+0000 7fb578a91640 1 -- 172.21.15.135:0/784043163 wait complete. 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 Processor -- start 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 -- start start 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 0x7fb574199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57410cff0 0x7fb57419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb574112da0 con 0x7fb574103ba0 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb574112c20 con 0x7fb57410a600 2024-05-20T17:34:29.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb578a91640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb574112f20 con 0x7fb57410cff0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59116/0 (socket says 172.21.15.135:59116) 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 -- 172.21.15.135:0/2180557791 learned_addr learned my addr 172.21.15.135:0/2180557791 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb571d9b640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 0x7fb574199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb572d9d640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57410cff0 0x7fb57419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 -- 172.21.15.135:0/2180557791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57410cff0 msgr2=0x7fb57419df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57410cff0 0x7fb57419df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 -- 172.21.15.135:0/2180557791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 msgr2=0x7fb574199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 0x7fb574199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.300+0000 7fb57259c640 1 -- 172.21.15.135:0/2180557791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57419e5a0 con 0x7fb574103ba0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb57259c640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb56400e9f0 tx=0x7fb56400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb5637fe640 1 -- 172.21.15.135:0/2180557791 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400cd80 con 0x7fb574103ba0 2024-05-20T17:34:29.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb5637fe640 1 -- 172.21.15.135:0/2180557791 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564005500 con 0x7fb574103ba0 2024-05-20T17:34:29.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57419e890 con 0x7fb574103ba0 2024-05-20T17:34:29.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb5637fe640 1 -- 172.21.15.135:0/2180557791 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564010690 con 0x7fb574103ba0 2024-05-20T17:34:29.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.301+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57419ed90 con 0x7fb574103ba0 2024-05-20T17:34:29.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.304+0000 7fb5637fe640 1 -- 172.21.15.135:0/2180557791 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7fb5640046c0 con 0x7fb574103ba0 2024-05-20T17:34:29.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.304+0000 7fb57fa0e740 1 Processor -- start 2024-05-20T17:34:29.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 -- start start 2024-05-20T17:34:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0da410 0x55c81d479490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d479f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c81d3de990 con 0x55c81d0b1550 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c81d3865b0 con 0x55c81d0b9730 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c81d3da950 con 0x55c81d0da410 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb5637fe640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 0x7fb55c0a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb572d9d640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 0x7fb55c0a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.305+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb572d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0da410 0x55c81d479490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59118/0 (socket says 172.21.15.135:59118) 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 -- 172.21.15.135:0/281704991 learned_addr learned my addr 172.21.15.135:0/281704991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb5637fe640 1 -- 172.21.15.135:0/2180557791 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb5640cfba0 con 0x7fb574103ba0 2024-05-20T17:34:29.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb571d9b640 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d479f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 -- 172.21.15.135:0/281704991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0da410 msgr2=0x55c81d479490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0da410 0x55c81d479490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 -- 172.21.15.135:0/281704991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 msgr2=0x55c81d479f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d479f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 -- 172.21.15.135:0/281704991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c81d1ba7e0 con 0x55c81d0b1550 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb57259c640 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb5640cd280 tx=0x7fb564098190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaf021c4cac890c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb572d9d640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 0x7fb55c0a5330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005e30 tx=0x7fb56c004a40 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.306+0000 7fb560ff9640 1 -- 172.21.15.135:0/281704991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56409b7d0 con 0x55c81d0b1550 2024-05-20T17:34:29.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.307+0000 7fb560ff9640 1 -- 172.21.15.135:0/281704991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56409c570 con 0x55c81d0b1550 2024-05-20T17:34:29.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 -- 172.21.15.135:0/281704991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 msgr2=0x55c81d4799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb5640cd280 tx=0x7fb564098190 comp rx=0 tx=0).stop 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 -- 172.21.15.135:0/281704991 shutdown_connections 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d479f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d4799d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/281704991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0da410 0x55c81d479490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 -- 172.21.15.135:0/281704991 >> 172.21.15.135:0/281704991 conn(0x55c81d0ce560 msgr2=0x55c81d475dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 -- 172.21.15.135:0/281704991 shutdown_connections 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.308+0000 7fb57fa0e740 1 -- 172.21.15.135:0/281704991 wait complete. 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 -- start start 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 Processor -- start 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d484260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0da410 0x55c81d4847a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c81d47c680 con 0x55c81d0b1550 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c81d399b40 con 0x55c81d0da410 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c81d47c800 con 0x55c81d0b9730 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57fa0e740 10 client.0 _ll_register_callbacks cb 0x55c81d38e0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59124/0 (socket says 172.21.15.135:59124) 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 -- 172.21.15.135:0/2002422669 learned_addr learned my addr 172.21.15.135:0/2002422669 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb572d9d640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0da410 0x55c81d4847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb571d9b640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d484260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 -- 172.21.15.135:0/2002422669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 msgr2=0x55c81d484260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d484260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 -- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0da410 msgr2=0x55c81d4847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.309+0000 7fb57259c640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0da410 0x55c81d4847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57259c640 1 -- 172.21.15.135:0/2002422669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c81d21af70 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57259c640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb564098280 tx=0x7fb5640984e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f941a3fd23e7f197 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640cd0b0 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb56409b2c0 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb564098670 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb56409c570 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 10 client.15828 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c81d0b2170 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564098670 con 0x55c81d0b1550 2024-05-20T17:34:29.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fb5640babc0 con 0x55c81d0b1550 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 10 client.15828 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 20 client.15828 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0991f0 0x55c81d496110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 4 client.15828 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.310+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c81d3ec0c0 con 0x55c81d0991f0 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.311+0000 7fb571d9b640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0991f0 0x55c81d496110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.311+0000 7fb559ffb640 10 client.15828 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.311+0000 7fb571d9b640 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0991f0 0x55c81d496110 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d72e0476bfb23ae server_cookie=728d68fe799c52d0 in_seq=0 out_seq=0 2024-05-20T17:34:29.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb559ffb640 1 -- 172.21.15.135:0/2002422669 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c81d3ec0c0 con 0x55c81d0991f0 2024-05-20T17:34:29.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb559ffb640 10 client.15828 handle_command_reply: tid=0 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 client.15828 shutdown 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 msgr2=0x55c81d489f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb564098280 tx=0x7fb5640984e0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 shutdown_connections 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0991f0 0x55c81d496110 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0da410 0x55c81d4847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb559ffb640 0 client.15828 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d484260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/2002422669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0b1550 0x55c81d489f20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 >> 172.21.15.135:0/2002422669 conn(0x55c81d0ce560 msgr2=0x55c81d4793b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 shutdown_connections 2024-05-20T17:34:29.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.312+0000 7fb57fa0e740 1 -- 172.21.15.135:0/2002422669 wait complete. 2024-05-20T17:34:29.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.313+0000 7fb57fa0e740 20 client.15828 trim_cache size 0 max 16384 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.330+0000 7fb57fa0e740 1 Processor -- start 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.330+0000 7fb57fa0e740 1 -- start start 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 0x55c81d47bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d4814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741af150 con 0x55c81d0991f0 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741aca20 con 0x55c81d0b1550 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741aa870 con 0x55c81d0b9730 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59136/0 (socket says 172.21.15.135:59136) 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 -- 172.21.15.135:0/358544239 learned_addr learned my addr 172.21.15.135:0/358544239 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb572d9d640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d4814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb571d9b640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 0x55c81d47bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 -- 172.21.15.135:0/358544239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 msgr2=0x55c81d4814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d4814a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 -- 172.21.15.135:0/358544239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 msgr2=0x55c81d47bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 0x55c81d47bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb57259c640 1 -- 172.21.15.135:0/358544239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c81d485040 con 0x55c81d0991f0 2024-05-20T17:34:29.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.331+0000 7fb571d9b640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 0x55c81d47bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:29.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.332+0000 7fb57259c640 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb56409be00 tx=0x7fb56409a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc9f31047c27900 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.332+0000 7fb55bfff640 1 -- 172.21.15.135:0/358544239 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56408f070 con 0x55c81d0991f0 2024-05-20T17:34:29.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.332+0000 7fb55bfff640 1 -- 172.21.15.135:0/358544239 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5640cd0b0 con 0x55c81d0991f0 2024-05-20T17:34:29.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.332+0000 7fb55bfff640 1 -- 172.21.15.135:0/358544239 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640baab0 con 0x55c81d0991f0 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- 172.21.15.135:0/358544239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 msgr2=0x55c81d484b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb56409be00 tx=0x7fb56409a380 comp rx=0 tx=0).stop 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- 172.21.15.135:0/358544239 shutdown_connections 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b9730 0x55c81d4814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b1550 0x55c81d47bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/358544239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d484b00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- 172.21.15.135:0/358544239 >> 172.21.15.135:0/358544239 conn(0x55c81d0ce560 msgr2=0x55c81d483280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- 172.21.15.135:0/358544239 shutdown_connections 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- 172.21.15.135:0/358544239 wait complete. 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.333+0000 7fb57fa0e740 1 -- start start 2024-05-20T17:34:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 Processor -- start 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b1550 0x55c81d4f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d48f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741aaee0 con 0x55c81d0991f0 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59138/0 (socket says 172.21.15.135:59138) 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57259c640 1 -- 172.21.15.135:0/972254735 learned_addr learned my addr 172.21.15.135:0/972254735 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741ac350 con 0x55c81d0b9730 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb572d9d640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d48f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb571d9b640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b1550 0x55c81d4f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.334+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741ab5b0 con 0x55c81d0b1550 2024-05-20T17:34:29.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57fa0e740 10 client.0 _ll_register_callbacks cb 0x7fb568017bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 -- 172.21.15.135:0/972254735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b1550 msgr2=0x55c81d4f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b1550 0x55c81d4f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 -- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 msgr2=0x55c81d48f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d48f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c81d48fe40 con 0x55c81d0991f0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5640cd0b0 con 0x55c81d0991f0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57259c640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb56409ad50 tx=0x7fb56409bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7923645320937f24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb559ffb640 10 client.15834 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb559ffb640 1 -- 172.21.15.135:0/972254735 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56408f070 con 0x55c81d0991f0 2024-05-20T17:34:29.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb559ffb640 1 -- 172.21.15.135:0/972254735 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb564086b30 con 0x55c81d0991f0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb559ffb640 1 -- 172.21.15.135:0/972254735 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb564086d50 con 0x55c81d0991f0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57fa0e740 10 client.15834 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.335+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55c81d48fe40 con 0x55c81d0991f0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb559ffb640 1 -- 172.21.15.135:0/972254735 <== mon.0 v2:172.21.15.135:3300/0 4 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fb56409b2c0 con 0x55c81d0991f0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 10 client.15834 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 20 client.15834 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0da410 0x55c81d500060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 4 client.15834 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c81d3e6410 con 0x55c81d0da410 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.336+0000 7fb571d9b640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0da410 0x55c81d500060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.337+0000 7fb571d9b640 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0da410 0x55c81d500060 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c3a9a2cc5e297d server_cookie=22b01d75a5fc4b58 in_seq=0 out_seq=0 2024-05-20T17:34:29.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.337+0000 7fb559ffb640 10 client.15834 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb559ffb640 1 -- 172.21.15.135:0/972254735 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c81d3e6410 con 0x55c81d0da410 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb559ffb640 10 client.15834 handle_command_reply: tid=0 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 client.15834 shutdown 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 msgr2=0x55c81d4f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb56409ad50 tx=0x7fb56409bd00 comp rx=0 tx=0).stop 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 shutdown_connections 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c81d0da410 0x55c81d500060 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c81d0b9730 0x55c81d48f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c81d0b1550 0x55c81d4f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb559ffb640 0 client.15834 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 --2- 172.21.15.135:0/972254735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c81d0991f0 0x55c81d4f68e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 >> 172.21.15.135:0/972254735 conn(0x55c81d0ce560 msgr2=0x55c81d47ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 shutdown_connections 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 1 -- 172.21.15.135:0/972254735 wait complete. 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.338+0000 7fb57fa0e740 20 client.15834 trim_cache size 0 max 16384 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "36eab441-c2e7-40ac-a4d3-70a1af7b55ca", 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-05-20T17:34:29.345 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:34:29.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 msgr2=0x7fb55c0a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 0x7fb55c0a5330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005e30 tx=0x7fb56c004a40 comp rx=0 tx=0).stop 2024-05-20T17:34:29.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 msgr2=0x7fb574199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb56400e9f0 tx=0x7fb56400edf0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 shutdown_connections 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb55c0a2e20 0x7fb55c0a5330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57410cff0 0x7fb57419df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb57410a600 0x7fb574199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 --2- 172.21.15.135:0/2180557791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb574103ba0 0x7fb574199740 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 >> 172.21.15.135:0/2180557791 conn(0x7fb5740770b0 msgr2=0x7fb574100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 shutdown_connections 2024-05-20T17:34:29.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.339+0000 7fb578a91640 1 -- 172.21.15.135:0/2180557791 wait complete. 2024-05-20T17:34:29.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:34:29.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:34:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 -- 172.21.15.135:0/2298205350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d3410c360 msgr2=0x7f1d3410e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/2298205350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d3410c360 0x7f1d3410e780 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009ca0 tx=0x7f1d2c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 -- 172.21.15.135:0/2298205350 shutdown_connections 2024-05-20T17:34:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/2298205350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d3410c360 0x7f1d3410e780 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/2298205350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d34101b20 0x7f1d34101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/2298205350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 0x7f1d341015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 -- 172.21.15.135:0/2298205350 >> 172.21.15.135:0/2298205350 conn(0x7f1d340770c0 msgr2=0x7f1d34077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 -- 172.21.15.135:0/2298205350 shutdown_connections 2024-05-20T17:34:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.513+0000 7f1d3aeab640 1 -- 172.21.15.135:0/2298205350 wait complete. 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 Processor -- start 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 -- start start 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 0x7f1d34198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d3410c360 0x7f1d3419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.514+0000 7f1d3aeab640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34111d10 con 0x7f1d34101b20 2024-05-20T17:34:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d3aeab640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34111b90 con 0x7f1d3410c360 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d3aeab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34111e90 con 0x7f1d34107a00 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35032/0 (socket says 172.21.15.135:35032) 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 -- 172.21.15.135:0/4154688990 learned_addr learned my addr 172.21.15.135:0/4154688990 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d33fff640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 0x7f1d34198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d39448640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d3410c360 0x7f1d3419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 -- 172.21.15.135:0/4154688990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 msgr2=0x7f1d34198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 0x7f1d34198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 -- 172.21.15.135:0/4154688990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d3410c360 msgr2=0x7f1d3419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d3410c360 0x7f1d3419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 -- 172.21.15.135:0/4154688990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3419d490 con 0x7f1d34101b20 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d38c47640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800d980 tx=0x7f1d2800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d31ffb640 1 -- 172.21.15.135:0/4154688990 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28016070 con 0x7f1d34101b20 2024-05-20T17:34:29.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d31ffb640 1 -- 172.21.15.135:0/4154688990 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d28009c30 con 0x7f1d34101b20 2024-05-20T17:34:29.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.515+0000 7f1d31ffb640 1 -- 172.21.15.135:0/4154688990 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2801a6f0 con 0x7f1d34101b20 2024-05-20T17:34:29.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.516+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3419d780 con 0x7f1d34101b20 2024-05-20T17:34:29.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.517+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3419dc50 con 0x7f1d34101b20 2024-05-20T17:34:29.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.520+0000 7f1d41e2a740 1 Processor -- start 2024-05-20T17:34:29.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.520+0000 7f1d31ffb640 1 -- 172.21.15.135:0/4154688990 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7f1d28010560 con 0x7f1d34101b20 2024-05-20T17:34:29.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.520+0000 7f1d41e2a740 1 -- start start 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 0x562124c71270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562124bd6d00 con 0x5621248d2390 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562124b7e4c0 con 0x5621248a94d0 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562124bd2cc0 con 0x5621248b16b0 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35038/0 (socket says 172.21.15.135:35038) 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d39448640 1 -- 172.21.15.135:0/3228390363 learned_addr learned my addr 172.21.15.135:0/3228390363 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d33fff640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d38c47640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 0x562124c71270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d31ffb640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 0x7f1d240a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d33fff640 1 -- 172.21.15.135:0/3228390363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 msgr2=0x562124c71270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.521+0000 7f1d31ffb640 1 -- 172.21.15.135:0/4154688990 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1d280d1000 con 0x7f1d34101b20 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d33fff640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 0x562124c71270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d33fff640 1 -- 172.21.15.135:0/3228390363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 msgr2=0x562124c70d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d33fff640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d33fff640 1 -- 172.21.15.135:0/3228390363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621249b47d0 con 0x5621248b16b0 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d39448640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d38c47640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 0x562124c71270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d39448640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 0x7f1d240a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d33fff640 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c717b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d34074f40 tx=0x7f1d20011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e27db663ccaf5db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d1effd640 1 -- 172.21.15.135:0/3228390363 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20009d70 con 0x5621248b16b0 2024-05-20T17:34:29.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d1effd640 1 -- 172.21.15.135:0/3228390363 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d200035f0 con 0x5621248b16b0 2024-05-20T17:34:29.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.522+0000 7f1d1effd640 1 -- 172.21.15.135:0/3228390363 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20019690 con 0x5621248b16b0 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- 172.21.15.135:0/3228390363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 msgr2=0x562124c717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d39448640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 0x7f1d240a53b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x562124c6dea0 tx=0x7f1d2c0095c0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c717b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d34074f40 tx=0x7f1d20011810 comp rx=0 tx=0).stop 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- 172.21.15.135:0/3228390363 shutdown_connections 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c717b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248a94d0 0x562124c71270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/3228390363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c70d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- 172.21.15.135:0/3228390363 >> 172.21.15.135:0/3228390363 conn(0x5621248c64e0 msgr2=0x562124c6d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- 172.21.15.135:0/3228390363 shutdown_connections 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- 172.21.15.135:0/3228390363 wait complete. 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 -- start start 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.524+0000 7f1d41e2a740 1 Processor -- start 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c7cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248b16b0 0x562124c7d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562124c7e020 con 0x5621248d2390 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562124b91b90 con 0x5621248b16b0 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562124c7e1a0 con 0x5621248a94d0 2024-05-20T17:34:29.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d41e2a740 10 client.0 _ll_register_callbacks cb 0x562124bcdda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35048/0 (socket says 172.21.15.135:35048) 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d39448640 1 -- 172.21.15.135:0/2363069054 learned_addr learned my addr 172.21.15.135:0/2363069054 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c7cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.525+0000 7f1d33fff640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248b16b0 0x562124c7d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 -- 172.21.15.135:0/2363069054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 msgr2=0x562124c7cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c7cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 -- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248b16b0 msgr2=0x562124c7d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248b16b0 0x562124c7d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 -- 172.21.15.135:0/2363069054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621248ea3f0 con 0x5621248d2390 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c7cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:29.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d39448640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009480 tx=0x7f1d2c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b835b0d7b9067095 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d13fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c004250 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1d2c0043f0 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d200035f0 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1d2c0045f0 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d41e2a740 10 client.15846 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.526+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5621248aa0f0 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d200035f0 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f1d2c030670 con 0x5621248d2390 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 10 client.15846 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:29.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 20 client.15846 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562124890f60 0x562124c8db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 4 client.15846 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562124be4430 con 0x562124890f60 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.527+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562124890f60 0x562124c8db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.528+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562124890f60 0x562124c8db30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa9e4e4a53ebccb server_cookie=94fff4288befb196 in_seq=0 out_seq=0 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.528+0000 7f1d13fff640 10 client.15846 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.528+0000 7f1d13fff640 1 -- 172.21.15.135:0/2363069054 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562124be4430 con 0x562124890f60 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.528+0000 7f1d13fff640 10 client.15846 handle_command_reply: tid=0 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.528+0000 7f1d41e2a740 1 client.15846 shutdown 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 msgr2=0x562124c7b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009480 tx=0x7f1d2c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 shutdown_connections 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562124890f60 0x562124c8db30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248d2390 0x562124c7b250 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248b16b0 0x562124c7d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2363069054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c7cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 >> 172.21.15.135:0/2363069054 conn(0x5621248c64e0 msgr2=0x562124c72a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d13fff640 0 client.15846 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 shutdown_connections 2024-05-20T17:34:29.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2363069054 wait complete. 2024-05-20T17:34:29.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.529+0000 7f1d41e2a740 20 client.15846 trim_cache size 0 max 16384 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 Processor -- start 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 -- start start 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c6d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341af050 con 0x5621248b16b0 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ac920 con 0x5621248c64e0 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.552+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341aa770 con 0x5621248a94d0 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35054/0 (socket says 172.21.15.135:35054) 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 -- 172.21.15.135:0/726510601 learned_addr learned my addr 172.21.15.135:0/726510601 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d33fff640 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d38c47640 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c6d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 -- 172.21.15.135:0/726510601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 msgr2=0x562124c730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 -- 172.21.15.135:0/726510601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 msgr2=0x562124c6d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c6d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 -- 172.21.15.135:0/726510601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562124c6e600 con 0x5621248b16b0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d39448640 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009900 tx=0x7f1d2c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400b1fedb48f0b71 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d1e7fc640 1 -- 172.21.15.135:0/726510601 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c004790 con 0x5621248b16b0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d1e7fc640 1 -- 172.21.15.135:0/726510601 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d2c036040 con 0x5621248b16b0 2024-05-20T17:34:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.553+0000 7f1d1e7fc640 1 -- 172.21.15.135:0/726510601 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0307e0 con 0x5621248b16b0 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 -- 172.21.15.135:0/726510601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 msgr2=0x562124c932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009900 tx=0x7f1d2c005d80 comp rx=0 tx=0).stop 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 -- 172.21.15.135:0/726510601 shutdown_connections 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248b16b0 0x562124c932f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248a94d0 0x562124c730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/726510601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c6d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 -- 172.21.15.135:0/726510601 >> 172.21.15.135:0/726510601 conn(0x562124c8de80 msgr2=0x562124c729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 -- 172.21.15.135:0/726510601 shutdown_connections 2024-05-20T17:34:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.554+0000 7f1d41e2a740 1 -- 172.21.15.135:0/726510601 wait complete. 2024-05-20T17:34:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.555+0000 7f1d41e2a740 1 -- start start 2024-05-20T17:34:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.555+0000 7f1d41e2a740 1 Processor -- start 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c80d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c812d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341aade0 con 0x5621248a94d0 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ac250 con 0x5621248c64e0 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ab4b0 con 0x5621248b16b0 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 10 client.0 _ll_register_callbacks cb 0x7f1d2c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35068/0 (socket says 172.21.15.135:35068) 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 -- 172.21.15.135:0/2653219464 learned_addr learned my addr 172.21.15.135:0/2653219464 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d39448640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c812d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d33fff640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c80d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 -- 172.21.15.135:0/2653219464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 msgr2=0x562124c80d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c80d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 -- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 msgr2=0x562124c812d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c812d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 -- 172.21.15.135:0/2653219464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562124c81a10 con 0x5621248a94d0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d39448640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c812d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d38c47640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1d28010fd0 tx=0x7f1d28012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58b742636c4cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d13fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a1790 con 0x5621248a94d0 2024-05-20T17:34:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d2c036040 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.556+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1d280d30b0 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1d280a6050 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 10 client.15852 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562124cf5e10 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d2c036040 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f1d280a5bc0 con 0x5621248a94d0 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 10 client.15852 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 20 client.15852 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5621248d2390 0x562124cf8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 4 client.15852 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562124bde780 con 0x5621248d2390 2024-05-20T17:34:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.557+0000 7f1d33fff640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5621248d2390 0x562124cf8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d33fff640 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5621248d2390 0x562124cf8550 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e9c94ca59a0e74 server_cookie=c10d4f8b1d9075b1 in_seq=0 out_seq=0 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d13fff640 10 client.15852 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d13fff640 1 -- 172.21.15.135:0/2653219464 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562124bde780 con 0x5621248d2390 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d13fff640 10 client.15852 handle_command_reply: tid=0 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 client.15852 shutdown 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 msgr2=0x562124c839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1d28010fd0 tx=0x7f1d28012040 comp rx=0 tx=0).stop 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 shutdown_connections 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5621248d2390 0x562124cf8550 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d13fff640 0 client.15852 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5621248c64e0 0x562124c812d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621248b16b0 0x562124c80d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 --2- 172.21.15.135:0/2653219464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621248a94d0 0x562124c839d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 >> 172.21.15.135:0/2653219464 conn(0x562124c8de80 msgr2=0x562124c7c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 shutdown_connections 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.558+0000 7f1d41e2a740 1 -- 172.21.15.135:0/2653219464 wait complete. 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d41e2a740 20 client.15852 trim_cache size 0 max 16384 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-05-20T17:34:29.567 INFO:teuthology.orchestra.run.smithi135.stdout: "36eab441-c2e7-40ac-a4d3-70a1af7b55ca": { 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "36eab441-c2e7-40ac-a4d3-70a1af7b55ca", 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:34:29.568 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:34:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 msgr2=0x7f1d240a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 0x7f1d240a53b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x562124c6dea0 tx=0x7f1d2c0095c0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 msgr2=0x7f1d34198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800d980 tx=0x7f1d2800de40 comp rx=0 tx=0).stop 2024-05-20T17:34:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 shutdown_connections 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1d240a2ea0 0x7f1d240a53b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d3410c360 0x7f1d3419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d34107a00 0x7f1d34198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 --2- 172.21.15.135:0/4154688990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d34101b20 0x7f1d34198630 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.559+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 >> 172.21.15.135:0/4154688990 conn(0x7f1d340770c0 msgr2=0x7f1d34103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.560+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 shutdown_connections 2024-05-20T17:34:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:29.560+0000 7f1d3aeab640 1 -- 172.21.15.135:0/4154688990 wait complete. 2024-05-20T17:34:29.576 INFO:tasks.cephfs.filesystem:scrub status for tag:36eab441-c2e7-40ac-a4d3-70a1af7b55ca - {'path': '/', 'tag': '36eab441-c2e7-40ac-a4d3-70a1af7b55ca', 'options': 'recursive,force'} 2024-05-20T17:34:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:29 smithi160 ceph-mon[36261]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:29 smithi172 ceph-mon[36511]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:29.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:29 smithi135 ceph-mon[32027]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:30 smithi160 ceph-mon[36261]: scrub queued for path: / 2024-05-20T17:34:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:30 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:30 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:34:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:30 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:30.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:30 smithi172 ceph-mon[36511]: scrub queued for path: / 2024-05-20T17:34:30.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:30 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:30.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:30 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:34:30.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:30 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:30.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:30 smithi135 ceph-mon[32027]: scrub queued for path: / 2024-05-20T17:34:30.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:30 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:30.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:30 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:34:30.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:30 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:34:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:31 smithi160 ceph-mon[36261]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:31.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:31 smithi172 ceph-mon[36511]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:31.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:31 smithi135 ceph-mon[32027]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 -- 172.21.15.135:0/3996049790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4101050 msgr2=0x7fa1c4101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/3996049790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4101050 0x7fa1c4101460 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b802a410 comp rx=0 tx=0).stop 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 -- 172.21.15.135:0/3996049790 shutdown_connections 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/3996049790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c410d550 0x7fa1c410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/3996049790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c4101050 0x7fa1c4101460 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/3996049790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 -- 172.21.15.135:0/3996049790 >> 172.21.15.135:0/3996049790 conn(0x7fa1c40fc860 msgr2=0x7fa1c40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 -- 172.21.15.135:0/3996049790 shutdown_connections 2024-05-20T17:34:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.663+0000 7fa1c93ce640 1 -- 172.21.15.135:0/3996049790 wait complete. 2024-05-20T17:34:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 Processor -- start 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 -- start start 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4101050 0x7fa1c41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112e60 con 0x7fa1c410d550 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112ce0 con 0x7fa1c4108ba0 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.664+0000 7fa1c93ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112fe0 con 0x7fa1c4101050 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35080/0 (socket says 172.21.15.135:35080) 2024-05-20T17:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 -- 172.21.15.135:0/2129904397 learned_addr learned my addr 172.21.15.135:0/2129904397 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4101050 0x7fa1c41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 -- 172.21.15.135:0/2129904397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4101050 msgr2=0x7fa1c41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4101050 0x7fa1c41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 -- 172.21.15.135:0/2129904397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 msgr2=0x7fa1c4199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 -- 172.21.15.135:0/2129904397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c419e640 con 0x7fa1c410d550 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1c37fe640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00eb40 tx=0x7fa1bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.665+0000 7fa1abfff640 1 -- 172.21.15.135:0/2129904397 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc004b20 con 0x7fa1c410d550 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.666+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c419e930 con 0x7fa1c410d550 2024-05-20T17:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.666+0000 7fa1abfff640 1 -- 172.21.15.135:0/2129904397 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1bc004cc0 con 0x7fa1c410d550 2024-05-20T17:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.666+0000 7fa1abfff640 1 -- 172.21.15.135:0/2129904397 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc010850 con 0x7fa1c410d550 2024-05-20T17:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.666+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c4101c20 con 0x7fa1c410d550 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.669+0000 7fa1d0276740 1 Processor -- start 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.669+0000 7fa1abfff640 1 -- 172.21.15.135:0/2129904397 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7fa1bc005020 con 0x7fa1c410d550 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.669+0000 7fa1d0276740 1 -- start start 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x558083632080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x5580836325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x558083632b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558083597340 con 0x5580832724d0 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55808353f290 con 0x55808326a2f0 2024-05-20T17:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1d0276740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558083593300 con 0x5580832931b0 2024-05-20T17:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x558083632b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x558083632b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35084/0 (socket says 172.21.15.135:35084) 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c27fc640 1 -- 172.21.15.135:0/2327621124 learned_addr learned my addr 172.21.15.135:0/2327621124 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x5580836325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1abfff640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 0x7fa1ac0a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x558083632080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/2327621124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 msgr2=0x558083632080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x558083632080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/2327621124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 msgr2=0x558083632b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x558083632b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c37fe640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 0x7fa1ac0a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.670+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/2327621124 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580835638e0 con 0x55808326a2f0 2024-05-20T17:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x558083632080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1abfff640 1 -- 172.21.15.135:0/2129904397 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa1bc0cffc0 con 0x7fa1c410d550 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x5580836325c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1c406ad90 tx=0x7fa1b40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fcde2520c67415 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1c37fe640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 0x7fa1ac0a5320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0cd5f0 tx=0x7fa1bc091720 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1a97fa640 1 -- 172.21.15.135:0/2327621124 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b401c480 con 0x55808326a2f0 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1a97fa640 1 -- 172.21.15.135:0/2327621124 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1b4011920 con 0x55808326a2f0 2024-05-20T17:34:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.671+0000 7fa1a97fa640 1 -- 172.21.15.135:0/2327621124 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b401a820 con 0x55808326a2f0 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- 172.21.15.135:0/2327621124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 msgr2=0x5580836325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x5580836325c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1c406ad90 tx=0x7fa1b40107a0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- 172.21.15.135:0/2327621124 shutdown_connections 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x558083632b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x5580836325c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2327621124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x558083632080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- 172.21.15.135:0/2327621124 >> 172.21.15.135:0/2327621124 conn(0x558083287300 msgr2=0x55808362e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- 172.21.15.135:0/2327621124 shutdown_connections 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- 172.21.15.135:0/2327621124 wait complete. 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.672+0000 7fa1d0276740 1 -- start start 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 Processor -- start 2024-05-20T17:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x55808363e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x55808363c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55808363f1b0 con 0x5580832724d0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558083552790 con 0x55808326a2f0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55808363f330 con 0x5580832931b0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1d0276740 10 client.0 _ll_register_callbacks cb 0x55808358da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35098/0 (socket says 172.21.15.135:35098) 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/3896294379 learned_addr learned my addr 172.21.15.135:0/3896294379 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x55808363e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.673+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x55808363c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/3896294379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 msgr2=0x55808363c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x55808363c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 msgr2=0x55808363e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x55808363e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 -- 172.21.15.135:0/3896294379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580832ab210 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4010fe0 tx=0x7fa1b4011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af7d4887d669c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b402b060 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa1b400bd80 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b4011920 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa1b4011ce0 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1d0276740 10 client.15864 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558083377620 con 0x5580832724d0 2024-05-20T17:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.674+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1b4011920 con 0x5580832724d0 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa1b4004b80 con 0x5580832724d0 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 10 client.15864 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 20 client.15864 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558083251d80 0x55808364e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 4 client.15864 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580835a4a70 con 0x558083251d80 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558083251d80 0x55808364e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558083251d80 0x55808364e840 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76523039c2716061 server_cookie=878c32716c58ffe4 in_seq=0 out_seq=0 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.675+0000 7fa1a6ff5640 10 client.15864 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3896294379 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5580835a4a70 con 0x558083251d80 2024-05-20T17:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1a6ff5640 10 client.15864 handle_command_reply: tid=0 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1d0276740 1 client.15864 shutdown 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 msgr2=0x55808363e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4010fe0 tx=0x7fa1b4011670 comp rx=0 tx=0).stop 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 shutdown_connections 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.676+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558083251d80 0x55808364e840 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1a6ff5640 0 client.15864 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832931b0 0x55808363c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580832724d0 0x55808363e640 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3896294379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x55808363e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 >> 172.21.15.135:0/3896294379 conn(0x558083287300 msgr2=0x558083631eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 shutdown_connections 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 1 -- 172.21.15.135:0/3896294379 wait complete. 2024-05-20T17:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.677+0000 7fa1d0276740 20 client.15864 trim_cache size 0 max 16384 2024-05-20T17:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 Processor -- start 2024-05-20T17:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 -- start start 2024-05-20T17:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x558083651870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x558083651db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41b3600 con 0x558083251d80 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41b0ed0 con 0x55808326a2f0 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1d0276740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41aed20 con 0x5580832724d0 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35102/0 (socket says 172.21.15.135:35102) 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 -- 172.21.15.135:0/2313612932 learned_addr learned my addr 172.21.15.135:0/2313612932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x558083651870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 -- 172.21.15.135:0/2313612932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 msgr2=0x558083651db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x558083651db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 -- 172.21.15.135:0/2313612932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 msgr2=0x558083651870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x558083651870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c27fc640 1 -- 172.21.15.135:0/2313612932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580836522f0 con 0x558083251d80 2024-05-20T17:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.692+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x558083651870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.693+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005ab0 tx=0x7fa1b80056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869c84e401416b87 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.693+0000 7fa1a8ff9640 1 -- 172.21.15.135:0/2313612932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8035040 con 0x558083251d80 2024-05-20T17:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.693+0000 7fa1a8ff9640 1 -- 172.21.15.135:0/2313612932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1b80329a0 con 0x558083251d80 2024-05-20T17:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.693+0000 7fa1a8ff9640 1 -- 172.21.15.135:0/2313612932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8003cd0 con 0x558083251d80 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 -- 172.21.15.135:0/2313612932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 msgr2=0x558083632520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005ab0 tx=0x7fa1b80056d0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 -- 172.21.15.135:0/2313612932 shutdown_connections 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x558083651db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55808326a2f0 0x558083651870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 --2- 172.21.15.135:0/2313612932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558083251d80 0x558083632520 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 -- 172.21.15.135:0/2313612932 >> 172.21.15.135:0/2313612932 conn(0x558083287300 msgr2=0x558083631e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 -- 172.21.15.135:0/2313612932 shutdown_connections 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.694+0000 7fa1d0276740 1 -- 172.21.15.135:0/2313612932 wait complete. 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 -- start start 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 Processor -- start 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x5580836af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5580832931b0 0x5580836a9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41af390 con 0x55808326a2f0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41b0800 con 0x5580832931b0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41afa60 con 0x5580832724d0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1d0276740 10 client.0 _ll_register_callbacks cb 0x7fa1bc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1c27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35108/0 (socket says 172.21.15.135:35108) 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1c27fc640 1 -- 172.21.15.135:0/3450570204 learned_addr learned my addr 172.21.15.135:0/3450570204 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x5580836af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.695+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5580832931b0 0x5580836a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 -- 172.21.15.135:0/3450570204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 msgr2=0x5580836af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x5580836af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 -- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5580832931b0 msgr2=0x5580836a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5580832931b0 0x5580836a9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 -- 172.21.15.135:0/3450570204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580836a9860 con 0x55808326a2f0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x5580836af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1c27fc640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b8003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36f88feb15b3e6f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8035040 con 0x55808326a2f0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa1b8046040 con 0x55808326a2f0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b80329a0 con 0x55808326a2f0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa1b8003ce0 con 0x55808326a2f0 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1d0276740 10 client.15870 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.696+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5580836b6510 con 0x55808326a2f0 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1b8004360 con 0x55808326a2f0 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa1b803a040 con 0x55808326a2f0 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 10 client.15870 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 20 client.15870 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5580832271c0 0x5580836b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 4 client.15870 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa1b80329a0 con 0x5580832271c0 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.697+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5580832271c0 0x5580836b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.698+0000 7fa1a6ff5640 10 client.15870 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.698+0000 7fa1c2ffd640 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5580832271c0 0x5580836b8b40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66872a59cdbfbbc8 server_cookie=efcc0878b953e470 in_seq=0 out_seq=0 2024-05-20T17:34:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1a6ff5640 1 -- 172.21.15.135:0/3450570204 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa1b80329a0 con 0x5580832271c0 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1a6ff5640 10 client.15870 handle_command_reply: tid=0 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 client.15870 shutdown 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 msgr2=0x5580836aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b8003930 comp rx=0 tx=0).stop 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 shutdown_connections 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5580832271c0 0x5580836b8b40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1a6ff5640 0 client.15870 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5580832931b0 0x5580836a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580832724d0 0x5580836af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 --2- 172.21.15.135:0/3450570204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55808326a2f0 0x5580836aee60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 >> 172.21.15.135:0/3450570204 conn(0x558083287300 msgr2=0x55808363da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 shutdown_connections 2024-05-20T17:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 1 -- 172.21.15.135:0/3450570204 wait complete. 2024-05-20T17:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.702+0000 7fa1d0276740 20 client.15870 trim_cache size 0 max 16384 2024-05-20T17:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 msgr2=0x7fa1ac0a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 0x7fa1ac0a5320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0cd5f0 tx=0x7fa1bc091720 comp rx=0 tx=0).stop 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 msgr2=0x7fa1c419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00eb40 tx=0x7fa1bc00c2d0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 shutdown_connections 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa1ac0a2e10 0x7fa1ac0a5320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1c410d550 0x7fa1c419e000 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c4108ba0 0x7fa1c4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 --2- 172.21.15.135:0/2129904397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c4101050 0x7fa1c41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 >> 172.21.15.135:0/2129904397 conn(0x7fa1c40fc860 msgr2=0x7fa1c40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 shutdown_connections 2024-05-20T17:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:32.703+0000 7fa1c93ce640 1 -- 172.21.15.135:0/2129904397 wait complete. 2024-05-20T17:34:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:33 smithi160 ceph-mon[36261]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:33 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:34:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:33 smithi172 ceph-mon[36511]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:33 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:34:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:33 smithi135 ceph-mon[32027]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:33 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:34:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:35 smithi160 ceph-mon[36261]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-20T17:34:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:35 smithi172 ceph-mon[36511]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-20T17:34:35.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:35 smithi135 ceph-mon[32027]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-20T17:34:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:36 smithi160 ceph-mon[36261]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:36.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:36 smithi172 ceph-mon[36511]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:36.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:36 smithi135 ceph-mon[32027]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:39.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:38 smithi135 ceph-mon[32027]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:39.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:38 smithi160 ceph-mon[36261]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:39.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:38 smithi172 ceph-mon[36511]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:40 smithi135 ceph-mon[32027]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:41.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:40 smithi160 ceph-mon[36261]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:41.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:40 smithi172 ceph-mon[36511]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-20T17:34:43.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:42 smithi135 ceph-mon[32027]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:43.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:42 smithi160 ceph-mon[36261]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:43.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:42 smithi172 ceph-mon[36511]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-05-20T17:34:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:44 smithi135 ceph-mon[32027]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:45.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:44 smithi160 ceph-mon[36261]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:45.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:44 smithi172 ceph-mon[36511]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:34:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 -- 172.21.15.135:0/2814634752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107a20 msgr2=0x7fa5981015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 --2- 172.21.15.135:0/2814634752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107a20 0x7fa5981015d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa594009900 tx=0x7fa59402a410 comp rx=0 tx=0).stop 2024-05-20T17:34:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 -- 172.21.15.135:0/2814634752 shutdown_connections 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 --2- 172.21.15.135:0/2814634752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 0x7fa59810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 --2- 172.21.15.135:0/2814634752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107ec0 0x7fa598101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 --2- 172.21.15.135:0/2814634752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107a20 0x7fa5981015d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 -- 172.21.15.135:0/2814634752 >> 172.21.15.135:0/2814634752 conn(0x7fa598077100 msgr2=0x7fa598077540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 -- 172.21.15.135:0/2814634752 shutdown_connections 2024-05-20T17:34:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.854+0000 7fa59f765640 1 -- 172.21.15.135:0/2814634752 wait complete. 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 Processor -- start 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 -- start start 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 0x7fa5981997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 0x7fa598199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa598112ec0 con 0x7fa598107ec0 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa598112d40 con 0x7fa598102180 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59f765640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa598113040 con 0x7fa598107a20 2024-05-20T17:34:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59dd02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.855+0000 7fa59dd02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50428/0 (socket says 172.21.15.135:50428) 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 -- 172.21.15.135:0/241947345 learned_addr learned my addr 172.21.15.135:0/241947345 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59d501640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 0x7fa5981997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59cd00640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 0x7fa598199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 -- 172.21.15.135:0/241947345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 msgr2=0x7fa598199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 0x7fa598199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 -- 172.21.15.135:0/241947345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 msgr2=0x7fa5981997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 0x7fa5981997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 -- 172.21.15.135:0/241947345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59819e620 con 0x7fa598107ec0 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59cd00640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 0x7fa598199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa59dd02640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa59000eb10 tx=0x7fa59000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa58e7fc640 1 -- 172.21.15.135:0/241947345 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590004b20 con 0x7fa598107ec0 2024-05-20T17:34:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa58e7fc640 1 -- 172.21.15.135:0/241947345 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa590004cc0 con 0x7fa598107ec0 2024-05-20T17:34:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.856+0000 7fa58e7fc640 1 -- 172.21.15.135:0/241947345 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590010760 con 0x7fa598107ec0 2024-05-20T17:34:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.858+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59819e910 con 0x7fa598107ec0 2024-05-20T17:34:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.858+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59819ede0 con 0x7fa598107ec0 2024-05-20T17:34:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa58e7fc640 1 -- 172.21.15.135:0/241947345 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138067+0+0 (secure 0 0 0) 0x7fa590005000 con 0x7fa598107ec0 2024-05-20T17:34:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 Processor -- start 2024-05-20T17:34:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 -- start start 2024-05-20T17:34:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14c11b0 0x564fe1860080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe1860b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fe17c5340 con 0x564fe14982f0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564fe176d290 con 0x564fe14a04d0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa5a6611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fe17c1300 con 0x564fe14c11b0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50432/0 (socket says 172.21.15.135:50432) 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.862+0000 7fa59d501640 1 -- 172.21.15.135:0/998306439 learned_addr learned my addr 172.21.15.135:0/998306439 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59cd00640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14c11b0 0x564fe1860080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59cd00640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe1860b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 -- 172.21.15.135:0/998306439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14c11b0 msgr2=0x564fe1860080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14c11b0 0x564fe1860080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 -- 172.21.15.135:0/998306439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 msgr2=0x564fe1860b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe1860b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 -- 172.21.15.135:0/998306439 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe17918e0 con 0x564fe14982f0 2024-05-20T17:34:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59cd00640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe1860b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa59d501640 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa594009900 tx=0x7fa594005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978c18f9ff498d42 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.863+0000 7fa58e7fc640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 0x7fa5840a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.864+0000 7fa5837fe640 1 -- 172.21.15.135:0/998306439 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594035040 con 0x564fe14982f0 2024-05-20T17:34:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.864+0000 7fa59cd00640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 0x7fa5840a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.864+0000 7fa5837fe640 1 -- 172.21.15.135:0/998306439 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa594004480 con 0x564fe14982f0 2024-05-20T17:34:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.864+0000 7fa5837fe640 1 -- 172.21.15.135:0/998306439 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940035f0 con 0x564fe14982f0 2024-05-20T17:34:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.864+0000 7fa58e7fc640 1 -- 172.21.15.135:0/241947345 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa5900cfd90 con 0x7fa598107ec0 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 -- 172.21.15.135:0/998306439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 msgr2=0x564fe18605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa59cd00640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 0x7fa5840a5420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa58800cfd0 tx=0x7fa588005850 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa594009900 tx=0x7fa594005fd0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 -- 172.21.15.135:0/998306439 shutdown_connections 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe1860b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14982f0 0x564fe18605c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 --2- 172.21.15.135:0/998306439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14c11b0 0x564fe1860080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 -- 172.21.15.135:0/998306439 >> 172.21.15.135:0/998306439 conn(0x564fe14b5300 msgr2=0x564fe185c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 -- 172.21.15.135:0/998306439 shutdown_connections 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.865+0000 7fa5a6611740 1 -- 172.21.15.135:0/998306439 wait complete. 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.866+0000 7fa5a6611740 1 -- start start 2024-05-20T17:34:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.866+0000 7fa5a6611740 1 Processor -- start 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.866+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe186c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe18667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fe186d0f0 con 0x564fe14c11b0 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564fe1780790 con 0x564fe14a04d0 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fe186d270 con 0x564fe14982f0 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa5a6611740 10 client.0 _ll_register_callbacks cb 0x564fe17bba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59d501640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe186c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59dd02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59dd02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50444/0 (socket says 172.21.15.135:50444) 2024-05-20T17:34:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59dd02640 1 -- 172.21.15.135:0/859437577 learned_addr learned my addr 172.21.15.135:0/859437577 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59d501640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe186c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:40228/0 (socket says 172.21.15.135:40228) 2024-05-20T17:34:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe18667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 -- 172.21.15.135:0/859437577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 msgr2=0x564fe186c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe186c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 -- 172.21.15.135:0/859437577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 msgr2=0x564fe1866d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 -- 172.21.15.135:0/859437577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe14d9210 con 0x564fe14a04d0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59dd02640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.867+0000 7fa59cd00640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe18667f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5880058c0 tx=0x7fa5880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c29bad8deae6273 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa580ff9640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588011ab0 con 0x564fe14a04d0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa588011c50 con 0x564fe14a04d0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa594004480 con 0x564fe14a04d0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa588011e50 con 0x564fe14a04d0 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa5a6611740 10 client.25526 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.868+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564fe15a5620 con 0x564fe14a04d0 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa594004480 con 0x564fe14a04d0 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa5880206f0 con 0x564fe14a04d0 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 10 client.25526 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 20 client.25526 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe147fd80 0x564fe18851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 4 client.25526 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.869+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe17d2a70 con 0x564fe147fd80 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.870+0000 7fa59d501640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe147fd80 0x564fe18851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.870+0000 7fa580ff9640 10 client.25526 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.870+0000 7fa59d501640 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe147fd80 0x564fe18851e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34868248038d39fd server_cookie=60eafaafc235f0e3 in_seq=0 out_seq=0 2024-05-20T17:34:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.871+0000 7fa580ff9640 1 -- 172.21.15.135:0/859437577 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564fe17d2a70 con 0x564fe147fd80 2024-05-20T17:34:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.871+0000 7fa580ff9640 10 client.25526 handle_command_reply: tid=0 2024-05-20T17:34:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.871+0000 7fa5a6611740 1 client.25526 shutdown 2024-05-20T17:34:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.871+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 msgr2=0x564fe18667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.871+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe18667f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5880058c0 tx=0x7fa5880046c0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.873+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 shutdown_connections 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.873+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe147fd80 0x564fe18851e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.873+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe14c11b0 0x564fe1866d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.873+0000 7fa580ff9640 0 client.25526 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe18667f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 1 --2- 172.21.15.135:0/859437577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe186c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 >> 172.21.15.135:0/859437577 conn(0x564fe14b5300 msgr2=0x564fe185fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 shutdown_connections 2024-05-20T17:34:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 1 -- 172.21.15.135:0/859437577 wait complete. 2024-05-20T17:34:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.874+0000 7fa5a6611740 20 client.25526 trim_cache size 0 max 16384 2024-05-20T17:34:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.904+0000 7fa5a6611740 1 Processor -- start 2024-05-20T17:34:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.904+0000 7fa5a6611740 1 -- start start 2024-05-20T17:34:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe1866d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50460/0 (socket says 172.21.15.135:50460) 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa59d501640 1 -- 172.21.15.135:0/4265689413 learned_addr learned my addr 172.21.15.135:0/4265689413 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa5a6611740 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe188a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.905+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981af0c0 con 0x564fe147fd80 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59cd00640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe1866d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981ac990 con 0x564fe14a04d0 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981aa7e0 con 0x564fe14982f0 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe188a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 -- 172.21.15.135:0/4265689413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 msgr2=0x564fe1866d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe1866d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 -- 172.21.15.135:0/4265689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 msgr2=0x564fe1860520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59dd02640 1 -- 172.21.15.135:0/4265689413 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe1871110 con 0x564fe14a04d0 2024-05-20T17:34:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59cd00640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe1866d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.906+0000 7fa59d501640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.907+0000 7fa59dd02640 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe188a9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5900049d0 tx=0x7fa59009b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1728d7b0982e03ed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.907+0000 7fa582ffd640 1 -- 172.21.15.135:0/4265689413 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900bc0d0 con 0x564fe14a04d0 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.907+0000 7fa582ffd640 1 -- 172.21.15.135:0/4265689413 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa59009c000 con 0x564fe14a04d0 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.907+0000 7fa582ffd640 1 -- 172.21.15.135:0/4265689413 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900a4a40 con 0x564fe14a04d0 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 msgr2=0x564fe188a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe188a9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5900049d0 tx=0x7fa59009b960 comp rx=0 tx=0).stop 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 shutdown_connections 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14a04d0 0x564fe188a9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14982f0 0x564fe1866d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 --2- 172.21.15.135:0/4265689413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe1860520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 >> 172.21.15.135:0/4265689413 conn(0x564fe14b5300 msgr2=0x564fe185fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 shutdown_connections 2024-05-20T17:34:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.908+0000 7fa5a6611740 1 -- 172.21.15.135:0/4265689413 wait complete. 2024-05-20T17:34:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.909+0000 7fa5a6611740 1 -- start start 2024-05-20T17:34:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.909+0000 7fa5a6611740 1 Processor -- start 2024-05-20T17:34:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 0x564fe187e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14a04d0 0x564fe18eb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981aae50 con 0x564fe147fd80 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981ac2c0 con 0x564fe14982f0 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5981ab520 con 0x564fe14a04d0 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa5a6611740 10 client.0 _ll_register_callbacks cb 0x7fa588012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa59d501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50462/0 (socket says 172.21.15.135:50462) 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa59d501640 1 -- 172.21.15.135:0/2205446796 learned_addr learned my addr 172.21.15.135:0/2205446796 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.910+0000 7fa59dd02640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14a04d0 0x564fe18eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59cd00640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 0x564fe187e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 -- 172.21.15.135:0/2205446796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14a04d0 msgr2=0x564fe18eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14a04d0 0x564fe18eb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 -- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 msgr2=0x564fe187e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 0x564fe187e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 -- 172.21.15.135:0/2205446796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe18ebaa0 con 0x564fe147fd80 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59cd00640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 0x564fe187e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa59d501640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x564fe185db70 tx=0x7fa594004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4618aa626252b4d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa580ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594035040 con 0x564fe147fd80 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa594005450 con 0x564fe147fd80 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.911+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa59009c000 con 0x564fe147fd80 2024-05-20T17:34:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.912+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa594061050 con 0x564fe147fd80 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.912+0000 7fa5a6611740 10 client.15888 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.912+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564fe18ecc30 con 0x564fe147fd80 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.912+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa59009c000 con 0x564fe147fd80 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa59405c030 con 0x564fe147fd80 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 10 client.15888 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 20 client.15888 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe14c11b0 0x564fe18ef020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 4 client.15888 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:34:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fe17ccdc0 con 0x564fe14c11b0 2024-05-20T17:34:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa59cd00640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe14c11b0 0x564fe18ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa580ff9640 10 client.15888 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.913+0000 7fa59cd00640 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe14c11b0 0x564fe18ef020 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45041e478eb0a48f server_cookie=e83d06725bf3f34e in_seq=0 out_seq=0 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa580ff9640 1 -- 172.21.15.135:0/2205446796 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564fe17ccdc0 con 0x564fe14c11b0 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa580ff9640 10 client.15888 handle_command_reply: tid=0 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 client.15888 shutdown 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 msgr2=0x564fe187e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x564fe185db70 tx=0x7fa594004520 comp rx=0 tx=0).stop 2024-05-20T17:34:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 shutdown_connections 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fe14c11b0 0x564fe18ef020 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fe14a04d0 0x564fe18eb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fe14982f0 0x564fe187e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 --2- 172.21.15.135:0/2205446796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fe147fd80 0x564fe187e3f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 >> 172.21.15.135:0/2205446796 conn(0x564fe14b5300 msgr2=0x564fe1865d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa580ff9640 0 client.15888 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 shutdown_connections 2024-05-20T17:34:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 1 -- 172.21.15.135:0/2205446796 wait complete. 2024-05-20T17:34:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.918+0000 7fa5a6611740 20 client.15888 trim_cache size 0 max 16384 2024-05-20T17:34:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:34:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:34:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:34:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:34:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 msgr2=0x7fa5840a5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 0x7fa5840a5420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa58800cfd0 tx=0x7fa588005850 comp rx=0 tx=0).stop 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 msgr2=0x7fa59819dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa59000eb10 tx=0x7fa59000c2d0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 shutdown_connections 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa5840a2f10 0x7fa5840a5420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa598107ec0 0x7fa59819dfe0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa598107a20 0x7fa598199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 --2- 172.21.15.135:0/241947345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598102180 0x7fa5981997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 >> 172.21.15.135:0/241947345 conn(0x7fa598077100 msgr2=0x7fa598103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 shutdown_connections 2024-05-20T17:34:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:45.919+0000 7fa59f765640 1 -- 172.21.15.135:0/241947345 wait complete. 2024-05-20T17:34:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:46 smithi135 ceph-mon[32027]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:47.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:46 smithi160 ceph-mon[36261]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:47.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:46 smithi172 ceph-mon[36511]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:34:49.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:48 smithi135 ceph-mon[32027]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:49.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:48 smithi160 ceph-mon[36261]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:49.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:48 smithi172 ceph-mon[36511]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:51.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:50 smithi135 ceph-mon[32027]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:51.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:50 smithi160 ceph-mon[36261]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:51.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:50 smithi172 ceph-mon[36511]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-20T17:34:53.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:52 smithi135 ceph-mon[32027]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:53.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:52 smithi135 ceph-mon[32027]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-20T17:34:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:52 smithi160 ceph-mon[36261]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:52 smithi160 ceph-mon[36261]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-20T17:34:53.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:52 smithi172 ceph-mon[36511]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:53.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:52 smithi172 ceph-mon[36511]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-20T17:34:55.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:54 smithi135 ceph-mon[32027]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:55.248 INFO:tasks.workunit.client.0.smithi135.stderr:Note: switching to 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'. 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr: git switch -c 2024-05-20T17:34:55.249 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr:Or undo this operation with: 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr: git switch - 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:55.250 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at d2b507c724e Merge PR #56984 into wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:34:55.255 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-20T17:34:55.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:54 smithi160 ceph-mon[36261]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:55.321 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-20T17:34:55.323 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T17:34:55.323 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-20T17:34:55.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:54 smithi172 ceph-mon[36511]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:56.031 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-20T17:34:56.085 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-20T17:34:56.124 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T17:34:56.126 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T17:34:56.126 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-20T17:34:56.164 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T17:34:56.168 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:34:56.168 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-20T17:34:56.225 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-05-20T17:34:56.228 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-05-20T17:34:56.229 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2b507c724ef6c8295ee0a35d185cdab167fd61d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-05-20T17:34:56.288 INFO:tasks.workunit.client.0.smithi135.stdout:getting blogbench 2024-05-20T17:34:56.332 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'getting blogbench' 2024-05-20T17:34:56.332 INFO:tasks.workunit.client.0.smithi135.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-05-20T17:34:56.332 INFO:tasks.workunit.client.0.smithi135.stderr:--2024-05-20 17:34:56-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-05-20T17:34:56.332 INFO:tasks.workunit.client.0.smithi135.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-05-20T17:34:56.392 INFO:tasks.workunit.client.0.smithi135.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-05-20T17:34:56.465 INFO:tasks.workunit.client.0.smithi135.stderr:HTTP request sent, awaiting response... 200 OK 2024-05-20T17:34:56.466 INFO:tasks.workunit.client.0.smithi135.stderr:Length: 103355 (101K) [application/octet-stream] 2024-05-20T17:34:56.468 INFO:tasks.workunit.client.0.smithi135.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-05-20T17:34:56.470 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:56.620 INFO:tasks.workunit.client.0.smithi135.stderr: 0K .......... .......... .......... .......... .......... 49% 333K 0s 2024-05-20T17:34:56.693 INFO:tasks.workunit.client.0.smithi135.stderr: 50K .......... .......... .......... .......... .......... 99% 660K 0s 2024-05-20T17:34:56.694 INFO:tasks.workunit.client.0.smithi135.stderr: 100K 100% 1.74T=0.2s 2024-05-20T17:34:56.694 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:56.694 INFO:tasks.workunit.client.0.smithi135.stderr:2024-05-20 17:34:56 (446 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-05-20T17:34:56.694 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-20T17:34:56.694 INFO:tasks.workunit.client.0.smithi135.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-05-20T17:34:56.725 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/ 2024-05-20T17:34:56.726 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/m4/ 2024-05-20T17:34:56.727 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-05-20T17:34:56.728 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/man/ 2024-05-20T17:34:56.729 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/man/blogbench.8 2024-05-20T17:34:56.731 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/man/Makefile.am 2024-05-20T17:34:56.731 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/man/Makefile.in 2024-05-20T17:34:56.733 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/ 2024-05-20T17:34:56.734 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/mysnprintf.c 2024-05-20T17:34:56.734 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/mysnprintf.h 2024-05-20T17:34:56.736 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/blogbench.c 2024-05-20T17:34:56.736 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/blogbench.h 2024-05-20T17:34:56.738 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/fakesnprintf.c 2024-05-20T17:34:56.738 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/fakesnprintf.h 2024-05-20T17:34:56.740 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/blogbench_p.h 2024-05-20T17:34:56.741 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-05-20T17:34:56.742 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-05-20T17:34:56.743 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/Makefile.am 2024-05-20T17:34:56.745 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/Makefile.in 2024-05-20T17:34:56.746 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/process.c 2024-05-20T17:34:56.747 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/globals.h 2024-05-20T17:34:56.748 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/commenter.c 2024-05-20T17:34:56.749 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/rewriter.c 2024-05-20T17:34:56.750 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/reader.c 2024-05-20T17:34:56.751 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/writer.c 2024-05-20T17:34:56.752 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/src/helpers.c 2024-05-20T17:34:56.753 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/NEWS 2024-05-20T17:34:56.754 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/compile 2024-05-20T17:34:56.755 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/depcomp 2024-05-20T17:34:56.756 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/aclocal.m4 2024-05-20T17:34:56.757 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/README 2024-05-20T17:34:56.758 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/configure 2024-05-20T17:34:56.762 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/configure.ac 2024-05-20T17:34:56.764 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/config.guess 2024-05-20T17:34:56.765 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/install-sh 2024-05-20T17:34:56.766 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/config.sub 2024-05-20T17:34:56.767 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/missing 2024-05-20T17:34:56.769 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/mkinstalldirs 2024-05-20T17:34:56.769 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/Makefile.am 2024-05-20T17:34:56.771 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/Makefile.in 2024-05-20T17:34:56.772 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/config.h.in 2024-05-20T17:34:56.772 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/AUTHORS 2024-05-20T17:34:56.773 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/INSTALL 2024-05-20T17:34:56.774 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/ChangeLog 2024-05-20T17:34:56.775 INFO:tasks.workunit.client.0.smithi135.stdout:blogbench-1.0/COPYING 2024-05-20T17:34:56.776 INFO:tasks.workunit.client.0.smithi135.stderr:+ cd blogbench-1.0/ 2024-05-20T17:34:56.776 INFO:tasks.workunit.client.0.smithi135.stdout:making blogbench 2024-05-20T17:34:56.777 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'making blogbench' 2024-05-20T17:34:56.777 INFO:tasks.workunit.client.0.smithi135.stderr:+ ./configure 2024-05-20T17:34:56.883 INFO:tasks.workunit.client.0.smithi135.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-20T17:34:57.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:56 smithi135 ceph-mon[32027]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:57.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:56 smithi160 ceph-mon[36261]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:57.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:56 smithi172 ceph-mon[36511]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-05-20T17:34:57.891 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether build environment is sane... yes 2024-05-20T17:34:57.902 INFO:tasks.workunit.client.0.smithi135.stdout:checking for gawk... gawk 2024-05-20T17:34:57.922 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether make sets $(MAKE)... yes 2024-05-20T17:34:57.947 INFO:tasks.workunit.client.0.smithi135.stdout:checking for gcc... gcc 2024-05-20T17:34:58.000 INFO:tasks.workunit.client.0.smithi135.stdout:checking for C compiler default output file name... a.out 2024-05-20T17:34:58.002 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether the C compiler works... yes 2024-05-20T17:34:58.005 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether we are cross compiling... no 2024-05-20T17:34:58.043 INFO:tasks.workunit.client.0.smithi135.stdout:checking for suffix of executables... 2024-05-20T17:34:58.085 INFO:tasks.workunit.client.0.smithi135.stdout:checking for suffix of object files... o 2024-05-20T17:34:58.119 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether we are using the GNU C compiler... yes 2024-05-20T17:34:58.153 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether gcc accepts -g... yes 2024-05-20T17:34:58.237 INFO:tasks.workunit.client.0.smithi135.stdout:checking for gcc option to accept ANSI C... none needed 2024-05-20T17:34:58.300 INFO:tasks.workunit.client.0.smithi135.stdout:checking for style of include used by make... GNU 2024-05-20T17:34:58.403 INFO:tasks.workunit.client.0.smithi135.stdout:checking dependency style of gcc... gcc3 2024-05-20T17:34:58.403 INFO:tasks.workunit.client.0.smithi135.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-20T17:34:58.488 INFO:tasks.workunit.client.0.smithi135.stdout:checking how to run the C preprocessor... gcc -E 2024-05-20T17:34:58.531 INFO:tasks.workunit.client.0.smithi135.stdout:checking for egrep... grep -E 2024-05-20T17:34:58.540 INFO:tasks.workunit.client.0.smithi135.stdout:checking for AIX... no 2024-05-20T17:34:58.618 INFO:tasks.workunit.client.0.smithi135.stdout:checking for library containing strerror... none required 2024-05-20T17:34:58.763 INFO:tasks.workunit.client.0.smithi135.stdout:checking for ANSI C header files... yes 2024-05-20T17:34:58.802 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-20T17:34:58.852 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/types.h... yes 2024-05-20T17:34:58.908 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/stat.h... yes 2024-05-20T17:34:58.960 INFO:tasks.workunit.client.0.smithi135.stdout:checking for stdlib.h... yes 2024-05-20T17:34:59.015 INFO:tasks.workunit.client.0.smithi135.stdout:checking for string.h... yes 2024-05-20T17:34:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 -- 172.21.15.135:0/1649155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c107a40 msgr2=0x7f9e2c1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 --2- 172.21.15.135:0/1649155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c107a40 0x7f9e2c1015d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009900 tx=0x7f9e1c02a410 comp rx=0 tx=0).stop 2024-05-20T17:34:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 -- 172.21.15.135:0/1649155239 shutdown_connections 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 --2- 172.21.15.135:0/1649155239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c10c3a0 0x7f9e2c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 --2- 172.21.15.135:0/1649155239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c101b10 0x7f9e2c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 --2- 172.21.15.135:0/1649155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c107a40 0x7f9e2c1015d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 -- 172.21.15.135:0/1649155239 >> 172.21.15.135:0/1649155239 conn(0x7f9e2c0fd210 msgr2=0x7f9e2c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 -- 172.21.15.135:0/1649155239 shutdown_connections 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.027+0000 7f9e32673640 1 -- 172.21.15.135:0/1649155239 wait complete. 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.028+0000 7f9e32673640 1 Processor -- start 2024-05-20T17:34:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.028+0000 7f9e32673640 1 -- start start 2024-05-20T17:34:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.028+0000 7f9e32673640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e32673640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c107a40 0x7f9e2c19faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e32673640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c10c3a0 0x7f9e2c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e32673640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c111db0 con 0x7f9e2c101b10 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e32673640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c111c30 con 0x7f9e2c10c3a0 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e32673640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c111f30 con 0x7f9e2c107a40 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45650/0 (socket says 172.21.15.135:45650) 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 -- 172.21.15.135:0/387814274 learned_addr learned my addr 172.21.15.135:0/387814274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c107a40 0x7f9e2c19faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e30c10640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c10c3a0 0x7f9e2c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 -- 172.21.15.135:0/387814274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c107a40 msgr2=0x7f9e2c19faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c107a40 0x7f9e2c19faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 -- 172.21.15.135:0/387814274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c10c3a0 msgr2=0x7f9e2c1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c10c3a0 0x7f9e2c1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 -- 172.21.15.135:0/387814274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c199e10 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c005940 tx=0x7f9e1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.029+0000 7f9e297fa640 1 -- 172.21.15.135:0/387814274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c03f030 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.030+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c19a040 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.030+0000 7f9e297fa640 1 -- 172.21.15.135:0/387814274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e1c003ce0 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.030+0000 7f9e297fa640 1 -- 172.21.15.135:0/387814274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c035070 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.030+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c1a6300 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.032+0000 7f9e297fa640 1 -- 172.21.15.135:0/387814274 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9e1c042030 con 0x7f9e2c101b10 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.032+0000 7f9e395fc740 1 Processor -- start 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.032+0000 7f9e395fc740 1 -- start start 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e297fa640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 0x7f9e140a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x5559395784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x5559395789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5559394dd340 con 0x5559391b84d0 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555939485290 con 0x5559391d91b0 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e395fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559394d9300 con 0x5559391b02f0 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e297fa640 1 -- 172.21.15.135:0/387814274 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9e1c0efa00 con 0x7f9e2c101b10 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e30c10640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 0x7f9e140a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:46038/0 (socket says 172.21.15.135:46038) 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 -- 172.21.15.135:0/273265409 learned_addr learned my addr 172.21.15.135:0/273265409 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e30c10640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x5559395789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x5559395784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 -- 172.21.15.135:0/273265409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 msgr2=0x5559395784b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x5559395784b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 -- 172.21.15.135:0/273265409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 msgr2=0x5559395789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x5559395789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 -- 172.21.15.135:0/273265409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559394a98e0 con 0x5559391d91b0 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x5559395784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e30c10640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 0x7f9e140a5200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009fd0 tx=0x7f9e24009ec0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.033+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0c4600 tx=0x7f9e1c0044e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0651b82da51110f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.034+0000 7f9e127fc640 1 -- 172.21.15.135:0/273265409 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c049070 con 0x5559391d91b0 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.034+0000 7f9e127fc640 1 -- 172.21.15.135:0/273265409 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e1c09a150 con 0x5559391d91b0 2024-05-20T17:34:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.034+0000 7f9e127fc640 1 -- 172.21.15.135:0/273265409 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0c4b30 con 0x5559391d91b0 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- 172.21.15.135:0/273265409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 msgr2=0x555939577f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0c4600 tx=0x7f9e1c0044e0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- 172.21.15.135:0/273265409 shutdown_connections 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x5559395789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x5559395784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 --2- 172.21.15.135:0/273265409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x555939577f70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- 172.21.15.135:0/273265409 >> 172.21.15.135:0/273265409 conn(0x5559391cd300 msgr2=0x555939574830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- 172.21.15.135:0/273265409 shutdown_connections 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- 172.21.15.135:0/273265409 wait complete. 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 -- start start 2024-05-20T17:34:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.035+0000 7f9e395fc740 1 Processor -- start 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x555939588580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555939589440 con 0x5559391d91b0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555939498790 con 0x5559391b84d0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559395895c0 con 0x5559391b02f0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 10 client.0 _ll_register_callbacks cb 0x5559394d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e30c10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e30c10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45658/0 (socket says 172.21.15.135:45658) 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e30c10640 1 -- 172.21.15.135:0/1265583722 learned_addr learned my addr 172.21.15.135:0/1265583722 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:46040/0 (socket says 172.21.15.135:46040) 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x555939588580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/1265583722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 msgr2=0x555939588580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x555939588580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/1265583722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 msgr2=0x555939586a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/1265583722 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559391f1210 con 0x5559391b84d0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e30c10640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c19ae80 tx=0x7f9e2000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb2acbe5e0b965d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2001b470 con 0x5559391b84d0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e1c09a150 con 0x5559391b84d0 2024-05-20T17:34:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.036+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9e20012450 con 0x5559391b84d0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9e20012650 con 0x5559391b84d0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 10 client.25544 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5559392bd620 con 0x5559391b84d0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e1c09a150 con 0x5559391b84d0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f9e2001bcd0 con 0x5559391b84d0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 10 client.25544 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 20 client.25544 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555939197d80 0x555939598ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 4 client.25544 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559394eaa70 con 0x555939197d80 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.037+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555939197d80 0x555939598ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.038+0000 7f9e0b7fe640 10 client.25544 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.038+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555939197d80 0x555939598ba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bc5073ad9cb4b6 server_cookie=536d4ee90cfdf71 in_seq=0 out_seq=0 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.038+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/1265583722 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5559394eaa70 con 0x555939197d80 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.038+0000 7f9e0b7fe640 10 client.25544 handle_command_reply: tid=0 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.038+0000 7f9e395fc740 1 client.25544 shutdown 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 msgr2=0x555939588ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c19ae80 tx=0x7f9e2000be60 comp rx=0 tx=0).stop 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 shutdown_connections 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555939197d80 0x555939598ba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391d91b0 0x555939586a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e0b7fe640 0 client.25544 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b84d0 0x555939588ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1265583722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b02f0 0x555939588580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 >> 172.21.15.135:0/1265583722 conn(0x5559391cd300 msgr2=0x555939577e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 shutdown_connections 2024-05-20T17:34:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 1 -- 172.21.15.135:0/1265583722 wait complete. 2024-05-20T17:34:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.039+0000 7f9e395fc740 20 client.25544 trim_cache size 0 max 16384 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 Processor -- start 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 -- start start 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b84d0 0x555939578520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1af1b0 con 0x5559391b02f0 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1aca80 con 0x5559391d91b0 2024-05-20T17:34:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.054+0000 7f9e395fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1aa8d0 con 0x5559391b84d0 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45668/0 (socket says 172.21.15.135:45668) 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:46048/0 (socket says 172.21.15.135:46048) 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e2bfff640 1 -- 172.21.15.135:0/1631622425 learned_addr learned my addr 172.21.15.135:0/1631622425 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b84d0 0x555939578520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 -- 172.21.15.135:0/1631622425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b84d0 msgr2=0x555939578520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b84d0 0x555939578520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 -- 172.21.15.135:0/1631622425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 msgr2=0x555939582270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 -- 172.21.15.135:0/1631622425 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555939587ee0 con 0x5559391d91b0 2024-05-20T17:34:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e30c10640 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009900 tx=0x7f9e2401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9fe374e1a012a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e11ffb640 1 -- 172.21.15.135:0/1631622425 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2402c070 con 0x5559391d91b0 2024-05-20T17:34:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e11ffb640 1 -- 172.21.15.135:0/1631622425 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e2400bd00 con 0x5559391d91b0 2024-05-20T17:34:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.055+0000 7f9e11ffb640 1 -- 172.21.15.135:0/1631622425 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24014040 con 0x5559391d91b0 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 -- 172.21.15.135:0/1631622425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 msgr2=0x5559395802c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009900 tx=0x7f9e2401d000 comp rx=0 tx=0).stop 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 -- 172.21.15.135:0/1631622425 shutdown_connections 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391d91b0 0x5559395802c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391b84d0 0x555939578520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 --2- 172.21.15.135:0/1631622425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b02f0 0x555939582270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 -- 172.21.15.135:0/1631622425 >> 172.21.15.135:0/1631622425 conn(0x5559391cd300 msgr2=0x555939577e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 -- 172.21.15.135:0/1631622425 shutdown_connections 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.056+0000 7f9e395fc740 1 -- 172.21.15.135:0/1631622425 wait complete. 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 -- start start 2024-05-20T17:34:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 Processor -- start 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391d91b0 0x5559395feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1aaf40 con 0x5559391b84d0 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1ac3b0 con 0x5559391b02f0 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c1ab610 con 0x5559391d91b0 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e395fc740 10 client.0 _ll_register_callbacks cb 0x7f9e20004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:46064/0 (socket says 172.21.15.135:46064) 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e2bfff640 1 -- 172.21.15.135:0/2882607114 learned_addr learned my addr 172.21.15.135:0/2882607114 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45674/0 (socket says 172.21.15.135:45674) 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.057+0000 7f9e30c10640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391d91b0 0x5559395feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/2882607114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391d91b0 msgr2=0x5559395feeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391d91b0 0x5559395feeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 msgr2=0x555939589810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 -- 172.21.15.135:0/2882607114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593958a5f0 con 0x5559391b84d0 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e2b7fe640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9e200244d0 tx=0x7f9e20012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be69cd942ecb3aef server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2002a040 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9e20024b60 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e2400bd00 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9e2003c050 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e395fc740 10 client.15906 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.058+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555939600450 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e2400bd00 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f9e2002d070 con 0x5559391b84d0 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 10 client.15906 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 20 client.15906 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55593916d1c0 0x555939602c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 4 client.15906 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:34:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559394e4dc0 con 0x55593916d1c0 2024-05-20T17:34:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55593916d1c0 0x555939602c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e0b7fe640 10 client.15906 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.059+0000 7f9e2bfff640 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55593916d1c0 0x555939602c00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97941c8d1b6ecec8 server_cookie=1d54adb84f600092 in_seq=0 out_seq=0 2024-05-20T17:34:59.070 INFO:tasks.workunit.client.0.smithi135.stdout:checking for memory.h... yes 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e0b7fe640 1 -- 172.21.15.135:0/2882607114 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559394e4dc0 con 0x55593916d1c0 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e0b7fe640 10 client.15906 handle_command_reply: tid=0 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 client.15906 shutdown 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 msgr2=0x555939589d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9e200244d0 tx=0x7f9e20012450 comp rx=0 tx=0).stop 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 shutdown_connections 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55593916d1c0 0x555939602c00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559391d91b0 0x5559395feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559391b84d0 0x555939589d50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 --2- 172.21.15.135:0/2882607114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5559391b02f0 0x555939589810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 >> 172.21.15.135:0/2882607114 conn(0x5559391cd300 msgr2=0x555939586280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e0b7fe640 0 client.15906 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 shutdown_connections 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 1 -- 172.21.15.135:0/2882607114 wait complete. 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.111+0000 7f9e395fc740 20 client.15906 trim_cache size 0 max 16384 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:34:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:34:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:34:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 msgr2=0x7f9e140a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 0x7f9e140a5200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009fd0 tx=0x7f9e24009ec0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 msgr2=0x7f9e2c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c005940 tx=0x7f9e1c0042f0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 shutdown_connections 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9e140a2cf0 0x7f9e140a5200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c10c3a0 0x7f9e2c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e2c107a40 0x7f9e2c19faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 --2- 172.21.15.135:0/387814274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e2c101b10 0x7f9e2c19f560 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 >> 172.21.15.135:0/387814274 conn(0x7f9e2c0fd210 msgr2=0x7f9e2c0ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 shutdown_connections 2024-05-20T17:34:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:34:59.112+0000 7f9e32673640 1 -- 172.21.15.135:0/387814274 wait complete. 2024-05-20T17:34:59.145 INFO:tasks.workunit.client.0.smithi135.stdout:checking for strings.h... yes 2024-05-20T17:34:59.199 INFO:tasks.workunit.client.0.smithi135.stdout:checking for inttypes.h... yes 2024-05-20T17:34:59.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:34:58 smithi135 ceph-mon[32027]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:59.250 INFO:tasks.workunit.client.0.smithi135.stdout:checking for stdint.h... yes 2024-05-20T17:34:59.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:34:58 smithi160 ceph-mon[36261]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:59.305 INFO:tasks.workunit.client.0.smithi135.stdout:checking for unistd.h... yes 2024-05-20T17:34:59.316 INFO:tasks.workunit.client.0.smithi135.stdout:checking for memory.h... (cached) yes 2024-05-20T17:34:59.320 INFO:tasks.workunit.client.0.smithi135.stdout:checking for strings.h... (cached) yes 2024-05-20T17:34:59.325 INFO:tasks.workunit.client.0.smithi135.stdout:checking for unistd.h... (cached) yes 2024-05-20T17:34:59.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:34:58 smithi172 ceph-mon[36511]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:34:59.373 INFO:tasks.workunit.client.0.smithi135.stdout:checking locale.h usability... yes 2024-05-20T17:34:59.394 INFO:tasks.workunit.client.0.smithi135.stdout:checking locale.h presence... yes 2024-05-20T17:34:59.394 INFO:tasks.workunit.client.0.smithi135.stdout:checking for locale.h... yes 2024-05-20T17:34:59.410 INFO:tasks.workunit.client.0.smithi135.stdout:checking for stdlib.h... (cached) yes 2024-05-20T17:34:59.415 INFO:tasks.workunit.client.0.smithi135.stdout:checking for string.h... (cached) yes 2024-05-20T17:34:59.463 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/socket.h usability... yes 2024-05-20T17:34:59.487 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/socket.h presence... yes 2024-05-20T17:34:59.487 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/socket.h... yes 2024-05-20T17:34:59.541 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/time.h usability... yes 2024-05-20T17:34:59.561 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/time.h presence... yes 2024-05-20T17:34:59.562 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/time.h... yes 2024-05-20T17:34:59.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:34:59.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:34:59.618 INFO:tasks.workunit.client.0.smithi135.stdout:checking fcntl.h usability... yes 2024-05-20T17:34:59.638 INFO:tasks.workunit.client.0.smithi135.stdout:checking fcntl.h presence... yes 2024-05-20T17:34:59.639 INFO:tasks.workunit.client.0.smithi135.stdout:checking for fcntl.h... yes 2024-05-20T17:34:59.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 -- 172.21.15.135:0/62446550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba9410a600 msgr2=0x7fba9410ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 --2- 172.21.15.135:0/62446550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba9410a600 0x7fba9410ca20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba84009900 tx=0x7fba8402a410 comp rx=0 tx=0).stop 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 -- 172.21.15.135:0/62446550 shutdown_connections 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 --2- 172.21.15.135:0/62446550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410cff0 0x7fba9410f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 --2- 172.21.15.135:0/62446550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba9410a600 0x7fba9410ca20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 --2- 172.21.15.135:0/62446550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba94103ba0 0x7fba94103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 -- 172.21.15.135:0/62446550 >> 172.21.15.135:0/62446550 conn(0x7fba940770b0 msgr2=0x7fba940774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 -- 172.21.15.135:0/62446550 shutdown_connections 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.697+0000 7fba9beca640 1 -- 172.21.15.135:0/62446550 wait complete. 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 Processor -- start 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 -- start start 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410a600 0x7fba94199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba9410cff0 0x7fba9419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112da0 con 0x7fba94103ba0 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112c20 con 0x7fba9410a600 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba9beca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112f20 con 0x7fba9410cff0 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59832/0 (socket says 172.21.15.135:59832) 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 -- 172.21.15.135:0/3720022257 learned_addr learned my addr 172.21.15.135:0/3720022257 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99465640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410a600 0x7fba94199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 -- 172.21.15.135:0/3720022257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba9410cff0 msgr2=0x7fba9419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba9410cff0 0x7fba9419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 -- 172.21.15.135:0/3720022257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410a600 msgr2=0x7fba94199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410a600 0x7fba94199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.698+0000 7fba99c66640 1 -- 172.21.15.135:0/3720022257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9419e640 con 0x7fba94103ba0 2024-05-20T17:34:59.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba99c66640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba9000d770 tx=0x7fba9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba8affd640 1 -- 172.21.15.135:0/3720022257 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90017070 con 0x7fba94103ba0 2024-05-20T17:34:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba8affd640 1 -- 172.21.15.135:0/3720022257 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba90005500 con 0x7fba94103ba0 2024-05-20T17:34:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9419e930 con 0x7fba94103ba0 2024-05-20T17:34:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba8affd640 1 -- 172.21.15.135:0/3720022257 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90004e00 con 0x7fba94103ba0 2024-05-20T17:34:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.699+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9419ee00 con 0x7fba94103ba0 2024-05-20T17:34:59.704 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/fcntl.h usability... yes 2024-05-20T17:34:59.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.701+0000 7fba8affd640 1 -- 172.21.15.135:0/3720022257 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fba90004fa0 con 0x7fba94103ba0 2024-05-20T17:34:59.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 Processor -- start 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 -- start start 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fba8affd640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 0x7fba800a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557126314d00 con 0x557126010390 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5571262bc4c0 con 0x557125fef6b0 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.702+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557126310cc0 con 0x557125fe74d0 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba9a467640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 0x7fba800a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59840/0 (socket says 172.21.15.135:59840) 2024-05-20T17:34:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 -- 172.21.15.135:0/2605221106 learned_addr learned my addr 172.21.15.135:0/2605221106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99465640 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba9a467640 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba8affd640 1 -- 172.21.15.135:0/3720022257 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fba900ceed0 con 0x7fba94103ba0 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 -- 172.21.15.135:0/2605221106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 msgr2=0x5571263af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 -- 172.21.15.135:0/2605221106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 msgr2=0x5571263af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 -- 172.21.15.135:0/2605221106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571260f27d0 con 0x557126010390 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba9a467640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 0x7fba800a5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009810 tx=0x7fba8c009db0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba99c66640 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fba9009b380 tx=0x7fba90016500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b74e9c823817b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba7ffff640 1 -- 172.21.15.135:0/2605221106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90020070 con 0x557126010390 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba7ffff640 1 -- 172.21.15.135:0/2605221106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba900046c0 con 0x557126010390 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.703+0000 7fba7ffff640 1 -- 172.21.15.135:0/2605221106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9009f7a0 con 0x557126010390 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 -- 172.21.15.135:0/2605221106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 msgr2=0x5571263aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fba9009b380 tx=0x7fba90016500 comp rx=0 tx=0).stop 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 -- 172.21.15.135:0/2605221106 shutdown_connections 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/2605221106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263aed30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 -- 172.21.15.135:0/2605221106 >> 172.21.15.135:0/2605221106 conn(0x5571260044e0 msgr2=0x5571263ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 -- 172.21.15.135:0/2605221106 shutdown_connections 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.704+0000 7fbaa2d71740 1 -- 172.21.15.135:0/2605221106 wait complete. 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 -- start start 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 Processor -- start 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263bae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5571263bbfc0 con 0x557126010390 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5571262cfb90 con 0x557125fef6b0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.705+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5571263bc140 con 0x557125fe74d0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fbaa2d71740 10 client.0 _ll_register_callbacks cb 0x55712630bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba9a467640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba9a467640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263b9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59842/0 (socket says 172.21.15.135:59842) 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:32902/0 (socket says 172.21.15.135:32902) 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba9a467640 1 -- 172.21.15.135:0/4078487120 learned_addr learned my addr 172.21.15.135:0/4078487120 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99c66640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 -- 172.21.15.135:0/4078487120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 msgr2=0x5571263bae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263bae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 -- 172.21.15.135:0/4078487120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 msgr2=0x5571263b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 -- 172.21.15.135:0/4078487120 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571260283f0 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba99465640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba84005940 tx=0x7fba84031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b8f6398377e636 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84035040 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fba84004240 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.706+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557126322430 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fba84004460 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 10 client.25562 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557125fe80f0 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557126322430 con 0x557125fef6b0 2024-05-20T17:34:59.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fba840035f0 con 0x557125fef6b0 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 10 client.25562 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 20 client.25562 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557125fcef60 0x5571263cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 4 client.25562 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55712631c780 con 0x557125fcef60 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.707+0000 7fba99c66640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557125fcef60 0x5571263cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.708+0000 7fba7d7fa640 10 client.25562 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.708+0000 7fba99c66640 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557125fcef60 0x5571263cbb90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40af53486a87aba server_cookie=66e826c48af3741a in_seq=0 out_seq=0 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.708+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4078487120 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55712631c780 con 0x557125fcef60 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.708+0000 7fba7d7fa640 10 client.25562 handle_command_reply: tid=0 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 client.25562 shutdown 2024-05-20T17:34:59.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 msgr2=0x5571263bb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba84005940 tx=0x7fba84031850 comp rx=0 tx=0).stop 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 shutdown_connections 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557125fcef60 0x5571263cbb90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557126010390 0x5571263b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fef6b0 0x5571263bb3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fba7d7fa640 0 client.25562 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4078487120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fe74d0 0x5571263bae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 >> 172.21.15.135:0/4078487120 conn(0x5571260044e0 msgr2=0x5571263b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 shutdown_connections 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4078487120 wait complete. 2024-05-20T17:34:59.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.709+0000 7fbaa2d71740 20 client.25562 trim_cache size 0 max 16384 2024-05-20T17:34:59.723 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/fcntl.h presence... yes 2024-05-20T17:34:59.723 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/fcntl.h... yes 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.727+0000 7fbaa2d71740 1 Processor -- start 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.727+0000 7fbaa2d71740 1 -- start start 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b1350 con 0x557125fcef60 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba941aec20 con 0x557125fe74d0 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba941aca70 con 0x557125fef6b0 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:32908/0 (socket says 172.21.15.135:32908) 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59852/0 (socket says 172.21.15.135:59852) 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 -- 172.21.15.135:0/89793418 learned_addr learned my addr 172.21.15.135:0/89793418 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba9a467640 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 -- 172.21.15.135:0/89793418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 msgr2=0x5571263d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 -- 172.21.15.135:0/89793418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 msgr2=0x5571263b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 -- 172.21.15.135:0/89793418 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571263ac0d0 con 0x557125fe74d0 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99c66640 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.728+0000 7fba99465640 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba8402a930 tx=0x7fba8402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a02d7475931f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fba7f7fe640 1 -- 172.21.15.135:0/89793418 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84035070 con 0x557125fe74d0 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fba7f7fe640 1 -- 172.21.15.135:0/89793418 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba84005520 con 0x557125fe74d0 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fba7f7fe640 1 -- 172.21.15.135:0/89793418 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84053070 con 0x557125fe74d0 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 -- 172.21.15.135:0/89793418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 msgr2=0x5571263ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba8402a930 tx=0x7fba8402a410 comp rx=0 tx=0).stop 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 -- 172.21.15.135:0/89793418 shutdown_connections 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263ab5b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/89793418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.729+0000 7fbaa2d71740 1 -- 172.21.15.135:0/89793418 >> 172.21.15.135:0/89793418 conn(0x5571260044e0 msgr2=0x5571263aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- 172.21.15.135:0/89793418 shutdown_connections 2024-05-20T17:34:59.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- 172.21.15.135:0/89793418 wait complete. 2024-05-20T17:34:59.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- start start 2024-05-20T17:34:59.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 Processor -- start 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ad0e0 con 0x557125fcef60 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ae550 con 0x557125fe74d0 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.730+0000 7fbaa2d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ad7b0 con 0x557125fef6b0 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fbaa2d71740 10 client.0 _ll_register_callbacks cb 0x7fba84009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:34:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59862/0 (socket says 172.21.15.135:59862) 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 -- 172.21.15.135:0/4209945823 learned_addr learned my addr 172.21.15.135:0/4209945823 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99465640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba9a467640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 -- 172.21.15.135:0/4209945823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 msgr2=0x5571263bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 -- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 msgr2=0x5571263bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 -- 172.21.15.135:0/4209945823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571263c1e20 con 0x557125fcef60 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99465640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba99c66640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba90097850 tx=0x7fba900048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8c7e07c51e0971 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:34:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba900b4060 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fba900996f0 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba84005520 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fba90084070 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fbaa2d71740 10 client.15924 fetch_fsmap learned FSMap version 22 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.731+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557126433f50 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba84005520 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fba900cc8a0 con 0x557125fcef60 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 10 client.15924 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 20 client.15924 populate_metadata read hostname 'smithi135' 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557126010390 0x5571264362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 4 client.15924 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:34:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571262996f0 con 0x557126010390 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fba99465640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557126010390 0x5571264362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fba7d7fa640 10 client.15924 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.732+0000 7fba99465640 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557126010390 0x5571264362f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa3c64a21cfde6d server_cookie=9ad95a9dfc35760d in_seq=0 out_seq=0 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fba7d7fa640 1 -- 172.21.15.135:0/4209945823 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5571262996f0 con 0x557126010390 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fba7d7fa640 10 client.15924 handle_command_reply: tid=0 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 client.15924 shutdown 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 msgr2=0x5571263bce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba90097850 tx=0x7fba900048a0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 shutdown_connections 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557126010390 0x5571264362f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557125fef6b0 0x5571263bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557125fe74d0 0x5571263bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fba7d7fa640 0 client.15924 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 --2- 172.21.15.135:0/4209945823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557125fcef60 0x5571263bce10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 >> 172.21.15.135:0/4209945823 conn(0x5571260044e0 msgr2=0x5571263aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 shutdown_connections 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 1 -- 172.21.15.135:0/4209945823 wait complete. 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.734+0000 7fbaa2d71740 20 client.15924 trim_cache size 0 max 16384 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-05-20T17:34:59.742 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:34:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 msgr2=0x7fba800a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 0x7fba800a5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009810 tx=0x7fba8c009db0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 msgr2=0x7fba941997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba9000d770 tx=0x7fba9000dc30 comp rx=0 tx=0).stop 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 shutdown_connections 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fba800a2d00 0x7fba800a5210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba9410cff0 0x7fba9419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba9410a600 0x7fba94199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 --2- 172.21.15.135:0/3720022257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba94103ba0 0x7fba941997e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 >> 172.21.15.135:0/3720022257 conn(0x7fba940770b0 msgr2=0x7fba94100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 shutdown_connections 2024-05-20T17:34:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.735+0000 7fba9beca640 1 -- 172.21.15.135:0/3720022257 wait complete. 2024-05-20T17:34:59.748 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-20T17:34:59.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:34:59.797 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/param.h usability... yes 2024-05-20T17:34:59.820 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/param.h presence... yes 2024-05-20T17:34:59.820 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/param.h... yes 2024-05-20T17:34:59.869 INFO:tasks.workunit.client.0.smithi135.stdout:checking ioctl.h usability... no 2024-05-20T17:34:59.889 INFO:tasks.workunit.client.0.smithi135.stdout:checking ioctl.h presence... no 2024-05-20T17:34:59.890 INFO:tasks.workunit.client.0.smithi135.stdout:checking for ioctl.h... no 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 -- 172.21.15.135:0/3537905295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 msgr2=0x7fde301015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 --2- 172.21.15.135:0/3537905295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde301015f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fde28009ca0 tx=0x7fde2802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 -- 172.21.15.135:0/3537905295 shutdown_connections 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 --2- 172.21.15.135:0/3537905295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 --2- 172.21.15.135:0/3537905295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 --2- 172.21.15.135:0/3537905295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde301015f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 -- 172.21.15.135:0/3537905295 >> 172.21.15.135:0/3537905295 conn(0x7fde30077130 msgr2=0x7fde30077570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:34:59.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 -- 172.21.15.135:0/3537905295 shutdown_connections 2024-05-20T17:34:59.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.902+0000 7fde3523f640 1 -- 172.21.15.135:0/3537905295 wait complete. 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 Processor -- start 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 -- start start 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde30199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde30111d20 con 0x7fde30107a10 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fde30111ba0 con 0x7fde3010c370 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde3523f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde30111ea0 con 0x7fde30101b30 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde30199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2f59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde30199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59874/0 (socket says 172.21.15.135:59874) 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2e59c640 1 -- 172.21.15.135:0/3796613348 learned_addr learned my addr 172.21.15.135:0/3796613348 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2ed9d640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.903+0000 7fde2f59e640 1 -- 172.21.15.135:0/3796613348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 msgr2=0x7fde30199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2f59e640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2f59e640 1 -- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 msgr2=0x7fde30199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2f59e640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde30199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2f59e640 1 -- 172.21.15.135:0/3796613348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3019e5d0 con 0x7fde3010c370 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2ed9d640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde2f59e640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3019df90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e970 tx=0x7fde2000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2000ccc0 con 0x7fde3010c370 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3019e8c0 con 0x7fde3010c370 2024-05-20T17:34:59.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde20005020 con 0x7fde3010c370 2024-05-20T17:34:59.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20004a00 con 0x7fde3010c370 2024-05-20T17:34:59.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.904+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde301a6240 con 0x7fde3010c370 2024-05-20T17:34:59.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.905+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde30069140 con 0x7fde3010c370 2024-05-20T17:34:59.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.907+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fde200051d0 con 0x7fde3010c370 2024-05-20T17:34:59.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.907+0000 7fde27fff640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 0x7fde1c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:34:59.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.907+0000 7fde2ed9d640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 0x7fde1c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:34:59.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.907+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fde200cf510 con 0x7fde3010c370 2024-05-20T17:34:59.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.908+0000 7fde2ed9d640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 0x7fde1c0a5210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde28000f80 tx=0x7fde280093f0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:34:59.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:34:59.911+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fde2009c160 con 0x7fde3010c370 2024-05-20T17:34:59.942 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/ioctl.h usability... yes 2024-05-20T17:34:59.961 INFO:tasks.workunit.client.0.smithi135.stdout:checking sys/ioctl.h presence... yes 2024-05-20T17:34:59.962 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sys/ioctl.h... yes 2024-05-20T17:35:00.012 INFO:tasks.workunit.client.0.smithi135.stdout:checking return type of signal handlers... void 2024-05-20T17:35:00.056 INFO:tasks.workunit.client.0.smithi135.stdout:checking for size_t... yes 2024-05-20T17:35:00.095 INFO:tasks.workunit.client.0.smithi135.stdout:checking for dev_t... yes 2024-05-20T17:35:00.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.136+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde301a6440 con 0x7fde3010c370 2024-05-20T17:35:00.138 INFO:tasks.workunit.client.0.smithi135.stdout:checking for short... yes 2024-05-20T17:35:00.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.137+0000 7fde27fff640 1 -- 172.21.15.135:0/3796613348 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7fde2009ba60 con 0x7fde3010c370 2024-05-20T17:35:00.139 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:35:00.139 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:33:17.908712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24523]},"id":1}]} 2024-05-20T17:35:00.139 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 22 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 msgr2=0x7fde1c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 0x7fde1c0a5210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde28000f80 tx=0x7fde280093f0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 msgr2=0x7fde3019df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3019df90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e970 tx=0x7fde2000ee30 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 shutdown_connections 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde1c0a2d00 0x7fde1c0a5210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde3010c370 0x7fde3019df90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde30107a10 0x7fde30199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 --2- 172.21.15.135:0/3796613348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde30101b30 0x7fde30199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 >> 172.21.15.135:0/3796613348 conn(0x7fde30077130 msgr2=0x7fde30073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 shutdown_connections 2024-05-20T17:35:00.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.139+0000 7fde3523f640 1 -- 172.21.15.135:0/3796613348 wait complete. 2024-05-20T17:35:00.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-20T17:35:00.232 INFO:tasks.workunit.client.0.smithi135.stdout:checking size of short... 2 2024-05-20T17:35:00.287 INFO:tasks.workunit.client.0.smithi135.stdout:checking for int... yes 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 -- 172.21.15.135:0/2773433477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a641013b0 msgr2=0x7f0a641017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 --2- 172.21.15.135:0/2773433477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a641013b0 0x7f0a641017c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009900 tx=0x7f0a5402a410 comp rx=0 tx=0).stop 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 -- 172.21.15.135:0/2773433477 shutdown_connections 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 --2- 172.21.15.135:0/2773433477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6410dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 --2- 172.21.15.135:0/2773433477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a64105940 0x7f0a64105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 --2- 172.21.15.135:0/2773433477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a641013b0 0x7f0a641017c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 -- 172.21.15.135:0/2773433477 >> 172.21.15.135:0/2773433477 conn(0x7f0a64076830 msgr2=0x7f0a64076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 -- 172.21.15.135:0/2773433477 shutdown_connections 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.323+0000 7f0a699f5640 1 -- 172.21.15.135:0/2773433477 wait complete. 2024-05-20T17:35:00.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 Processor -- start 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 -- start start 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 0x7f0a641986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111ce0 con 0x7f0a64105940 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111b60 con 0x7f0a641013b0 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a699f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111e60 con 0x7f0a64106400 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59896/0 (socket says 172.21.15.135:59896) 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a5bfff640 1 -- 172.21.15.135:0/3620311738 learned_addr learned my addr 172.21.15.135:0/3620311738 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 0x7f0a641986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.324+0000 7f0a637fe640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 -- 172.21.15.135:0/3620311738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 msgr2=0x7f0a6419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 -- 172.21.15.135:0/3620311738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 msgr2=0x7f0a641986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 0x7f0a641986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 -- 172.21.15.135:0/3620311738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6419d520 con 0x7f0a64105940 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a637fe640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 0x7f0a641986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9c0 tx=0x7f0a4c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a689f3640 1 -- 172.21.15.135:0/3620311738 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00cd80 con 0x7f0a64105940 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6419d810 con 0x7f0a64105940 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641a5190 con 0x7f0a64105940 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a689f3640 1 -- 172.21.15.135:0/3620311738 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a4c005500 con 0x7f0a64105940 2024-05-20T17:35:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.325+0000 7f0a689f3640 1 -- 172.21.15.135:0/3620311738 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c010690 con 0x7f0a64105940 2024-05-20T17:35:00.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.327+0000 7f0a70971740 1 Processor -- start 2024-05-20T17:35:00.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 -- start start 2024-05-20T17:35:00.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a689f3640 1 -- 172.21.15.135:0/3620311738 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0a4c010830 con 0x7f0a64105940 2024-05-20T17:35:00.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a63f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956a26b0 0x55bc95a649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc959c7c40 con 0x55bc9569a4d0 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc9596f580 con 0x55bc956a26b0 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a70971740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc959c3c00 con 0x55bc956c3390 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59906/0 (socket says 172.21.15.135:59906) 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a62ffd640 1 -- 172.21.15.135:0/1591721173 learned_addr learned my addr 172.21.15.135:0/1591721173 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a63f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956a26b0 0x55bc95a649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 -- 172.21.15.135:0/1591721173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956a26b0 msgr2=0x55bc95a649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956a26b0 0x55bc95a649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 -- 172.21.15.135:0/1591721173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 msgr2=0x55bc95a64470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.328+0000 7f0a637fe640 1 -- 172.21.15.135:0/1591721173 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc956db3f0 con 0x55bc956c3390 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a689f3640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 0x7f0a500a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a637fe640 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a63f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009e40 tx=0x7f0a5c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ec290cc5479700 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 0x7f0a500a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a689f3640 1 -- 172.21.15.135:0/3620311738 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0a4c0cf6e0 con 0x7f0a64105940 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a59ffb640 1 -- 172.21.15.135:0/1591721173 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c003b70 con 0x55bc956c3390 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a59ffb640 1 -- 172.21.15.135:0/1591721173 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a5c003d10 con 0x55bc956c3390 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.329+0000 7f0a59ffb640 1 -- 172.21.15.135:0/1591721173 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0119a0 con 0x55bc956c3390 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 -- 172.21.15.135:0/1591721173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 msgr2=0x55bc95a63f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a63f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009e40 tx=0x7f0a5c00f730 comp rx=0 tx=0).stop 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 0x7f0a500a5290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bc95a654f0 tx=0x7f0a540058d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 -- 172.21.15.135:0/1591721173 shutdown_connections 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc956a26b0 0x55bc95a649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc9569a4d0 0x55bc95a64470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 --2- 172.21.15.135:0/1591721173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a63f30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 -- 172.21.15.135:0/1591721173 >> 172.21.15.135:0/1591721173 conn(0x55bc956b74e0 msgr2=0x55bc95a606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 -- 172.21.15.135:0/1591721173 shutdown_connections 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.330+0000 7f0a70971740 1 -- 172.21.15.135:0/1591721173 wait complete. 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 -- start start 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 Processor -- start 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a6e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a7a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc95a71280 con 0x55bc956a26b0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc95982c40 con 0x55bc9569a4d0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc95a71400 con 0x55bc956c3390 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a70971740 10 client.0 _ll_register_callbacks cb 0x55bc956dabe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59908/0 (socket says 172.21.15.135:59908) 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a5bfff640 1 -- 172.21.15.135:0/934673770 learned_addr learned my addr 172.21.15.135:0/934673770 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a637fe640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a7a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.331+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a6e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 -- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 msgr2=0x55bc95a6e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a6e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 -- 172.21.15.135:0/934673770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 msgr2=0x55bc95a6e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 -- 172.21.15.135:0/934673770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc957a57d0 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a6e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a637fe640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a7a7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c006010 tx=0x7f0a5c009330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54ed2541e6c7f09 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c009ae0 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a5c003d10 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0a5c004c50 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0a5c003ec0 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a70971740 10 client.25489 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.332+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bc95a7d960 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a5c003d10 con 0x55bc956c3390 2024-05-20T17:35:00.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f0a5c011ae0 con 0x55bc956c3390 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 10 client.25489 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 10 client.25489 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 20 client.25489 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc95681f60 0x55bc95a80d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 4 client.25489 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc959d5370 con 0x55bc95681f60 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc95681f60 0x55bc95a80d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.333+0000 7f0a42ffd640 10 client.25489 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc95681f60 0x55bc95a80d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea41ea2ef1e78103 server_cookie=94185943c4b9fd1c in_seq=0 out_seq=0 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a42ffd640 1 -- 172.21.15.135:0/934673770 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc959d5370 con 0x55bc95681f60 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a42ffd640 10 client.25489 handle_command_reply: tid=0 2024-05-20T17:35:00.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a70971740 1 client.25489 shutdown 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 msgr2=0x55bc95a7a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.334+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a7a7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c006010 tx=0x7f0a5c009330 comp rx=0 tx=0).stop 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 shutdown_connections 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc95681f60 0x55bc95a80d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956c3390 0x55bc95a7a7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a42ffd640 0 client.25489 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 --2- 172.21.15.135:0/934673770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a6e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 >> 172.21.15.135:0/934673770 conn(0x55bc956b74e0 msgr2=0x55bc95a63d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 shutdown_connections 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 1 -- 172.21.15.135:0/934673770 wait complete. 2024-05-20T17:35:00.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.335+0000 7f0a70971740 20 client.25489 trim_cache size 0 max 16384 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 Processor -- start 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 -- start start 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956a26b0 0x55bc95a5d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44011080 con 0x55bc95681f60 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4400e950 con 0x55bc9569a4d0 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a70971740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4400c7a0 con 0x55bc956a26b0 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.349+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59916/0 (socket says 172.21.15.135:59916) 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2703644927 learned_addr learned my addr 172.21.15.135:0/2703644927 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a637fe640 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956a26b0 0x55bc95a5d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2703644927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956a26b0 msgr2=0x55bc95a5d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956a26b0 0x55bc95a5d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2703644927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 msgr2=0x55bc95a689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2703644927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc95a65520 con 0x55bc95681f60 2024-05-20T17:35:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0a54006010 tx=0x7f0a5403f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5375a4ba534e699e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a597fa640 1 -- 172.21.15.135:0/2703644927 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54043070 con 0x55bc95681f60 2024-05-20T17:35:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a597fa640 1 -- 172.21.15.135:0/2703644927 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54058070 con 0x55bc95681f60 2024-05-20T17:35:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.350+0000 7f0a597fa640 1 -- 172.21.15.135:0/2703644927 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54035040 con 0x55bc95681f60 2024-05-20T17:35:00.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 -- 172.21.15.135:0/2703644927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 msgr2=0x55bc95a6d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0a54006010 tx=0x7f0a5403f070 comp rx=0 tx=0).stop 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 -- 172.21.15.135:0/2703644927 shutdown_connections 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc956a26b0 0x55bc95a5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 --2- 172.21.15.135:0/2703644927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc95681f60 0x55bc95a6d500 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 -- 172.21.15.135:0/2703644927 >> 172.21.15.135:0/2703644927 conn(0x55bc956b74e0 msgr2=0x55bc95a5cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 -- 172.21.15.135:0/2703644927 shutdown_connections 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.351+0000 7f0a70971740 1 -- 172.21.15.135:0/2703644927 wait complete. 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 -- start start 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 Processor -- start 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 0x55bc95a76720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a76c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4400ce10 con 0x55bc956a26b0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4400e280 con 0x55bc9569a4d0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4400d4e0 con 0x55bc95681f60 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a70971740 10 client.0 _ll_register_callbacks cb 0x7f0a5c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a637fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 0x55bc95a76720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a637fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59918/0 (socket says 172.21.15.135:59918) 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a637fe640 1 -- 172.21.15.135:0/2087021809 learned_addr learned my addr 172.21.15.135:0/2087021809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.352+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a76c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 msgr2=0x55bc95a76c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a76c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2087021809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 msgr2=0x55bc95a6a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 -- 172.21.15.135:0/2087021809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc95a612a0 con 0x55bc95681f60 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a637fe640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a76c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a62ffd640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 0x55bc95a76720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a54033000 tx=0x7f0a54005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee26c766af4b125 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54043040 con 0x55bc95681f60 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0a540533a0 con 0x55bc95681f60 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a54058070 con 0x55bc95681f60 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0a540535a0 con 0x55bc95681f60 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a70971740 10 client.25495 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.353+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bc95ae8500 con 0x55bc95681f60 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54058070 con 0x55bc95681f60 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f0a54004d40 con 0x55bc95681f60 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 10 client.25495 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 10 client.25495 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 20 client.25495 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc956c3390 0x55bc95aeac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 4 client.25495 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc959cf6c0 con 0x55bc956c3390 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc956c3390 0x55bc95aeac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a42ffd640 10 client.25495 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:00.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.354+0000 7f0a5bfff640 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc956c3390 0x55bc95aeac60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=394781b1260a0fdd server_cookie=b6a2fd57b2c40bf8 in_seq=0 out_seq=0 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a42ffd640 1 -- 172.21.15.135:0/2087021809 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc959cf6c0 con 0x55bc956c3390 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a42ffd640 10 client.25495 handle_command_reply: tid=0 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 client.25495 shutdown 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 msgr2=0x55bc95a76720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 0x55bc95a76720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a54033000 tx=0x7f0a54005f30 comp rx=0 tx=0).stop 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 shutdown_connections 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x55bc956c3390 0x55bc95aeac60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc956a26b0 0x55bc95a6a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a42ffd640 0 client.25495 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc9569a4d0 0x55bc95a76c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 --2- 172.21.15.135:0/2087021809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc95681f60 0x55bc95a76720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 >> 172.21.15.135:0/2087021809 conn(0x55bc956b74e0 msgr2=0x55bc95a63cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 shutdown_connections 2024-05-20T17:35:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 1 -- 172.21.15.135:0/2087021809 wait complete. 2024-05-20T17:35:00.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a70971740 20 client.25495 trim_cache size 0 max 16384 2024-05-20T17:35:00.364 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 msgr2=0x7f0a500a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 0x7f0a500a5290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bc95a654f0 tx=0x7f0a540058d0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 msgr2=0x7f0a64198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9c0 tx=0x7f0a4c00ee80 comp rx=0 tx=0).stop 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 shutdown_connections 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.355+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0a500a2d80 0x7f0a500a5290 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a64106400 0x7f0a6419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a64105940 0x7f0a64198c20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 --2- 172.21.15.135:0/3620311738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a641013b0 0x7f0a641986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 >> 172.21.15.135:0/3620311738 conn(0x7f0a64076830 msgr2=0x7f0a640ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 shutdown_connections 2024-05-20T17:35:00.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.356+0000 7f0a699f5640 1 -- 172.21.15.135:0/3620311738 wait complete. 2024-05-20T17:35:00.366 INFO:tasks.workunit.client.0.smithi135.stdout:checking size of int... 4 2024-05-20T17:35:00.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-20T17:35:00.410 INFO:tasks.workunit.client.0.smithi135.stdout:checking for long... yes 2024-05-20T17:35:00.488 INFO:tasks.workunit.client.0.smithi135.stdout:checking size of long... 8 2024-05-20T17:35:00.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 -- 172.21.15.135:0/1118638139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 msgr2=0x7f3ff4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1118638139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff4102190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009860 tx=0x7f3fe802a340 comp rx=0 tx=0).stop 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 -- 172.21.15.135:0/1118638139 shutdown_connections 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1118638139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4102800 0x7f3ff410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1118638139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff4102190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1118638139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4107a50 0x7f3ff4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 -- 172.21.15.135:0/1118638139 >> 172.21.15.135:0/1118638139 conn(0x7f3ff4076830 msgr2=0x7f3ff4076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 -- 172.21.15.135:0/1118638139 shutdown_connections 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 -- 172.21.15.135:0/1118638139 wait complete. 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.528+0000 7f3ffa006640 1 Processor -- start 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 -- start start 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 0x7f3ff419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff4111d90 con 0x7f3ff4107a50 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff4111c10 con 0x7f3ff4107ef0 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ffa006640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff4111f10 con 0x7f3ff4102800 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59936/0 (socket says 172.21.15.135:59936) 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1467036369 learned_addr learned my addr 172.21.15.135:0/1467036369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 0x7f3ff419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1467036369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 msgr2=0x7f3ff419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 0x7f3ff419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1467036369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 msgr2=0x7f3ff419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1467036369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff41a5a80 con 0x7f3ff4107a50 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.529+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 0x7f3ff419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802a860 tx=0x7f3fe8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ff0ff9640 1 -- 172.21.15.135:0/1467036369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8037040 con 0x7f3ff4107a50 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff41a5d10 con 0x7f3ff4107a50 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ff0ff9640 1 -- 172.21.15.135:0/1467036369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fe8040070 con 0x7f3ff4107a50 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ff0ff9640 1 -- 172.21.15.135:0/1467036369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8003ad0 con 0x7f3ff4107a50 2024-05-20T17:35:00.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.530+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff41a61f0 con 0x7f3ff4107a50 2024-05-20T17:35:00.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.532+0000 7f3ff0ff9640 1 -- 172.21.15.135:0/1467036369 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3fe8003c70 con 0x7f3ff4107a50 2024-05-20T17:35:00.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.532+0000 7f4000f84740 1 Processor -- start 2024-05-20T17:35:00.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.532+0000 7f4000f84740 1 -- start start 2024-05-20T17:35:00.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf844d0 0x55c1bc34c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc34c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc2b1c40 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc259580 con 0x55c1bbfad390 2024-05-20T17:35:00.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f4000f84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc2adc00 con 0x55c1bbf844d0 2024-05-20T17:35:00.537 INFO:tasks.workunit.client.0.smithi135.stdout:checking for long long... yes 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc34c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:33010/0 (socket says 172.21.15.135:33010) 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2460502152 learned_addr learned my addr 172.21.15.135:0/2460502152 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf844d0 0x55c1bc34c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff0ff9640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 0x7f3fdc0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2460502152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf844d0 msgr2=0x55c1bc34c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf844d0 0x55c1bc34c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2460502152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf8c6b0 msgr2=0x55c1bc34c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc34c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2460502152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bbfc53f0 con 0x55c1bbfad390 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff0ff9640 1 -- 172.21.15.135:0/1467036369 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3fe80ef3d0 con 0x7f3ff4107a50 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 0x7f3fdc0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.533+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009a40 tx=0x7f3fec0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427dd1179a5ec218 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f3fd9ffb640 1 -- 172.21.15.135:0/2460502152 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec004310 con 0x55c1bbfad390 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f3fd9ffb640 1 -- 172.21.15.135:0/2460502152 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fec00d4a0 con 0x55c1bbfad390 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f3fd9ffb640 1 -- 172.21.15.135:0/2460502152 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec019810 con 0x55c1bbfad390 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f4000f84740 1 -- 172.21.15.135:0/2460502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 msgr2=0x55c1bc34bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f4000f84740 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009a40 tx=0x7f3fec0095c0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.534+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 0x7f3fdc0a5210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fec020000 tx=0x7f3fec019e60 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 -- 172.21.15.135:0/2460502152 shutdown_connections 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc34c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf844d0 0x55c1bc34c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 --2- 172.21.15.135:0/2460502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbfad390 0x55c1bc34bd20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 -- 172.21.15.135:0/2460502152 >> 172.21.15.135:0/2460502152 conn(0x55c1bbfa14e0 msgr2=0x55c1bc3484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 -- 172.21.15.135:0/2460502152 shutdown_connections 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 -- 172.21.15.135:0/2460502152 wait complete. 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 -- start start 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 Processor -- start 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.535+0000 7f4000f84740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc356910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbfad390 0x55c1bc35c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc359010 con 0x55c1bbf844d0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc26cc40 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c1bc359190 con 0x55c1bbfad390 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 10 client.0 _ll_register_callbacks cb 0x55c1bbfc4be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc356910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59954/0 (socket says 172.21.15.135:59954) 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff37fe640 1 -- 172.21.15.135:0/1600000118 learned_addr learned my addr 172.21.15.135:0/1600000118 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbfad390 0x55c1bc35c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbfad390 msgr2=0x55c1bc35c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbfad390 0x55c1bc35c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1600000118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 msgr2=0x55c1bc3563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 -- 172.21.15.135:0/1600000118 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bc08f7d0 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc356910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80ecc30 tx=0x7f3fe80f2a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8949318a2794a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3fd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80bb7d0 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3fe8004250 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.536+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fec00d4a0 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3fe80bb360 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 10 client.25604 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c1bc365800 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fec00d4a0 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f3fe803a070 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 10 client.25604 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 10 client.25604 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 20 client.25604 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf6bf60 0x55c1bc368c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 4 client.25604 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1bc2bf370 con 0x55c1bbf6bf60 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.537+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf6bf60 0x55c1bc368c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.538+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf6bf60 0x55c1bc368c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36245a08c0955c70 server_cookie=4657d1f845d5e870 in_seq=0 out_seq=0 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.538+0000 7f3fd2ffd640 10 client.25604 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1600000118 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c1bc2bf370 con 0x55c1bbf6bf60 2024-05-20T17:35:00.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f3fd2ffd640 10 client.25604 handle_command_reply: tid=0 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 client.25604 shutdown 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 msgr2=0x55c1bc356910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc356910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80ecc30 tx=0x7f3fe80f2a50 comp rx=0 tx=0).stop 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 shutdown_connections 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf6bf60 0x55c1bc368c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbfad390 0x55c1bc35c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f3fd2ffd640 0 client.25604 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc356910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 --2- 172.21.15.135:0/1600000118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbf844d0 0x55c1bc3563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 >> 172.21.15.135:0/1600000118 conn(0x55c1bbfa14e0 msgr2=0x55c1bc34da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 shutdown_connections 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 1 -- 172.21.15.135:0/1600000118 wait complete. 2024-05-20T17:35:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.539+0000 7f4000f84740 20 client.25604 trim_cache size 0 max 16384 2024-05-20T17:35:00.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 Processor -- start 2024-05-20T17:35:00.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 -- start start 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc36e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41b14e0 con 0x55c1bbfad390 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41aedb0 con 0x55c1bbf844d0 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f4000f84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41acc00 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59964/0 (socket says 172.21.15.135:59964) 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2351508932 learned_addr learned my addr 172.21.15.135:0/2351508932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc36e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2351508932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 msgr2=0x55c1bc36e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.553+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc36e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2351508932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 msgr2=0x55c1bc35c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3ff3fff640 1 -- 172.21.15.135:0/2351508932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bc34d810 con 0x55c1bbfad390 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00edd0 tx=0x7f3fec029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95832830d57d1612 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3fd97fa640 1 -- 172.21.15.135:0/2351508932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec035070 con 0x55c1bbfad390 2024-05-20T17:35:00.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3fd97fa640 1 -- 172.21.15.135:0/2351508932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fec0097c0 con 0x55c1bbfad390 2024-05-20T17:35:00.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.554+0000 7f3fd97fa640 1 -- 172.21.15.135:0/2351508932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec005180 con 0x55c1bbfad390 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- 172.21.15.135:0/2351508932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 msgr2=0x55c1bc36e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00edd0 tx=0x7f3fec029000 comp rx=0 tx=0).stop 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- 172.21.15.135:0/2351508932 shutdown_connections 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc36e950 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc36e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 --2- 172.21.15.135:0/2351508932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- 172.21.15.135:0/2351508932 >> 172.21.15.135:0/2351508932 conn(0x55c1bbfa14e0 msgr2=0x55c1bc354a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- 172.21.15.135:0/2351508932 shutdown_connections 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- 172.21.15.135:0/2351508932 wait complete. 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.555+0000 7f4000f84740 1 -- start start 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 Processor -- start 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc35e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41ad270 con 0x55c1bbfad390 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41ae6e0 con 0x55c1bbf844d0 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41ad940 con 0x55c1bbf8c6b0 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f4000f84740 10 client.0 _ll_register_callbacks cb 0x7f3fe80f2c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59978/0 (socket says 172.21.15.135:59978) 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff3fff640 1 -- 172.21.15.135:0/1925648455 learned_addr learned my addr 172.21.15.135:0/1925648455 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc35e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 -- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 msgr2=0x55c1bc35e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc35e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 -- 172.21.15.135:0/1925648455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 msgr2=0x55c1bc3c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff37fe640 1 -- 172.21.15.135:0/1925648455 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bc3c94c0 con 0x55c1bbf844d0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.556+0000 7f3ff3fff640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3ff37fe640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35dd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55c1bc356f80 tx=0x7f3fe4012a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aeefdab74e56989 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:00.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe401e980 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3fe4027470 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fec0097c0 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3fe4027670 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 10 client.25610 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c1bc3d07f0 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fec0097c0 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f3fe400f040 con 0x55c1bbf844d0 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 10 client.25610 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 10 client.25610 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 20 client.25610 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf413a0 0x55c1bc3d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 4 client.25610 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.557+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1bc2b96c0 con 0x55c1bbf413a0 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf413a0 0x55c1bc3d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f3fd2ffd640 10 client.25610 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f3ff2ffd640 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf413a0 0x55c1bc3d2f60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ccfa198f3b7569d server_cookie=7061c2ee0303de51 in_seq=0 out_seq=0 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f3fd2ffd640 1 -- 172.21.15.135:0/1925648455 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1bc2b96c0 con 0x55c1bbf413a0 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f3fd2ffd640 10 client.25610 handle_command_reply: tid=0 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.558+0000 7f4000f84740 1 client.25610 shutdown 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 msgr2=0x55c1bc35dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35dd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55c1bc356f80 tx=0x7f3fe4012a40 comp rx=0 tx=0).stop 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 shutdown_connections 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c1bbf413a0 0x55c1bc3d2f60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c1bbfad390 0x55c1bc3c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c1bbf8c6b0 0x55c1bc35e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3fd2ffd640 0 client.25610 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 --2- 172.21.15.135:0/1925648455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c1bbf844d0 0x55c1bc35dd70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 >> 172.21.15.135:0/1925648455 conn(0x55c1bbfa14e0 msgr2=0x55c1bc34fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 shutdown_connections 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 1 -- 172.21.15.135:0/1925648455 wait complete. 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f4000f84740 20 client.25610 trim_cache size 0 max 16384 2024-05-20T17:35:00.567 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:00.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 msgr2=0x7f3fdc0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 0x7f3fdc0a5210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fec020000 tx=0x7f3fec019e60 comp rx=0 tx=0).stop 2024-05-20T17:35:00.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 msgr2=0x7f3ff419acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802a860 tx=0x7f3fe8033d90 comp rx=0 tx=0).stop 2024-05-20T17:35:00.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 shutdown_connections 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3fdc0a2d00 0x7f3fdc0a5210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4107ef0 0x7f3ff419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff4107a50 0x7f3ff419acb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 --2- 172.21.15.135:0/1467036369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ff4102800 0x7f3ff419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.559+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 >> 172.21.15.135:0/1467036369 conn(0x7f3ff4076830 msgr2=0x7f3ff40ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.560+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 shutdown_connections 2024-05-20T17:35:00.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.560+0000 7f3ffa006640 1 -- 172.21.15.135:0/1467036369 wait complete. 2024-05-20T17:35:00.573 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-20T17:35:00.609 INFO:tasks.workunit.client.0.smithi135.stdout:checking size of long long... 8 2024-05-20T17:35:00.659 INFO:tasks.workunit.client.0.smithi135.stdout:checking for ssize_t... yes 2024-05-20T17:35:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 -- 172.21.15.135:0/1435346578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108b50 msgr2=0x7ff618100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 --2- 172.21.15.135:0/1435346578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108b50 0x7ff618100be0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff608009900 tx=0x7ff60802a410 comp rx=0 tx=0).stop 2024-05-20T17:35:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 -- 172.21.15.135:0/1435346578 shutdown_connections 2024-05-20T17:35:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 --2- 172.21.15.135:0/1435346578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618101790 0x7ff61810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 --2- 172.21.15.135:0/1435346578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618108ff0 0x7ff618101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 --2- 172.21.15.135:0/1435346578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108b50 0x7ff618100be0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 -- 172.21.15.135:0/1435346578 >> 172.21.15.135:0/1435346578 conn(0x7ff618076830 msgr2=0x7ff618076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 -- 172.21.15.135:0/1435346578 shutdown_connections 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.689+0000 7ff61e910640 1 -- 172.21.15.135:0/1435346578 wait complete. 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 Processor -- start 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 -- start start 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618101790 0x7ff61819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618108b50 0x7ff61819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff618112ed0 con 0x7ff618108ff0 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff618112d50 con 0x7ff618101790 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61e910640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff618113050 con 0x7ff618108b50 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59996/0 (socket says 172.21.15.135:59996) 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 -- 172.21.15.135:0/2046023393 learned_addr learned my addr 172.21.15.135:0/2046023393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff617fff640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618101790 0x7ff61819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff60ffff640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618108b50 0x7ff61819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 -- 172.21.15.135:0/2046023393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618108b50 msgr2=0x7ff61819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618108b50 0x7ff61819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 -- 172.21.15.135:0/2046023393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618101790 msgr2=0x7ff61819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618101790 0x7ff61819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.690+0000 7ff61cead640 1 -- 172.21.15.135:0/2046023393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff618199de0 con 0x7ff618108ff0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff61cead640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff61000eb40 tx=0x7ff61000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff615ffb640 1 -- 172.21.15.135:0/2046023393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610004b20 con 0x7ff618108ff0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff615ffb640 1 -- 172.21.15.135:0/2046023393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff610004cc0 con 0x7ff618108ff0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61819a070 con 0x7ff618108ff0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff615ffb640 1 -- 172.21.15.135:0/2046023393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610010850 con 0x7ff618108ff0 2024-05-20T17:35:00.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.691+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6181a62d0 con 0x7ff618108ff0 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.693+0000 7ff615ffb640 1 -- 172.21.15.135:0/2046023393 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff610005020 con 0x7ff618108ff0 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 Processor -- start 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 -- start start 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923f8390 0x556b92796bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b92797130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b926fcc40 con 0x556b923d76b0 2024-05-20T17:35:00.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b926a4580 con 0x556b923f8390 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff6257ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556b926f8c00 con 0x556b923cf4d0 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff615ffb640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 0x7ff6040a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60006/0 (socket says 172.21.15.135:60006) 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff60ffff640 1 -- 172.21.15.135:0/691420559 learned_addr learned my addr 172.21.15.135:0/691420559 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff60ffff640 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923f8390 0x556b92796bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff617fff640 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b92797130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff61cead640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 0x7ff6040a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.694+0000 7ff615ffb640 1 -- 172.21.15.135:0/2046023393 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff6100cfc60 con 0x7ff618108ff0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 -- 172.21.15.135:0/691420559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 msgr2=0x556b92797130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b92797130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 -- 172.21.15.135:0/691420559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923f8390 msgr2=0x556b92796bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923f8390 0x556b92796bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 -- 172.21.15.135:0/691420559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b924103f0 con 0x556b923d76b0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60ffff640 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff6000126b0 tx=0x7ff600009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916354ab5b0c9cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff61cead640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 0x7ff6040a5210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff61000eb10 tx=0x7ff61006bfe0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60e7fc640 1 -- 172.21.15.135:0/691420559 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600012040 con 0x556b923d76b0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60e7fc640 1 -- 172.21.15.135:0/691420559 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6000121e0 con 0x556b923d76b0 2024-05-20T17:35:00.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.695+0000 7ff60e7fc640 1 -- 172.21.15.135:0/691420559 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600010820 con 0x556b923d76b0 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- 172.21.15.135:0/691420559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 msgr2=0x556b92797670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff6000126b0 tx=0x7ff600009f90 comp rx=0 tx=0).stop 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- 172.21.15.135:0/691420559 shutdown_connections 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b92797670 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b92797130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 --2- 172.21.15.135:0/691420559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923f8390 0x556b92796bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- 172.21.15.135:0/691420559 >> 172.21.15.135:0/691420559 conn(0x556b923ec4e0 msgr2=0x556b927934d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- 172.21.15.135:0/691420559 shutdown_connections 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- 172.21.15.135:0/691420559 wait complete. 2024-05-20T17:35:00.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.696+0000 7ff6257ba740 1 -- start start 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 Processor -- start 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b927a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 0x556b927a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b927a8500 con 0x556b923f8390 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556b926b7c40 con 0x556b923d76b0 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556b927a8680 con 0x556b923cf4d0 2024-05-20T17:35:00.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff6257ba740 10 client.0 _ll_register_callbacks cb 0x556b9240fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60014/0 (socket says 172.21.15.135:60014) 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 -- 172.21.15.135:0/3220924097 learned_addr learned my addr 172.21.15.135:0/3220924097 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff617fff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 0x556b927a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b927a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 -- 172.21.15.135:0/3220924097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 msgr2=0x556b927a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b927a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 -- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 msgr2=0x556b927a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 0x556b927a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff60ffff640 1 -- 172.21.15.135:0/3220924097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b924da7d0 con 0x556b923f8390 2024-05-20T17:35:00.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.697+0000 7ff617fff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 0x556b927a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff60ffff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff600011fd0 tx=0x7ff600017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba6b2636b7a31ee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600012040 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff600004030 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6000121e0 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff600004230 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 10 client.15978 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556b927b4b80 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6000121e0 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7ff6000105a0 con 0x556b923f8390 2024-05-20T17:35:00.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 10 client.15978 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 20 client.15978 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b923b6f60 0x556b927b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 4 client.15978 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.698+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b9270a370 con 0x556b923b6f60 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.699+0000 7ff617fff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b923b6f60 0x556b927b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.699+0000 7ff5f77fe640 10 client.15978 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:00.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.699+0000 7ff617fff640 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b923b6f60 0x556b927b7f90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a058f3dbde82819d server_cookie=139295ddab100041 in_seq=0 out_seq=0 2024-05-20T17:35:00.711 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sig_atomic_t... yes 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff5f77fe640 1 -- 172.21.15.135:0/3220924097 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556b9270a370 con 0x556b923b6f60 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff5f77fe640 10 client.15978 handle_command_reply: tid=0 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 client.15978 shutdown 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 msgr2=0x556b927b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff600011fd0 tx=0x7ff600017040 comp rx=0 tx=0).stop 2024-05-20T17:35:00.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 shutdown_connections 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b923b6f60 0x556b927b7f90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927b19b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923d76b0 0x556b927a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 --2- 172.21.15.135:0/3220924097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923cf4d0 0x556b927a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff5f77fe640 0 client.15978 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 >> 172.21.15.135:0/3220924097 conn(0x556b923ec4e0 msgr2=0x556b927974e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 shutdown_connections 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 1 -- 172.21.15.135:0/3220924097 wait complete. 2024-05-20T17:35:00.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.701+0000 7ff6257ba740 20 client.15978 trim_cache size 0 max 16384 2024-05-20T17:35:00.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 Processor -- start 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 -- start start 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923f8390 0x556b927bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181af140 con 0x556b923d76b0 2024-05-20T17:35:00.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181aca10 con 0x556b923cf4d0 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.715+0000 7ff6257ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181aa880 con 0x556b923f8390 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff617fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:33088/0 (socket says 172.21.15.135:33088) 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff617fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60016/0 (socket says 172.21.15.135:60016) 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 -- 172.21.15.135:0/1696929137 learned_addr learned my addr 172.21.15.135:0/1696929137 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923f8390 0x556b927bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 -- 172.21.15.135:0/1696929137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923f8390 msgr2=0x556b927bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923f8390 0x556b927bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 -- 172.21.15.135:0/1696929137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 msgr2=0x556b927b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 -- 172.21.15.135:0/1696929137 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b927a8350 con 0x556b923cf4d0 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff617fff640 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60ffff640 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff600011fa0 tx=0x7ff600009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b53f0c1fa78946a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60dffb640 1 -- 172.21.15.135:0/1696929137 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600009930 con 0x556b923cf4d0 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60dffb640 1 -- 172.21.15.135:0/1696929137 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff600005550 con 0x556b923cf4d0 2024-05-20T17:35:00.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.716+0000 7ff60dffb640 1 -- 172.21.15.135:0/1696929137 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600010290 con 0x556b923cf4d0 2024-05-20T17:35:00.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 -- 172.21.15.135:0/1696929137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 msgr2=0x556b92798f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff600011fa0 tx=0x7ff600009f90 comp rx=0 tx=0).stop 2024-05-20T17:35:00.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 -- 172.21.15.135:0/1696929137 shutdown_connections 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923f8390 0x556b927bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923d76b0 0x556b927b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 --2- 172.21.15.135:0/1696929137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b92798f90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 -- 172.21.15.135:0/1696929137 >> 172.21.15.135:0/1696929137 conn(0x556b923ec4e0 msgr2=0x556b92798880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 -- 172.21.15.135:0/1696929137 shutdown_connections 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.717+0000 7ff6257ba740 1 -- 172.21.15.135:0/1696929137 wait complete. 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 -- start start 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 Processor -- start 2024-05-20T17:35:00.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b927aa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923d76b0 0x556b927aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181aaed0 con 0x556b923f8390 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181ac340 con 0x556b923cf4d0 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6181ab5a0 con 0x556b923d76b0 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff6257ba740 10 client.0 _ll_register_callbacks cb 0x7ff600009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60026/0 (socket says 172.21.15.135:60026) 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 -- 172.21.15.135:0/2085088188 learned_addr learned my addr 172.21.15.135:0/2085088188 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b927aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff617fff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923d76b0 0x556b927aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 -- 172.21.15.135:0/2085088188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923d76b0 msgr2=0x556b927aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923d76b0 0x556b927aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 -- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 msgr2=0x556b927aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b927aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.718+0000 7ff60ffff640 1 -- 172.21.15.135:0/2085088188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b9281e2c0 con 0x556b923f8390 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff60ffff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff6000057a0 tx=0x7ff600017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9699e5a949048585 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6000120b0 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff600012250 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff600005550 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff600010030 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 10 client.15984 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556b9281f520 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff600005550 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7ff600020900 con 0x556b923f8390 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 10 client.15984 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:00.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 20 client.15984 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b9238c3a0 0x556b92821a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 4 client.15984 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.719+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b927046c0 con 0x556b9238c3a0 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.720+0000 7ff617fff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b9238c3a0 0x556b92821a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.720+0000 7ff5f77fe640 10 client.15984 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.720+0000 7ff617fff640 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b9238c3a0 0x556b92821a00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9183e52e0e692a1a server_cookie=446e3792ae4d54a3 in_seq=0 out_seq=0 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff5f77fe640 1 -- 172.21.15.135:0/2085088188 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b927046c0 con 0x556b9238c3a0 2024-05-20T17:35:00.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff5f77fe640 10 client.15984 handle_command_reply: tid=0 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 client.15984 shutdown 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 msgr2=0x556b927ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff6000057a0 tx=0x7ff600017040 comp rx=0 tx=0).stop 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 shutdown_connections 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556b9238c3a0 0x556b92821a00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b923f8390 0x556b927ab190 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b923d76b0 0x556b927aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff5f77fe640 0 client.15984 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:00.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 --2- 172.21.15.135:0/2085088188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556b923cf4d0 0x556b927aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 >> 172.21.15.135:0/2085088188 conn(0x556b923ec4e0 msgr2=0x556b92796ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 shutdown_connections 2024-05-20T17:35:00.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.721+0000 7ff6257ba740 1 -- 172.21.15.135:0/2085088188 wait complete. 2024-05-20T17:35:00.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff6257ba740 20 client.15984 trim_cache size 0 max 16384 2024-05-20T17:35:00.735 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 msgr2=0x7ff6040a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 0x7ff6040a5210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff61000eb10 tx=0x7ff61006bfe0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 msgr2=0x7ff6181996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff61000eb40 tx=0x7ff61000c2d0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 shutdown_connections 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff6040a2d00 0x7ff6040a5210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618108ff0 0x7ff6181996b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff618108b50 0x7ff61819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 --2- 172.21.15.135:0/2046023393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff618101790 0x7ff61819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:00.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 >> 172.21.15.135:0/2046023393 conn(0x7ff618076830 msgr2=0x7ff6180ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:00.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 shutdown_connections 2024-05-20T17:35:00.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:00.722+0000 7ff61e910640 1 -- 172.21.15.135:0/2046023393 wait complete. 2024-05-20T17:35:00.754 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether gcc needs -traditional... no 2024-05-20T17:35:00.795 INFO:tasks.workunit.client.0.smithi135.stdout:checking for an ANSI C-conforming const... yes 2024-05-20T17:35:00.821 INFO:tasks.workunit.client.0.smithi135.stdout:checking for inline... inline 2024-05-20T17:35:00.884 INFO:tasks.workunit.client.0.smithi135.stdout:checking for working alloca.h... yes 2024-05-20T17:35:00.937 INFO:tasks.workunit.client.0.smithi135.stdout:checking for alloca... yes 2024-05-20T17:35:01.008 INFO:tasks.workunit.client.0.smithi135.stdout:checking for working memcmp... yes 2024-05-20T17:35:01.066 INFO:tasks.workunit.client.0.smithi135.stdout:checking for strftime... yes 2024-05-20T17:35:01.149 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-05-20T17:35:01.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:00 smithi135 ceph-mon[32027]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:35:01.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:00 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3796613348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:01.213 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether stat accepts an empty string... no 2024-05-20T17:35:01.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:00 smithi160 ceph-mon[36261]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:35:01.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:00 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3796613348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:01.270 INFO:tasks.workunit.client.0.smithi135.stdout:checking for vprintf... yes 2024-05-20T17:35:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:checking for _doprnt... no 2024-05-20T17:35:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:00 smithi172 ceph-mon[36511]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-20T17:35:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:00 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3796613348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-20T17:35:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-20T17:35:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:checking for the pthreads library -lpthreads... no 2024-05-20T17:35:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether pthreads work without any flags... yes 2024-05-20T17:35:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-05-20T17:35:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:checking if more special flags are required for pthreads... no 2024-05-20T17:35:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:checking for cc_r... gcc 2024-05-20T17:35:01.599 INFO:tasks.workunit.client.0.smithi135.stdout:checking for setrlimit... yes 2024-05-20T17:35:01.663 INFO:tasks.workunit.client.0.smithi135.stdout:checking for setproctitle... no 2024-05-20T17:35:01.722 INFO:tasks.workunit.client.0.smithi135.stdout:checking for getopt_long... yes 2024-05-20T17:35:01.739 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-20T17:35:01.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:35:01.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-20T17:35:01.790 INFO:tasks.workunit.client.0.smithi135.stdout:checking for strtoull... yes 2024-05-20T17:35:01.858 INFO:tasks.workunit.client.0.smithi135.stdout:checking for strtoq... yes 2024-05-20T17:35:01.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 -- 172.21.15.135:0/1153982597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae81079d0 msgr2=0x7f6ae8101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/1153982597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae81079d0 0x7f6ae8101560 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009900 tx=0x7f6ad802a410 comp rx=0 tx=0).stop 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 -- 172.21.15.135:0/1153982597 shutdown_connections 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/1153982597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae810c330 0x7f6ae810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/1153982597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/1153982597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae81079d0 0x7f6ae8101560 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 -- 172.21.15.135:0/1153982597 >> 172.21.15.135:0/1153982597 conn(0x7f6ae80770b0 msgr2=0x7f6ae80774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 -- 172.21.15.135:0/1153982597 shutdown_connections 2024-05-20T17:35:01.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.858+0000 7f6aec8f9640 1 -- 172.21.15.135:0/1153982597 wait complete. 2024-05-20T17:35:01.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 Processor -- start 2024-05-20T17:35:01.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 -- start start 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae81079d0 0x7f6ae8199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 0x7f6ae819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8111ce0 con 0x7f6ae8101aa0 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8111b60 con 0x7f6ae810c330 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.859+0000 7f6aec8f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8111e60 con 0x7f6ae81079d0 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60034/0 (socket says 172.21.15.135:60034) 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 -- 172.21.15.135:0/2211800776 learned_addr learned my addr 172.21.15.135:0/2211800776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 0x7f6ae819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6adffff640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae81079d0 0x7f6ae8199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 -- 172.21.15.135:0/2211800776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae81079d0 msgr2=0x7f6ae8199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae81079d0 0x7f6ae8199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 -- 172.21.15.135:0/2211800776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 msgr2=0x7f6ae819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 0x7f6ae819dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 -- 172.21.15.135:0/2211800776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae819e5f0 con 0x7f6ae8101aa0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 0x7f6ae819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6ae659c640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8005940 tx=0x7f6ad8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6adf7fe640 1 -- 172.21.15.135:0/2211800776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad803f030 con 0x7f6ae8101aa0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae819e880 con 0x7f6ae8101aa0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6adf7fe640 1 -- 172.21.15.135:0/2211800776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad8003ad0 con 0x7f6ae8101aa0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6adf7fe640 1 -- 172.21.15.135:0/2211800776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8035070 con 0x7f6ae8101aa0 2024-05-20T17:35:01.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.860+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae819edc0 con 0x7f6ae8101aa0 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6adf7fe640 1 -- 172.21.15.135:0/2211800776 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6ad8042030 con 0x7f6ae8101aa0 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 Processor -- start 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 -- start start 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c351990 con 0x55fa0c04d410 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c2f95b0 con 0x55fa0c02c730 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6af379c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c34d950 con 0x55fa0c024550 2024-05-20T17:35:01.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6ae6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6ae6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60044/0 (socket says 172.21.15.135:60044) 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.863+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/1713112567 learned_addr learned my addr 172.21.15.135:0/1713112567 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adffff640 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae659c640 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adf7fe640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 0x7f6ad40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/1713112567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 msgr2=0x55fa0c3eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/1713112567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 msgr2=0x55fa0c3ecf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3ecf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/1713112567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0c12d7e0 con 0x55fa0c04d410 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adf7fe640 1 -- 172.21.15.135:0/2211800776 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6ad80ef9e0 con 0x7f6ae8101aa0 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 0x7f6ad40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00108d0 tx=0x7f6ae0010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235339a64c8f4384 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adcff9640 1 -- 172.21.15.135:0/1713112567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000ee50 con 0x55fa0c04d410 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adcff9640 1 -- 172.21.15.135:0/1713112567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae001ddb0 con 0x55fa0c04d410 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.864+0000 7f6adcff9640 1 -- 172.21.15.135:0/1713112567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae001cc40 con 0x55fa0c04d410 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 -- 172.21.15.135:0/1713112567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 msgr2=0x55fa0c3ec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 0x7f6ad40a5210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0021000 tx=0x7f6ae001e000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00108d0 tx=0x7f6ae0010d90 comp rx=0 tx=0).stop 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 -- 172.21.15.135:0/1713112567 shutdown_connections 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 --2- 172.21.15.135:0/1713112567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c04d410 0x55fa0c3ec510 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 -- 172.21.15.135:0/1713112567 >> 172.21.15.135:0/1713112567 conn(0x55fa0c041560 msgr2=0x55fa0c3e8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 -- 172.21.15.135:0/1713112567 shutdown_connections 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.865+0000 7f6af379c740 1 -- 172.21.15.135:0/1713112567 wait complete. 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 -- start start 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 Processor -- start 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 0x55fa0c3fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c3fdd80 con 0x55fa0c02c730 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c30cb40 con 0x55fa0c04d410 2024-05-20T17:35:01.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa0c3fdf00 con 0x55fa0c024550 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6af379c740 10 client.0 _ll_register_callbacks cb 0x55fa0c3010f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6adffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6ae6d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 0x55fa0c3fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6adffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60056/0 (socket says 172.21.15.135:60056) 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.866+0000 7f6adffff640 1 -- 172.21.15.135:0/3935772534 learned_addr learned my addr 172.21.15.135:0/3935772534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae659c640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/3935772534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 msgr2=0x55fa0c3fcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3fcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/3935772534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 msgr2=0x55fa0c3fd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 -- 172.21.15.135:0/3935772534 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0c18df70 con 0x55fa0c04d410 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6adffff640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 0x55fa0c3fafa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000f010 tx=0x7f6ae001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc359571132072a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000ee50 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae001ddb0 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6ae0023040 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6ae001da60 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6af379c740 10 client.25640 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.867+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55fa0c025170 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae001ddb0 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6ae000f040 con 0x55fa0c04d410 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 10 client.25640 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 10 client.25640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 20 client.25640 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:01.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c00c1f0 0x55fa0c40d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 4 client.25640 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa0c35f0c0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6ae659c640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c00c1f0 0x55fa0c40d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6acdffb640 10 client.25640 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.868+0000 7f6ae659c640 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c00c1f0 0x55fa0c40d500 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=102e6c5a6eddf3e9 server_cookie=eda13e84b39da5af in_seq=0 out_seq=0 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6acdffb640 1 -- 172.21.15.135:0/3935772534 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fa0c35f0c0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6acdffb640 10 client.25640 handle_command_reply: tid=0 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 client.25640 shutdown 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 msgr2=0x55fa0c3fafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 0x55fa0c3fafa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000f010 tx=0x7f6ae001c960 comp rx=0 tx=0).stop 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 shutdown_connections 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c00c1f0 0x55fa0c40d500 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c04d410 0x55fa0c3fafa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c02c730 0x55fa0c3fd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6acdffb640 0 client.25640 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 --2- 172.21.15.135:0/3935772534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c3fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 >> 172.21.15.135:0/3935772534 conn(0x55fa0c041560 msgr2=0x55fa0c3ec3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 shutdown_connections 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.869+0000 7f6af379c740 1 -- 172.21.15.135:0/3935772534 wait complete. 2024-05-20T17:35:01.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.870+0000 7f6af379c740 20 client.25640 trim_cache size 0 max 16384 2024-05-20T17:35:01.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 Processor -- start 2024-05-20T17:35:01.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 -- start start 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c00c1f0 0x55fa0c3f4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3fa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81af210 con 0x55fa0c024550 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81acae0 con 0x55fa0c02c730 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6af379c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81aa950 con 0x55fa0c00c1f0 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6adffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6adffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60064/0 (socket says 172.21.15.135:60064) 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6adffff640 1 -- 172.21.15.135:0/2899521924 learned_addr learned my addr 172.21.15.135:0/2899521924 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3fa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.888+0000 7f6ae659c640 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c00c1f0 0x55fa0c3f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 -- 172.21.15.135:0/2899521924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c00c1f0 msgr2=0x55fa0c3f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c00c1f0 0x55fa0c3f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 -- 172.21.15.135:0/2899521924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 msgr2=0x55fa0c3fa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3fa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 -- 172.21.15.135:0/2899521924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0c3ed2a0 con 0x55fa0c024550 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6adffff640 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0012580 tx=0x7f6ad0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af150b3c60fda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6acffff640 1 -- 172.21.15.135:0/2899521924 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0022070 con 0x55fa0c024550 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6acffff640 1 -- 172.21.15.135:0/2899521924 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad00035f0 con 0x55fa0c024550 2024-05-20T17:35:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.889+0000 7f6acffff640 1 -- 172.21.15.135:0/2899521924 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000f740 con 0x55fa0c024550 2024-05-20T17:35:01.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- 172.21.15.135:0/2899521924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 msgr2=0x55fa0c3f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0012580 tx=0x7f6ad0005f90 comp rx=0 tx=0).stop 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- 172.21.15.135:0/2899521924 shutdown_connections 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c3fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c024550 0x55fa0c3f4da0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 --2- 172.21.15.135:0/2899521924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c00c1f0 0x55fa0c3f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- 172.21.15.135:0/2899521924 >> 172.21.15.135:0/2899521924 conn(0x55fa0c041560 msgr2=0x55fa0c3eeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- 172.21.15.135:0/2899521924 shutdown_connections 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- 172.21.15.135:0/2899521924 wait complete. 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 -- start start 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.890+0000 7f6af379c740 1 Processor -- start 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c400970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c400eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81aafa0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ac410 con 0x55fa0c02c730 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ab670 con 0x55fa0c024550 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6af379c740 10 client.0 _ll_register_callbacks cb 0x7f6ae0020020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60080/0 (socket says 172.21.15.135:60080) 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 -- 172.21.15.135:0/181187503 learned_addr learned my addr 172.21.15.135:0/181187503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6adffff640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c400970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c400eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 -- 172.21.15.135:0/181187503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 msgr2=0x55fa0c400970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c400970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 -- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 msgr2=0x55fa0c400eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c400eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae659c640 1 -- 172.21.15.135:0/181187503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0c4014f0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6ae6d9d640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c400eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.891+0000 7f6adffff640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c400970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6ae659c640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8031b80 tx=0x7f6ad803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e372a9e16c2e4f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8049070 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6ad8003c80 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad00035f0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6ad80bbfb0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 10 client.16002 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55fa0c475630 con 0x55fa0c00c1f0 2024-05-20T17:35:01.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad00035f0 con 0x55fa0c00c1f0 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6ad803bc00 con 0x55fa0c00c1f0 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 10 client.16002 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 20 client.16002 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c04d410 0x55fa0c477d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 4 client.16002 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa0c359410 con 0x55fa0c04d410 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.892+0000 7f6adffff640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c04d410 0x55fa0c477d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.893+0000 7f6acdffb640 10 client.16002 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.893+0000 7f6adffff640 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c04d410 0x55fa0c477d40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a37d67e06e8d3be server_cookie=2be6a74cb84931f1 in_seq=0 out_seq=0 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6acdffb640 1 -- 172.21.15.135:0/181187503 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa0c359410 con 0x55fa0c04d410 2024-05-20T17:35:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6acdffb640 10 client.16002 handle_command_reply: tid=0 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 client.16002 shutdown 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 msgr2=0x55fa0c403600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8031b80 tx=0x7f6ad803d000 comp rx=0 tx=0).stop 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 shutdown_connections 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fa0c04d410 0x55fa0c477d40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa0c02c730 0x55fa0c400eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa0c024550 0x55fa0c400970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 --2- 172.21.15.135:0/181187503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fa0c00c1f0 0x55fa0c403600 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6acdffb640 0 client.16002 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 >> 172.21.15.135:0/181187503 conn(0x55fa0c041560 msgr2=0x55fa0c3f3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 shutdown_connections 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 1 -- 172.21.15.135:0/181187503 wait complete. 2024-05-20T17:35:01.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.895+0000 7f6af379c740 20 client.16002 trim_cache size 0 max 16384 2024-05-20T17:35:01.902 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:35:01.902 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-05-20T17:35:01.902 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "e255c49b-a946-4e14-aca8-9409d9dfa575", 2024-05-20T17:35:01.902 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-05-20T17:35:01.902 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 msgr2=0x7f6ad40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 0x7f6ad40a5210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0021000 tx=0x7f6ae001e000 comp rx=0 tx=0).stop 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 msgr2=0x7f6ae8199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8005940 tx=0x7f6ad8004270 comp rx=0 tx=0).stop 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 shutdown_connections 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6ad40a2d00 0x7f6ad40a5210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae810c330 0x7f6ae819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae81079d0 0x7f6ae8199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 --2- 172.21.15.135:0/2211800776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8101aa0 0x7f6ae8199790 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:01.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 >> 172.21.15.135:0/2211800776 conn(0x7f6ae80770b0 msgr2=0x7f6ae80fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:01.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 shutdown_connections 2024-05-20T17:35:01.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:01.896+0000 7f6aec8f9640 1 -- 172.21.15.135:0/2211800776 wait complete. 2024-05-20T17:35:01.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:35:01.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:35:01.922 INFO:tasks.workunit.client.0.smithi135.stdout:checking for snprintf... yes 2024-05-20T17:35:02.025 INFO:tasks.workunit.client.0.smithi135.stdout:checking for vsnprintf... yes 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 -- 172.21.15.135:0/3328251088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec1079d0 msgr2=0x7f26ec101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 --2- 172.21.15.135:0/3328251088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec1079d0 0x7f26ec101560 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009900 tx=0x7f26dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 -- 172.21.15.135:0/3328251088 shutdown_connections 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 --2- 172.21.15.135:0/3328251088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec10c330 0x7f26ec10e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 --2- 172.21.15.135:0/3328251088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec101aa0 0x7f26ec101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 --2- 172.21.15.135:0/3328251088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec1079d0 0x7f26ec101560 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 -- 172.21.15.135:0/3328251088 >> 172.21.15.135:0/3328251088 conn(0x7f26ec0770b0 msgr2=0x7f26ec0774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 -- 172.21.15.135:0/3328251088 shutdown_connections 2024-05-20T17:35:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.046+0000 7f26f22e2640 1 -- 172.21.15.135:0/3328251088 wait complete. 2024-05-20T17:35:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 Processor -- start 2024-05-20T17:35:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 -- start start 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 0x7f26ec1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 0x7f26ec198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111ce0 con 0x7f26ec10c330 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111b60 con 0x7f26ec101aa0 2024-05-20T17:35:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f22e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111e60 con 0x7f26ec1079d0 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60110/0 (socket says 172.21.15.135:60110) 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26f087f640 1 -- 172.21.15.135:0/2081995715 learned_addr learned my addr 172.21.15.135:0/2081995715 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.047+0000 7f26ebfff640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 0x7f26ec1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 0x7f26ec198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 -- 172.21.15.135:0/2081995715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 msgr2=0x7f26ec198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 0x7f26ec198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 -- 172.21.15.135:0/2081995715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 msgr2=0x7f26ec1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 0x7f26ec1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 -- 172.21.15.135:0/2081995715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec19d500 con 0x7f26ec10c330 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 0x7f26ec198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26ebfff640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 0x7f26ec1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f087f640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26e400eca0 tx=0x7f26e400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26e97fa640 1 -- 172.21.15.135:0/2081995715 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4004b20 con 0x7f26ec10c330 2024-05-20T17:35:02.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26e97fa640 1 -- 172.21.15.135:0/2081995715 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e4004cc0 con 0x7f26ec10c330 2024-05-20T17:35:02.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec19d7f0 con 0x7f26ec10c330 2024-05-20T17:35:02.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26e97fa640 1 -- 172.21.15.135:0/2081995715 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4017650 con 0x7f26ec10c330 2024-05-20T17:35:02.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.048+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec19dcf0 con 0x7f26ec10c330 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.050+0000 7f26e97fa640 1 -- 172.21.15.135:0/2081995715 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f26e4005020 con 0x7f26ec10c330 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 Processor -- start 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 -- start start 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26e97fa640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 0x7f26d40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 0x7f26d40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fe55207d00 con 0x55fe54ee26b0 2024-05-20T17:35:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fe551af4c0 con 0x55fe54eda4d0 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f9186740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe55203cc0 con 0x55fe54f03390 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26e97fa640 1 -- 172.21.15.135:0/2081995715 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f26e40d0f30 con 0x7f26ec10c330 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26eb7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26eb7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:33168/0 (socket says 172.21.15.135:33168) 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26eb7fe640 1 -- 172.21.15.135:0/909597259 learned_addr learned my addr 172.21.15.135:0/909597259 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.051+0000 7f26ebfff640 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 -- 172.21.15.135:0/909597259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 msgr2=0x55fe552a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 -- 172.21.15.135:0/909597259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 msgr2=0x55fe552a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 -- 172.21.15.135:0/909597259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe54fe57d0 con 0x55fe54ee26b0 2024-05-20T17:35:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 0x7f26d40a5210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009fd0 tx=0x7f26e0009b20 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26f087f640 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552a27b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ce680 tx=0x7f26e409d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678c190d9f52d8dc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26d27fc640 1 -- 172.21.15.135:0/909597259 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b6070 con 0x55fe54ee26b0 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26d27fc640 1 -- 172.21.15.135:0/909597259 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e409d450 con 0x55fe54ee26b0 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.052+0000 7f26d27fc640 1 -- 172.21.15.135:0/909597259 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b6210 con 0x55fe54ee26b0 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- 172.21.15.135:0/909597259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 msgr2=0x55fe552a27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552a27b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ce680 tx=0x7f26e409d2e0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- 172.21.15.135:0/909597259 shutdown_connections 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552a27b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 --2- 172.21.15.135:0/909597259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- 172.21.15.135:0/909597259 >> 172.21.15.135:0/909597259 conn(0x55fe54ef74e0 msgr2=0x55fe5529e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- 172.21.15.135:0/909597259 shutdown_connections 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- 172.21.15.135:0/909597259 wait complete. 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.053+0000 7f26f9186740 1 -- start start 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 Processor -- start 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552ade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54ee26b0 0x55fe552ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fe552af020 con 0x55fe54f03390 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fe551c2b90 con 0x55fe54eda4d0 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe552af1a0 con 0x55fe54ee26b0 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f9186740 10 client.0 _ll_register_callbacks cb 0x55fe551feda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60116/0 (socket says 172.21.15.135:60116) 2024-05-20T17:35:02.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 -- 172.21.15.135:0/903622797 learned_addr learned my addr 172.21.15.135:0/903622797 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54ee26b0 0x55fe552ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 -- 172.21.15.135:0/903622797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54ee26b0 msgr2=0x55fe552ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54ee26b0 0x55fe552ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 -- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 msgr2=0x55fe552ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.054+0000 7f26f087f640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f087f640 1 -- 172.21.15.135:0/903622797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe54f1b3f0 con 0x55fe54f03390 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26ebfff640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f087f640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ce6e0 tx=0x7f26e4005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3490b816c009b4de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b6040 con 0x55fe54f03390 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f26e409b750 con 0x55fe54f03390 2024-05-20T17:35:02.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26e409d450 con 0x55fe54f03390 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f26e40a1800 con 0x55fe54f03390 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 10 client.16014 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55fe54edb0f0 con 0x55fe54f03390 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e409d450 con 0x55fe54f03390 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f26e409c9a0 con 0x55fe54f03390 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 10 client.16014 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 20 client.16014 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54ec1f60 0x55fe552beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 4 client.16014 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.055+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe55215430 con 0x55fe54ec1f60 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.056+0000 7f26ebfff640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54ec1f60 0x55fe552beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.056+0000 7f26cb7fe640 10 client.16014 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.056+0000 7f26ebfff640 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54ec1f60 0x55fe552beaa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d99296cfe78f77ca server_cookie=787e5f33ff40e4df in_seq=0 out_seq=0 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.057+0000 7f26cb7fe640 1 -- 172.21.15.135:0/903622797 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe55215430 con 0x55fe54ec1f60 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.057+0000 7f26cb7fe640 10 client.16014 handle_command_reply: tid=0 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.057+0000 7f26f9186740 1 client.16014 shutdown 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.057+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 msgr2=0x55fe552ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ce6e0 tx=0x7f26e4005860 comp rx=0 tx=0).stop 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 shutdown_connections 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54ec1f60 0x55fe552beaa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552ac370 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54ee26b0 0x55fe552ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26cb7fe640 0 client.16014 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:02.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 --2- 172.21.15.135:0/903622797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 >> 172.21.15.135:0/903622797 conn(0x55fe54ef74e0 msgr2=0x55fe552a3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 shutdown_connections 2024-05-20T17:35:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 1 -- 172.21.15.135:0/903622797 wait complete. 2024-05-20T17:35:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.058+0000 7f26f9186740 20 client.16014 trim_cache size 0 max 16384 2024-05-20T17:35:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 Processor -- start 2024-05-20T17:35:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 -- start start 2024-05-20T17:35:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 0x55fe552ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 0x55fe5529e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.075+0000 7f26f9186740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1af0f0 con 0x55fe54f03390 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f9186740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1ac9c0 con 0x55fe54ee26b0 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f9186740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1aa810 con 0x55fe54eda4d0 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60130/0 (socket says 172.21.15.135:60130) 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 -- 172.21.15.135:0/3013233401 learned_addr learned my addr 172.21.15.135:0/3013233401 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 0x55fe5529e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 0x55fe552ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 -- 172.21.15.135:0/3013233401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 msgr2=0x55fe552ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 0x55fe552ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 -- 172.21.15.135:0/3013233401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 msgr2=0x55fe5529e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 0x55fe5529e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 -- 172.21.15.135:0/3013233401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe552a30a0 con 0x55fe54f03390 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 0x55fe552ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 0x55fe5529e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26f087f640 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26e400bb90 tx=0x7f26e40ce730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e6bba1eeb87bd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26d1ffb640 1 -- 172.21.15.135:0/3013233401 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b6040 con 0x55fe54f03390 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26d1ffb640 1 -- 172.21.15.135:0/3013233401 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e409d450 con 0x55fe54f03390 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.076+0000 7f26d1ffb640 1 -- 172.21.15.135:0/3013233401 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e409c930 con 0x55fe54f03390 2024-05-20T17:35:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- 172.21.15.135:0/3013233401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 msgr2=0x55fe552a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26e400bb90 tx=0x7f26e40ce730 comp rx=0 tx=0).stop 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- 172.21.15.135:0/3013233401 shutdown_connections 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54f03390 0x55fe552a7550 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54ee26b0 0x55fe5529e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 --2- 172.21.15.135:0/3013233401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54eda4d0 0x55fe552ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- 172.21.15.135:0/3013233401 >> 172.21.15.135:0/3013233401 conn(0x55fe54ef74e0 msgr2=0x55fe5529dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- 172.21.15.135:0/3013233401 shutdown_connections 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- 172.21.15.135:0/3013233401 wait complete. 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.077+0000 7f26f9186740 1 -- start start 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 Processor -- start 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552bee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1aae80 con 0x55fe54ee26b0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1ac2f0 con 0x55fe54eda4d0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec1ab550 con 0x55fe54f03390 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f9186740 10 client.0 _ll_register_callbacks cb 0x7f26e40b4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60146/0 (socket says 172.21.15.135:60146) 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 -- 172.21.15.135:0/1549958361 learned_addr learned my addr 172.21.15.135:0/1549958361 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26f087f640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 -- 172.21.15.135:0/1549958361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 msgr2=0x55fe552bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 -- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 msgr2=0x55fe552c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 -- 172.21.15.135:0/1549958361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe552b9460 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55fe5529f820 tx=0x7f26e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e471989129ec0960 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.078+0000 7f26cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0005020 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f26e00051c0 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26e409d450 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f26e00053c0 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 10 client.16020 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55fe55326380 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e409d450 con 0x55fe54ee26b0 2024-05-20T17:35:02.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f26e001f070 con 0x55fe54ee26b0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 10 client.16020 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 20 client.16020 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54e973a0 0x55fe55328b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 4 client.16020 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe552ad300 con 0x55fe54e973a0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.079+0000 7f26ebfff640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54e973a0 0x55fe55328b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.080+0000 7f26cb7fe640 10 client.16020 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.080+0000 7f26ebfff640 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54e973a0 0x55fe55328b90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d398f020ed19b613 server_cookie=a61881f90d9ab48a in_seq=0 out_seq=0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26cb7fe640 1 -- 172.21.15.135:0/1549958361 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fe552ad300 con 0x55fe54e973a0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26cb7fe640 10 client.16020 handle_command_reply: tid=0 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 client.16020 shutdown 2024-05-20T17:35:02.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 msgr2=0x55fe552c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55fe5529f820 tx=0x7f26e0004730 comp rx=0 tx=0).stop 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 shutdown_connections 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fe54e973a0 0x55fe55328b90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe54f03390 0x55fe552bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe54ee26b0 0x55fe552c1e90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 --2- 172.21.15.135:0/1549958361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe54eda4d0 0x55fe552c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26cb7fe640 0 client.16020 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.081+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 >> 172.21.15.135:0/1549958361 conn(0x55fe54ef74e0 msgr2=0x55fe552a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 shutdown_connections 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f9186740 1 -- 172.21.15.135:0/1549958361 wait complete. 2024-05-20T17:35:02.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f9186740 20 client.16020 trim_cache size 0 max 16384 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "e255c49b-a946-4e14-aca8-9409d9dfa575": { 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "e255c49b-a946-4e14-aca8-9409d9dfa575", 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:35:02.094 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 msgr2=0x7f26d40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 0x7f26d40a5210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009fd0 tx=0x7f26e0009b20 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 msgr2=0x7f26ec19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26e400eca0 tx=0x7f26e400b690 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 shutdown_connections 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f26d40a2d00 0x7f26d40a5210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec10c330 0x7f26ec19cec0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ec1079d0 0x7f26ec198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 --2- 172.21.15.135:0/2081995715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec101aa0 0x7f26ec1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:02.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 >> 172.21.15.135:0/2081995715 conn(0x7f26ec0770b0 msgr2=0x7f26ec103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:02.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 shutdown_connections 2024-05-20T17:35:02.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:02.082+0000 7f26f22e2640 1 -- 172.21.15.135:0/2081995715 wait complete. 2024-05-20T17:35:02.097 INFO:tasks.cephfs.filesystem:scrub status for tag:e255c49b-a946-4e14-aca8-9409d9dfa575 - {'path': '/', 'tag': 'e255c49b-a946-4e14-aca8-9409d9dfa575', 'options': 'recursive,force'} 2024-05-20T17:35:02.153 INFO:tasks.workunit.client.0.smithi135.stdout:checking for vfprintf... yes 2024-05-20T17:35:02.215 INFO:tasks.workunit.client.0.smithi135.stdout:checking for gethostname... yes 2024-05-20T17:35:02.278 INFO:tasks.workunit.client.0.smithi135.stdout:checking for setlocale... yes 2024-05-20T17:35:02.341 INFO:tasks.workunit.client.0.smithi135.stdout:checking for sync... yes 2024-05-20T17:35:02.407 INFO:tasks.workunit.client.0.smithi135.stdout:checking whether snprintf is C99 conformant... done 2024-05-20T17:35:02.417 INFO:tasks.workunit.client.0.smithi135.stdout:configure: creating ./config.status 2024-05-20T17:35:02.574 INFO:tasks.workunit.client.0.smithi135.stdout:config.status: creating Makefile 2024-05-20T17:35:02.591 INFO:tasks.workunit.client.0.smithi135.stdout:config.status: creating src/Makefile 2024-05-20T17:35:02.611 INFO:tasks.workunit.client.0.smithi135.stdout:config.status: creating man/Makefile 2024-05-20T17:35:02.624 INFO:tasks.workunit.client.0.smithi135.stdout:config.status: creating config.h 2024-05-20T17:35:02.679 INFO:tasks.workunit.client.0.smithi135.stdout:config.status: executing depfiles commands 2024-05-20T17:35:02.812 INFO:tasks.workunit.client.0.smithi135.stderr:+ make 2024-05-20T17:35:02.824 INFO:tasks.workunit.client.0.smithi135.stdout:make all-recursive 2024-05-20T17:35:02.826 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-20T17:35:02.828 INFO:tasks.workunit.client.0.smithi135.stdout:Making all in src 2024-05-20T17:35:02.835 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-05-20T17:35:02.835 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-05-20T17:35:02.835 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-05-20T17:35:02.936 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-05-20T17:35:02.936 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-05-20T17:35:03.025 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-05-20T17:35:03.025 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-05-20T17:35:03.078 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-05-20T17:35:03.078 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-05-20T17:35:03.128 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-05-20T17:35:03.128 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-05-20T17:35:03.177 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-05-20T17:35:03.177 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: pgmap v54: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: scrub queued for path: / 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:02 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:35:03.224 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-05-20T17:35:03.224 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-05-20T17:35:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: pgmap v54: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-05-20T17:35:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: scrub queued for path: / 2024-05-20T17:35:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:03.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:02 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:35:03.299 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-05-20T17:35:03.299 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: pgmap v54: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: scrub queued for path: / 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:02 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:35:03.334 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-05-20T17:35:03.335 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-05-20T17:35:03.370 INFO:tasks.workunit.client.0.smithi135.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-05-20T17:35:03.371 INFO:tasks.workunit.client.0.smithi135.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-05-20T17:35:03.409 INFO:tasks.workunit.client.0.smithi135.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-05-20T17:35:03.428 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-05-20T17:35:03.428 INFO:tasks.workunit.client.0.smithi135.stdout:Making all in man 2024-05-20T17:35:03.471 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-05-20T17:35:03.472 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Nothing to be done for 'all'. 2024-05-20T17:35:03.472 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-05-20T17:35:03.473 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-20T17:35:03.474 INFO:tasks.workunit.client.0.smithi135.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-20T17:35:03.474 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-20T17:35:03.475 INFO:tasks.workunit.client.0.smithi135.stderr:+ cd src 2024-05-20T17:35:03.475 INFO:tasks.workunit.client.0.smithi135.stderr:+ mkdir blogtest_in 2024-05-20T17:35:03.476 INFO:tasks.workunit.client.0.smithi135.stdout:running blogbench 2024-05-20T17:35:03.477 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'running blogbench' 2024-05-20T17:35:03.477 INFO:tasks.workunit.client.0.smithi135.stderr:+ ./blogbench -d blogtest_in 2024-05-20T17:35:03.477 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-20T17:35:03.477 INFO:tasks.workunit.client.0.smithi135.stdout:Frequency = 10 secs 2024-05-20T17:35:03.477 INFO:tasks.workunit.client.0.smithi135.stdout:Scratch dir = [blogtest_in] 2024-05-20T17:35:05.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:05 smithi172 ceph-mon[36511]: pgmap v55: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 173 KiB/s wr, 51 op/s 2024-05-20T17:35:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:05 smithi135 ceph-mon[32027]: pgmap v55: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 173 KiB/s wr, 51 op/s 2024-05-20T17:35:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:05 smithi160 ceph-mon[36261]: pgmap v55: 97 pgs: 97 active+clean; 3.0 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 173 KiB/s wr, 51 op/s 2024-05-20T17:35:05.604 INFO:tasks.workunit.client.0.smithi135.stdout:Spawning 3 writers... 2024-05-20T17:35:05.605 INFO:tasks.workunit.client.0.smithi135.stdout:Spawning 1 rewriters... 2024-05-20T17:35:05.605 INFO:tasks.workunit.client.0.smithi135.stdout:Spawning 5 commenters... 2024-05-20T17:35:05.605 INFO:tasks.workunit.client.0.smithi135.stdout:Spawning 100 readers... 2024-05-20T17:35:05.607 INFO:tasks.workunit.client.0.smithi135.stdout:Benchmarking for 30 iterations. 2024-05-20T17:35:05.607 INFO:tasks.workunit.client.0.smithi135.stdout:The test will run during 5 minutes. 2024-05-20T17:35:05.607 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-20T17:35:05.607 INFO:tasks.workunit.client.0.smithi135.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-05-20T17:35:07.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:07 smithi172 ceph-mon[36511]: pgmap v56: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 495 KiB/s wr, 106 op/s 2024-05-20T17:35:07.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:07 smithi135 ceph-mon[32027]: pgmap v56: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 495 KiB/s wr, 106 op/s 2024-05-20T17:35:07.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:07 smithi160 ceph-mon[36261]: pgmap v56: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 495 KiB/s wr, 106 op/s 2024-05-20T17:35:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:09 smithi172 ceph-mon[36511]: pgmap v57: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:09.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:09 smithi135 ceph-mon[32027]: pgmap v57: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:09 smithi160 ceph-mon[36261]: pgmap v57: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:11 smithi135 ceph-mon[32027]: pgmap v58: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:11 smithi160 ceph-mon[36261]: pgmap v58: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:11.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:11 smithi172 ceph-mon[36511]: pgmap v58: 97 pgs: 97 active+clean; 5.9 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 495 KiB/s wr, 103 op/s 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 -- 172.21.15.135:0/3312792218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410ad30 msgr2=0x7f6fb41048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/3312792218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410ad30 0x7f6fb41048d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009900 tx=0x7f6fa802a410 comp rx=0 tx=0).stop 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 -- 172.21.15.135:0/3312792218 shutdown_connections 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/3312792218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb4105480 0x7f6fb4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/3312792218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb410b1d0 0x7f6fb4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/3312792218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410ad30 0x7f6fb41048d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 -- 172.21.15.135:0/3312792218 >> 172.21.15.135:0/3312792218 conn(0x7f6fb41003b0 msgr2=0x7f6fb4102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 -- 172.21.15.135:0/3312792218 shutdown_connections 2024-05-20T17:35:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.215+0000 7f6fbabb5640 1 -- 172.21.15.135:0/3312792218 wait complete. 2024-05-20T17:35:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 Processor -- start 2024-05-20T17:35:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 -- start start 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 0x7f6fb41a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb410ad30 0x7f6fb41a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4115080 con 0x7f6fb410b1d0 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4114f00 con 0x7f6fb4105480 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fbabb5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4115200 con 0x7f6fb410ad30 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38180/0 (socket says 172.21.15.135:38180) 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 -- 172.21.15.135:0/1483987506 learned_addr learned my addr 172.21.15.135:0/1483987506 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb8951640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 0x7f6fb41a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb410ad30 0x7f6fb41a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 -- 172.21.15.135:0/1483987506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb410ad30 msgr2=0x7f6fb41a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb410ad30 0x7f6fb41a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 -- 172.21.15.135:0/1483987506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 msgr2=0x7f6fb41a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 0x7f6fb41a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb9152640 1 -- 172.21.15.135:0/1483987506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb419bf80 con 0x7f6fb410b1d0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.216+0000 7f6fb8951640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 0x7f6fb41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fb9152640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00eaa0 tx=0x7f6fac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fb1ffb640 1 -- 172.21.15.135:0/1483987506 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00cdb0 con 0x7f6fb410b1d0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fb1ffb640 1 -- 172.21.15.135:0/1483987506 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fac005020 con 0x7f6fb410b1d0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fb1ffb640 1 -- 172.21.15.135:0/1483987506 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0116b0 con 0x7f6fb410b1d0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb419c270 con 0x7f6fb410b1d0 2024-05-20T17:35:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.217+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb41a8550 con 0x7f6fb410b1d0 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb1ffb640 1 -- 172.21.15.135:0/1483987506 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6fac005560 con 0x7f6fb410b1d0 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 Processor -- start 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 -- start start 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b2f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b2f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d7b258340 con 0x557d7af541b0 2024-05-20T17:35:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557d7b200290 con 0x557d7af334d0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557d7b254300 con 0x557d7af2b2f0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb1ffb640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 0x7f6fa40a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38184/0 (socket says 172.21.15.135:38184) 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb3fff640 1 -- 172.21.15.135:0/438366182 learned_addr learned my addr 172.21.15.135:0/438366182 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b2f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.220+0000 7f6fb9152640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 0x7f6fa40a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb8951640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b2f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb1ffb640 1 -- 172.21.15.135:0/1483987506 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6fac0cf620 con 0x7f6fb410b1d0 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 -- 172.21.15.135:0/438366182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 msgr2=0x557d7b2f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b2f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 -- 172.21.15.135:0/438366182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 msgr2=0x557d7b2f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b2f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 -- 172.21.15.135:0/438366182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7b2248e0 con 0x557d7af541b0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb8951640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b2f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb9152640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 0x7f6fa40a5280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0cce20 tx=0x7f6fac070040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00135d0 tx=0x7f6fa00095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5977c690a73cfb49 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6f9effd640 1 -- 172.21.15.135:0/438366182 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0004030 con 0x557d7af541b0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6f9effd640 1 -- 172.21.15.135:0/438366182 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa0005500 con 0x557d7af541b0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.221+0000 7f6f9effd640 1 -- 172.21.15.135:0/438366182 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0004d20 con 0x557d7af541b0 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/438366182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 msgr2=0x557d7b2f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00135d0 tx=0x7f6fa00095d0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/438366182 shutdown_connections 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b2f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b2f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/438366182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af541b0 0x557d7b2f3080 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/438366182 >> 172.21.15.135:0/438366182 conn(0x557d7af48300 msgr2=0x557d7b2ef830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/438366182 shutdown_connections 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/438366182 wait complete. 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 -- start start 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.222+0000 7f6fc1a5e740 1 Processor -- start 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 0x557d7b2ff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af541b0 0x557d7b2fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d7b300150 con 0x557d7af334d0 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557d7b213790 con 0x557d7af2b2f0 2024-05-20T17:35:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557d7b3002d0 con 0x557d7af541b0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fc1a5e740 10 client.0 _ll_register_callbacks cb 0x557d7b24ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38186/0 (socket says 172.21.15.135:38186) 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb8951640 1 -- 172.21.15.135:0/3507835846 learned_addr learned my addr 172.21.15.135:0/3507835846 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 0x557d7b2ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af541b0 0x557d7b2fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 -- 172.21.15.135:0/3507835846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af541b0 msgr2=0x557d7b2fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af541b0 0x557d7b2fd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 -- 172.21.15.135:0/3507835846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 msgr2=0x557d7b2ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb3fff640 1 -- 172.21.15.135:0/3507835846 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7af6c210 con 0x557d7af2b2f0 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.223+0000 7f6fb8951640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 0x557d7b2ff170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00135d0 tx=0x7f6fa0015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b54ecfb9bdf077 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0028030 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fa0005500 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6fa0013020 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6fa0013220 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 10 client.25676 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557d7b038620 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa0005500 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6fa00214d0 con 0x557d7af2b2f0 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 10 client.25676 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 20 client.25676 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af12d80 0x557d7b30f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 4 client.25676 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.224+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d7b265a70 con 0x557d7af12d80 2024-05-20T17:35:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.225+0000 7f6fb8951640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af12d80 0x557d7b30f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.225+0000 7f6f93fff640 10 client.25676 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.225+0000 7f6fb8951640 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af12d80 0x557d7b30f7f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f0484f2a7a8e7 server_cookie=cb4866044f24ea29 in_seq=0 out_seq=0 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6f93fff640 1 -- 172.21.15.135:0/3507835846 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557d7b265a70 con 0x557d7af12d80 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6f93fff640 10 client.25676 handle_command_reply: tid=0 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 client.25676 shutdown 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 msgr2=0x557d7b2ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 0x557d7b2ff170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00135d0 tx=0x7f6fa0015040 comp rx=0 tx=0).stop 2024-05-20T17:35:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 shutdown_connections 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af12d80 0x557d7b30f7f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af541b0 0x557d7b2fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6f93fff640 0 client.25676 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b2ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/3507835846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af2b2f0 0x557d7b2ff170 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 >> 172.21.15.135:0/3507835846 conn(0x557d7af48300 msgr2=0x557d7b2f2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 shutdown_connections 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/3507835846 wait complete. 2024-05-20T17:35:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.228+0000 7f6fc1a5e740 20 client.25676 trim_cache size 0 max 16384 2024-05-20T17:35:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 Processor -- start 2024-05-20T17:35:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 -- start start 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b314d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b3152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41b3620 con 0x557d7af334d0 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41b0ef0 con 0x557d7af12d80 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41aed40 con 0x557d7af2b2f0 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b3152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41266/0 (socket says 172.21.15.135:41266) 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.243+0000 7f6fb3fff640 1 -- 172.21.15.135:0/2866632342 learned_addr learned my addr 172.21.15.135:0/2866632342 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb8951640 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b314d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 -- 172.21.15.135:0/2866632342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 msgr2=0x557d7b314d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b314d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 -- 172.21.15.135:0/2866632342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 msgr2=0x557d7b3152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b3152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 -- 172.21.15.135:0/2866632342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7b2ffd70 con 0x557d7af12d80 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0021970 tx=0x7f6fa0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d968ac79689dc69 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6f9e7fc640 1 -- 172.21.15.135:0/2866632342 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0028040 con 0x557d7af12d80 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6f9e7fc640 1 -- 172.21.15.135:0/2866632342 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa0026070 con 0x557d7af12d80 2024-05-20T17:35:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.244+0000 7f6f9e7fc640 1 -- 172.21.15.135:0/2866632342 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000f480 con 0x557d7af12d80 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/2866632342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 msgr2=0x557d7b2fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0021970 tx=0x7f6fa0000bc0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/2866632342 shutdown_connections 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af334d0 0x557d7b3152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af2b2f0 0x557d7b314d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/2866632342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af12d80 0x557d7b2fd590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/2866632342 >> 172.21.15.135:0/2866632342 conn(0x557d7af48300 msgr2=0x557d7b2fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/2866632342 shutdown_connections 2024-05-20T17:35:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/2866632342 wait complete. 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.245+0000 7f6fc1a5e740 1 -- start start 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 Processor -- start 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af12d80 0x557d7b3041c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b304c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41af3b0 con 0x557d7af2b2f0 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41b0820 con 0x557d7af334d0 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb41afa80 con 0x557d7af12d80 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fc1a5e740 10 client.0 _ll_register_callbacks cb 0x7f6fa0009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38200/0 (socket says 172.21.15.135:38200) 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 -- 172.21.15.135:0/171700202 learned_addr learned my addr 172.21.15.135:0/171700202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b304c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af12d80 0x557d7b3041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 -- 172.21.15.135:0/171700202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af12d80 msgr2=0x557d7b3041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af12d80 0x557d7b3041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 -- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 msgr2=0x557d7b304c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b304c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb8951640 1 -- 172.21.15.135:0/171700202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7b375980 con 0x557d7af2b2f0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.246+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b304c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fb8951640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005940 tx=0x7f6fa80041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ce034c5740eaf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8035040 con 0x557d7af2b2f0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fa0026070 con 0x557d7af2b2f0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6fa8005230 con 0x557d7af2b2f0 2024-05-20T17:35:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6fa8054050 con 0x557d7af2b2f0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 10 client.16038 fetch_fsmap learned FSMap version 22 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557d7b376c10 con 0x557d7af2b2f0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa0026070 con 0x557d7af2b2f0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6fa80464a0 con 0x557d7af2b2f0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 10 client.16038 fetch_fsmap finished waiting for FSMap version 22 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 20 client.16038 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af541b0 0x557d7b379470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 4 client.16038 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d7b25fdc0 con 0x557d7af541b0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.247+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af541b0 0x557d7b379470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.248+0000 7f6f93fff640 10 client.16038 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:12.248+0000 7f6fb3fff640 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af541b0 0x557d7b379470 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f890e6160363f3 server_cookie=13baaaedb96d88b0 in_seq=0 out_seq=0 2024-05-20T17:35:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:13 smithi135 ceph-mon[32027]: pgmap v59: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 2.5 MiB/s wr, 189 op/s 2024-05-20T17:35:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:13 smithi160 ceph-mon[36261]: pgmap v59: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 2.5 MiB/s wr, 189 op/s 2024-05-20T17:35:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:13 smithi172 ceph-mon[36511]: pgmap v59: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 2.5 MiB/s wr, 189 op/s 2024-05-20T17:35:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6f93fff640 1 -- 172.21.15.135:0/171700202 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d7b25fdc0 con 0x557d7af541b0 2024-05-20T17:35:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6f93fff640 10 client.16038 handle_command_reply: tid=0 2024-05-20T17:35:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 client.16038 shutdown 2024-05-20T17:35:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 msgr2=0x557d7b304700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005940 tx=0x7f6fa80041a0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 shutdown_connections 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x557d7af541b0 0x557d7b379470 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557d7af334d0 0x557d7b304c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d7af2b2f0 0x557d7b304700 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6f93fff640 0 client.16038 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 --2- 172.21.15.135:0/171700202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557d7af12d80 0x557d7b3041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 >> 172.21.15.135:0/171700202 conn(0x557d7af48300 msgr2=0x557d7b2f6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 shutdown_connections 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.094+0000 7f6fc1a5e740 1 -- 172.21.15.135:0/171700202 wait complete. 2024-05-20T17:35:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.095+0000 7f6fc1a5e740 20 client.16038 trim_cache size 0 max 16384 2024-05-20T17:35:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:35:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:35:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:35:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:35:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.099+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 msgr2=0x7f6fa40a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.099+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 0x7f6fa40a5280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0cce20 tx=0x7f6fac070040 comp rx=0 tx=0).stop 2024-05-20T17:35:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.099+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 msgr2=0x7f6fb419b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.099+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00eaa0 tx=0x7f6fac00ef60 comp rx=0 tx=0).stop 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 shutdown_connections 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6fa40a2d70 0x7f6fa40a5280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb410b1d0 0x7f6fb419b8e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb410ad30 0x7f6fb41a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 --2- 172.21.15.135:0/1483987506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4105480 0x7f6fb41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.102+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 >> 172.21.15.135:0/1483987506 conn(0x7f6fb41003b0 msgr2=0x7f6fb41108d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.103+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 shutdown_connections 2024-05-20T17:35:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:15.103+0000 7f6fbabb5640 1 -- 172.21.15.135:0/1483987506 wait complete. 2024-05-20T17:35:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:15 smithi135 ceph-mon[32027]: pgmap v60: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-05-20T17:35:15.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:15 smithi160 ceph-mon[36261]: pgmap v60: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-05-20T17:35:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:15 smithi172 ceph-mon[36511]: pgmap v60: 97 pgs: 97 active+clean; 29 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-05-20T17:35:15.607 INFO:tasks.workunit.client.0.smithi135.stdout: 14 203705 826 128400 680 67759 981 2024-05-20T17:35:17.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:17 smithi135 ceph-mon[32027]: pgmap v61: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 184 op/s 2024-05-20T17:35:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:17 smithi160 ceph-mon[36261]: pgmap v61: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 184 op/s 2024-05-20T17:35:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:17 smithi172 ceph-mon[36511]: pgmap v61: 97 pgs: 97 active+clean; 31 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 184 op/s 2024-05-20T17:35:19.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:19 smithi172 ceph-mon[36511]: pgmap v62: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:19.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:19 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:19 smithi135 ceph-mon[32027]: pgmap v62: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:19 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:19.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:19 smithi160 ceph-mon[36261]: pgmap v62: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:19.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:19 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:21 smithi135 ceph-mon[32027]: pgmap v63: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:21 smithi160 ceph-mon[36261]: pgmap v63: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:21.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:21 smithi172 ceph-mon[36511]: pgmap v63: 97 pgs: 97 active+clean; 39 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 474 op/s 2024-05-20T17:35:23.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:23 smithi135 ceph-mon[32027]: pgmap v64: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-05-20T17:35:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:23 smithi160 ceph-mon[36261]: pgmap v64: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-05-20T17:35:23.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:23 smithi172 ceph-mon[36511]: pgmap v64: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-05-20T17:35:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:24 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:24.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:24 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:24.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:24 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:25.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:25 smithi135 ceph-mon[32027]: pgmap v65: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 430 op/s 2024-05-20T17:35:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:25 smithi160 ceph-mon[36261]: pgmap v65: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 430 op/s 2024-05-20T17:35:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:25 smithi172 ceph-mon[36511]: pgmap v65: 97 pgs: 97 active+clean; 45 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 430 op/s 2024-05-20T17:35:25.607 INFO:tasks.workunit.client.0.smithi135.stdout: 26 246318 588 151729 635 92537 1014 2024-05-20T17:35:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:27 smithi135 ceph-mon[32027]: pgmap v66: 97 pgs: 97 active+clean; 45 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 434 op/s 2024-05-20T17:35:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:27 smithi160 ceph-mon[36261]: pgmap v66: 97 pgs: 97 active+clean; 45 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 434 op/s 2024-05-20T17:35:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:27 smithi172 ceph-mon[36511]: pgmap v66: 97 pgs: 97 active+clean; 45 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 434 op/s 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 -- 172.21.15.135:0/1266733369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad88101b10 msgr2=0x7fad88101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 --2- 172.21.15.135:0/1266733369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad88101b10 0x7fad88101f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009900 tx=0x7fad7c02a410 comp rx=0 tx=0).stop 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 -- 172.21.15.135:0/1266733369 shutdown_connections 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 --2- 172.21.15.135:0/1266733369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad8810c3a0 0x7fad8810e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 --2- 172.21.15.135:0/1266733369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad88101b10 0x7fad88101f20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 --2- 172.21.15.135:0/1266733369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88107a40 0x7fad881015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 -- 172.21.15.135:0/1266733369 >> 172.21.15.135:0/1266733369 conn(0x7fad880fd210 msgr2=0x7fad880ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 -- 172.21.15.135:0/1266733369 shutdown_connections 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.214+0000 7fad8f637640 1 -- 172.21.15.135:0/1266733369 wait complete. 2024-05-20T17:35:28.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 Processor -- start 2024-05-20T17:35:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 -- start start 2024-05-20T17:35:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88101b10 0x7fad8819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad88107a40 0x7fad8819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad88111d50 con 0x7fad8810c3a0 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad88111bd0 con 0x7fad88107a40 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8f637640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad88111ed0 con 0x7fad88101b10 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39798/0 (socket says 172.21.15.135:39798) 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 -- 172.21.15.135:0/3999455708 learned_addr learned my addr 172.21.15.135:0/3999455708 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad88107a40 0x7fad8819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88101b10 0x7fad8819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 -- 172.21.15.135:0/3999455708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88101b10 msgr2=0x7fad8819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88101b10 0x7fad8819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 -- 172.21.15.135:0/3999455708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad88107a40 msgr2=0x7fad8819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad88107a40 0x7fad8819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.215+0000 7fad8dbd4640 1 -- 172.21.15.135:0/3999455708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad881a59a0 con 0x7fad8810c3a0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad8dbd4640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e970 tx=0x7fad7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad867fc640 1 -- 172.21.15.135:0/3999455708 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7800ccc0 con 0x7fad8810c3a0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad867fc640 1 -- 172.21.15.135:0/3999455708 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7800ce60 con 0x7fad8810c3a0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad881a5c90 con 0x7fad8810c3a0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad867fc640 1 -- 172.21.15.135:0/3999455708 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78010490 con 0x7fad8810c3a0 2024-05-20T17:35:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.216+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad881a6160 con 0x7fad8810c3a0 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad867fc640 1 -- 172.21.15.135:0/3999455708 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fad78005020 con 0x7fad8810c3a0 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 Processor -- start 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 -- start start 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b2f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a12b25c340 con 0x55a12af581b0 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a12b204290 con 0x55a12af374d0 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.219+0000 7fad965b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a12b258300 con 0x55a12af2f2f0 2024-05-20T17:35:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8d3d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39806/0 (socket says 172.21.15.135:39806) 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3530523590 learned_addr learned my addr 172.21.15.135:0/3530523590 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b2f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad867fc640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 0x7fad700a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3530523590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 msgr2=0x55a12b2f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3530523590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 msgr2=0x55a12b2f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b2f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3530523590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12b2288e0 con 0x55a12af581b0 2024-05-20T17:35:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8dbd4640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 0x7fad700a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009900 tx=0x7fad7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c721b55fd108d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad867fc640 1 -- 172.21.15.135:0/3999455708 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad780cf870 con 0x7fad8810c3a0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad6f7fe640 1 -- 172.21.15.135:0/3530523590 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c044020 con 0x55a12af581b0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad6f7fe640 1 -- 172.21.15.135:0/3530523590 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7c004030 con 0x55a12af581b0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.220+0000 7fad6f7fe640 1 -- 172.21.15.135:0/3530523590 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c035040 con 0x55a12af581b0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 -- 172.21.15.135:0/3530523590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 msgr2=0x55a12b2f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009900 tx=0x7fad7c000bc0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad8dbd4640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 0x7fad700a5200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad780cd070 tx=0x7fad7806acc0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 -- 172.21.15.135:0/3530523590 shutdown_connections 2024-05-20T17:35:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b2f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 --2- 172.21.15.135:0/3530523590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b2f7080 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 -- 172.21.15.135:0/3530523590 >> 172.21.15.135:0/3530523590 conn(0x55a12af4c300 msgr2=0x55a12b2f3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 -- 172.21.15.135:0/3530523590 shutdown_connections 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.221+0000 7fad965b1740 1 -- 172.21.15.135:0/3530523590 wait complete. 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 -- start start 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 Processor -- start 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b301730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b301c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a12b304150 con 0x55a12af581b0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a12b217790 con 0x55a12af374d0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a12b3042d0 con 0x55a12af2f2f0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad965b1740 10 client.0 _ll_register_callbacks cb 0x55a12b252a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.222+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39818/0 (socket says 172.21.15.135:39818) 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 -- 172.21.15.135:0/1539088868 learned_addr learned my addr 172.21.15.135:0/1539088868 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b301c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b301730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 -- 172.21.15.135:0/1539088868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 msgr2=0x55a12b301730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b301730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 -- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 msgr2=0x55a12b301c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b301c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 -- 172.21.15.135:0/1539088868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12af70210 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005160 tx=0x7fad7c0051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3aabf1c4f39c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c044070 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad7c0315b0 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad7c004030 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad7c035040 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad965b1740 10 client.16050 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.223+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a12b03c620 con 0x55a12af581b0 2024-05-20T17:35:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7c004030 con 0x55a12af581b0 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad7c0035f0 con 0x55a12af581b0 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 10 client.16050 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 20 client.16050 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af16d80 0x55a12b3137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 4 client.16050 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a12b269a70 con 0x55a12af16d80 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af16d80 0x55a12b3137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad6cff9640 10 client.16050 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.224+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af16d80 0x55a12b3137c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8020239efb86b648 server_cookie=d378f1db84bca55b in_seq=0 out_seq=0 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad6cff9640 1 -- 172.21.15.135:0/1539088868 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a12b269a70 con 0x55a12af16d80 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad6cff9640 10 client.16050 handle_command_reply: tid=0 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 client.16050 shutdown 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 msgr2=0x55a12b3076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005160 tx=0x7fad7c0051c0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 shutdown_connections 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af16d80 0x55a12b3137c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af581b0 0x55a12b3076a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad6cff9640 0 client.16050 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b301c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 --2- 172.21.15.135:0/1539088868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b301730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 >> 172.21.15.135:0/1539088868 conn(0x55a12af4c300 msgr2=0x55a12b2f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 shutdown_connections 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 1 -- 172.21.15.135:0/1539088868 wait complete. 2024-05-20T17:35:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.228+0000 7fad965b1740 20 client.16050 trim_cache size 0 max 16384 2024-05-20T17:35:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 Processor -- start 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 -- start start 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af16d80 0x55a12b2f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b1240 con 0x55a12af374d0 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad881aeb10 con 0x55a12af16d80 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad965b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad881ac960 con 0x55a12af2f2f0 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39830/0 (socket says 172.21.15.135:39830) 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3450602744 learned_addr learned my addr 172.21.15.135:0/3450602744 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.244+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af16d80 0x55a12b2f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3450602744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 msgr2=0x55a12b2fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3450602744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af16d80 msgr2=0x55a12b2f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af16d80 0x55a12b2f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 -- 172.21.15.135:0/3450602744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12b2f8460 con 0x55a12af374d0 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad7c003ee0 tx=0x7fad7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e298dea9ba2b7ef server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad6effd640 1 -- 172.21.15.135:0/3450602744 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c044040 con 0x55a12af374d0 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad6effd640 1 -- 172.21.15.135:0/3450602744 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7c005230 con 0x55a12af374d0 2024-05-20T17:35:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.245+0000 7fad6effd640 1 -- 172.21.15.135:0/3450602744 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0037f0 con 0x55a12af374d0 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- 172.21.15.135:0/3450602744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 msgr2=0x55a12b2feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad7c003ee0 tx=0x7fad7c000bc0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- 172.21.15.135:0/3450602744 shutdown_connections 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af374d0 0x55a12b2feca0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b2fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 --2- 172.21.15.135:0/3450602744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af16d80 0x55a12b2f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- 172.21.15.135:0/3450602744 >> 172.21.15.135:0/3450602744 conn(0x55a12af4c300 msgr2=0x55a12b2f6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- 172.21.15.135:0/3450602744 shutdown_connections 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- 172.21.15.135:0/3450602744 wait complete. 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 -- start start 2024-05-20T17:35:28.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.246+0000 7fad965b1740 1 Processor -- start 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b30d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b373a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad881acfd0 con 0x55a12af16d80 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad881ae440 con 0x55a12af374d0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad881ad6a0 con 0x55a12af2f2f0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad965b1740 10 client.0 _ll_register_callbacks cb 0x7fad80009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8cbd2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39844/0 (socket says 172.21.15.135:39844) 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8cbd2640 1 -- 172.21.15.135:0/1842430388 learned_addr learned my addr 172.21.15.135:0/1842430388 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b30d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b373a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 -- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 msgr2=0x55a12b373a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b373a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 -- 172.21.15.135:0/1842430388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 msgr2=0x55a12b30d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8d3d3640 1 -- 172.21.15.135:0/1842430388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12b373fd0 con 0x55a12af2f2f0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.247+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad8d3d3640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b30d650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55a12b2f8430 tx=0x7fad80010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c315a5b47a4610 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80003e60 con 0x55a12af2f2f0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad7c005230 con 0x55a12af2f2f0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad80004040 con 0x55a12af2f2f0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad80004240 con 0x55a12af2f2f0 2024-05-20T17:35:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 10 client.25588 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a12b37b2f0 con 0x55a12af2f2f0 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad7c005230 con 0x55a12af2f2f0 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad80030c10 con 0x55a12af2f2f0 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 10 client.25588 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 20 client.25588 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af581b0 0x55a12b37da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 4 client.25588 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.248+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a12b263dc0 con 0x55a12af581b0 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.249+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af581b0 0x55a12b37da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.249+0000 7fad6cff9640 10 client.25588 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:28.249+0000 7fad8cbd2640 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af581b0 0x55a12b37da00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6126518ab27f79 server_cookie=7b4d872d50972260 in_seq=0 out_seq=0 2024-05-20T17:35:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:28 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:35:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:28 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:28 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:28 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:28 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:28 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:35:28.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:28 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:28 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:28 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:28 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:28 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:35:28.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:28 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:28 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:28 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:28.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:28 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:29 smithi135 ceph-mon[32027]: pgmap v67: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2024-05-20T17:35:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:29 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:35:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:29 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:35:29.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:29 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:29 smithi160 ceph-mon[36261]: pgmap v67: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2024-05-20T17:35:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:29 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:35:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:29 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:35:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:29 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:29 smithi172 ceph-mon[36511]: pgmap v67: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2024-05-20T17:35:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:29 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:35:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:29 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:35:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:29 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:35:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad6cff9640 1 -- 172.21.15.135:0/1842430388 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a12b263dc0 con 0x55a12af581b0 2024-05-20T17:35:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad6cff9640 10 client.25588 handle_command_reply: tid=0 2024-05-20T17:35:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 client.25588 shutdown 2024-05-20T17:35:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 msgr2=0x55a12b30d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b30d650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55a12b2f8430 tx=0x7fad80010b80 comp rx=0 tx=0).stop 2024-05-20T17:35:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 shutdown_connections 2024-05-20T17:35:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55a12af581b0 0x55a12b37da00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a12af374d0 0x55a12b373a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12af2f2f0 0x55a12b30d650 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 --2- 172.21.15.135:0/1842430388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a12af16d80 0x55a12b30d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 >> 172.21.15.135:0/1842430388 conn(0x55a12af4c300 msgr2=0x55a12b302a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad6cff9640 0 client.25588 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.332+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 shutdown_connections 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.333+0000 7fad965b1740 1 -- 172.21.15.135:0/1842430388 wait complete. 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.333+0000 7fad965b1740 20 client.25588 trim_cache size 0 max 16384 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:35:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:35:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 msgr2=0x7fad700a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 0x7fad700a5200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad780cd070 tx=0x7fad7806acc0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 msgr2=0x7fad8819b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad7800e970 tx=0x7fad7800ed70 comp rx=0 tx=0).stop 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 shutdown_connections 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad700a2cf0 0x7fad700a5200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.334+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad8810c3a0 0x7fad8819b110 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.335+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad88107a40 0x7fad8819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.335+0000 7fad8f637640 1 --2- 172.21.15.135:0/3999455708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad88101b10 0x7fad8819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.335+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 >> 172.21.15.135:0/3999455708 conn(0x7fad880fd210 msgr2=0x7fad880fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.335+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 shutdown_connections 2024-05-20T17:35:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:31.335+0000 7fad8f637640 1 -- 172.21.15.135:0/3999455708 wait complete. 2024-05-20T17:35:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:31 smithi135 ceph-mon[32027]: pgmap v68: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 60 op/s 2024-05-20T17:35:31.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:31 smithi160 ceph-mon[36261]: pgmap v68: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 60 op/s 2024-05-20T17:35:31.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:31 smithi172 ceph-mon[36511]: pgmap v68: 97 pgs: 97 active+clean; 51 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 60 op/s 2024-05-20T17:35:32.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:35:32.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:35:32.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 -- 172.21.15.135:0/1285428607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 msgr2=0x7f9fbc10f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 --2- 172.21.15.135:0/1285428607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc10f940 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009ca0 tx=0x7f9fb402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 -- 172.21.15.135:0/1285428607 shutdown_connections 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 --2- 172.21.15.135:0/1285428607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc10f940 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 --2- 172.21.15.135:0/1285428607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc101020 0x7f9fbc101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 --2- 172.21.15.135:0/1285428607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc108b70 0x7f9fbc100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 -- 172.21.15.135:0/1285428607 >> 172.21.15.135:0/1285428607 conn(0x7f9fbc0768d0 msgr2=0x7f9fbc076d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 -- 172.21.15.135:0/1285428607 shutdown_connections 2024-05-20T17:35:32.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.221+0000 7f9fc107a640 1 -- 172.21.15.135:0/1285428607 wait complete. 2024-05-20T17:35:32.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 Processor -- start 2024-05-20T17:35:32.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 -- start start 2024-05-20T17:35:32.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 0x7f9fbc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 0x7f9fbc199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc112e30 con 0x7f9fbc10d520 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc112cb0 con 0x7f9fbc108b70 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fc107a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc112fb0 con 0x7f9fbc101020 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fbb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 0x7f9fbc199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fbb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33678/0 (socket says 172.21.15.135:33678) 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fbb59e640 1 -- 172.21.15.135:0/466682155 learned_addr learned my addr 172.21.15.135:0/466682155 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.222+0000 7f9fb259c640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 0x7f9fbc199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53726/0 (socket says 172.21.15.135:53726) 2024-05-20T17:35:32.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 0x7f9fbc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 -- 172.21.15.135:0/466682155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 msgr2=0x7f9fbc199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 0x7f9fbc199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 -- 172.21.15.135:0/466682155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 msgr2=0x7f9fbc199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 0x7f9fbc199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 -- 172.21.15.135:0/466682155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc19e5d0 con 0x7f9fbc10d520 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 0x7f9fbc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fbb59e640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40319f0 tx=0x7f9fb4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fb8d99640 1 -- 172.21.15.135:0/466682155 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4003b70 con 0x7f9fbc10d520 2024-05-20T17:35:32.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc19e860 con 0x7f9fbc10d520 2024-05-20T17:35:32.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fb8d99640 1 -- 172.21.15.135:0/466682155 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fb4003d10 con 0x7f9fbc10d520 2024-05-20T17:35:32.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fb8d99640 1 -- 172.21.15.135:0/466682155 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb402fcb0 con 0x7f9fbc10d520 2024-05-20T17:35:32.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.223+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc19edb0 con 0x7f9fbc10d520 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.226+0000 7f9fc8002740 1 Processor -- start 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.226+0000 7f9fb8d99640 1 -- 172.21.15.135:0/466682155 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9fb40305c0 con 0x7f9fbc10d520 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 -- start start 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b496d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55796b3fcd00 con 0x55796b0cf4d0 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55796b3a44c0 con 0x55796b0d76b0 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fc8002740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55796b3f8cc0 con 0x55796b0f8390 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33694/0 (socket says 172.21.15.135:33694) 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fbad9d640 1 -- 172.21.15.135:0/2016308030 learned_addr learned my addr 172.21.15.135:0/2016308030 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b496d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb8d99640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 0x7f9fa80a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 -- 172.21.15.135:0/2016308030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 msgr2=0x55796b496d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b496d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 -- 172.21.15.135:0/2016308030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 msgr2=0x55796b497270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fb259c640 1 -- 172.21.15.135:0/2016308030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796b1da7d0 con 0x55796b0d76b0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.227+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fbb59e640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 0x7f9fa80a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fb8d99640 1 -- 172.21.15.135:0/466682155 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9fb40f0470 con 0x7f9fbc10d520 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fb259c640 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4977b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009730 tx=0x7f9fa40096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92848468aa12218a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fb159a640 1 -- 172.21.15.135:0/2016308030 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004050 con 0x55796b0d76b0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fbb59e640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 0x7f9fa80a5210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40edd80 tx=0x7f9fb408ea60 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fb159a640 1 -- 172.21.15.135:0/2016308030 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa4005500 con 0x55796b0d76b0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.228+0000 7f9fb159a640 1 -- 172.21.15.135:0/2016308030 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004d80 con 0x55796b0d76b0 2024-05-20T17:35:32.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- 172.21.15.135:0/2016308030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 msgr2=0x55796b4977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4977b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009730 tx=0x7f9fa40096c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- 172.21.15.135:0/2016308030 shutdown_connections 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4977b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b497270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 --2- 172.21.15.135:0/2016308030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b496d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- 172.21.15.135:0/2016308030 >> 172.21.15.135:0/2016308030 conn(0x55796b0ec4e0 msgr2=0x55796b4934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- 172.21.15.135:0/2016308030 shutdown_connections 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- 172.21.15.135:0/2016308030 wait complete. 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 -- start start 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.229+0000 7f9fc8002740 1 Processor -- start 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55796b4a4020 con 0x55796b0f8390 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55796b3b7b90 con 0x55796b0d76b0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55796b4a41a0 con 0x55796b0cf4d0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fc8002740 10 client.0 _ll_register_callbacks cb 0x55796b3f3da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33696/0 (socket says 172.21.15.135:33696) 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fb259c640 1 -- 172.21.15.135:0/680261633 learned_addr learned my addr 172.21.15.135:0/680261633 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fb259c640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 -- 172.21.15.135:0/680261633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 msgr2=0x55796b4a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 -- 172.21.15.135:0/680261633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 msgr2=0x55796b4a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 -- 172.21.15.135:0/680261633 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796b1103f0 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55796b494470 tx=0x7f9fac009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9b1a6c775f0029 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.230+0000 7f9fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac004440 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9fac0116e0 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa4005500 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9fac0118e0 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 10 client.25712 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55796b0d00f0 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa4005500 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9fac01d400 con 0x55796b0d76b0 2024-05-20T17:35:32.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 10 client.25712 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 20 client.25712 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b0b6f60 0x55796b4b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 4 client.25712 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55796b40a430 con 0x55796b0b6f60 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.231+0000 7f9fb259c640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b0b6f60 0x55796b4b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.232+0000 7f9fa27fc640 10 client.25712 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.232+0000 7f9fb259c640 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b0b6f60 0x55796b4b3c40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36db4bc6932b3672 server_cookie=2ae30aa49413f057 in_seq=0 out_seq=0 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.234+0000 7f9fa27fc640 1 -- 172.21.15.135:0/680261633 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55796b40a430 con 0x55796b0b6f60 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.234+0000 7f9fa27fc640 10 client.25712 handle_command_reply: tid=0 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.234+0000 7f9fc8002740 1 client.25712 shutdown 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.234+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 msgr2=0x55796b4a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.234+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55796b494470 tx=0x7f9fac009f90 comp rx=0 tx=0).stop 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 shutdown_connections 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b0b6f60 0x55796b4b3c40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fa27fc640 0 client.25712 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a32c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 --2- 172.21.15.135:0/680261633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 >> 172.21.15.135:0/680261633 conn(0x55796b0ec4e0 msgr2=0x55796b498a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 shutdown_connections 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 1 -- 172.21.15.135:0/680261633 wait complete. 2024-05-20T17:35:32.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.235+0000 7f9fc8002740 20 client.25712 trim_cache size 0 max 16384 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.253+0000 7f9fc8002740 1 Processor -- start 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.253+0000 7f9fc8002740 1 -- start start 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b4a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1b1300 con 0x55796b0cf4d0 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1aebd0 con 0x55796b0d76b0 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fc8002740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1aca20 con 0x55796b0f8390 2024-05-20T17:35:32.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53764/0 (socket says 172.21.15.135:53764) 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33710/0 (socket says 172.21.15.135:33710) 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 -- 172.21.15.135:0/4012946450 learned_addr learned my addr 172.21.15.135:0/4012946450 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fb259c640 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b4a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 -- 172.21.15.135:0/4012946450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 msgr2=0x55796b4a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b4a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 -- 172.21.15.135:0/4012946450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 msgr2=0x55796b4a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 -- 172.21.15.135:0/4012946450 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796b4b3f70 con 0x55796b0d76b0 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fb259c640 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.254+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fac01d8a0 tx=0x7f9fac0116e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d4d4bff068a0c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fb0d99640 1 -- 172.21.15.135:0/4012946450 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02a030 con 0x55796b0d76b0 2024-05-20T17:35:32.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fb0d99640 1 -- 172.21.15.135:0/4012946450 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fac034070 con 0x55796b0d76b0 2024-05-20T17:35:32.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fb0d99640 1 -- 172.21.15.135:0/4012946450 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac01de60 con 0x55796b0d76b0 2024-05-20T17:35:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 -- 172.21.15.135:0/4012946450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 msgr2=0x55796b49ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fac01d8a0 tx=0x7f9fac0116e0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 -- 172.21.15.135:0/4012946450 shutdown_connections 2024-05-20T17:35:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0f8390 0x55796b4a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b49ca70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 --2- 172.21.15.135:0/4012946450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0cf4d0 0x55796b4a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 -- 172.21.15.135:0/4012946450 >> 172.21.15.135:0/4012946450 conn(0x55796b0ec4e0 msgr2=0x55796b4a0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 -- 172.21.15.135:0/4012946450 shutdown_connections 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.255+0000 7f9fc8002740 1 -- 172.21.15.135:0/4012946450 wait complete. 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 -- start start 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 Processor -- start 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1ad090 con 0x55796b0f8390 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1ae500 con 0x55796b0d76b0 2024-05-20T17:35:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1ad760 con 0x55796b0cf4d0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fc8002740 10 client.0 _ll_register_callbacks cb 0x7f9fac0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fb259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fbad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53768/0 (socket says 172.21.15.135:53768) 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fbad9d640 1 -- 172.21.15.135:0/459517784 learned_addr learned my addr 172.21.15.135:0/459517784 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.256+0000 7f9fb259c640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 -- 172.21.15.135:0/459517784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 msgr2=0x55796b4a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 -- 172.21.15.135:0/459517784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 msgr2=0x55796b4a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 -- 172.21.15.135:0/459517784 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796b4a5810 con 0x55796b0d76b0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fbad9d640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9fac011dc0 tx=0x7f9fac011e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d723fb3999ff64d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac03c070 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fac034070 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9fac0052c0 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9fac045050 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fc8002740 10 client.25718 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55796b51bdf0 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fac034070 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.257+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9fac03f020 con 0x55796b0d76b0 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 10 client.25718 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 10 client.25718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 20 client.25718 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b08c3a0 0x55796b51e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 4 client.25718 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:35:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55796b404780 con 0x55796b08c3a0 2024-05-20T17:35:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fb259c640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b08c3a0 0x55796b51e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fa27fc640 10 client.25718 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.258+0000 7f9fb259c640 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b08c3a0 0x55796b51e490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166a1d6647b84bc6 server_cookie=72518ac54596eb19 in_seq=0 out_seq=0 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.260+0000 7f9fa27fc640 1 -- 172.21.15.135:0/459517784 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55796b404780 con 0x55796b08c3a0 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.260+0000 7f9fa27fc640 10 client.25718 handle_command_reply: tid=0 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.260+0000 7f9fc8002740 1 client.25718 shutdown 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 msgr2=0x55796b4a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9fac011dc0 tx=0x7f9fac011e60 comp rx=0 tx=0).stop 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 shutdown_connections 2024-05-20T17:35:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55796b08c3a0 0x55796b51e490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55796b0f8390 0x55796b4a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fa27fc640 0 client.25718 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55796b0d76b0 0x55796b4a4c60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 --2- 172.21.15.135:0/459517784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55796b0cf4d0 0x55796b4a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 >> 172.21.15.135:0/459517784 conn(0x55796b0ec4e0 msgr2=0x55796b4988a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 shutdown_connections 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 1 -- 172.21.15.135:0/459517784 wait complete. 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc8002740 20 client.25718 trim_cache size 0 max 16384 2024-05-20T17:35:32.267 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:35:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-05-20T17:35:32.268 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-05-20T17:35:32.268 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:35:32.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 msgr2=0x7f9fa80a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 0x7f9fa80a5210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40edd80 tx=0x7f9fb408ea60 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 msgr2=0x7f9fbc19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40319f0 tx=0x7f9fb4031a20 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 shutdown_connections 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9fa80a2d00 0x7f9fa80a5210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fbc10d520 0x7f9fbc19df90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fbc108b70 0x7f9fbc199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 --2- 172.21.15.135:0/466682155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fbc101020 0x7f9fbc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 >> 172.21.15.135:0/466682155 conn(0x7f9fbc0768d0 msgr2=0x7f9fbc1094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 shutdown_connections 2024-05-20T17:35:32.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.261+0000 7f9fc107a640 1 -- 172.21.15.135:0/466682155 wait complete. 2024-05-20T17:35:32.274 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-20T17:35:32.275 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 -- 172.21.15.135:0/2196993465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410c330 msgr2=0x7f8ac410e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 --2- 172.21.15.135:0/2196993465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410c330 0x7f8ac410e750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009ca0 tx=0x7f8abc02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 -- 172.21.15.135:0/2196993465 shutdown_connections 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 --2- 172.21.15.135:0/2196993465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac410c330 0x7f8ac410e750 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 --2- 172.21.15.135:0/2196993465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac4101aa0 0x7f8ac4101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 --2- 172.21.15.135:0/2196993465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac41079d0 0x7f8ac4101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 -- 172.21.15.135:0/2196993465 >> 172.21.15.135:0/2196993465 conn(0x7f8ac40770c0 msgr2=0x7f8ac4077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 -- 172.21.15.135:0/2196993465 shutdown_connections 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.394+0000 7f8acabb5640 1 -- 172.21.15.135:0/2196993465 wait complete. 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 Processor -- start 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 -- start start 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac41079d0 0x7f8ac4199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac410c330 0x7f8ac419df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4111d00 con 0x7f8ac4101aa0 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4111b80 con 0x7f8ac410c330 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8acabb5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4111e80 con 0x7f8ac41079d0 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33742/0 (socket says 172.21.15.135:33742) 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 -- 172.21.15.135:0/4069706613 learned_addr learned my addr 172.21.15.135:0/4069706613 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac9152640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac410c330 0x7f8ac419df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8abbfff640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac41079d0 0x7f8ac4199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 -- 172.21.15.135:0/4069706613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac41079d0 msgr2=0x7f8ac4199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac41079d0 0x7f8ac4199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 -- 172.21.15.135:0/4069706613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac410c330 msgr2=0x7f8ac419df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac410c330 0x7f8ac419df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.395+0000 7f8ac8951640 1 -- 172.21.15.135:0/4069706613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac419e550 con 0x7f8ac4101aa0 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8ac8951640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000e9c0 tx=0x7f8ac000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000cd80 con 0x7f8ac4101aa0 2024-05-20T17:35:32.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac0005500 con 0x7f8ac4101aa0 2024-05-20T17:35:32.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac419e840 con 0x7f8ac4101aa0 2024-05-20T17:35:32.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0010690 con 0x7f8ac4101aa0 2024-05-20T17:35:32.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.396+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac41a61c0 con 0x7f8ac4101aa0 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.397+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac4102c80 con 0x7f8ac4101aa0 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.399+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8ac00046c0 con 0x7f8ac4101aa0 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.400+0000 7f8ab9ffb640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 0x7f8aac0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.400+0000 7f8abbfff640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 0x7f8aac0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.400+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8ac00cf940 con 0x7f8ac4101aa0 2024-05-20T17:35:32.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.400+0000 7f8abbfff640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 0x7f8aac0a5290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ac410e830 tx=0x7f8ab4005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.404+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8ac0053850 con 0x7f8ac4101aa0 2024-05-20T17:35:32.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.630+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ac4069f50 con 0x7f8ac4101aa0 2024-05-20T17:35:32.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.630+0000 7f8ab9ffb640 1 -- 172.21.15.135:0/4069706613 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7f8ac009c560 con 0x7f8ac4101aa0 2024-05-20T17:35:32.632 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:35:32.632 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:35:22.791206+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:35:32.632 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 24 2024-05-20T17:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 msgr2=0x7f8aac0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 0x7f8aac0a5290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ac410e830 tx=0x7f8ab4005f90 comp rx=0 tx=0).stop 2024-05-20T17:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 msgr2=0x7f8ac41996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000e9c0 tx=0x7f8ac000ee80 comp rx=0 tx=0).stop 2024-05-20T17:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 shutdown_connections 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8aac0a2d80 0x7f8aac0a5290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac410c330 0x7f8ac419df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac41079d0 0x7f8ac4199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 --2- 172.21.15.135:0/4069706613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ac4101aa0 0x7f8ac41996f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 >> 172.21.15.135:0/4069706613 conn(0x7f8ac40770c0 msgr2=0x7f8ac4068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 shutdown_connections 2024-05-20T17:35:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.633+0000 7f8acabb5640 1 -- 172.21.15.135:0/4069706613 wait complete. 2024-05-20T17:35:32.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.761+0000 7f0b27056640 1 -- 172.21.15.135:0/144591718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b20102210 msgr2=0x7f0b20102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.761+0000 7f0b27056640 1 --2- 172.21.15.135:0/144591718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b20102210 0x7f0b20102620 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009ca0 tx=0x7f0b1002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.761+0000 7f0b27056640 1 -- 172.21.15.135:0/144591718 shutdown_connections 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.761+0000 7f0b27056640 1 --2- 172.21.15.135:0/144591718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b2010c350 0x7f0b2010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 --2- 172.21.15.135:0/144591718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b20102210 0x7f0b20102620 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 --2- 172.21.15.135:0/144591718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b201079f0 0x7f0b20101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 -- 172.21.15.135:0/144591718 >> 172.21.15.135:0/144591718 conn(0x7f0b20076830 msgr2=0x7f0b20076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 -- 172.21.15.135:0/144591718 shutdown_connections 2024-05-20T17:35:32.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 -- 172.21.15.135:0/144591718 wait complete. 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 Processor -- start 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 -- start start 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.762+0000 7f0b27056640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b20102210 0x7f0b2019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 0x7f0b2019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20111d00 con 0x7f0b201079f0 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20111b80 con 0x7f0b2010c350 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20111e80 con 0x7f0b20102210 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b255f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 0x7f0b2019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33762/0 (socket says 172.21.15.135:33762) 2024-05-20T17:35:32.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b20102210 0x7f0b2019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 -- 172.21.15.135:0/236373890 learned_addr learned my addr 172.21.15.135:0/236373890 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 -- 172.21.15.135:0/236373890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b20102210 msgr2=0x7f0b2019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b20102210 0x7f0b2019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 -- 172.21.15.135:0/236373890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 msgr2=0x7f0b2019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 0x7f0b2019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 -- 172.21.15.135:0/236373890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b201a5970 con 0x7f0b201079f0 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b255f3640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 0x7f0b2019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000f80 tx=0x7f0b100319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1dffb640 1 -- 172.21.15.135:0/236373890 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1002fa20 con 0x7f0b201079f0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1dffb640 1 -- 172.21.15.135:0/236373890 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b1002f380 con 0x7f0b201079f0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b201a5c00 con 0x7f0b201079f0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.763+0000 7f0b1dffb640 1 -- 172.21.15.135:0/236373890 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1003a660 con 0x7f0b201079f0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.764+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b201a6150 con 0x7f0b201079f0 2024-05-20T17:35:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.766+0000 7f0b1dffb640 1 -- 172.21.15.135:0/236373890 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0b100305c0 con 0x7f0b201079f0 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.766+0000 7f0b2dfd5740 1 Processor -- start 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.766+0000 7f0b2dfd5740 1 -- start start 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564acecddd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acecde7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564acec43c40 con 0x564ace9164d0 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564acebeb580 con 0x564ace91e6b0 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564acec3fc00 con 0x564ace93f390 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1dffb640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 0x7f0b0c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b255f3640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 0x7f0b0c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33768/0 (socket says 172.21.15.135:33768) 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b24df2640 1 -- 172.21.15.135:0/2289904782 learned_addr learned my addr 172.21.15.135:0/2289904782 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acecde7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b255f3640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564acecddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1dffb640 1 -- 172.21.15.135:0/236373890 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b100f05c0 con 0x7f0b201079f0 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2289904782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 msgr2=0x564acecddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564acecddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2289904782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 msgr2=0x564acecde260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2289904782 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ace9573f0 con 0x564ace91e6b0 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b24df2640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b255f3640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 0x7f0b0c0a5210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b18011840 tx=0x7f0b18009cf0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.767+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acecde7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b100ede20 tx=0x7f0b1002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7b4f33d32d3509 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.768+0000 7f0b16ffd640 1 -- 172.21.15.135:0/2289904782 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b100bc730 con 0x564ace91e6b0 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.768+0000 7f0b16ffd640 1 -- 172.21.15.135:0/2289904782 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b10036070 con 0x564ace91e6b0 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.768+0000 7f0b16ffd640 1 -- 172.21.15.135:0/2289904782 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10008220 con 0x564ace91e6b0 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2289904782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 msgr2=0x564acecde7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acecde7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b100ede20 tx=0x7f0b1002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2289904782 shutdown_connections 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acecde7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace9164d0 0x564acecde260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2289904782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564acecddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2289904782 >> 172.21.15.135:0/2289904782 conn(0x564ace9334e0 msgr2=0x564acecda4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2289904782 shutdown_connections 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2289904782 wait complete. 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 -- start start 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.769+0000 7f0b2dfd5740 1 Processor -- start 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acece8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace91e6b0 0x564acece88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564aceceae30 con 0x564ace93f390 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564acebfec40 con 0x564ace9164d0 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564aceceafb0 con 0x564ace91e6b0 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 10 client.0 _ll_register_callbacks cb 0x564ace956be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acece8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33776/0 (socket says 172.21.15.135:33776) 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 -- 172.21.15.135:0/3387700832 learned_addr learned my addr 172.21.15.135:0/3387700832 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace91e6b0 0x564acece88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 -- 172.21.15.135:0/3387700832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace91e6b0 msgr2=0x564acece88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace91e6b0 0x564acece88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 -- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 msgr2=0x564acece8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acece8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 -- 172.21.15.135:0/3387700832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acea217d0 con 0x564ace93f390 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b24df2640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acece8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b255f3640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b18011480 tx=0x7f0b18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2663788e7f726f5e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0afffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18010ac0 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b18010c60 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b10036070 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.770+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b18010e60 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 10 client.16092 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564acecf7490 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b10036070 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b1801e070 con 0x564ace93f390 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 10 client.16092 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 20 client.16092 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8fdf60 0x564acecfa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 4 client.16092 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564acec51370 con 0x564ace8fdf60 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.771+0000 7f0b24df2640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8fdf60 0x564acecfa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0afffff640 10 client.16092 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b24df2640 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8fdf60 0x564acecfa8d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=776a8e910bc32ba6 server_cookie=f992638e0d46432e in_seq=0 out_seq=0 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0afffff640 1 -- 172.21.15.135:0/3387700832 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564acec51370 con 0x564ace8fdf60 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0afffff640 10 client.16092 handle_command_reply: tid=0 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 client.16092 shutdown 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 msgr2=0x564acecee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b18011480 tx=0x7f0b18005f90 comp rx=0 tx=0).stop 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 shutdown_connections 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8fdf60 0x564acecfa8d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acecee1a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0afffff640 0 client.16092 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace91e6b0 0x564acece88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/3387700832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acece8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.772+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 >> 172.21.15.135:0/3387700832 conn(0x564ace9334e0 msgr2=0x564acecdfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.773+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 shutdown_connections 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.773+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/3387700832 wait complete. 2024-05-20T17:35:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.773+0000 7f0b2dfd5740 20 client.16092 trim_cache size 0 max 16384 2024-05-20T17:35:32.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 Processor -- start 2024-05-20T17:35:32.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 -- start start 2024-05-20T17:35:32.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace9164d0 0x564acecee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acece9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201b11c0 con 0x564ace93f390 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201aea90 con 0x564ace91e6b0 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ac8e0 con 0x564ace9164d0 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b255f3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acece9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b255f3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33790/0 (socket says 172.21.15.135:33790) 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b255f3640 1 -- 172.21.15.135:0/2426893170 learned_addr learned my addr 172.21.15.135:0/2426893170 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.786+0000 7f0b24df2640 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace9164d0 0x564acecee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2426893170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace9164d0 msgr2=0x564acecee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace9164d0 0x564acecee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2426893170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 msgr2=0x564acece19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2426893170 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564acecdf540 con 0x564ace91e6b0 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b255f3640 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acece9fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b1002ade0 tx=0x7f0b10030cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0215955da67035 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b167fc640 1 -- 172.21.15.135:0/2426893170 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10037270 con 0x564ace91e6b0 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b167fc640 1 -- 172.21.15.135:0/2426893170 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b100d3030 con 0x564ace91e6b0 2024-05-20T17:35:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.787+0000 7f0b167fc640 1 -- 172.21.15.135:0/2426893170 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b100c2130 con 0x564ace91e6b0 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2426893170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 msgr2=0x564acece9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acece9fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b1002ade0 tx=0x7f0b10030cf0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2426893170 shutdown_connections 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace93f390 0x564acece19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace91e6b0 0x564acece9fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2426893170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace9164d0 0x564acecee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2426893170 >> 172.21.15.135:0/2426893170 conn(0x564ace9334e0 msgr2=0x564acece98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2426893170 shutdown_connections 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2426893170 wait complete. 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 -- start start 2024-05-20T17:35:32.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 Processor -- start 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.788+0000 7f0b2dfd5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564aced60c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201acf50 con 0x564ace91e6b0 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ae3c0 con 0x564ace9164d0 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ad620 con 0x564ace93f390 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 10 client.0 _ll_register_callbacks cb 0x7f0b18011120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b1ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33794/0 (socket says 172.21.15.135:33794) 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b1ffff640 1 -- 172.21.15.135:0/2972030582 learned_addr learned my addr 172.21.15.135:0/2972030582 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53838/0 (socket says 172.21.15.135:53838) 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b255f3640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564aced60c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 -- 172.21.15.135:0/2972030582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 msgr2=0x564aced60c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564aced60c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 -- 172.21.15.135:0/2972030582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 msgr2=0x564acecefb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 -- 172.21.15.135:0/2972030582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acecf03e0 con 0x564ace9164d0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b24df2640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x564acece79e0 tx=0x7f0b08012b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85315d44430115d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0afffff640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08024070 con 0x564ace9164d0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b080035f0 con 0x564ace9164d0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b100d3030 con 0x564ace9164d0 2024-05-20T17:35:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b0802f050 con 0x564ace9164d0 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 10 client.25742 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.789+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564aced62220 con 0x564ace9164d0 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b100d3030 con 0x564ace9164d0 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b08010b40 con 0x564ace9164d0 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 10 client.25742 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 10 client.25742 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 20 client.25742 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8d33a0 0x564aced64940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 4 client.25742 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564acece3d60 con 0x564ace8d33a0 2024-05-20T17:35:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8d33a0 0x564aced64940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0afffff640 10 client.25742 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.790+0000 7f0b1ffff640 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8d33a0 0x564aced64940 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=799cf205f738ccb9 server_cookie=63b7362213aaba5b in_seq=0 out_seq=0 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0afffff640 1 -- 172.21.15.135:0/2972030582 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564acece3d60 con 0x564ace8d33a0 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0afffff640 10 client.25742 handle_command_reply: tid=0 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 client.25742 shutdown 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 msgr2=0x564acecef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x564acece79e0 tx=0x7f0b08012b40 comp rx=0 tx=0).stop 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 shutdown_connections 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x564ace8d33a0 0x564aced64940 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ace93f390 0x564aced60c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ace91e6b0 0x564acecefb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 --2- 172.21.15.135:0/2972030582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564ace9164d0 0x564acecef600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0afffff640 0 client.25742 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:35:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 >> 172.21.15.135:0/2972030582 conn(0x564ace9334e0 msgr2=0x564acece0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 shutdown_connections 2024-05-20T17:35:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 1 -- 172.21.15.135:0/2972030582 wait complete. 2024-05-20T17:35:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b2dfd5740 20 client.25742 trim_cache size 0 max 16384 2024-05-20T17:35:32.801 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 msgr2=0x7f0b0c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 0x7f0b0c0a5210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b18011840 tx=0x7f0b18009cf0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 msgr2=0x7f0b2019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.791+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000f80 tx=0x7f0b100319f0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 shutdown_connections 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b0c0a2d00 0x7f0b0c0a5210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b2010c350 0x7f0b2019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b201079f0 0x7f0b2019aba0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 --2- 172.21.15.135:0/236373890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b20102210 0x7f0b2019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 >> 172.21.15.135:0/236373890 conn(0x7f0b20076830 msgr2=0x7f0b201030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 shutdown_connections 2024-05-20T17:35:32.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.792+0000 7f0b27056640 1 -- 172.21.15.135:0/236373890 wait complete. 2024-05-20T17:35:32.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-20T17:35:32.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 -- 172.21.15.135:0/256991915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff010c360 msgr2=0x7f8ff010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/256991915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff010c360 0x7f8ff010e780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009ca0 tx=0x7f8fe802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 -- 172.21.15.135:0/256991915 shutdown_connections 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/256991915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff010c360 0x7f8ff010e780 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/256991915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ff0101b20 0x7f8ff0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/256991915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0107a00 0x7f8ff01015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 -- 172.21.15.135:0/256991915 >> 172.21.15.135:0/256991915 conn(0x7f8ff00770c0 msgr2=0x7f8ff0077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 -- 172.21.15.135:0/256991915 shutdown_connections 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.927+0000 7f8ff7cca640 1 -- 172.21.15.135:0/256991915 wait complete. 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 Processor -- start 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 -- start start 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0101b20 0x7f8ff019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ff010c360 0x7f8ff019b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111d30 con 0x7f8ff0107a00 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111bb0 con 0x7f8ff010c360 2024-05-20T17:35:32.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff7cca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111eb0 con 0x7f8ff0101b20 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33814/0 (socket says 172.21.15.135:33814) 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff5a66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0101b20 0x7f8ff019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.928+0000 7f8ff5265640 1 -- 172.21.15.135:0/4106470648 learned_addr learned my addr 172.21.15.135:0/4106470648 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 -- 172.21.15.135:0/4106470648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0101b20 msgr2=0x7f8ff019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0101b20 0x7f8ff019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 -- 172.21.15.135:0/4106470648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ff010c360 msgr2=0x7f8ff019b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ff010c360 0x7f8ff019b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 -- 172.21.15.135:0/4106470648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff01a58c0 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff5265640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000e9f0 tx=0x7f8fe000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8fe6ffd640 1 -- 172.21.15.135:0/4106470648 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000ccc0 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff01a5bb0 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8fe6ffd640 1 -- 172.21.15.135:0/4106470648 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00035f0 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8fe6ffd640 1 -- 172.21.15.135:0/4106470648 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000ce60 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.929+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff01a6150 con 0x7f8ff0107a00 2024-05-20T17:35:32.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.933+0000 7f8fe6ffd640 1 -- 172.21.15.135:0/4106470648 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8fe0010750 con 0x7f8ff0107a00 2024-05-20T17:35:32.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.935+0000 7f8fe6ffd640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 0x7f8fdc0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.935+0000 7f8fe6ffd640 1 -- 172.21.15.135:0/4106470648 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8fe00cf740 con 0x7f8ff0107a00 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.935+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 0x7f8fdc0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.935+0000 7f8ffeb73740 1 Processor -- start 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 -- start start 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 0x7f8fdc0a5290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0102a00 tx=0x7f8fec005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b614cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 0x55c9b6150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9b60a8c40 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c9b6050580 con 0x55c9b5d836b0 2024-05-20T17:35:32.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9b60a4c00 con 0x55c9b5da4390 2024-05-20T17:35:32.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33826/0 (socket says 172.21.15.135:33826) 2024-05-20T17:35:32.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.936+0000 7f8ff5265640 1 -- 172.21.15.135:0/149104824 learned_addr learned my addr 172.21.15.135:0/149104824 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 -- 172.21.15.135:0/149104824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 msgr2=0x55c9b614cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b614cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff6267640 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 0x55c9b6150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 -- 172.21.15.135:0/149104824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 msgr2=0x55c9b6150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 0x55c9b6150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 -- 172.21.15.135:0/149104824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b5dbc3f0 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff6267640 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 0x55c9b6150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8ff5265640 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00a43a0 tx=0x7f8fe009b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2232d621e645b08f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8fdbfff640 1 -- 172.21.15.135:0/149104824 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00b4e60 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8fdbfff640 1 -- 172.21.15.135:0/149104824 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00b1070 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.937+0000 7f8fdbfff640 1 -- 172.21.15.135:0/149104824 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00cd270 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 -- 172.21.15.135:0/149104824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 msgr2=0x55c9b614d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00a43a0 tx=0x7f8fe009b680 comp rx=0 tx=0).stop 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 -- 172.21.15.135:0/149104824 shutdown_connections 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d836b0 0x55c9b6150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614d1a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/149104824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b614cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 -- 172.21.15.135:0/149104824 >> 172.21.15.135:0/149104824 conn(0x55c9b5d984e0 msgr2=0x55c9b613ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 -- 172.21.15.135:0/149104824 shutdown_connections 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.939+0000 7f8ffeb73740 1 -- 172.21.15.135:0/149104824 wait complete. 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.940+0000 7f8ffeb73740 1 -- start start 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.940+0000 7f8ffeb73740 1 Processor -- start 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 0x55c9b61432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b6143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9b6151670 con 0x55c9b5d836b0 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c9b6063c40 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9b61517f0 con 0x55c9b5da4390 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5a66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5a66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53850/0 (socket says 172.21.15.135:53850) 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5a66640 1 -- 172.21.15.135:0/1624538169 learned_addr learned my addr 172.21.15.135:0/1624538169 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 0x55c9b61432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ffeb73740 10 client.0 _ll_register_callbacks cb 0x55c9b5dbbbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff6267640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b6143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 -- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 msgr2=0x55c9b6143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b6143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 -- 172.21.15.135:0/1624538169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 msgr2=0x55c9b614b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5265640 1 -- 172.21.15.135:0/1624538169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b5e867d0 con 0x55c9b5d836b0 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.941+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.942+0000 7f8ff5265640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 0x55c9b61432d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55c9b6140790 tx=0x7f8fe0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45c9f9ac875de20 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.942+0000 7f8fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.942+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00b4e60 con 0x55c9b5d836b0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.942+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8fe0099f60 con 0x55c9b5d836b0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.942+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe00b1070 con 0x55c9b5d836b0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.943+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fe00a48d0 con 0x55c9b5d836b0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.943+0000 7f8ffeb73740 10 client.16110 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.943+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c9b616d5c0 con 0x55c9b5d836b0 2024-05-20T17:35:32.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.943+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00b1070 con 0x55c9b5d836b0 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.943+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fe009b180 con 0x55c9b5d836b0 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 10 client.16110 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 10 client.16110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 20 client.16110 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5d62f60 0x55c9b6170920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 4 client.16110 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:32.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9b60b6370 con 0x55c9b5d62f60 2024-05-20T17:35:32.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5d62f60 0x55c9b6170920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.944+0000 7f8fd97fa640 10 client.16110 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:32.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.945+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5d62f60 0x55c9b6170920 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4691462a3ce7151f server_cookie=21e6ffba81a3017c in_seq=0 out_seq=0 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.945+0000 7f8fd97fa640 1 -- 172.21.15.135:0/1624538169 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9b60b6370 con 0x55c9b5d62f60 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.945+0000 7f8fd97fa640 10 client.16110 handle_command_reply: tid=0 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.945+0000 7f8ffeb73740 1 client.16110 shutdown 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 msgr2=0x55c9b61432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 0x55c9b61432d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55c9b6140790 tx=0x7f8fe0003f10 comp rx=0 tx=0).stop 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 shutdown_connections 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5d62f60 0x55c9b6170920 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8fd97fa640 0 client.16110 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5da4390 0x55c9b6143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d836b0 0x55c9b61432d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/1624538169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 >> 172.21.15.135:0/1624538169 conn(0x55c9b5d984e0 msgr2=0x55c9b613ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 shutdown_connections 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 1 -- 172.21.15.135:0/1624538169 wait complete. 2024-05-20T17:35:32.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.946+0000 7f8ffeb73740 20 client.16110 trim_cache size 0 max 16384 2024-05-20T17:35:32.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 Processor -- start 2024-05-20T17:35:32.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 -- start start 2024-05-20T17:35:32.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d62f60 0x55c9b614c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b6154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01af2c0 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01acb90 con 0x55c9b5d62f60 2024-05-20T17:35:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01aa9e0 con 0x55c9b5d836b0 2024-05-20T17:35:32.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33852/0 (socket says 172.21.15.135:33852) 2024-05-20T17:35:32.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ff5265640 1 -- 172.21.15.135:0/202215002 learned_addr learned my addr 172.21.15.135:0/202215002 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d62f60 0x55c9b614c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.961+0000 7f8ff6267640 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b6154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 -- 172.21.15.135:0/202215002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 msgr2=0x55c9b6154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b6154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 -- 172.21.15.135:0/202215002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d62f60 msgr2=0x55c9b614c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d62f60 0x55c9b614c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 -- 172.21.15.135:0/202215002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b6154840 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8ff5265640 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0099f10 tx=0x7f8fe0003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348a973b1b73a13f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8fdb7fe640 1 -- 172.21.15.135:0/202215002 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00b4e60 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8fdb7fe640 1 -- 172.21.15.135:0/202215002 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00b1020 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.962+0000 7f8fdb7fe640 1 -- 172.21.15.135:0/202215002 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00ba4f0 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- 172.21.15.135:0/202215002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 msgr2=0x55c9b614ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0099f10 tx=0x7f8fe0003e10 comp rx=0 tx=0).stop 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- 172.21.15.135:0/202215002 shutdown_connections 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b6154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d7b4d0 0x55c9b614ce30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/202215002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d62f60 0x55c9b614c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- 172.21.15.135:0/202215002 >> 172.21.15.135:0/202215002 conn(0x55c9b5d984e0 msgr2=0x55c9b613db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- 172.21.15.135:0/202215002 shutdown_connections 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- 172.21.15.135:0/202215002 wait complete. 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 -- start start 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.963+0000 7f8ffeb73740 1 Processor -- start 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d62f60 0x55c9b6173050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b6173590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ab050 con 0x55c9b5d62f60 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ac4c0 con 0x55c9b5d7b4d0 2024-05-20T17:35:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01ab720 con 0x55c9b5d836b0 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ffeb73740 10 client.0 _ll_register_callbacks cb 0x7f8fe009b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff5a66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d62f60 0x55c9b6173050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b6173590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53878/0 (socket says 172.21.15.135:53878) 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 -- 172.21.15.135:0/3827315910 learned_addr learned my addr 172.21.15.135:0/3827315910 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff5265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b6173590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53872/0 (socket says 172.21.15.135:53872) 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 -- 172.21.15.135:0/3827315910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 msgr2=0x55c9b6173590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b6173590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 -- 172.21.15.135:0/3827315910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d62f60 msgr2=0x55c9b6173050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d62f60 0x55c9b6173050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.964+0000 7f8ff6267640 1 -- 172.21.15.135:0/3827315910 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b61cffd0 con 0x55c9b5d836b0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8ff6267640 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8035000 tx=0x7f8fe8003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b52c39aa02e728 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8031450 con 0x55c9b5d836b0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe00b1020 con 0x55c9b5d836b0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8fe80315f0 con 0x55c9b5d836b0 2024-05-20T17:35:32.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fe8053050 con 0x55c9b5d836b0 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8ffeb73740 10 client.25642 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c9b61d8550 con 0x55c9b5d836b0 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00b1020 con 0x55c9b5d836b0 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.965+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fe802f730 con 0x55c9b5d836b0 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 10 client.25642 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 10 client.25642 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:35:32.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 20 client.25642 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5da4390 0x55c9b61dad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 4 client.25642 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9b60b06c0 con 0x55c9b5da4390 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5da4390 0x55c9b61dad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8fd97fa640 10 client.25642 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ff5a66640 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5da4390 0x55c9b61dad10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b79b1e7df37413f2 server_cookie=294725c4d6e525f0 in_seq=0 out_seq=0 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8fd97fa640 1 -- 172.21.15.135:0/3827315910 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9b60b06c0 con 0x55c9b5da4390 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8fd97fa640 10 client.25642 handle_command_reply: tid=0 2024-05-20T17:35:32.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.966+0000 7f8ffeb73740 1 client.25642 shutdown 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 msgr2=0x55c9b61cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8035000 tx=0x7f8fe8003970 comp rx=0 tx=0).stop 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 shutdown_connections 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x55c9b5da4390 0x55c9b61dad10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9b5d836b0 0x55c9b61cfa10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9b5d7b4d0 0x55c9b6173590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8fd97fa640 0 client.25642 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 --2- 172.21.15.135:0/3827315910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9b5d62f60 0x55c9b6173050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 >> 172.21.15.135:0/3827315910 conn(0x55c9b5d984e0 msgr2=0x55c9b61429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 shutdown_connections 2024-05-20T17:35:32.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 1 -- 172.21.15.135:0/3827315910 wait complete. 2024-05-20T17:35:32.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ffeb73740 20 client.25642 trim_cache size 0 max 16384 2024-05-20T17:35:32.980 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:32.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 msgr2=0x7f8fdc0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 0x7f8fdc0a5290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0102a00 tx=0x7f8fec005f90 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 msgr2=0x7f8ff019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000e9f0 tx=0x7f8fe000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 shutdown_connections 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8fdc0a2d80 0x7f8fdc0a5290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.967+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ff010c360 0x7f8ff019b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.968+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff0107a00 0x7f8ff019aaf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.968+0000 7f8ff7cca640 1 --2- 172.21.15.135:0/4106470648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff0101b20 0x7f8ff019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.968+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 >> 172.21.15.135:0/4106470648 conn(0x7f8ff00770c0 msgr2=0x7f8ff0103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.968+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 shutdown_connections 2024-05-20T17:35:32.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:32.968+0000 7f8ff7cca640 1 -- 172.21.15.135:0/4106470648 wait complete. 2024-05-20T17:35:32.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-20T17:35:33.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 -- 172.21.15.135:0/2527936144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98410d000 msgr2=0x7fd98410f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 --2- 172.21.15.135:0/2527936144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98410d000 0x7fd98410f4f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009ca0 tx=0x7fd97c02a950 comp rx=0 tx=0).stop 2024-05-20T17:35:33.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 -- 172.21.15.135:0/2527936144 shutdown_connections 2024-05-20T17:35:33.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 --2- 172.21.15.135:0/2527936144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98410d000 0x7fd98410f4f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 --2- 172.21.15.135:0/2527936144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410a6a0 0x7fd98410cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 --2- 172.21.15.135:0/2527936144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd984103c40 0x7fd984104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 -- 172.21.15.135:0/2527936144 >> 172.21.15.135:0/2527936144 conn(0x7fd9840770b0 msgr2=0x7fd9840774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 -- 172.21.15.135:0/2527936144 shutdown_connections 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.107+0000 7fd98931a640 1 -- 172.21.15.135:0/2527936144 wait complete. 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 Processor -- start 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 -- start start 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98410a6a0 0x7fd984199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410d000 0x7fd98419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd984112db0 con 0x7fd984103c40 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd984112c30 con 0x7fd98410a6a0 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd98931a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd984112f30 con 0x7fd98410d000 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33888/0 (socket says 172.21.15.135:33888) 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 -- 172.21.15.135:0/2714271955 learned_addr learned my addr 172.21.15.135:0/2714271955 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd97bfff640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98410a6a0 0x7fd984199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410d000 0x7fd98419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 -- 172.21.15.135:0/2714271955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410d000 msgr2=0x7fd98419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410d000 0x7fd98419df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 -- 172.21.15.135:0/2714271955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98410a6a0 msgr2=0x7fd984199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98410a6a0 0x7fd984199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 -- 172.21.15.135:0/2714271955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98419e5b0 con 0x7fd984103c40 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.108+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd97400ea60 tx=0x7fd97400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.109+0000 7fd980ff9640 1 -- 172.21.15.135:0/2714271955 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97400cde0 con 0x7fd984103c40 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.109+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98419e8a0 con 0x7fd984103c40 2024-05-20T17:35:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.109+0000 7fd980ff9640 1 -- 172.21.15.135:0/2714271955 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9740035f0 con 0x7fd984103c40 2024-05-20T17:35:33.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.109+0000 7fd980ff9640 1 -- 172.21.15.135:0/2714271955 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974010670 con 0x7fd984103c40 2024-05-20T17:35:33.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.109+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9841a6220 con 0x7fd984103c40 2024-05-20T17:35:33.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.111+0000 7fd980ff9640 1 -- 172.21.15.135:0/2714271955 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd9740037a0 con 0x7fd984103c40 2024-05-20T17:35:33.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.111+0000 7fd9901c2740 1 Processor -- start 2024-05-20T17:35:33.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.111+0000 7fd9901c2740 1 -- start start 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef78e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adef6f3c40 con 0x55adef3ef390 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55adef69b580 con 0x55adef3c64d0 2024-05-20T17:35:33.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9901c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adef6efc00 con 0x55adef3ce6b0 2024-05-20T17:35:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef78e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33902/0 (socket says 172.21.15.135:33902) 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9837fe640 1 -- 172.21.15.135:0/182563623 learned_addr learned my addr 172.21.15.135:0/182563623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53904/0 (socket says 172.21.15.135:53904) 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd980ff9640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 0x7fd9700a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 -- 172.21.15.135:0/182563623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 msgr2=0x55adef78e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 -- 172.21.15.135:0/182563623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 msgr2=0x55adef78dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd97bfff640 1 -- 172.21.15.135:0/182563623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adef4073f0 con 0x55adef3ce6b0 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd982ffd640 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9837fe640 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.112+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 0x7fd9700a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.113+0000 7fd980ff9640 1 -- 172.21.15.135:0/2714271955 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd9740cf700 con 0x7fd984103c40 2024-05-20T17:35:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.113+0000 7fd97bfff640 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef78e7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009bd0 tx=0x7fd96c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d794417530229b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.113+0000 7fd9797fa640 1 -- 172.21.15.135:0/182563623 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c004050 con 0x55adef3ce6b0 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.113+0000 7fd9797fa640 1 -- 172.21.15.135:0/182563623 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd96c005500 con 0x55adef3ce6b0 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.113+0000 7fd9797fa640 1 -- 172.21.15.135:0/182563623 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c004d90 con 0x55adef3ce6b0 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- 172.21.15.135:0/182563623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 msgr2=0x55adef78e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 0x7fd9700a5210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55adef78ae90 tx=0x7fd97c03c040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef78e7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009bd0 tx=0x7fd96c011810 comp rx=0 tx=0).stop 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- 172.21.15.135:0/182563623 shutdown_connections 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef78e7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef78e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 --2- 172.21.15.135:0/182563623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef78dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- 172.21.15.135:0/182563623 >> 172.21.15.135:0/182563623 conn(0x55adef3e34e0 msgr2=0x55adef78a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- 172.21.15.135:0/182563623 shutdown_connections 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- 172.21.15.135:0/182563623 wait complete. 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 -- start start 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.114+0000 7fd9901c2740 1 Processor -- start 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef798950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef79e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55adef79afb0 con 0x55adef3ef390 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55adef6aec40 con 0x55adef3c64d0 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adef79b130 con 0x55adef3ce6b0 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9901c2740 10 client.0 _ll_register_callbacks cb 0x55adef406be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef79e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53906/0 (socket says 172.21.15.135:53906) 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd97bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef798950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 -- 172.21.15.135:0/907101952 learned_addr learned my addr 172.21.15.135:0/907101952 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 -- 172.21.15.135:0/907101952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 msgr2=0x55adef798950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef798950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 -- 172.21.15.135:0/907101952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 msgr2=0x55adef79e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef79e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 -- 172.21.15.135:0/907101952 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adef4d17d0 con 0x55adef3c64d0 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd9837fe640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef79e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd982ffd640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cd450 tx=0x7fd974009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a3dcb2734d24c7d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd96a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.115+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97409b9f0 con 0x55adef3c64d0 2024-05-20T17:35:33.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd96c005500 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd974098290 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd97409b580 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 10 client.25766 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55adef7abbf0 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd96c005500 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd9740cfbb0 con 0x55adef3c64d0 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 10 client.25766 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 10 client.25766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 20 client.25766 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3adf60 0x55adef7af160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 4 client.25766 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adef701370 con 0x55adef3adf60 2024-05-20T17:35:33.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.116+0000 7fd97bfff640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3adf60 0x55adef7af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.117+0000 7fd96a7fc640 10 client.25766 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.117+0000 7fd97bfff640 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3adf60 0x55adef7af160 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f88350790826ff06 server_cookie=fbb6368b0098b982 in_seq=0 out_seq=0 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd96a7fc640 1 -- 172.21.15.135:0/907101952 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55adef701370 con 0x55adef3adf60 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd96a7fc640 10 client.25766 handle_command_reply: tid=0 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 client.25766 shutdown 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 msgr2=0x55adef798410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cd450 tx=0x7fd974009490 comp rx=0 tx=0).stop 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 shutdown_connections 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3adf60 0x55adef7af160 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef79e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef798950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 --2- 172.21.15.135:0/907101952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef798410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd96a7fc640 0 client.25766 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:33.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 >> 172.21.15.135:0/907101952 conn(0x55adef3e34e0 msgr2=0x55adef78fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 shutdown_connections 2024-05-20T17:35:33.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.119+0000 7fd9901c2740 1 -- 172.21.15.135:0/907101952 wait complete. 2024-05-20T17:35:33.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.120+0000 7fd9901c2740 20 client.25766 trim_cache size 0 max 16384 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.133+0000 7fd9901c2740 1 Processor -- start 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.133+0000 7fd9901c2740 1 -- start start 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841af090 con 0x55adef3ef390 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ac960 con 0x55adef3c64d0 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9901c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841aa7b0 con 0x55adef3ce6b0 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53918/0 (socket says 172.21.15.135:53918) 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd982ffd640 1 -- 172.21.15.135:0/271074832 learned_addr learned my addr 172.21.15.135:0/271074832 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33912/0 (socket says 172.21.15.135:33912) 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd97bfff640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 -- 172.21.15.135:0/271074832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 msgr2=0x55adef7b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 -- 172.21.15.135:0/271074832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 msgr2=0x55adef7988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 -- 172.21.15.135:0/271074832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adef793da0 con 0x55adef3ef390 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd97bfff640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd982ffd640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd9837fe640 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005e30 tx=0x7fd97c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6d21701babbcf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd978ff9640 1 -- 172.21.15.135:0/271074832 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c034040 con 0x55adef3ef390 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd978ff9640 1 -- 172.21.15.135:0/271074832 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c003e50 con 0x55adef3ef390 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.134+0000 7fd978ff9640 1 -- 172.21.15.135:0/271074832 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0306a0 con 0x55adef3ef390 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 -- 172.21.15.135:0/271074832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 msgr2=0x55adef7b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005e30 tx=0x7fd97c042000 comp rx=0 tx=0).stop 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 -- 172.21.15.135:0/271074832 shutdown_connections 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef7b4ea0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 --2- 172.21.15.135:0/271074832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef7988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 -- 172.21.15.135:0/271074832 >> 172.21.15.135:0/271074832 conn(0x55adef3e34e0 msgr2=0x55adef7981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 -- 172.21.15.135:0/271074832 shutdown_connections 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.135+0000 7fd9901c2740 1 -- 172.21.15.135:0/271074832 wait complete. 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 -- start start 2024-05-20T17:35:33.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 Processor -- start 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841aae20 con 0x55adef3ef390 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ac290 con 0x55adef3c64d0 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ab4f0 con 0x55adef3ce6b0 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9901c2740 10 client.0 _ll_register_callbacks cb 0x7fd97400e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33926/0 (socket says 172.21.15.135:33926) 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd9837fe640 1 -- 172.21.15.135:0/2708221395 learned_addr learned my addr 172.21.15.135:0/2708221395 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53926/0 (socket says 172.21.15.135:53926) 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.136+0000 7fd97bfff640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 -- 172.21.15.135:0/2708221395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 msgr2=0x55adef7a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 -- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 msgr2=0x55adef79fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 -- 172.21.15.135:0/2708221395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adef815a40 con 0x55adef3ef390 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9837fe640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009a60 tx=0x7fd97c004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d59fe46895e78b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c004250 con 0x55adef3ef390 2024-05-20T17:35:33.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd97c0043f0 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97c003e50 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd97c063460 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9901c2740 10 client.16134 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55adef816c90 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c003e50 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.137+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd97c0525f0 con 0x55adef3ef390 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 10 client.16134 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 20 client.16134 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3833a0 0x55adef819440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:33.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 4 client.16134 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55adef6fb6c0 con 0x55adef3833a0 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3833a0 0x55adef819440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd96a7fc640 10 client.16134 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.138+0000 7fd982ffd640 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3833a0 0x55adef819440 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf43e2f0a6c4101c server_cookie=399ab1d24fb6dcbc in_seq=0 out_seq=0 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd96a7fc640 1 -- 172.21.15.135:0/2708221395 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55adef6fb6c0 con 0x55adef3833a0 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd96a7fc640 10 client.16134 handle_command_reply: tid=0 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 client.16134 shutdown 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 msgr2=0x55adef815500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009a60 tx=0x7fd97c004900 comp rx=0 tx=0).stop 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 shutdown_connections 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55adef3833a0 0x55adef819440 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55adef3ef390 0x55adef815500 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adef3ce6b0 0x55adef7a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd96a7fc640 0 client.16134 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 --2- 172.21.15.135:0/2708221395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adef3c64d0 0x55adef79fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 >> 172.21.15.135:0/2708221395 conn(0x55adef3e34e0 msgr2=0x55adef791820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 shutdown_connections 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.140+0000 7fd9901c2740 1 -- 172.21.15.135:0/2708221395 wait complete. 2024-05-20T17:35:33.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd9901c2740 20 client.16134 trim_cache size 0 max 16384 2024-05-20T17:35:33.149 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:35:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 msgr2=0x7fd9700a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 0x7fd9700a5210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55adef78ae90 tx=0x7fd97c03c040 comp rx=0 tx=0).stop 2024-05-20T17:35:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 msgr2=0x7fd984199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd97400ea60 tx=0x7fd97400ef20 comp rx=0 tx=0).stop 2024-05-20T17:35:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 shutdown_connections 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd9700a2d00 0x7fd9700a5210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd98410d000 0x7fd98419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98410a6a0 0x7fd984199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 --2- 172.21.15.135:0/2714271955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984103c40 0x7fd984199750 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 >> 172.21.15.135:0/2714271955 conn(0x7fd9840770b0 msgr2=0x7fd984100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 shutdown_connections 2024-05-20T17:35:33.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:33.141+0000 7fd98931a640 1 -- 172.21.15.135:0/2714271955 wait complete. 2024-05-20T17:35:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:33 smithi135 ceph-mon[32027]: pgmap v69: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 562 op/s 2024-05-20T17:35:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:33 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4069706613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:33 smithi160 ceph-mon[36261]: pgmap v69: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 562 op/s 2024-05-20T17:35:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:33 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4069706613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:33.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:33 smithi172 ceph-mon[36511]: pgmap v69: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 562 op/s 2024-05-20T17:35:33.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:33 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4069706613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:35:34.155 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-20T17:35:34.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:35:34.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-20T17:35:34.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 -- 172.21.15.135:0/3296673651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24101750 msgr2=0x7f0e2410f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/3296673651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24101750 0x7f0e2410f5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009ca0 tx=0x7f0e1c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 -- 172.21.15.135:0/3296673651 shutdown_connections 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/3296673651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24101750 0x7f0e2410f5f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/3296673651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 0x7f0e241010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/3296673651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24108ad0 0x7f0e24100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 -- 172.21.15.135:0/3296673651 >> 172.21.15.135:0/3296673651 conn(0x7f0e24076830 msgr2=0x7f0e24076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 -- 172.21.15.135:0/3296673651 shutdown_connections 2024-05-20T17:35:34.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.286+0000 7f0e28cbc640 1 -- 172.21.15.135:0/3296673651 wait complete. 2024-05-20T17:35:34.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 Processor -- start 2024-05-20T17:35:34.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 -- start start 2024-05-20T17:35:34.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24108ad0 0x7f0e24199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 0x7f0e2419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24112e30 con 0x7f0e24108ad0 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24112cb0 con 0x7f0e24108f70 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e28cbc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24112fb0 con 0x7f0e24101750 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.287+0000 7f0e21d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24108ad0 0x7f0e24199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53956/0 (socket says 172.21.15.135:53956) 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 -- 172.21.15.135:0/1411448699 learned_addr learned my addr 172.21.15.135:0/1411448699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 0x7f0e2419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 -- 172.21.15.135:0/1411448699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 msgr2=0x7f0e2419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 0x7f0e2419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 -- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24108ad0 msgr2=0x7f0e24199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24108ad0 0x7f0e24199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 -- 172.21.15.135:0/1411448699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2419e630 con 0x7f0e24101750 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e2259c640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400e9f0 tx=0x7f0e1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e137fe640 1 -- 172.21.15.135:0/1411448699 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1400ccc0 con 0x7f0e24101750 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2419e920 con 0x7f0e24101750 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e137fe640 1 -- 172.21.15.135:0/1411448699 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e14005500 con 0x7f0e24101750 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e137fe640 1 -- 172.21.15.135:0/1411448699 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14018630 con 0x7f0e24101750 2024-05-20T17:35:34.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.288+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e241a62a0 con 0x7f0e24101750 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.291+0000 7f0e137fe640 1 -- 172.21.15.135:0/1411448699 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0e140046c0 con 0x7f0e24101750 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.291+0000 7f0e2fc37740 1 Processor -- start 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.291+0000 7f0e2fc37740 1 -- start start 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558fb55c6990 con 0x558fb52a1730 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558fb556e5b0 con 0x558fb52c2410 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558fb55c2950 con 0x558fb5299550 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e21d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53932/0 (socket says 172.21.15.135:53932) 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53972/0 (socket says 172.21.15.135:53972) 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 -- 172.21.15.135:0/3452930094 learned_addr learned my addr 172.21.15.135:0/3452930094 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e137fe640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 0x7f0e0c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 -- 172.21.15.135:0/3452930094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 msgr2=0x558fb5661b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 -- 172.21.15.135:0/3452930094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 msgr2=0x558fb56620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 -- 172.21.15.135:0/3452930094 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fb53a27e0 con 0x558fb52c2410 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e2259c640 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e137fe640 1 -- 172.21.15.135:0/1411448699 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e140cf920 con 0x7f0e24101750 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 0x7f0e0c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.292+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009ca0 tx=0x7f0e1c009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba823a868dadc69 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.293+0000 7f0e10ff9640 1 -- 172.21.15.135:0/3452930094 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c042040 con 0x558fb52c2410 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.293+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 0x7f0e0c0a5210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c04d000 tx=0x7f0e1c04e000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.293+0000 7f0e10ff9640 1 -- 172.21.15.135:0/3452930094 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c036040 con 0x558fb52c2410 2024-05-20T17:35:34.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.293+0000 7f0e10ff9640 1 -- 172.21.15.135:0/3452930094 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c02f9f0 con 0x558fb52c2410 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- 172.21.15.135:0/3452930094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 msgr2=0x558fb5661620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009ca0 tx=0x7f0e1c009850 comp rx=0 tx=0).stop 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- 172.21.15.135:0/3452930094 shutdown_connections 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb5299550 0x558fb5661b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/3452930094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52c2410 0x558fb5661620 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- 172.21.15.135:0/3452930094 >> 172.21.15.135:0/3452930094 conn(0x558fb52b6560 msgr2=0x558fb565ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- 172.21.15.135:0/3452930094 shutdown_connections 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- 172.21.15.135:0/3452930094 wait complete. 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 -- start start 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.294+0000 7f0e2fc37740 1 Processor -- start 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb566dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb566bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558fb566e970 con 0x558fb5299550 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558fb5581b40 con 0x558fb52a1730 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558fb566eaf0 con 0x558fb52c2410 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 10 client.0 _ll_register_callbacks cb 0x558fb55760f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:34.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33964/0 (socket says 172.21.15.135:33964) 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e21d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb566dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 -- 172.21.15.135:0/2515508840 learned_addr learned my addr 172.21.15.135:0/2515508840 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb566bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 -- 172.21.15.135:0/2515508840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 msgr2=0x558fb566bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb566bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 -- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 msgr2=0x558fb566dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb566dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 -- 172.21.15.135:0/2515508840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fb5402f70 con 0x558fb5299550 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb566dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0e140982a0 tx=0x7f0e14009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73b033ec9bb486a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1409e070 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e1409b490 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.295+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c036040 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0e1409b980 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 10 client.16146 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558fb529a170 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c036040 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0e1409ad00 con 0x558fb5299550 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 10 client.16146 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 20 client.16146 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb52811f0 0x558fb567e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 4 client.16146 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:34.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fb55d40c0 con 0x558fb52811f0 2024-05-20T17:35:34.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.296+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb52811f0 0x558fb567e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.297+0000 7f0e09ffb640 10 client.16146 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.297+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb52811f0 0x558fb567e200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb863d4a662eab2c server_cookie=dd520493721040a5 in_seq=0 out_seq=0 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2515508840 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558fb55d40c0 con 0x558fb52811f0 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e09ffb640 10 client.16146 handle_command_reply: tid=0 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 client.16146 shutdown 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 msgr2=0x558fb566d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0e140982a0 tx=0x7f0e14009310 comp rx=0 tx=0).stop 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 shutdown_connections 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb52811f0 0x558fb567e200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb566bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb566dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e09ffb640 0 client.16146 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2515508840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb566d6d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 >> 172.21.15.135:0/2515508840 conn(0x558fb52b6560 msgr2=0x558fb56613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 shutdown_connections 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2515508840 wait complete. 2024-05-20T17:35:34.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.300+0000 7f0e2fc37740 20 client.16146 trim_cache size 0 max 16384 2024-05-20T17:35:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 Processor -- start 2024-05-20T17:35:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 -- start start 2024-05-20T17:35:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb5299550 0x558fb566da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb5683f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241b1310 con 0x558fb52a1730 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241aebe0 con 0x558fb5299550 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241aca30 con 0x558fb52c2410 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e21d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e21d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33980/0 (socket says 172.21.15.135:33980) 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e21d9b640 1 -- 172.21.15.135:0/1962690705 learned_addr learned my addr 172.21.15.135:0/1962690705 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb5683f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.320+0000 7f0e2259c640 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb5299550 0x558fb566da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 -- 172.21.15.135:0/1962690705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 msgr2=0x558fb5683f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb5683f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 -- 172.21.15.135:0/1962690705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb5299550 msgr2=0x558fb566da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb5299550 0x558fb566da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 -- 172.21.15.135:0/1962690705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fb567ad50 con 0x558fb52a1730 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0e241093a0 tx=0x7f0e18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f808dc16bb333435 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e0bfff640 1 -- 172.21.15.135:0/1962690705 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18005020 con 0x558fb52a1730 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e0bfff640 1 -- 172.21.15.135:0/1962690705 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1800f7f0 con 0x558fb52a1730 2024-05-20T17:35:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.321+0000 7f0e0bfff640 1 -- 172.21.15.135:0/1962690705 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004a70 con 0x558fb52a1730 2024-05-20T17:35:34.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- 172.21.15.135:0/1962690705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 msgr2=0x558fb56839c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0e241093a0 tx=0x7f0e18005f90 comp rx=0 tx=0).stop 2024-05-20T17:35:34.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- 172.21.15.135:0/1962690705 shutdown_connections 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb5683f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb52a1730 0x558fb56839c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/1962690705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb5299550 0x558fb566da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- 172.21.15.135:0/1962690705 >> 172.21.15.135:0/1962690705 conn(0x558fb52b6560 msgr2=0x558fb566d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- 172.21.15.135:0/1962690705 shutdown_connections 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- 172.21.15.135:0/1962690705 wait complete. 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 -- start start 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.322+0000 7f0e2fc37740 1 Processor -- start 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb56740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb56ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ad0a0 con 0x558fb5299550 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ae510 con 0x558fb52a1730 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ad770 con 0x558fb52c2410 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 10 client.0 _ll_register_callbacks cb 0x7f0e1400ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33988/0 (socket says 172.21.15.135:33988) 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 -- 172.21.15.135:0/2023460892 learned_addr learned my addr 172.21.15.135:0/2023460892 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e22d9d640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb56ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb56740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 -- 172.21.15.135:0/2023460892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 msgr2=0x558fb56ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb56ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 -- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 msgr2=0x558fb56740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb56740f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 -- 172.21.15.135:0/2023460892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fb56de230 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2259c640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400cf10 tx=0x7f0e1409b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aec6faea584c6c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1409e040 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e140a1380 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.323+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1800f7f0 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0e140056b0 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 10 client.16152 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558fb56e67a0 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1800f7f0 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0e14004f20 con 0x558fb5299550 2024-05-20T17:35:34.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 10 client.16152 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 20 client.16152 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb5256630 0x558fb56e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 4 client.16152 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558fb55ce410 con 0x558fb5256630 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.324+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb5256630 0x558fb56e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.325+0000 7f0e09ffb640 10 client.16152 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.325+0000 7f0e21d9b640 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb5256630 0x558fb56e8ea0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5673c72c3c9de8 server_cookie=d5daf4d15c9564e9 in_seq=0 out_seq=0 2024-05-20T17:35:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.435+0000 7f0e09ffb640 1 -- 172.21.15.135:0/2023460892 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558fb55ce410 con 0x558fb5256630 2024-05-20T17:35:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.435+0000 7f0e09ffb640 10 client.16152 handle_command_reply: tid=0 2024-05-20T17:35:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.435+0000 7f0e2fc37740 1 client.16152 shutdown 2024-05-20T17:35:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.435+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 msgr2=0x558fb5673bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.435+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400cf10 tx=0x7f0e1409b540 comp rx=0 tx=0).stop 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 shutdown_connections 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x558fb5256630 0x558fb56e8ea0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558fb52c2410 0x558fb56ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558fb52a1730 0x558fb56740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 --2- 172.21.15.135:0/2023460892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fb5299550 0x558fb5673bb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 >> 172.21.15.135:0/2023460892 conn(0x558fb52b6560 msgr2=0x558fb56658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e09ffb640 0 client.16152 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 shutdown_connections 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 1 -- 172.21.15.135:0/2023460892 wait complete. 2024-05-20T17:35:34.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e2fc37740 20 client.16152 trim_cache size 0 max 16384 2024-05-20T17:35:34.439 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:35:34.439 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-05-20T17:35:34.439 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "a5597c0b-0fb8-4c92-84bf-68576c85c899", 2024-05-20T17:35:34.439 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-05-20T17:35:34.439 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 msgr2=0x7f0e0c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.436+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 0x7f0e0c0a5210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c04d000 tx=0x7f0e1c04e000 comp rx=0 tx=0).stop 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 msgr2=0x7f0e241997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400e9f0 tx=0x7f0e1400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 shutdown_connections 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0e0c0a2d00 0x7f0e0c0a5210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e24108f70 0x7f0e2419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e24108ad0 0x7f0e24199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 --2- 172.21.15.135:0/1411448699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e24101750 0x7f0e241997d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 >> 172.21.15.135:0/1411448699 conn(0x7f0e24076830 msgr2=0x7f0e240ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 shutdown_connections 2024-05-20T17:35:34.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.437+0000 7f0e28cbc640 1 -- 172.21.15.135:0/1411448699 wait complete. 2024-05-20T17:35:34.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:35:34.451 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:35:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 -- 172.21.15.135:0/698876207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754108ae0 msgr2=0x7f37541026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 --2- 172.21.15.135:0/698876207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754108ae0 0x7f37541026d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f374c009900 tx=0x7f374c02a410 comp rx=0 tx=0).stop 2024-05-20T17:35:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 -- 172.21.15.135:0/698876207 shutdown_connections 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 --2- 172.21.15.135:0/698876207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754103280 0x7f375410f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 --2- 172.21.15.135:0/698876207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 0x7f3754102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 --2- 172.21.15.135:0/698876207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754108ae0 0x7f37541026d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 -- 172.21.15.135:0/698876207 >> 172.21.15.135:0/698876207 conn(0x7f3754078230 msgr2=0x7f3754078670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 -- 172.21.15.135:0/698876207 shutdown_connections 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.572+0000 7f375be5f640 1 -- 172.21.15.135:0/698876207 wait complete. 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 Processor -- start 2024-05-20T17:35:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 -- start start 2024-05-20T17:35:34.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754108ae0 0x7f375419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 0x7f3754199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3754112e70 con 0x7f3754103280 2024-05-20T17:35:34.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3754112cf0 con 0x7f3754108f80 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375be5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3754112ff0 con 0x7f3754108ae0 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33996/0 (socket says 172.21.15.135:33996) 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f3759bfb640 1 -- 172.21.15.135:0/4079965318 learned_addr learned my addr 172.21.15.135:0/4079965318 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f37593fa640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754108ae0 0x7f375419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.573+0000 7f375a3fc640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 0x7f3754199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 -- 172.21.15.135:0/4079965318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754108ae0 msgr2=0x7f375419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754108ae0 0x7f375419fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 -- 172.21.15.135:0/4079965318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 msgr2=0x7f3754199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 0x7f3754199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 -- 172.21.15.135:0/4079965318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3754199d80 con 0x7f3754103280 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3759bfb640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f374c02a930 tx=0x7f374c003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3752ffd640 1 -- 172.21.15.135:0/4079965318 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c03f070 con 0x7f3754103280 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3752ffd640 1 -- 172.21.15.135:0/4079965318 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374c031c90 con 0x7f3754103280 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3754199fb0 con 0x7f3754103280 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f3752ffd640 1 -- 172.21.15.135:0/4079965318 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c035030 con 0x7f3754103280 2024-05-20T17:35:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.574+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375419a4a0 con 0x7f3754103280 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.577+0000 7f3752ffd640 1 -- 172.21.15.135:0/4079965318 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f374c042070 con 0x7f3754103280 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 Processor -- start 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 -- start start 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c2e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c2e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f452b93d00 con 0x55f45288f390 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f452b3b4c0 con 0x55f4528664d0 2024-05-20T17:35:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3762dd7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f452b8fcc0 con 0x55f45286e6b0 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f375a3fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f375a3fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34010/0 (socket says 172.21.15.135:34010) 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f37593fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c2e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f375a3fc640 1 -- 172.21.15.135:0/822299004 learned_addr learned my addr 172.21.15.135:0/822299004 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.578+0000 7f3752ffd640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 0x7f373c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f375a3fc640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 0x7f373c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 -- 172.21.15.135:0/822299004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 msgr2=0x55f452c2e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c2e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 -- 172.21.15.135:0/822299004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 msgr2=0x55f452c2dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 -- 172.21.15.135:0/822299004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4529717d0 con 0x55f4528664d0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f375a3fc640 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3752ffd640 1 -- 172.21.15.135:0/4079965318 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f374c0efa80 con 0x7f3754103280 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f3759bfb640 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c2e100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f374c0ed1d0 tx=0x7f374c03b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d82f14369509e1e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f375a3fc640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 0x7f373c0a5210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55f452c2aed0 tx=0x7f3744004730 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f373bfff640 1 -- 172.21.15.135:0/822299004 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c049070 con 0x55f4528664d0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f373bfff640 1 -- 172.21.15.135:0/822299004 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374c0c4c10 con 0x55f4528664d0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.579+0000 7f373bfff640 1 -- 172.21.15.135:0/822299004 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c0f7040 con 0x55f4528664d0 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 -- 172.21.15.135:0/822299004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 msgr2=0x55f452c2e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c2e100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f374c0ed1d0 tx=0x7f374c03b720 comp rx=0 tx=0).stop 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 -- 172.21.15.135:0/822299004 shutdown_connections 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c2e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c2e100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 --2- 172.21.15.135:0/822299004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c2dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 -- 172.21.15.135:0/822299004 >> 172.21.15.135:0/822299004 conn(0x55f4528834e0 msgr2=0x55f452c2a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 -- 172.21.15.135:0/822299004 shutdown_connections 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.580+0000 7f3762dd7740 1 -- 172.21.15.135:0/822299004 wait complete. 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 -- start start 2024-05-20T17:35:34.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 Processor -- start 2024-05-20T17:35:34.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c3e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c3c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f452c3f250 con 0x55f45288f390 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f452b4eb90 con 0x55f4528664d0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.581+0000 7f3762dd7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f452c3f3d0 con 0x55f45286e6b0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3762dd7740 10 client.0 _ll_register_callbacks cb 0x55f452b8ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f375a3fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c3c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f37593fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c3e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:54002/0 (socket says 172.21.15.135:54002) 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 -- 172.21.15.135:0/3417202587 learned_addr learned my addr 172.21.15.135:0/3417202587 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 -- 172.21.15.135:0/3417202587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 msgr2=0x55f452c3e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c3e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 -- 172.21.15.135:0/3417202587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 msgr2=0x55f452c3c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c3c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 -- 172.21.15.135:0/3417202587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4528a73f0 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f375a3fc640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c3c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3759bfb640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f374c0bbd50 tx=0x7f374c003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33100dbbf9d4688 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f37397fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c049050 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374c0c4c10 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f374c0ed450 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f374c0bc050 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3762dd7740 10 client.25802 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.582+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f4528670f0 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374c0c4c10 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f374c0dabe0 con 0x55f4528664d0 2024-05-20T17:35:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 10 client.25802 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 10 client.25802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 20 client.25802 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45284df60 0x55f452c4eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 4 client.25802 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f452ba1430 con 0x55f45284df60 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.583+0000 7f37593fa640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45284df60 0x55f452c4eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.584+0000 7f37397fa640 10 client.25802 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.584+0000 7f37593fa640 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45284df60 0x55f452c4eb20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae6138f9a844e4ae server_cookie=ba063f41f82fdb15 in_seq=0 out_seq=0 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.588+0000 7f37397fa640 1 -- 172.21.15.135:0/3417202587 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f452ba1430 con 0x55f45284df60 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.588+0000 7f37397fa640 10 client.25802 handle_command_reply: tid=0 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.588+0000 7f3762dd7740 1 client.25802 shutdown 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 msgr2=0x55f452c3e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f374c0bbd50 tx=0x7f374c003f50 comp rx=0 tx=0).stop 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 shutdown_connections 2024-05-20T17:35:34.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45284df60 0x55f452c4eb20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45288f390 0x55f452c3c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f37397fa640 0 client.25802 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c3e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 --2- 172.21.15.135:0/3417202587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4528664d0 0x55f452c3e180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 >> 172.21.15.135:0/3417202587 conn(0x55f4528834e0 msgr2=0x55f452c2e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 shutdown_connections 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 1 -- 172.21.15.135:0/3417202587 wait complete. 2024-05-20T17:35:34.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.589+0000 7f3762dd7740 20 client.25802 trim_cache size 0 max 16384 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 Processor -- start 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 -- start start 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45284df60 0x55f452c3e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37541af2b0 con 0x55f4528664d0 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37541acb80 con 0x55f45284df60 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3762dd7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37541aa9d0 con 0x55f45286e6b0 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f37593fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f375a3fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f37593fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34014/0 (socket says 172.21.15.135:34014) 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f37593fa640 1 -- 172.21.15.135:0/1062932526 learned_addr learned my addr 172.21.15.135:0/1062932526 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.609+0000 7f3759bfb640 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45284df60 0x55f452c3e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 -- 172.21.15.135:0/1062932526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 msgr2=0x55f452c364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 -- 172.21.15.135:0/1062932526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45284df60 msgr2=0x55f452c3e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45284df60 0x55f452c3e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 -- 172.21.15.135:0/1062932526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f452c1b990 con 0x55f4528664d0 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f37593fa640 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f375406b3a0 tx=0x7f3748009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9c0018d928a77a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f373b7fe640 1 -- 172.21.15.135:0/1062932526 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748022070 con 0x55f4528664d0 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f373b7fe640 1 -- 172.21.15.135:0/1062932526 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374801ee50 con 0x55f4528664d0 2024-05-20T17:35:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.610+0000 7f373b7fe640 1 -- 172.21.15.135:0/1062932526 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748004440 con 0x55f4528664d0 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- 172.21.15.135:0/1062932526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 msgr2=0x55f452c35f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f375406b3a0 tx=0x7f3748009500 comp rx=0 tx=0).stop 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- 172.21.15.135:0/1062932526 shutdown_connections 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45286e6b0 0x55f452c364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c35f70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 --2- 172.21.15.135:0/1062932526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45284df60 0x55f452c3e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- 172.21.15.135:0/1062932526 >> 172.21.15.135:0/1062932526 conn(0x55f4528834e0 msgr2=0x55f452c3df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- 172.21.15.135:0/1062932526 shutdown_connections 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- 172.21.15.135:0/1062932526 wait complete. 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.611+0000 7f3762dd7740 1 -- start start 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 Processor -- start 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45286e6b0 0x55f452c403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37541ab040 con 0x55f4528664d0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37541ac4b0 con 0x55f45286e6b0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37541ab710 con 0x55f45284df60 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f37593fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3762dd7740 10 client.0 _ll_register_callbacks cb 0x7f3744009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f37593fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34022/0 (socket says 172.21.15.135:34022) 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f3759bfb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:54042/0 (socket says 172.21.15.135:54042) 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f37593fa640 1 -- 172.21.15.135:0/432365825 learned_addr learned my addr 172.21.15.135:0/432365825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.612+0000 7f375a3fc640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45286e6b0 0x55f452c403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 -- 172.21.15.135:0/432365825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 msgr2=0x55f452c44b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 -- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45286e6b0 msgr2=0x55f452c403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:34.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45286e6b0 0x55f452c403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 -- 172.21.15.135:0/432365825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f452c40a80 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f3759bfb640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37593fa640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3748014010 tx=0x7f37480111c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c000b7e95e54b9c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37397fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748022070 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f374801e630 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374801ee50 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f374801e830 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f3762dd7740 10 client.16170 fetch_fsmap learned FSMap version 24 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f452cb6af0 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.613+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374801ee50 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3748030800 con 0x55f4528664d0 2024-05-20T17:35:34.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 10 client.16170 fetch_fsmap finished waiting for FSMap version 24 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 20 client.16170 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45288f390 0x55f452cb9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 4 client.16170 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f452b9b780 con 0x55f45288f390 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3759bfb640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45288f390 0x55f452cb9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f37397fa640 10 client.16170 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.614+0000 7f3759bfb640 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45288f390 0x55f452cb9280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfdbad817f7ed32 server_cookie=e96849e6d5fa11ae in_seq=0 out_seq=0 2024-05-20T17:35:34.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f37397fa640 1 -- 172.21.15.135:0/432365825 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55f452b9b780 con 0x55f45288f390 2024-05-20T17:35:34.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f37397fa640 10 client.16170 handle_command_reply: tid=0 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 client.16170 shutdown 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 msgr2=0x55f452c3fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3748014010 tx=0x7f37480111c0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 shutdown_connections 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f45288f390 0x55f452cb9280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f45286e6b0 0x55f452c403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4528664d0 0x55f452c3fe80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 --2- 172.21.15.135:0/432365825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f45284df60 0x55f452c44b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f37397fa640 0 client.16170 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.618+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 >> 172.21.15.135:0/432365825 conn(0x55f4528834e0 msgr2=0x55f452c3adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 shutdown_connections 2024-05-20T17:35:34.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f3762dd7740 1 -- 172.21.15.135:0/432365825 wait complete. 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f3762dd7740 20 client.16170 trim_cache size 0 max 16384 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "scrub active (2 inodes in the stack)", 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "a5597c0b-0fb8-4c92-84bf-68576c85c899": { 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "a5597c0b-0fb8-4c92-84bf-68576c85c899", 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-05-20T17:35:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:35:34.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:35:34.625 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:35:34.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 msgr2=0x7f373c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 0x7f373c0a5210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55f452c2aed0 tx=0x7f3744004730 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 msgr2=0x7f375419f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f374c02a930 tx=0x7f374c003b20 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 shutdown_connections 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f373c0a2d00 0x7f373c0a5210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3754108f80 0x7f3754199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3754108ae0 0x7f375419fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 --2- 172.21.15.135:0/4079965318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754103280 0x7f375419f4d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 >> 172.21.15.135:0/4079965318 conn(0x7f3754078230 msgr2=0x7f3754104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 shutdown_connections 2024-05-20T17:35:34.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:35:34.619+0000 7f375be5f640 1 -- 172.21.15.135:0/4079965318 wait complete. 2024-05-20T17:35:34.632 INFO:tasks.cephfs.filesystem:scrub status for tag:a5597c0b-0fb8-4c92-84bf-68576c85c899 - {'path': '/', 'tag': 'a5597c0b-0fb8-4c92-84bf-68576c85c899', 'options': 'recursive,force'} 2024-05-20T17:35:34.964 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.657+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in auth v14 ap=1 s=9817 n(v0 rc2024-05-20T17:34:56.731540+0000 b9817 1=1+0) caps={25025=pAsLsXsFscr/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000207:[<0x10000000204/Makefile.in v6>,<0x10000000201/man v12>,<0x10000000006/blogbench-1.0 v464>,<0x10000000005/tmp v12>,<0x100000001fb/client.0 v12>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v28>,<0x10000000001/sv_1 v51>,<0x10000000000/qa v39>,<0x1/volumes v37>]//[]","memoryvalue":"(3)0x10000000207:[<0x10000000204/Makefile.in v14>,<0x10000000201/man v2063>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:34.965 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.658+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am auth v10 ap=1 s=55 n(v0 rc2024-05-20T17:34:56.730540+0000 b55 1=1+0) caps={25025=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000206:[<0x10000000204/Makefile.am v4>,<0x10000000201/man v12>,<0x10000000006/blogbench-1.0 v464>,<0x10000000005/tmp v12>,<0x100000001fb/client.0 v12>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v28>,<0x10000000001/sv_1 v51>,<0x10000000000/qa v39>,<0x1/volumes v37>]//[]","memoryvalue":"(3)0x10000000206:[<0x10000000204/Makefile.am v10>,<0x10000000201/man v2063>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:34.965 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.658+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile auth v33 ap=1 s=10056 n(v0 rc2024-05-20T17:35:02.620418+0000 b10056 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000372:[<0x10000000204/Makefile v33>,<0x10000000201/man v2063>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000372:[<0x10000000204/Makefile v33>,<0x10000000201/man v2063>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:34.965 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.659+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8 auth v18 ap=1 s=964 n(v0 rc2024-05-20T17:34:56.729540+0000 b964 1=1+0) caps={25025=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000205:[<0x10000000204/blogbench.8 v2>,<0x10000000201/man v12>,<0x10000000006/blogbench-1.0 v464>,<0x10000000005/tmp v12>,<0x100000001fb/client.0 v12>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v28>,<0x10000000001/sv_1 v51>,<0x10000000000/qa v39>,<0x1/volumes v37>]//[]","memoryvalue":"(3)0x10000000205:[<0x10000000204/blogbench.8 v18>,<0x10000000201/man v2063>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:34.965 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.962+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg auth v360 ap=1 s=47048 n(v0 rc2024-05-20T17:35:24.885957+0000 b47048 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d8:[<0x10000001447/picture-18.jpg v186>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014d8:[<0x10000001447/picture-18.jpg v360>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:35 smithi160 ceph-mon[36261]: pgmap v70: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 520 op/s 2024-05-20T17:35:35.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:35 smithi160 ceph-mon[36261]: scrub queued for path: / 2024-05-20T17:35:35.191 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:35 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:35.191 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:35 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:35.194 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.935+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml auth v1000 ap=1 s=22618 n(v0 rc2024-05-20T17:35:05.724354+0000 b22618 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879611700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003df:[<0x1000000039a/article-64.xml v1000>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003df:[<0x1000000039a/article-64.xml v1000>,<0x10000000399/blog-0 v44264>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.194 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.950+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg auth v1014 ap=1 s=14807 n(v0 rc2024-05-20T17:35:06.344341+0000 b14807 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d4:[<0x1000000039a/picture-27.jpg v1014>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d4:[<0x1000000039a/picture-27.jpg v1014>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.194 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.950+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003be [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml auth v988 ap=1 s=13147 n(v0 rc2024-05-20T17:35:05.668355+0000 b13147 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003be:[<0x1000000039a/article-75.xml v988>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003be:[<0x1000000039a/article-75.xml v988>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.194 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.951+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000430 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml auth v1024 ap=1 s=9035 n(v0 rc2024-05-20T17:35:05.886351+0000 b9035 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000430:[<0x1000000039a/article-37.xml v1024>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000430:[<0x1000000039a/article-37.xml v1024>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.194 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.951+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml auth v1026 ap=1 s=32296 n(v0 rc2024-05-20T17:35:05.679355+0000 b32296 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c4:[<0x1000000039a/article-73.xml v1026>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c4:[<0x1000000039a/article-73.xml v1026>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.951+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml auth v1006 ap=1 s=22457 n(v0 rc2024-05-20T17:35:05.869351+0000 b22457 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042a:[<0x1000000039a/article-39.xml v1006>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000042a:[<0x1000000039a/article-39.xml v1006>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.951+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000433 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml auth v994 ap=1 s=28834 n(v0 rc2024-05-20T17:35:05.895351+0000 b28834 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000433:[<0x1000000039a/article-36.xml v994>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000433:[<0x1000000039a/article-36.xml v994>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.953+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml auth v984 ap=1 s=28278 n(v0 rc2024-05-20T17:35:06.113346+0000 b28278 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047c:[<0x1000000039a/article-12.xml v984>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000047c:[<0x1000000039a/article-12.xml v984>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.953+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml auth v992 ap=1 s=32559 n(v0 rc2024-05-20T17:35:06.214344+0000 b32559 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87961d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049c:[<0x1000000039a/article-1.xml v992>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000049c:[<0x1000000039a/article-1.xml v992>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.953+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg auth v1012 ap=1 s=33508 n(v0 rc2024-05-20T17:35:06.303342+0000 b33508 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b7a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c6:[<0x1000000039a/picture-34.jpg v1012>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c6:[<0x1000000039a/picture-34.jpg v1012>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.954+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ea [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg auth v990 ap=1 s=34908 n(v0 rc2024-05-20T17:35:06.411340+0000 b34908 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b7bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ea:[<0x1000000039a/picture-16.jpg v990>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ea:[<0x1000000039a/picture-16.jpg v990>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.954+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml auth v1008 ap=1 s=6943 n(v0 rc2024-05-20T17:35:05.714354+0000 b6943 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b7b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d9:[<0x1000000039a/article-66.xml v1008>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d9:[<0x1000000039a/article-66.xml v1008>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.954+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml auth v1002 ap=1 s=29795 n(v0 rc2024-05-20T17:35:05.658355+0000 b29795 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b7c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b8:[<0x1000000039a/article-77.xml v1002>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003b8:[<0x1000000039a/article-77.xml v1002>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.955+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml auth v986 ap=1 s=29753 n(v0 rc2024-05-20T17:35:06.011348+0000 b29753 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045a:[<0x1000000039a/article-23.xml v986>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000045a:[<0x1000000039a/article-23.xml v986>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.955+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml auth v1028 ap=1 s=31888 n(v0 rc2024-05-20T17:35:06.064347+0000 b31888 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046d:[<0x1000000039a/article-17.xml v1028>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000046d:[<0x1000000039a/article-17.xml v1028>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.195 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.955+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml auth v1004 ap=1 s=25244 n(v0 rc2024-05-20T17:35:05.728354+0000 b25244 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e2:[<0x1000000039a/article-63.xml v1004>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003e2:[<0x1000000039a/article-63.xml v1004>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.955+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg auth v1018 ap=1 s=62571 n(v0 rc2024-05-20T17:35:06.315342+0000 b62571 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b87600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ca:[<0x1000000039a/picture-32.jpg v1018>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ca:[<0x1000000039a/picture-32.jpg v1018>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.956+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg auth v1020 ap=1 s=15161 n(v0 rc2024-05-20T17:35:06.224344+0000 b15161 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b88100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a2:[<0x1000000039a/picture-48.jpg v1020>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004a2:[<0x1000000039a/picture-48.jpg v1020>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.956+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000504 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg auth v1000 ap=1 s=52028 n(v0 rc2024-05-20T17:35:06.488338+0000 b52028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bcb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000504:[<0x1000000039a/picture-3.jpg v1000>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000504:[<0x1000000039a/picture-3.jpg v1000>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.957+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg auth v992 ap=1 s=54744 n(v0 rc2024-05-20T17:35:06.441339+0000 b54744 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f4:[<0x1000000039a/picture-11.jpg v992>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f4:[<0x1000000039a/picture-11.jpg v992>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.957+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000490 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml auth v978 ap=1 s=1750 n(v0 rc2024-05-20T17:35:06.191344+0000 b1750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000490:[<0x1000000039a/article-5.xml v978>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000490:[<0x1000000039a/article-5.xml v978>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.957+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000439 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml auth v972 ap=1 s=2325 n(v0 rc2024-05-20T17:35:05.912350+0000 b2325 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bcd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000439:[<0x1000000039a/article-34.xml v972>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000439:[<0x1000000039a/article-34.xml v972>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.958+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ac [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml auth v976 ap=1 s=25946 n(v0 rc2024-05-20T17:35:05.636356+0000 b25946 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bdeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ac:[<0x1000000039a/article-81.xml v976>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ac:[<0x1000000039a/article-81.xml v976>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.958+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml auth v1004 ap=1 s=29012 n(v0 rc2024-05-20T17:35:05.652356+0000 b29012 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bdf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b6:[<0x1000000039a/article-78.xml v1004>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003b6:[<0x1000000039a/article-78.xml v1004>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.196 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.958+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000449 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml auth v994 ap=1 s=30278 n(v0 rc2024-05-20T17:35:05.958349+0000 b30278 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bdf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000449:[<0x1000000039a/article-29.xml v994>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000449:[<0x1000000039a/article-29.xml v994>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.958+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ec [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml auth v996 ap=1 s=19893 n(v0 rc2024-05-20T17:35:05.743354+0000 b19893 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bdfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ec:[<0x1000000039a/article-60.xml v996>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ec:[<0x1000000039a/article-60.xml v996>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.958+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ba [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg auth v988 ap=1 s=49903 n(v0 rc2024-05-20T17:35:06.269343+0000 b49903 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879be0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ba:[<0x1000000039a/picture-40.jpg v988>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ba:[<0x1000000039a/picture-40.jpg v988>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.959+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml auth v984 ap=1 s=11367 n(v0 rc2024-05-20T17:35:06.020348+0000 b11367 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879be0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045d:[<0x1000000039a/article-22.xml v984>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000045d:[<0x1000000039a/article-22.xml v984>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.959+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml auth v990 ap=1 s=7431 n(v0 rc2024-05-20T17:35:05.798353+0000 b7431 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040b:[<0x1000000039a/article-49.xml v990>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000040b:[<0x1000000039a/article-49.xml v990>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.960+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml auth v987 ap=1 s=23937 n(v0 rc2024-05-20T17:35:05.835352+0000 b23937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041f:[<0x1000000039a/article-43.xml v987>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000041f:[<0x1000000039a/article-43.xml v987>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.960+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml auth v1007 ap=1 s=7752 n(v0 rc2024-05-20T17:35:05.921350+0000 b7752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043d:[<0x1000000039a/article-33.xml v1007>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000043d:[<0x1000000039a/article-33.xml v1007>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.961+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000500 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg auth v1009 ap=1 s=19661 n(v0 rc2024-05-20T17:35:06.476339+0000 b19661 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000500:[<0x1000000039a/picture-5.jpg v1009>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000500:[<0x1000000039a/picture-5.jpg v1009>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.962+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml auth v1005 ap=1 s=16932 n(v0 rc2024-05-20T17:35:05.758353+0000 b16932 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bfc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f3:[<0x1000000039a/article-57.xml v1005>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003f3:[<0x1000000039a/article-57.xml v1005>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.962+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml auth v1001 ap=1 s=12819 n(v0 rc2024-05-20T17:35:05.647356+0000 b12819 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bfdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b2:[<0x1000000039a/article-79.xml v1001>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003b2:[<0x1000000039a/article-79.xml v1001>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.964+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml auth v1015 ap=1 s=11522 n(v0 rc2024-05-20T17:35:05.753354+0000 b11522 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bfe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f1:[<0x1000000039a/article-58.xml v1015>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003f1:[<0x1000000039a/article-58.xml v1015>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.965+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml auth v997 ap=1 s=6998 n(v0 rc2024-05-20T17:35:05.777353+0000 b6998 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bfec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ff:[<0x1000000039a/article-53.xml v997>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ff:[<0x1000000039a/article-53.xml v997>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.966+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml auth v999 ap=1 s=5093 n(v0 rc2024-05-20T17:35:05.966349+0000 b5093 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c0a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044c:[<0x1000000039a/article-28.xml v999>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000044c:[<0x1000000039a/article-28.xml v999>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.968+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000403 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml auth v979 ap=1 s=22083 n(v0 rc2024-05-20T17:35:05.782353+0000 b22083 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c0ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000403:[<0x1000000039a/article-52.xml v979>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000403:[<0x1000000039a/article-52.xml v979>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.974+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg auth v995 ap=1 s=36705 n(v0 rc2024-05-20T17:35:06.236344+0000 b36705 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c0c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a8:[<0x1000000039a/picture-46.jpg v995>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004a8:[<0x1000000039a/picture-46.jpg v995>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.974+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ae [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml auth v981 ap=1 s=29091 n(v0 rc2024-05-20T17:35:05.641356+0000 b29091 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b9e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ae:[<0x1000000039a/article-80.xml v981>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ae:[<0x1000000039a/article-80.xml v981>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.976+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg auth v997 ap=1 s=25910 n(v0 rc2024-05-20T17:35:06.447339+0000 b25910 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879b9f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f6:[<0x1000000039a/picture-10.jpg v997>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f6:[<0x1000000039a/picture-10.jpg v997>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.978+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000508 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg auth v1023 ap=1 s=45263 n(v0 rc2024-05-20T17:35:06.499338+0000 b45263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ba0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000508:[<0x1000000039a/picture-1.jpg v1023>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000508:[<0x1000000039a/picture-1.jpg v1023>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.198 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.979+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000484 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml auth v985 ap=1 s=20964 n(v0 rc2024-05-20T17:35:06.146345+0000 b20964 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ba0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000484:[<0x1000000039a/article-9.xml v985>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000484:[<0x1000000039a/article-9.xml v985>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:34.980+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml auth v999 ap=1 s=13570 n(v0 rc2024-05-20T17:35:05.826352+0000 b13570 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ba1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041b:[<0x1000000039a/article-44.xml v999>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000041b:[<0x1000000039a/article-44.xml v999>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.005+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg auth v1033 ap=1 s=31107 n(v0 rc2024-05-20T17:35:06.471339+0000 b31107 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ba1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fe:[<0x1000000039a/picture-6.jpg v1033>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004fe:[<0x1000000039a/picture-6.jpg v1033>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.007+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml auth v1029 ap=1 s=17019 n(v0 rc2024-05-20T17:35:05.719354+0000 b17019 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879baa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003dc:[<0x1000000039a/article-65.xml v1029>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003dc:[<0x1000000039a/article-65.xml v1029>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.009+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml auth v1013 ap=1 s=3786 n(v0 rc2024-05-20T17:35:05.733354+0000 b3786 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879baab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e5:[<0x1000000039a/article-62.xml v1013>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003e5:[<0x1000000039a/article-62.xml v1013>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.013+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000457 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml auth v1001 ap=1 s=2490 n(v0 rc2024-05-20T17:35:06.003348+0000 b2490 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000457:[<0x1000000039a/article-24.xml v1001>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000457:[<0x1000000039a/article-24.xml v1001>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.201 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.014+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg auth v989 ap=1 s=48554 n(v0 rc2024-05-20T17:35:06.338341+0000 b48554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d2:[<0x1000000039a/picture-28.jpg v989>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d2:[<0x1000000039a/picture-28.jpg v989>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.015+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml auth v977 ap=1 s=14262 n(v0 rc2024-05-20T17:35:05.614356+0000 b14262 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bacc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a0:[<0x1000000039a/article-85.xml v977>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003a0:[<0x1000000039a/article-85.xml v977>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.016+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml auth v1015 ap=1 s=23375 n(v0 rc2024-05-20T17:35:05.709354+0000 b23375 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d6:[<0x1000000039a/article-67.xml v1015>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d6:[<0x1000000039a/article-67.xml v1015>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.017+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg auth v1003 ap=1 s=32736 n(v0 rc2024-05-20T17:35:06.285343+0000 b32736 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c0:[<0x1000000039a/picture-37.jpg v1003>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c0:[<0x1000000039a/picture-37.jpg v1003>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.017+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg auth v1017 ap=1 s=16081 n(v0 rc2024-05-20T17:35:06.405340+0000 b16081 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e8:[<0x1000000039a/picture-17.jpg v1017>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e8:[<0x1000000039a/picture-17.jpg v1017>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.018+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000496 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml auth v1021 ap=1 s=6285 n(v0 rc2024-05-20T17:35:06.202344+0000 b6285 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000496:[<0x1000000039a/article-3.xml v1021>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000496:[<0x1000000039a/article-3.xml v1021>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.019+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004da [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg auth v983 ap=1 s=21344 n(v0 rc2024-05-20T17:35:06.361341+0000 b21344 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004da:[<0x1000000039a/picture-24.jpg v983>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004da:[<0x1000000039a/picture-24.jpg v983>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.020+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg auth v987 ap=1 s=38747 n(v0 rc2024-05-20T17:35:06.309342+0000 b38747 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c8:[<0x1000000039a/picture-33.jpg v987>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c8:[<0x1000000039a/picture-33.jpg v987>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.020+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml auth v1009 ap=1 s=30812 n(v0 rc2024-05-20T17:35:06.168345+0000 b30812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048b:[<0x1000000039a/article-7.xml v1009>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000048b:[<0x1000000039a/article-7.xml v1009>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.202 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.021+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg auth v991 ap=1 s=48229 n(v0 rc2024-05-20T17:35:06.257343+0000 b48229 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b4:[<0x1000000039a/picture-42.jpg v991>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004b4:[<0x1000000039a/picture-42.jpg v991>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.021+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg auth v1019 ap=1 s=51252 n(v0 rc2024-05-20T17:35:06.275343+0000 b51252 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879bb8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bc:[<0x1000000039a/picture-39.jpg v1019>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004bc:[<0x1000000039a/picture-39.jpg v1019>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.023+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml auth v1020 ap=1 s=26706 n(v0 rc2024-05-20T17:35:05.748354+0000 b26706 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879cce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ef:[<0x1000000039a/article-59.xml v1020>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ef:[<0x1000000039a/article-59.xml v1020>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.024+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg auth v1026 ap=1 s=49760 n(v0 rc2024-05-20T17:35:06.429340+0000 b49760 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ccec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f0:[<0x1000000039a/picture-13.jpg v1026>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f0:[<0x1000000039a/picture-13.jpg v1026>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.025+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg auth v982 ap=1 s=27186 n(v0 rc2024-05-20T17:35:06.398340+0000 b27186 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ccf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e6:[<0x1000000039a/picture-18.jpg v982>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e6:[<0x1000000039a/picture-18.jpg v982>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.026+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml auth v1014 ap=1 s=12214 n(v0 rc2024-05-20T17:35:05.673355+0000 b12214 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8797c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c1:[<0x1000000039a/article-74.xml v1014>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c1:[<0x1000000039a/article-74.xml v1014>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.026+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000469 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml auth v988 ap=1 s=15847 n(v0 rc2024-05-20T17:35:06.056347+0000 b15847 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000469:[<0x1000000039a/article-18.xml v988>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000469:[<0x1000000039a/article-18.xml v988>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.028+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg auth v1028 ap=1 s=56985 n(v0 rc2024-05-20T17:35:06.391340+0000 b56985 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e4:[<0x1000000039a/picture-19.jpg v1028>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e4:[<0x1000000039a/picture-19.jpg v1028>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.029+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000407 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml auth v990 ap=1 s=18033 n(v0 rc2024-05-20T17:35:05.786353+0000 b18033 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000407:[<0x1000000039a/article-51.xml v990>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000407:[<0x1000000039a/article-51.xml v990>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.203 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.030+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml auth v1002 ap=1 s=26509 n(v0 rc2024-05-20T17:35:05.975349+0000 b26509 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044e:[<0x1000000039a/article-27.xml v1002>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000044e:[<0x1000000039a/article-27.xml v1002>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.030+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000502 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg auth v1004 ap=1 s=10239 n(v0 rc2024-05-20T17:35:06.482338+0000 b10239 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000502:[<0x1000000039a/picture-4.jpg v1004>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000502:[<0x1000000039a/picture-4.jpg v1004>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.030+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg auth v1010 ap=1 s=31623 n(v0 rc2024-05-20T17:35:06.297342+0000 b31623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c4:[<0x1000000039a/picture-35.jpg v1010>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c4:[<0x1000000039a/picture-35.jpg v1010>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.031+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000506 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg auth v994 ap=1 s=24922 n(v0 rc2024-05-20T17:35:06.493338+0000 b24922 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000506:[<0x1000000039a/picture-2.jpg v994>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000506:[<0x1000000039a/picture-2.jpg v994>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.031+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml auth v998 ap=1 s=11996 n(v0 rc2024-05-20T17:35:05.694355+0000 b11996 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cd:[<0x1000000039a/article-70.xml v998>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003cd:[<0x1000000039a/article-70.xml v998>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.032+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000463 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml auth v992 ap=1 s=21531 n(v0 rc2024-05-20T17:35:06.039348+0000 b21531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000463:[<0x1000000039a/article-20.xml v992>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000463:[<0x1000000039a/article-20.xml v992>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.032+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg auth v1022 ap=1 s=14519 n(v0 rc2024-05-20T17:35:06.423340+0000 b14519 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ee:[<0x1000000039a/picture-14.jpg v1022>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ee:[<0x1000000039a/picture-14.jpg v1022>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.033+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml auth v1006 ap=1 s=8932 n(v0 rc2024-05-20T17:35:05.624356+0000 b8932 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a7:[<0x1000000039a/article-83.xml v1006>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003a7:[<0x1000000039a/article-83.xml v1006>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.039+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml auth v1008 ap=1 s=7356 n(v0 rc2024-05-20T17:35:05.738354+0000 b7356 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e8:[<0x1000000039a/article-61.xml v1008>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003e8:[<0x1000000039a/article-61.xml v1008>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.204 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.040+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000424 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml auth v1016 ap=1 s=28009 n(v0 rc2024-05-20T17:35:05.852351+0000 b28009 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000424:[<0x1000000039a/article-41.xml v1016>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000424:[<0x1000000039a/article-41.xml v1016>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.041+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000417 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml auth v1018 ap=1 s=13103 n(v0 rc2024-05-20T17:35:05.819352+0000 b13103 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ce9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000417:[<0x1000000039a/article-45.xml v1018>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000417:[<0x1000000039a/article-45.xml v1018>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.041+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml auth v1000 ap=1 s=15063 n(v0 rc2024-05-20T17:35:05.699355+0000 b15063 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879cea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d0:[<0x1000000039a/article-69.xml v1000>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d0:[<0x1000000039a/article-69.xml v1000>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.043+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg auth v1032 ap=1 s=37212 n(v0 rc2024-05-20T17:35:06.464339+0000 b37212 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ceac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fc:[<0x1000000039a/picture-7.jpg v1032>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004fc:[<0x1000000039a/picture-7.jpg v1032>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.043+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000442 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml auth v1024 ap=1 s=11868 n(v0 rc2024-05-20T17:35:05.941350+0000 b11868 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ceb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000442:[<0x1000000039a/article-31.xml v1024>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000442:[<0x1000000039a/article-31.xml v1024>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.044+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg auth v984 ap=1 s=53704 n(v0 rc2024-05-20T17:35:06.453339+0000 b53704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ceb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f8:[<0x1000000039a/picture-9.jpg v984>,<0x10000000399/blog-0 v17306>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f8:[<0x1000000039a/picture-9.jpg v984>,<0x10000000399/blog-0 v46190>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.180+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml auth v1369 ap=1 s=26324 n(v0 rc2024-05-20T17:35:05.771353+0000 b26324 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8799a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f8:[<0x1000000039b/article-37.xml v1369>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f8:[<0x1000000039b/article-37.xml v1369>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.180+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg auth v1463 ap=1 s=42706 n(v0 rc2024-05-20T17:35:07.439319+0000 b42706 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8799a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000061c:[<0x1000000039b/picture-27.jpg v1463>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000061c:[<0x1000000039b/picture-27.jpg v1463>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.181+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml auth v1359 ap=1 s=14154 n(v0 rc2024-05-20T17:35:05.734354+0000 b14154 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8799a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e0:[<0x1000000039b/article-39.xml v1359>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e0:[<0x1000000039b/article-39.xml v1359>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.182+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000404 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml auth v1481 ap=1 s=22369 n(v0 rc2024-05-20T17:35:05.790353+0000 b22369 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879920000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000404:[<0x1000000039b/article-36.xml v1481>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000404:[<0x1000000039b/article-36.xml v1481>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.183+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml auth v1407 ap=1 s=14174 n(v0 rc2024-05-20T17:35:07.019327+0000 b14174 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879920580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a2:[<0x1000000039b/article-12.xml v1407>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000005a2:[<0x1000000039b/article-12.xml v1407>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.205 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.183+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000605 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml auth v1387 ap=1 s=15695 n(v0 rc2024-05-20T17:35:07.363320+0000 b15695 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879920b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000605:[<0x1000000039b/article-1.xml v1387>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000605:[<0x1000000039b/article-1.xml v1387>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.185+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000885 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg auth v1421 ap=1 s=60570 n(v0 rc2024-05-20T17:35:09.960266+0000 b60570 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879922100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000885:[<0x1000000039b/picture-16.jpg v1421>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000885:[<0x1000000039b/picture-16.jpg v1421>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.188+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000497 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml auth v1451 ap=1 s=21393 n(v0 rc2024-05-20T17:35:06.212344+0000 b21393 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000497:[<0x1000000039b/article-23.xml v1451>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000497:[<0x1000000039b/article-23.xml v1451>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.189+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000577 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml auth v1427 ap=1 s=28305 n(v0 rc2024-05-20T17:35:06.876330+0000 b28305 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000577:[<0x1000000039b/article-17.xml v1427>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000577:[<0x1000000039b/article-17.xml v1427>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.194+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg auth v2017 ap=1 s=56228 n(v0 rc2024-05-20T17:35:11.761229+0000 b56228 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e0:[<0x1000000039b/picture-11.jpg v1632>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000009e0:[<0x1000000039b/picture-11.jpg v2017>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.194+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml auth v1395 ap=1 s=29838 n(v0 rc2024-05-20T17:35:07.218323+0000 b29838 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8798cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e1:[<0x1000000039b/article-5.xml v1395>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000005e1:[<0x1000000039b/article-5.xml v1395>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.206 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.195+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml auth v1365 ap=1 s=27118 n(v0 rc2024-05-20T17:35:05.841352+0000 b27118 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8798cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041c:[<0x1000000039b/article-34.xml v1365>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000041c:[<0x1000000039b/article-34.xml v1365>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:35 smithi172 ceph-mon[36511]: pgmap v70: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 520 op/s 2024-05-20T17:35:35.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:35 smithi172 ceph-mon[36511]: scrub queued for path: / 2024-05-20T17:35:35.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:35 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:35.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:35 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.963+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg auth v340 ap=1 s=58754 n(v0 rc2024-05-20T17:35:24.945956+0000 b58754 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf81700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f4:[<0x10000001447/picture-13.jpg v216>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014f4:[<0x10000001447/picture-13.jpg v340>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.964+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001521 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg auth v304 ap=1 s=29874 n(v0 rc2024-05-20T17:35:25.033954+0000 b29874 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001521:[<0x10000001447/picture-4.jpg v270>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001521:[<0x10000001447/picture-4.jpg v304>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.964+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg auth v364 ap=1 s=50565 n(v0 rc2024-05-20T17:35:24.867958+0000 b50565 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d4:[<0x10000001447/picture-19.jpg v180>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014d4:[<0x10000001447/picture-19.jpg v364>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.965+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001472 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml auth v362 ap=1 s=31847 n(v0 rc2024-05-20T17:35:24.562964+0000 b31847 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001472:[<0x10000001447/article-18.xml v54>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001472:[<0x10000001447/article-18.xml v362>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.965+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg auth v296 ap=1 s=64929 n(v0 rc2024-05-20T17:35:25.051954+0000 b64929 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152b:[<0x10000001447/picture-2.jpg v282>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000152b:[<0x10000001447/picture-2.jpg v296>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.966+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001467 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml auth v370 ap=1 s=8336 n(v0 rc2024-05-20T17:35:24.525965+0000 b8336 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf8fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001467:[<0x10000001447/article-20.xml v42>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001467:[<0x10000001447/article-20.xml v370>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.966+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg auth v344 ap=1 s=12025 n(v0 rc2024-05-20T17:35:24.934956+0000 b12025 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf90100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ee:[<0x10000001447/picture-14.jpg v210>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ee:[<0x10000001447/picture-14.jpg v344>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.225 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.967+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001512 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg auth v316 ap=1 s=25358 n(v0 rc2024-05-20T17:35:25.005955+0000 b25358 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001512:[<0x10000001447/picture-7.jpg v252>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001512:[<0x10000001447/picture-7.jpg v316>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.967+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001508 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg auth v324 ap=1 s=42789 n(v0 rc2024-05-20T17:35:24.986955+0000 b42789 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf90c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001508:[<0x10000001447/picture-9.jpg v240>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001508:[<0x10000001447/picture-9.jpg v324>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.968+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001503 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg auth v328 ap=1 s=18343 n(v0 rc2024-05-20T17:35:24.977955+0000 b18343 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf91180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001503:[<0x10000001447/picture-10.jpg v234>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001503:[<0x10000001447/picture-10.jpg v328>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.968+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001530 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg auth{0=1} v292 pv386 ap=3 s=32118 n(v0 rc2024-05-20T17:35:25.061954+0000 b32118 1=1+0)->n(v0 rc2024-05-20T17:35:25.061954+0000 b32118 1=1+0) (ifile excl->sync w=1) cr={25025=0-4194304@3} caps={25025=pAsLsXsFscr/pFscr@2},l=25025(-1) mcw={0=Fscr} | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf91700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001530:[<0x10000001447/picture-1.jpg v288>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001530:[<0x10000001447/picture-1.jpg v292>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.969+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml auth v326 ap=1 s=10017 n(v0 rc2024-05-20T17:35:24.702961+0000 b10017 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf98000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149c:[<0x10000001447/article-9.xml v108>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000149c:[<0x10000001447/article-9.xml v326>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.969+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001517 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg auth v312 ap=1 s=16812 n(v0 rc2024-05-20T17:35:25.015955+0000 b16812 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf98580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001517:[<0x10000001447/picture-6.jpg v258>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001517:[<0x10000001447/picture-6.jpg v312>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.970+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001450 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml auth v380 ap=1 s=23816 n(v0 rc2024-05-20T17:35:24.349968+0000 b23816 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf98b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001450:[<0x10000001447/article-24.xml v16>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001450:[<0x10000001447/article-24.xml v380>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.970+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg auth v356 ap=1 s=57261 n(v0 rc2024-05-20T17:35:24.901957+0000 b57261 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dd:[<0x10000001447/picture-17.jpg v192>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014dd:[<0x10000001447/picture-17.jpg v356>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.971+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml auth v302 ap=1 s=20857 n(v0 rc2024-05-20T17:35:24.786959+0000 b20857 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b8:[<0x10000001447/article-3.xml v144>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014b8:[<0x10000001447/article-3.xml v302>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.226 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.971+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml auth v318 ap=1 s=30475 n(v0 rc2024-05-20T17:35:24.737960+0000 b30475 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a5:[<0x10000001447/article-7.xml v120>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014a5:[<0x10000001447/article-7.xml v318>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.971+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml auth v322 ap=1 s=31262 n(v0 rc2024-05-20T17:35:24.721961+0000 b31262 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a0:[<0x10000001447/article-8.xml v114>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014a0:[<0x10000001447/article-8.xml v322>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.972+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg auth v320 ap=1 s=34179 n(v0 rc2024-05-20T17:35:24.995955+0000 b34179 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf9a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150d:[<0x10000001447/picture-8.jpg v246>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000150d:[<0x10000001447/picture-8.jpg v320>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.972+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001463 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml auth v374 ap=1 s=30684 n(v0 rc2024-05-20T17:35:24.506965+0000 b30684 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001463:[<0x10000001447/article-21.xml v36>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001463:[<0x10000001447/article-21.xml v374>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.973+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001489 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml auth v342 ap=1 s=29774 n(v0 rc2024-05-20T17:35:24.644962+0000 b29774 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001489:[<0x10000001447/article-13.xml v84>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001489:[<0x10000001447/article-13.xml v342>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.973+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml auth v298 ap=1 s=6815 n(v0 rc2024-05-20T17:35:24.804959+0000 b6815 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014bc:[<0x10000001447/article-2.xml v150>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014bc:[<0x10000001447/article-2.xml v298>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.974+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014aa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml auth v314 ap=1 s=15813 n(v0 rc2024-05-20T17:35:24.748960+0000 b15813 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014aa:[<0x10000001447/article-6.xml v126>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014aa:[<0x10000001447/article-6.xml v314>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.974+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg auth v308 ap=1 s=29393 n(v0 rc2024-05-20T17:35:25.023954+0000 b29393 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151c:[<0x10000001447/picture-5.jpg v264>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000151c:[<0x10000001447/picture-5.jpg v308>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.975+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001526 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg auth v300 ap=1 s=10383 n(v0 rc2024-05-20T17:35:25.043954+0000 b10383 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001526:[<0x10000001447/picture-3.jpg v276>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001526:[<0x10000001447/picture-3.jpg v300>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.975+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg auth v332 ap=1 s=50105 n(v0 rc2024-05-20T17:35:24.966956+0000 b50105 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fe:[<0x10000001447/picture-11.jpg v228>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014fe:[<0x10000001447/picture-11.jpg v332>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.227 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.976+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ae [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml auth v310 ap=1 s=25324 n(v0 rc2024-05-20T17:35:24.760960+0000 b25324 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ae:[<0x10000001447/article-5.xml v132>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ae:[<0x10000001447/article-5.xml v310>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.976+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001459 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml auth v30 ap=1 s=32726 n(v0 rc2024-05-20T17:35:24.465966+0000 b32726 1=1+0)/n(v0 rc2024-05-20T17:35:24.448966+0000 b32726 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdfa7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001459:[<0x10000001447/article-22.xml v30>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001459:[<0x10000001447/article-22.xml v30>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.976+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001484 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml auth v346 ap=1 s=23165 n(v0 rc2024-05-20T17:35:24.634963+0000 b23165 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001484:[<0x10000001447/article-14.xml v78>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001484:[<0x10000001447/article-14.xml v346>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.977+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg auth v376 ap=1 s=15456 n(v0 rc2024-05-20T17:35:24.833958+0000 b15456 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c6:[<0x10000001447/picture-22.jpg v162>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014c6:[<0x10000001447/picture-22.jpg v376>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.978+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001492 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml auth v334 ap=1 s=11954 n(v0 rc2024-05-20T17:35:24.671962+0000 b11954 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001492:[<0x10000001447/article-11.xml v96>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001492:[<0x10000001447/article-11.xml v334>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.978+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml auth v354 ap=1 s=1774 n(v0 rc2024-05-20T17:35:24.601963+0000 b1774 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147b:[<0x10000001447/article-16.xml v66>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000147b:[<0x10000001447/article-16.xml v354>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.979+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001449 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml auth v384 ap=1 s=9803 n(v0 rc2024-05-20T17:35:24.324969+0000 b9803 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfa9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001449:[<0x10000001447/article-26.xml v4>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001449:[<0x10000001447/article-26.xml v384>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.228 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.979+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg auth v348 ap=1 s=21666 n(v0 rc2024-05-20T17:35:24.922957+0000 b21666 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e8:[<0x10000001447/picture-15.jpg v204>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014e8:[<0x10000001447/picture-15.jpg v348>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.980+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001497 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml auth v330 ap=1 s=26621 n(v0 rc2024-05-20T17:35:24.686961+0000 b26621 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001497:[<0x10000001447/article-10.xml v102>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001497:[<0x10000001447/article-10.xml v330>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.980+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg auth v336 ap=1 s=28391 n(v0 rc2024-05-20T17:35:24.956956+0000 b28391 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f9:[<0x10000001447/picture-12.jpg v222>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014f9:[<0x10000001447/picture-12.jpg v336>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.980+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml auth v306 ap=1 s=17665 n(v0 rc2024-05-20T17:35:24.772960+0000 b17665 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b3:[<0x10000001447/article-4.xml v138>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014b3:[<0x10000001447/article-4.xml v306>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.981+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000144d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml auth v382 ap=1 s=11066 n(v0 rc2024-05-20T17:35:24.337969+0000 b11066 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000144d:[<0x10000001447/article-25.xml v10>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000144d:[<0x10000001447/article-25.xml v382>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.981+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg auth v372 ap=1 s=62784 n(v0 rc2024-05-20T17:35:24.844958+0000 b62784 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ca:[<0x10000001447/picture-21.jpg v168>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ca:[<0x10000001447/picture-21.jpg v372>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.982+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001480 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml auth v350 ap=1 s=32738 n(v0 rc2024-05-20T17:35:24.619963+0000 b32738 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001480:[<0x10000001447/article-15.xml v72>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001480:[<0x10000001447/article-15.xml v350>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.982+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml auth v366 ap=1 s=3560 n(v0 rc2024-05-20T17:35:24.543964+0000 b3560 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146d:[<0x10000001447/article-19.xml v48>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000146d:[<0x10000001447/article-19.xml v366>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.983+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg auth v368 ap=1 s=26456 n(v0 rc2024-05-20T17:35:24.855958+0000 b26456 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cf:[<0x10000001447/picture-20.jpg v174>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014cf:[<0x10000001447/picture-20.jpg v368>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.984+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml auth v338 ap=1 s=22776 n(v0 rc2024-05-20T17:35:24.655962+0000 b22776 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148e:[<0x10000001447/article-12.xml v90>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000148e:[<0x10000001447/article-12.xml v338>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.229 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.984+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml auth v294 ap=1 s=8556 n(v0 rc2024-05-20T17:35:24.819959+0000 b8556 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfb7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c1:[<0x10000001447/article-1.xml v156>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014c1:[<0x10000001447/article-1.xml v294>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.985+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg auth v352 ap=1 s=25261 n(v0 rc2024-05-20T17:35:24.911957+0000 b25261 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfc2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e3:[<0x10000001447/picture-16.jpg v198>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014e3:[<0x10000001447/picture-16.jpg v352>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.985+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001454 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml auth v378 ap=1 s=8125 n(v0 rc2024-05-20T17:35:24.394968+0000 b8125 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001454:[<0x10000001447/article-23.xml v22>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001454:[<0x10000001447/article-23.xml v378>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:34.986+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001476 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml auth v358 ap=1 s=25869 n(v0 rc2024-05-20T17:35:24.583964+0000 b25869 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdfc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001476:[<0x10000001447/article-17.xml v60>,<0x10000000399/blog-26 v32578>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001476:[<0x10000001447/article-17.xml v358>,<0x10000000399/blog-26 v42514>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.040+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml auth v16 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.601901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d7:[<0x100000017cf/article-74.xml v16>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d7:[<0x100000017cf/article-74.xml v16>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.042+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001804 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml auth v106 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.824896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001804:[<0x100000017cf/article-59.xml v106>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001804:[<0x100000017cf/article-59.xml v106>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.042+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml auth v154 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.938894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde50680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181c:[<0x100000017cf/article-51.xml v154>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181c:[<0x100000017cf/article-51.xml v154>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.043+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml auth v40 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.657900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde51180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e3:[<0x100000017cf/article-70.xml v40>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e3:[<0x100000017cf/article-70.xml v40>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.230 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.044+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml auth v94 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.792897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fe:[<0x100000017cf/article-61.xml v94>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017fe:[<0x100000017cf/article-61.xml v94>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.048+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001838 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml auth v214 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.096891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001838:[<0x100000017cf/article-41.xml v214>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001838:[<0x100000017cf/article-41.xml v214>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.048+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml auth v190 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.033892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182e:[<0x100000017cf/article-45.xml v190>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182e:[<0x100000017cf/article-45.xml v190>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.048+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml auth v46 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.673900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e6:[<0x100000017cf/article-69.xml v46>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e6:[<0x100000017cf/article-69.xml v46>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.050+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001830 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml auth v196 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.048892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001830:[<0x100000017cf/article-44.xml v196>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001830:[<0x100000017cf/article-44.xml v196>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.050+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml auth v70 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.731898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f2:[<0x100000017cf/article-65.xml v70>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f2:[<0x100000017cf/article-65.xml v70>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.051+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml auth v88 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.773897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fb:[<0x100000017cf/article-62.xml v88>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017fb:[<0x100000017cf/article-62.xml v88>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.051+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ec [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml auth v58 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.700899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde70000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ec:[<0x100000017cf/article-67.xml v58>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ec:[<0x100000017cf/article-67.xml v58>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.052+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001810 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml auth v130 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.886895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001810:[<0x100000017cf/article-55.xml v130>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001810:[<0x100000017cf/article-55.xml v130>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.231 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.053+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml auth v52 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.686899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e9:[<0x100000017cf/article-68.xml v52>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e9:[<0x100000017cf/article-68.xml v52>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.054+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml auth v4 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.576902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d1:[<0x100000017cf/article-76.xml v4>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d1:[<0x100000017cf/article-76.xml v4>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.055+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml auth v160 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.950894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde80000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181f:[<0x100000017cf/article-50.xml v160>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181f:[<0x100000017cf/article-50.xml v160>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.056+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml auth v124 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.870895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde81080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180d:[<0x100000017cf/article-56.xml v124>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180d:[<0x100000017cf/article-56.xml v124>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.056+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001834 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml auth v202 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.065891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde81600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001834:[<0x100000017cf/article-43.xml v202>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001834:[<0x100000017cf/article-43.xml v202>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.057+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml auth v118 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.856896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde82100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180a:[<0x100000017cf/article-57.xml v118>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180a:[<0x100000017cf/article-57.xml v118>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.058+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001807 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml auth v112 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.840896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde82680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001807:[<0x100000017cf/article-58.xml v112>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001807:[<0x100000017cf/article-58.xml v112>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.058+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001816 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml auth v142 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.911895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde82c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001816:[<0x100000017cf/article-53.xml v142>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001816:[<0x100000017cf/article-53.xml v142>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.059+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001819 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml auth v148 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.926894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde83700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001819:[<0x100000017cf/article-52.xml v148>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001819:[<0x100000017cf/article-52.xml v148>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.232 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.062+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml auth v256 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.221888+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde94580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184d:[<0x100000017cf/article-34.xml v256>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184d:[<0x100000017cf/article-34.xml v256>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.062+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001801 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml auth v100 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.808897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001801:[<0x100000017cf/article-60.xml v100>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001801:[<0x100000017cf/article-60.xml v100>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.063+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001822 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml auth v166 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.969893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde95b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001822:[<0x100000017cf/article-49.xml v166>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001822:[<0x100000017cf/article-49.xml v166>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.064+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml auth v184 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.020892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182b:[<0x100000017cf/article-46.xml v184>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182b:[<0x100000017cf/article-46.xml v184>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.064+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001828 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml auth v178 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.003893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde96c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001828:[<0x100000017cf/article-47.xml v178>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001828:[<0x100000017cf/article-47.xml v178>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.067+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml auth v34 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.643900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde97180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e0:[<0x100000017cf/article-71.xml v34>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e0:[<0x100000017cf/article-71.xml v34>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.068+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001813 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml auth v136 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.897895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd324580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001813:[<0x100000017cf/article-54.xml v136>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001813:[<0x100000017cf/article-54.xml v136>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.069+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001825 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml auth v172 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.985893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd325600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001825:[<0x100000017cf/article-48.xml v172>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001825:[<0x100000017cf/article-48.xml v172>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.070+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001841 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml auth v232 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.142890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd326680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001841:[<0x100000017cf/article-38.xml v232>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001841:[<0x100000017cf/article-38.xml v232>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.070+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017dd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml auth v28 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.627900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd326c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017dd:[<0x100000017cf/article-72.xml v28>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017dd:[<0x100000017cf/article-72.xml v28>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.233 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.071+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml auth v250 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.197889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd327180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184a:[<0x100000017cf/article-35.xml v250>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184a:[<0x100000017cf/article-35.xml v250>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.072+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml auth v220 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.109890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd327700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183b:[<0x100000017cf/article-40.xml v220>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183b:[<0x100000017cf/article-40.xml v220>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.073+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001835 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml auth v208 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.079891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdea8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001835:[<0x100000017cf/article-42.xml v208>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001835:[<0x100000017cf/article-42.xml v208>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.074+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml auth v76 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.746898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdea9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f5:[<0x100000017cf/article-64.xml v76>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f5:[<0x100000017cf/article-64.xml v76>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.074+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml auth v10 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.588901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdea9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d4:[<0x100000017cf/article-75.xml v10>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d4:[<0x100000017cf/article-75.xml v10>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.075+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001844 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml auth v238 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.153890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdea9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001844:[<0x100000017cf/article-37.xml v238>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001844:[<0x100000017cf/article-37.xml v238>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.075+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017da [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml auth v22 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.613901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdeaa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017da:[<0x100000017cf/article-73.xml v22>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017da:[<0x100000017cf/article-73.xml v22>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.075+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml auth v226 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.125890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdeaa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183e:[<0x100000017cf/article-39.xml v226>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183e:[<0x100000017cf/article-39.xml v226>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.076+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001847 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml auth v244 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.168889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdeaac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001847:[<0x100000017cf/article-36.xml v244>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001847:[<0x100000017cf/article-36.xml v244>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.077+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml auth v64 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.716899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdeba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ef:[<0x100000017cf/article-66.xml v64>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ef:[<0x100000017cf/article-66.xml v64>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.234 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.078+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml auth v82 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.760898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdebb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f8:[<0x100000017cf/article-63.xml v82>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f8:[<0x100000017cf/article-63.xml v82>,<0x10000000399/blog-33 v38618>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.079+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000670 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml auth v1006 ap=1 s=22305 n(v0 rc2024-05-20T17:35:07.776312+0000 b22305 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd604680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000670:[<0x10000000655/article-64.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000670:[<0x10000000655/article-64.xml v1006>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.081+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000661 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml auth v1014 ap=1 s=32657 n(v0 rc2024-05-20T17:35:07.719313+0000 b32657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000661:[<0x10000000655/article-75.xml v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000661:[<0x10000000655/article-75.xml v1014>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.082+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml auth v1036 ap=1 s=30180 n(v0 rc2024-05-20T17:35:08.021307+0000 b30180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a5:[<0x10000000655/article-37.xml v1036>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006a5:[<0x10000000655/article-37.xml v1036>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.082+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000779 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg auth v1028 ap=1 s=49907 n(v0 rc2024-05-20T17:35:08.690293+0000 b49907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000779:[<0x10000000655/picture-27.jpg v1028>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000779:[<0x10000000655/picture-27.jpg v1028>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.083+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000663 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml auth v1012 ap=1 s=3532 n(v0 rc2024-05-20T17:35:07.729313+0000 b3532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000663:[<0x10000000655/article-73.xml v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000663:[<0x10000000655/article-73.xml v1012>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.083+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml auth v1038 ap=1 s=22763 n(v0 rc2024-05-20T17:35:08.004307+0000 b22763 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a1:[<0x10000000655/article-39.xml v1038>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006a1:[<0x10000000655/article-39.xml v1038>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.083+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml auth v1034 ap=1 s=28788 n(v0 rc2024-05-20T17:35:08.029306+0000 b28788 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a7:[<0x10000000655/article-36.xml v1034>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006a7:[<0x10000000655/article-36.xml v1034>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.084+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml auth v1018 ap=1 s=27033 n(v0 rc2024-05-20T17:35:08.183303+0000 b27033 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d9:[<0x10000000655/article-12.xml v1018>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006d9:[<0x10000000655/article-12.xml v1018>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.085+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000725 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg auth v1042 ap=1 s=15079 n(v0 rc2024-05-20T17:35:08.417298+0000 b15079 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000725:[<0x10000000655/picture-52.jpg v1042>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000725:[<0x10000000655/picture-52.jpg v1042>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.085+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml auth{0=1} v1220 ap=1 s=31433 n(v0 rc2024-05-20T17:35:08.270301+0000 b31433 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd5e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f1:[<0x10000000655/article-1.xml v1022>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006f1:[<0x10000000655/article-1.xml v1220>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.086+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg auth v1032 ap=1 s=45874 n(v0 rc2024-05-20T17:35:08.571295+0000 b45874 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075b:[<0x10000000655/picture-34.jpg v1032>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000075b:[<0x10000000655/picture-34.jpg v1032>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.235 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.086+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000722 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg auth v1044 ap=1 s=50757 n(v0 rc2024-05-20T17:35:08.410299+0000 b50757 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000722:[<0x10000000655/picture-53.jpg v1044>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000722:[<0x10000000655/picture-53.jpg v1044>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.087+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg auth v1010 ap=1 s=16472 n(v0 rc2024-05-20T17:35:08.291301+0000 b16472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f8:[<0x10000000655/picture-67.jpg v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006f8:[<0x10000000655/picture-67.jpg v1010>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.087+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml auth v1008 ap=1 s=31608 n(v0 rc2024-05-20T17:35:07.766312+0000 b31608 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd623600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066d:[<0x10000000655/article-66.xml v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000066d:[<0x10000000655/article-66.xml v1008>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.088+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg auth v1024 ap=1 s=43523 n(v0 rc2024-05-20T17:35:08.976287+0000 b43523 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c4:[<0x10000000655/picture-16.jpg v1024>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007c4:[<0x10000000655/picture-16.jpg v1024>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.088+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml auth v1016 ap=1 s=10320 n(v0 rc2024-05-20T17:35:07.708313+0000 b10320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd624100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065e:[<0x10000000655/article-77.xml v1016>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000065e:[<0x10000000655/article-77.xml v1016>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.094+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml auth v1020 ap=1 s=8714 n(v0 rc2024-05-20T17:35:08.110305+0000 b8714 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd62e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c1:[<0x10000000655/article-23.xml v1020>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006c1:[<0x10000000655/article-23.xml v1020>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.095+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006cd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml auth v1026 ap=1 s=6316 n(v0 rc2024-05-20T17:35:08.144304+0000 b6316 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd62f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006cd:[<0x10000000655/article-17.xml v1026>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006cd:[<0x10000000655/article-17.xml v1026>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.096+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000761 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg auth v1030 ap=1 s=17145 n(v0 rc2024-05-20T17:35:08.588295+0000 b17145 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd62f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000761:[<0x10000000655/picture-32.jpg v1030>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000761:[<0x10000000655/picture-32.jpg v1030>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.096+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000671 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml auth v1004 ap=1 s=25937 n(v0 rc2024-05-20T17:35:07.782312+0000 b25937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd62fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000671:[<0x10000000655/article-63.xml v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000671:[<0x10000000655/article-63.xml v1004>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.097+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000731 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg auth v1040 ap=1 s=42623 n(v0 rc2024-05-20T17:35:08.447298+0000 b42623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd630100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000731:[<0x10000000655/picture-48.jpg v1040>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000731:[<0x10000000655/picture-48.jpg v1040>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.099+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg auth v1000 ap=1 s=27049 n(v0 rc2024-05-20T17:35:10.229261+0000 b27049 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd718c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093f:[<0x10000000655/picture-3.jpg v1000>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000093f:[<0x10000000655/picture-3.jpg v1000>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.236 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.102+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg auth v1014 ap=1 s=16061 n(v0 rc2024-05-20T17:35:08.395299+0000 b16061 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd72e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071c:[<0x10000000655/picture-55.jpg v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000071c:[<0x10000000655/picture-55.jpg v1014>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.103+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000914 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg auth v1004 ap=1 s=18887 n(v0 rc2024-05-20T17:35:10.096264+0000 b18887 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd72eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000914:[<0x10000000655/picture-11.jpg v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000914:[<0x10000000655/picture-11.jpg v1004>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.103+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml auth v1002 ap=1 s=24878 n(v0 rc2024-05-20T17:35:08.246302+0000 b24878 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd72f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e9:[<0x10000000655/article-5.xml v1002>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006e9:[<0x10000000655/article-5.xml v1002>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.104+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ab [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml auth v1010 ap=1 s=22370 n(v0 rc2024-05-20T17:35:08.042306+0000 b22370 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd72f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ab:[<0x10000000655/article-34.xml v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006ab:[<0x10000000655/article-34.xml v1010>,<0x10000000399/blog-5 v39396>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.106+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000658 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml auth v998 ap=1 s=2067 n(v0 rc2024-05-20T17:35:07.685314+0000 b2067 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd730c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000658:[<0x10000000655/article-81.xml v998>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000658:[<0x10000000655/article-81.xml v998>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.106+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml auth v996 ap=1 s=12738 n(v0 rc2024-05-20T17:35:07.703313+0000 b12738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd731180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065c:[<0x10000000655/article-78.xml v996>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000065c:[<0x10000000655/article-78.xml v996>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.106+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml auth v1008 ap=1 s=2719 n(v0 rc2024-05-20T17:35:08.076305+0000 b2719 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd731700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b5:[<0x10000000655/article-29.xml v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006b5:[<0x10000000655/article-29.xml v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.107+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000675 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml auth v992 ap=1 s=6573 n(v0 rc2024-05-20T17:35:07.804311+0000 b6573 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd73e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000675:[<0x10000000655/article-60.xml v992>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000675:[<0x10000000655/article-60.xml v992>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.108+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000704 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg auth v994 ap=1 s=52611 n(v0 rc2024-05-20T17:35:08.330300+0000 b52611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd73e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000704:[<0x10000000655/picture-63.jpg v994>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000704:[<0x10000000655/picture-63.jpg v994>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.108+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000749 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg auth v1012 ap=1 s=14341 n(v0 rc2024-05-20T17:35:08.517296+0000 b14341 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd73eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000749:[<0x10000000655/picture-40.jpg v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000749:[<0x10000000655/picture-40.jpg v1012>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.237 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.109+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml auth v1006 ap=1 s=17623 n(v0 rc2024-05-20T17:35:08.116305+0000 b17623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd73f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c3:[<0x10000000655/article-22.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006c3:[<0x10000000655/article-22.xml v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.110+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml auth v990 ap=1 s=21542 n(v0 rc2024-05-20T17:35:07.908309+0000 b21542 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd740680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000068d:[<0x10000000655/article-49.xml v990>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000068d:[<0x10000000655/article-49.xml v990>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.113+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000699 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml auth v1021 ap=1 s=26392 n(v0 rc2024-05-20T17:35:07.974308+0000 b26392 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000699:[<0x10000000655/article-43.xml v1021>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000699:[<0x10000000655/article-43.xml v1021>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.113+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml auth v1019 ap=1 s=6324 n(v0 rc2024-05-20T17:35:08.049306+0000 b6324 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ad:[<0x10000000655/article-33.xml v1019>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006ad:[<0x10000000655/article-33.xml v1019>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.114+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000935 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg auth v1015 ap=1 s=11381 n(v0 rc2024-05-20T17:35:10.197262+0000 b11381 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000935:[<0x10000000655/picture-5.jpg v1015>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000935:[<0x10000000655/picture-5.jpg v1015>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.115+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg auth v1025 ap=1 s=48602 n(v0 rc2024-05-20T17:35:08.431298+0000 b48602 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072b:[<0x10000000655/picture-50.jpg v1025>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000072b:[<0x10000000655/picture-50.jpg v1025>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.116+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000713 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg auth v1029 ap=1 s=49018 n(v0 rc2024-05-20T17:35:08.374299+0000 b49018 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd700100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000713:[<0x10000000655/picture-58.jpg v1029>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000713:[<0x10000000655/picture-58.jpg v1029>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.116+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml auth v1003 ap=1 s=17462 n(v0 rc2024-05-20T17:35:07.845310+0000 b17462 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd700680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067d:[<0x10000000655/article-57.xml v1003>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000067d:[<0x10000000655/article-57.xml v1003>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.118+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg auth v1009 ap=1 s=54877 n(v0 rc2024-05-20T17:35:08.313301+0000 b54877 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd701700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fe:[<0x10000000655/picture-65.jpg v1009>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006fe:[<0x10000000655/picture-65.jpg v1009>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.120+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml auth v1005 ap=1 s=11420 n(v0 rc2024-05-20T17:35:07.832311+0000 b11420 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd709080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067b:[<0x10000000655/article-58.xml v1005>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000067b:[<0x10000000655/article-58.xml v1005>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.120+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000685 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml auth v1001 ap=1 s=19279 n(v0 rc2024-05-20T17:35:07.876310+0000 b19279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd709600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000685:[<0x10000000655/article-53.xml v1001>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000685:[<0x10000000655/article-53.xml v1001>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.238 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.122+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml auth v1017 ap=1 s=30077 n(v0 rc2024-05-20T17:35:08.082305+0000 b30077 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd70a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b7:[<0x10000000655/article-28.xml v1017>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006b7:[<0x10000000655/article-28.xml v1017>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.123+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000687 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml auth v999 ap=1 s=17350 n(v0 rc2024-05-20T17:35:07.884309+0000 b17350 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd70b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000687:[<0x10000000655/article-52.xml v999>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000687:[<0x10000000655/article-52.xml v999>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.123+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg auth v1011 ap=1 s=63669 n(v0 rc2024-05-20T17:35:08.274301+0000 b63669 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd70b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f3:[<0x10000000655/picture-69.jpg v1011>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006f3:[<0x10000000655/picture-69.jpg v1011>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.127+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000728 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg auth v1027 ap=1 s=43836 n(v0 rc2024-05-20T17:35:08.424298+0000 b43836 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd716580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000728:[<0x10000000655/picture-51.jpg v1027>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000728:[<0x10000000655/picture-51.jpg v1027>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.128+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000707 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg auth v1007 ap=1 s=36178 n(v0 rc2024-05-20T17:35:08.339300+0000 b36178 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd717080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000707:[<0x10000000655/picture-62.jpg v1007>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000707:[<0x10000000655/picture-62.jpg v1007>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.129+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000737 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg auth v1023 ap=1 s=42500 n(v0 rc2024-05-20T17:35:08.463297+0000 b42500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd717b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000737:[<0x10000000655/picture-46.jpg v1023>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000737:[<0x10000000655/picture-46.jpg v1023>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.129+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000701 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg auth v998 ap=1 s=58450 n(v0 rc2024-05-20T17:35:08.321300+0000 b58450 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd669080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000701:[<0x10000000655/picture-64.jpg v998>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000701:[<0x10000000655/picture-64.jpg v998>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.239 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.130+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000659 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml auth v1006 ap=1 s=10699 n(v0 rc2024-05-20T17:35:07.693313+0000 b10699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd669600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000659:[<0x10000000655/article-80.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000659:[<0x10000000655/article-80.xml v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.248 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.132+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg auth v1018 ap=1 s=28556 n(v0 rc2024-05-20T17:35:10.118263+0000 b28556 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd66a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091b:[<0x10000000655/picture-10.jpg v1018>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000091b:[<0x10000000655/picture-10.jpg v1018>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.248 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.133+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg auth{0=1} v1008 ap=1 s=49790 n(v0 rc2024-05-20T17:35:10.266260+0000 b49790 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd66b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094b:[<0x10000000655/picture-1.jpg v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000094b:[<0x10000000655/picture-1.jpg v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.248 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.135+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml auth v1016 ap=1 s=20999 n(v0 rc2024-05-20T17:35:08.217303+0000 b20999 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd676000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e1:[<0x10000000655/article-9.xml v1016>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006e1:[<0x10000000655/article-9.xml v1016>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.248 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.135+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000697 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml auth v994 ap=1 s=9311 n(v0 rc2024-05-20T17:35:07.960308+0000 b9311 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd676580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000697:[<0x10000000655/article-44.xml v994>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000697:[<0x10000000655/article-44.xml v994>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.248 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.136+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000930 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg auth v1012 ap=1 s=28304 n(v0 rc2024-05-20T17:35:10.183262+0000 b28304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd676b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000930:[<0x10000000655/picture-6.jpg v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000930:[<0x10000000655/picture-6.jpg v1012>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.136+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml auth v1000 ap=1 s=30893 n(v0 rc2024-05-20T17:35:07.771312+0000 b30893 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd677080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066e:[<0x10000000655/article-65.xml v1000>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000066e:[<0x10000000655/article-65.xml v1000>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.137+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000672 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml auth v996 ap=1 s=27937 n(v0 rc2024-05-20T17:35:07.787311+0000 b27937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd677b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000672:[<0x10000000655/article-62.xml v996>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000672:[<0x10000000655/article-62.xml v996>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.138+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml auth v1024 ap=1 s=7721 n(v0 rc2024-05-20T17:35:08.105305+0000 b7721 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd678680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006bf:[<0x10000000655/article-24.xml v1024>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006bf:[<0x10000000655/article-24.xml v1024>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.140+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000773 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg auth v1026 ap=1 s=46757 n(v0 rc2024-05-20T17:35:08.651294+0000 b46757 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd679700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000773:[<0x10000000655/picture-28.jpg v1026>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000773:[<0x10000000655/picture-28.jpg v1026>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.140+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml auth v1002 ap=1 s=22494 n(v0 rc2024-05-20T17:35:07.761312+0000 b22494 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd680580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066c:[<0x10000000655/article-67.xml v1002>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000066c:[<0x10000000655/article-67.xml v1002>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.141+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000752 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg auth v1030 ap=1 s=12570 n(v0 rc2024-05-20T17:35:08.545296+0000 b12570 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd681080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000752:[<0x10000000655/picture-37.jpg v1030>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000752:[<0x10000000655/picture-37.jpg v1030>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.142+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007be [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg auth v1020 ap=1 s=35703 n(v0 rc2024-05-20T17:35:08.958287+0000 b35703 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd681600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007be:[<0x10000000655/picture-17.jpg v1020>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007be:[<0x10000000655/picture-17.jpg v1020>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.142+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml auth v1010 ap=1 s=5243 n(v0 rc2024-05-20T17:35:08.260302+0000 b5243 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd681b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ed:[<0x10000000655/article-3.xml v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006ed:[<0x10000000655/article-3.xml v1010>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.143+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg auth v1022 ap=1 s=59243 n(v0 rc2024-05-20T17:35:08.786291+0000 b59243 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd682100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000078e:[<0x10000000655/picture-24.jpg v1022>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000078e:[<0x10000000655/picture-24.jpg v1022>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.143+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg auth v1028 ap=1 s=62469 n(v0 rc2024-05-20T17:35:08.580295+0000 b62469 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd682680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075e:[<0x10000000655/picture-33.jpg v1028>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000075e:[<0x10000000655/picture-33.jpg v1028>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.249 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.143+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000716 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg auth v1036 ap=1 s=9201 n(v0 rc2024-05-20T17:35:08.381299+0000 b9201 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd682c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000716:[<0x10000000655/picture-57.jpg v1036>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000716:[<0x10000000655/picture-57.jpg v1036>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.144+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml auth v1014 ap=1 s=7970 n(v0 rc2024-05-20T17:35:08.232302+0000 b7970 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd683180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e5:[<0x10000000655/article-7.xml v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006e5:[<0x10000000655/article-7.xml v1014>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.144+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000743 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg auth v1034 ap=1 s=62623 n(v0 rc2024-05-20T17:35:08.498297+0000 b62623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd683700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000743:[<0x10000000655/picture-42.jpg v1034>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000743:[<0x10000000655/picture-42.jpg v1034>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.145+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg auth v1004 ap=1 s=26547 n(v0 rc2024-05-20T17:35:08.282301+0000 b26547 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd614000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f5:[<0x10000000655/picture-68.jpg v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006f5:[<0x10000000655/picture-68.jpg v1004>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.145+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg auth v1032 ap=1 s=43416 n(v0 rc2024-05-20T17:35:08.527296+0000 b43416 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd614580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074c:[<0x10000000655/picture-39.jpg v1032>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000074c:[<0x10000000655/picture-39.jpg v1032>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.146+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000678 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml auth v1002 ap=1 s=17688 n(v0 rc2024-05-20T17:35:07.819311+0000 b17688 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000678:[<0x10000000655/article-59.xml v1002>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000678:[<0x10000000655/article-59.xml v1002>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.147+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000903 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg auth v1026 ap=1 s=10748 n(v0 rc2024-05-20T17:35:10.046265+0000 b10748 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd630c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000903:[<0x10000000655/picture-13.jpg v1026>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000903:[<0x10000000655/picture-13.jpg v1026>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.148+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg auth v1030 ap=1 s=21151 n(v0 rc2024-05-20T17:35:08.936288+0000 b21151 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd631700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b6:[<0x10000000655/picture-18.jpg v1030>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007b6:[<0x10000000655/picture-18.jpg v1030>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.148+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000662 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml auth v1012 ap=1 s=25789 n(v0 rc2024-05-20T17:35:07.724313+0000 b25789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd650000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000662:[<0x10000000655/article-74.xml v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000662:[<0x10000000655/article-74.xml v1012>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.148+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml auth v1032 ap=1 s=24650 n(v0 rc2024-05-20T17:35:08.139304+0000 b24650 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd650580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006cb:[<0x10000000655/article-18.xml v1032>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006cb:[<0x10000000655/article-18.xml v1032>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.250 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.149+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ac [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg auth v1034 ap=1 s=40128 n(v0 rc2024-05-20T17:35:08.908288+0000 b40128 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd651080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ac:[<0x10000000655/picture-19.jpg v1034>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007ac:[<0x10000000655/picture-19.jpg v1034>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.150+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000689 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml auth v1000 ap=1 s=1652 n(v0 rc2024-05-20T17:35:07.892309+0000 b1652 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@11},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd651600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000689:[<0x10000000655/article-51.xml v1000>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000689:[<0x10000000655/article-51.xml v1000>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.151+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml auth v1036 ap=1 s=4750 n(v0 rc2024-05-20T17:35:08.087305+0000 b4750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd652100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b9:[<0x10000000655/article-27.xml v1036>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006b9:[<0x10000000655/article-27.xml v1036>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.152+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg auth v1020 ap=1 s=36003 n(v0 rc2024-05-20T17:35:10.215261+0000 b36003 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd652680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093b:[<0x10000000655/picture-4.jpg v1020>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000093b:[<0x10000000655/picture-4.jpg v1020>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.152+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000758 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg auth v1038 ap=1 s=29438 n(v0 rc2024-05-20T17:35:08.562295+0000 b29438 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd652c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000758:[<0x10000000655/picture-35.jpg v1038>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000758:[<0x10000000655/picture-35.jpg v1038>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.153+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000947 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg auth{0=1} v1213 ap=1 s=46247 n(v0 rc2024-05-20T17:35:10.253260+0000 b46247 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd653180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000947:[<0x10000000655/picture-2.jpg v1018>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000947:[<0x10000000655/picture-2.jpg v1213>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.153+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000668 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml auth v1010 ap=1 s=27177 n(v0 rc2024-05-20T17:35:07.745312+0000 b27177 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd653700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000668:[<0x10000000655/article-70.xml v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000668:[<0x10000000655/article-70.xml v1010>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.155+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml auth v1014 ap=1 s=11067 n(v0 rc2024-05-20T17:35:08.127304+0000 b11067 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c7:[<0x10000000655/article-20.xml v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006c7:[<0x10000000655/article-20.xml v1014>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.155+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg auth v1028 ap=1 s=24576 n(v0 rc2024-05-20T17:35:09.014286+0000 b24576 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cf:[<0x10000000655/picture-14.jpg v1028>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007cf:[<0x10000000655/picture-14.jpg v1028>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.156+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000674 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml auth v1006 ap=1 s=7688 n(v0 rc2024-05-20T17:35:07.799311+0000 b7688 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000674:[<0x10000000655/article-61.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000674:[<0x10000000655/article-61.xml v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.157+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml auth v1040 ap=1 s=2368 n(v0 rc2024-05-20T17:35:07.988307+0000 b2368 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069d:[<0x10000000655/article-41.xml v1040>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000069d:[<0x10000000655/article-41.xml v1040>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.251 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.157+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000695 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml auth v998 ap=1 s=24891 n(v0 rc2024-05-20T17:35:07.949308+0000 b24891 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000695:[<0x10000000655/article-45.xml v998>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000695:[<0x10000000655/article-45.xml v998>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.158+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000669 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml auth v1008 ap=1 s=27956 n(v0 rc2024-05-20T17:35:07.750312+0000 b27956 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000669:[<0x10000000655/article-69.xml v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000669:[<0x10000000655/article-69.xml v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.158+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg auth v1004 ap=1 s=9677 n(v0 rc2024-05-20T17:35:08.348300+0000 b9677 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070a:[<0x10000000655/picture-61.jpg v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000070a:[<0x10000000655/picture-61.jpg v1004>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.159+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg auth v1022 ap=1 s=24429 n(v0 rc2024-05-20T17:35:10.170262+0000 b24429 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092c:[<0x10000000655/picture-7.jpg v1022>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000092c:[<0x10000000655/picture-7.jpg v1022>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.159+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml auth v1016 ap=1 s=21586 n(v0 rc2024-05-20T17:35:08.063306+0000 b21586 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd65f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b1:[<0x10000000655/article-31.xml v1016>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006b1:[<0x10000000655/article-31.xml v1016>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.160+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000923 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg auth v1024 ap=1 s=13459 n(v0 rc2024-05-20T17:35:10.142263+0000 b13459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd668000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000923:[<0x10000000655/picture-9.jpg v1024>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000923:[<0x10000000655/picture-9.jpg v1024>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.162+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001767 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg auth v526 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.004913+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdcce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001767:[<0x1000000162b/picture-13.jpg v526>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001767:[<0x1000000162b/picture-13.jpg v526>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.163+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001755 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg auth v496 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.896916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdcce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001755:[<0x1000000162b/picture-18.jpg v496>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001755:[<0x1000000162b/picture-18.jpg v496>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.164+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001751 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg auth v490 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.875916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdccec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001751:[<0x1000000162b/picture-19.jpg v490>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001751:[<0x1000000162b/picture-19.jpg v490>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.164+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg auth v112 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.157931+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdccf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166f:[<0x1000000162b/picture-82.jpg v112>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000166f:[<0x1000000162b/picture-82.jpg v112>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.164+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001789 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg auth v580 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.188910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdccf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001789:[<0x1000000162b/picture-4.jpg v580>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001789:[<0x1000000162b/picture-4.jpg v580>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.252 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.165+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001714 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg auth v394 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.567922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc61700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001714:[<0x1000000162b/picture-35.jpg v394>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001714:[<0x1000000162b/picture-35.jpg v394>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.165+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg auth v592 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.223909+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd857180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178f:[<0x1000000162b/picture-2.jpg v592>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000178f:[<0x1000000162b/picture-2.jpg v592>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.166+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg auth v136 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.206930+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167c:[<0x1000000162b/picture-78.jpg v136>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000167c:[<0x1000000162b/picture-78.jpg v136>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.166+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001764 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg auth v520 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.985914+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001764:[<0x1000000162b/picture-14.jpg v520>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001764:[<0x1000000162b/picture-14.jpg v520>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.167+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001656 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg auth v70 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.086932+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001656:[<0x1000000162b/picture-89.jpg v70>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001656:[<0x1000000162b/picture-89.jpg v70>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.167+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ba [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg auth v238 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.354927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ba:[<0x1000000162b/picture-61.jpg v238>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ba:[<0x1000000162b/picture-61.jpg v238>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.168+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg auth v562 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.126911+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177e:[<0x1000000162b/picture-7.jpg v562>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000177e:[<0x1000000162b/picture-7.jpg v562>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.168+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001776 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg auth v550 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.090912+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001776:[<0x1000000162b/picture-9.jpg v550>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001776:[<0x1000000162b/picture-9.jpg v550>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.169+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg auth v220 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.332927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016b0:[<0x1000000162b/picture-64.jpg v220>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016b0:[<0x1000000162b/picture-64.jpg v220>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.169+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001772 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg auth v544 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.072912+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001772:[<0x1000000162b/picture-10.jpg v544>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001772:[<0x1000000162b/picture-10.jpg v544>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.253 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.169+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001792 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg auth{0=1} v604 ap=1 s=33772 n(v0 rc2024-05-20T17:35:27.236909+0000 b33772 1=1+0) caps={25025=pAsLsXsFscr/pFscr@12} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f0cdd6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001792:[<0x1000000162b/picture-1.jpg v598>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001792:[<0x1000000162b/picture-1.jpg v604>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.170+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg auth v106 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.146931+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166b:[<0x1000000162b/picture-83.jpg v106>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000166b:[<0x1000000162b/picture-83.jpg v106>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.171+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001782 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg auth v568 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.148910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001782:[<0x1000000162b/picture-6.jpg v568>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001782:[<0x1000000162b/picture-6.jpg v568>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.172+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg auth v436 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.688920+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172f:[<0x1000000162b/picture-28.jpg v436>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000172f:[<0x1000000162b/picture-28.jpg v436>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.172+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg auth v52 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.053933+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164b:[<0x1000000162b/picture-92.jpg v52>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000164b:[<0x1000000162b/picture-92.jpg v52>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.173+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg auth v382 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.550923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170d:[<0x1000000162b/picture-37.jpg v382>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000170d:[<0x1000000162b/picture-37.jpg v382>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.173+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001759 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg auth v502 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.925915+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001759:[<0x1000000162b/picture-17.jpg v502>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001759:[<0x1000000162b/picture-17.jpg v502>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.174+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001664 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg auth v94 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.120932+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001664:[<0x1000000162b/picture-85.jpg v94>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001664:[<0x1000000162b/picture-85.jpg v94>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.174+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001641 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml auth v34 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.028934+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001641:[<0x1000000162b/article-3.xml v34>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001641:[<0x1000000162b/article-3.xml v34>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.254 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.174+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg auth v460 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.766918+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173e:[<0x1000000162b/picture-24.jpg v460>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000173e:[<0x1000000162b/picture-24.jpg v460>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.175+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000171b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg auth v406 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.590922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000171b:[<0x1000000162b/picture-33.jpg v406>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000171b:[<0x1000000162b/picture-33.jpg v406>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.176+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg auth v262 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.383926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c8:[<0x1000000162b/picture-57.jpg v262>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016c8:[<0x1000000162b/picture-57.jpg v262>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.176+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001631 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml auth v10 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.989934+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001631:[<0x1000000162b/article-7.xml v10>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001631:[<0x1000000162b/article-7.xml v10>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.177+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg auth v352 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.514924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fc:[<0x1000000162b/picture-42.jpg v352>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016fc:[<0x1000000162b/picture-42.jpg v352>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.177+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg auth v196 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.304928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdd7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a3:[<0x1000000162b/picture-68.jpg v196>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016a3:[<0x1000000162b/picture-68.jpg v196>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.178+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001706 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg auth v370 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.536923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001706:[<0x1000000162b/picture-39.jpg v370>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001706:[<0x1000000162b/picture-39.jpg v370>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.178+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg auth v454 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.747919+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173a:[<0x1000000162b/picture-25.jpg v454>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000173a:[<0x1000000162b/picture-25.jpg v454>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.178+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml auth v4 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.978935+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162d:[<0x1000000162b/article-8.xml v4>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000162d:[<0x1000000162b/article-8.xml v4>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.179+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001723 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg auth v418 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.626921+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001723:[<0x1000000162b/picture-31.jpg v418>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001723:[<0x1000000162b/picture-31.jpg v418>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.255 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.180+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg auth v310 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.460925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e4:[<0x1000000162b/picture-49.jpg v310>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016e4:[<0x1000000162b/picture-49.jpg v310>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.182+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg auth v556 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.106911+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177a:[<0x1000000162b/picture-8.jpg v556>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000177a:[<0x1000000162b/picture-8.jpg v556>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.183+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001659 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg auth v76 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.094932+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001659:[<0x1000000162b/picture-88.jpg v76>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001659:[<0x1000000162b/picture-88.jpg v76>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.183+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001737 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg auth v448 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.725919+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001737:[<0x1000000162b/picture-26.jpg v448>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001737:[<0x1000000162b/picture-26.jpg v448>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.184+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001636 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml auth v16 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.000934+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001636:[<0x1000000162b/article-6.xml v16>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001636:[<0x1000000162b/article-6.xml v16>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.185+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001645 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml auth v40 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.036933+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001645:[<0x1000000162b/article-2.xml v40>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001645:[<0x1000000162b/article-2.xml v40>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.185+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg auth v280 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.408926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cddf3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d2:[<0x1000000162b/picture-54.jpg v280>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d2:[<0x1000000162b/picture-54.jpg v280>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.186+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg auth v430 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.672920+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde10000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172b:[<0x1000000162b/picture-29.jpg v430>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000172b:[<0x1000000162b/picture-29.jpg v430>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.186+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001660 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg auth v88 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.110932+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde10580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001660:[<0x1000000162b/picture-86.jpg v88>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001660:[<0x1000000162b/picture-86.jpg v88>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.187+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001672 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg auth v118 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.168931+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde10b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001672:[<0x1000000162b/picture-81.jpg v118>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001672:[<0x1000000162b/picture-81.jpg v118>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.256 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.187+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001786 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg auth v574 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.171910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde11080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001786:[<0x1000000162b/picture-5.jpg v574>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001786:[<0x1000000162b/picture-5.jpg v574>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.188+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg auth v304 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.449925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde11600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e0:[<0x1000000162b/picture-50.jpg v304>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016e0:[<0x1000000162b/picture-50.jpg v304>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.188+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg auth v256 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.375926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde11b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c5:[<0x1000000162b/picture-58.jpg v256>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016c5:[<0x1000000162b/picture-58.jpg v256>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.189+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg auth v214 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.325927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde12100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ad:[<0x1000000162b/picture-65.jpg v214>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ad:[<0x1000000162b/picture-65.jpg v214>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.190+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001680 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg auth v142 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.217930+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde12680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001680:[<0x1000000162b/picture-77.jpg v142>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001680:[<0x1000000162b/picture-77.jpg v142>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.190+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000169f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg auth v190 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.297928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde12c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000169f:[<0x1000000162b/picture-69.jpg v190>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000169f:[<0x1000000162b/picture-69.jpg v190>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.190+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016dd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg auth v298 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.438925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde13180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016dd:[<0x1000000162b/picture-51.jpg v298>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016dd:[<0x1000000162b/picture-51.jpg v298>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.191+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg auth v232 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.347927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde13700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016b7:[<0x1000000162b/picture-62.jpg v232>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016b7:[<0x1000000162b/picture-62.jpg v232>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.192+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg auth v328 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.487924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ee:[<0x1000000162b/picture-46.jpg v328>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ee:[<0x1000000162b/picture-46.jpg v328>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.192+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg auth v586 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.205909+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178c:[<0x1000000162b/picture-3.jpg v586>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000178c:[<0x1000000162b/picture-3.jpg v586>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.193+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg auth v274 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.399926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016cf:[<0x1000000162b/picture-55.jpg v274>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016cf:[<0x1000000162b/picture-55.jpg v274>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.193+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg auth v538 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.049912+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176f:[<0x1000000162b/picture-11.jpg v538>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000176f:[<0x1000000162b/picture-11.jpg v538>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.193+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000169c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg auth v184 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.289928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000169c:[<0x1000000162b/picture-70.jpg v184>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000169c:[<0x1000000162b/picture-70.jpg v184>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.194+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml auth v22 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.011934+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163a:[<0x1000000162b/article-5.xml v22>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000163a:[<0x1000000162b/article-5.xml v22>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.195+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001698 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg auth v178 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.282928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001698:[<0x1000000162b/picture-71.jpg v178>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001698:[<0x1000000162b/picture-71.jpg v178>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.199+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg auth v226 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.339927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016b3:[<0x1000000162b/picture-63.jpg v226>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016b3:[<0x1000000162b/picture-63.jpg v226>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.199+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001703 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg auth v364 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.529923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001703:[<0x1000000162b/picture-40.jpg v364>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001703:[<0x1000000162b/picture-40.jpg v364>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.200+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg auth v82 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.102932+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165d:[<0x1000000162b/picture-87.jpg v82>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000165d:[<0x1000000162b/picture-87.jpg v82>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.201+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001667 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg auth v100 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.133931+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001667:[<0x1000000162b/picture-84.jpg v100>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001667:[<0x1000000162b/picture-84.jpg v100>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.258 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.201+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001742 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg auth v466 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.791918+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001742:[<0x1000000162b/picture-23.jpg v466>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001742:[<0x1000000162b/picture-23.jpg v466>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.201+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001679 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg auth v130 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.195930+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001679:[<0x1000000162b/picture-79.jpg v130>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001679:[<0x1000000162b/picture-79.jpg v130>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.202+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg auth v334 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.494924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f2:[<0x1000000162b/picture-45.jpg v334>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f2:[<0x1000000162b/picture-45.jpg v334>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.202+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg auth v358 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.522923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ff:[<0x1000000162b/picture-41.jpg v358>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ff:[<0x1000000162b/picture-41.jpg v358>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.203+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016be [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg auth v244 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.361927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016be:[<0x1000000162b/picture-60.jpg v244>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016be:[<0x1000000162b/picture-60.jpg v244>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.203+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg auth v208 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.318928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a9:[<0x1000000162b/picture-66.jpg v208>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016a9:[<0x1000000162b/picture-66.jpg v208>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.204+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001675 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg auth v124 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.181930+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001675:[<0x1000000162b/picture-80.jpg v124>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001675:[<0x1000000162b/picture-80.jpg v124>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.204+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg auth v58 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.067933+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164f:[<0x1000000162b/picture-91.jpg v58>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000164f:[<0x1000000162b/picture-91.jpg v58>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.205+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001746 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg auth v472 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.817917+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001746:[<0x1000000162b/picture-22.jpg v472>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001746:[<0x1000000162b/picture-22.jpg v472>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.205+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001760 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg auth v514 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.965914+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001760:[<0x1000000162b/picture-15.jpg v514>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001760:[<0x1000000162b/picture-15.jpg v514>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.206+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016cc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg auth v268 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.392926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde2d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016cc:[<0x1000000162b/picture-56.jpg v268>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016cc:[<0x1000000162b/picture-56.jpg v268>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.259 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.207+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg auth v322 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.480924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde36000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016eb:[<0x1000000162b/picture-47.jpg v322>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016eb:[<0x1000000162b/picture-47.jpg v322>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.207+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg auth v532 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.022913+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde36580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176b:[<0x1000000162b/picture-12.jpg v532>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000176b:[<0x1000000162b/picture-12.jpg v532>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.207+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg auth v340 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.500924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde36b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f5:[<0x1000000162b/picture-44.jpg v340>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f5:[<0x1000000162b/picture-44.jpg v340>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.208+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml auth v28 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.019934+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde37080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163e:[<0x1000000162b/article-4.xml v28>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000163e:[<0x1000000162b/article-4.xml v28>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.209+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001695 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg auth v172 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.275929+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde37600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001695:[<0x1000000162b/picture-72.jpg v172>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001695:[<0x1000000162b/picture-72.jpg v172>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.209+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg auth v250 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.368927+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde37b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c1:[<0x1000000162b/picture-59.jpg v250>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016c1:[<0x1000000162b/picture-59.jpg v250>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.210+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001690 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg auth v166 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.264929+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde38100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001690:[<0x1000000162b/picture-73.jpg v166>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001690:[<0x1000000162b/picture-73.jpg v166>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.210+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg auth v478 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.838917+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde38680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174a:[<0x1000000162b/picture-21.jpg v478>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000174a:[<0x1000000162b/picture-21.jpg v478>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.211+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001688 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg auth v154 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.244929+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde38c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001688:[<0x1000000162b/picture-75.jpg v154>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001688:[<0x1000000162b/picture-75.jpg v154>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.212+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001727 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg auth v424 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.647921+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde39180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001727:[<0x1000000162b/picture-30.jpg v424>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001727:[<0x1000000162b/picture-30.jpg v424>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.212+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001711 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg auth v388 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.559923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde39700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001711:[<0x1000000162b/picture-36.jpg v388>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001711:[<0x1000000162b/picture-36.jpg v388>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.260 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.213+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg auth v346 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.508924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde42000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f8:[<0x1000000162b/picture-43.jpg v346>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f8:[<0x1000000162b/picture-43.jpg v346>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.214+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg auth v484 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.856916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde42580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174e:[<0x1000000162b/picture-20.jpg v484>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000174e:[<0x1000000162b/picture-20.jpg v484>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.214+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg auth v376 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.543923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde42b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170a:[<0x1000000162b/picture-38.jpg v376>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000170a:[<0x1000000162b/picture-38.jpg v376>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.215+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001733 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg auth v442 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.703920+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde43080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001733:[<0x1000000162b/picture-27.jpg v442>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001733:[<0x1000000162b/picture-27.jpg v442>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.215+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg auth v292 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.427925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde43600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d9:[<0x1000000162b/picture-52.jpg v292>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d9:[<0x1000000162b/picture-52.jpg v292>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.216+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001648 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml auth v46 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.045933+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde43b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001648:[<0x1000000162b/article-1.xml v46>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001648:[<0x1000000162b/article-1.xml v46>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.217+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001717 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg auth v400 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.574922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde44100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001717:[<0x1000000162b/picture-34.jpg v400>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001717:[<0x1000000162b/picture-34.jpg v400>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.218+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg auth v286 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.418926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde44680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d6:[<0x1000000162b/picture-53.jpg v286>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d6:[<0x1000000162b/picture-53.jpg v286>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.218+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg auth v202 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.311928+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde44c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a6:[<0x1000000162b/picture-67.jpg v202>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016a6:[<0x1000000162b/picture-67.jpg v202>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.219+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001652 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg auth v64 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.078933+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde45180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001652:[<0x1000000162b/picture-90.jpg v64>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001652:[<0x1000000162b/picture-90.jpg v64>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.261 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.219+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg auth v508 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.945915+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde45700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175c:[<0x1000000162b/picture-16.jpg v508>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000175c:[<0x1000000162b/picture-16.jpg v508>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.220+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000168c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg auth v160 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.254929+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000168c:[<0x1000000162b/picture-74.jpg v160>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000168c:[<0x1000000162b/picture-74.jpg v160>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.220+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001683 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg auth v148 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.230929+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001683:[<0x1000000162b/picture-76.jpg v148>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001683:[<0x1000000162b/picture-76.jpg v148>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.221+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000171f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg auth v412 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.608922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000171f:[<0x1000000162b/picture-32.jpg v412>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000171f:[<0x1000000162b/picture-32.jpg v412>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.221+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg auth v316 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.471924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cde4f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e7:[<0x1000000162b/picture-48.jpg v316>,<0x10000000399/blog-29 v36560>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016e7:[<0x1000000162b/picture-48.jpg v316>,<0x10000000399/blog-29 v46302>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.222+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml auth v208 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.443904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbc9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b9:[<0x10000001744/article-59.xml v208>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b9:[<0x10000001744/article-59.xml v208>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.223+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001749 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml auth v10 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.834917+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001749:[<0x10000001744/article-92.xml v10>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001749:[<0x10000001744/article-92.xml v10>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.224+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml auth v118 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.203909+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbcb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178b:[<0x10000001744/article-74.xml v118>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000178b:[<0x10000001744/article-74.xml v118>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.224+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001836 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml auth v454 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.082891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbcb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001836:[<0x10000001744/article-18.xml v454>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001836:[<0x10000001744/article-18.xml v454>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.226+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml auth v256 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.578901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd010580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d2:[<0x10000001744/article-51.xml v256>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d2:[<0x10000001744/article-51.xml v256>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.262 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.226+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml auth v400 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.928894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd010b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181a:[<0x10000001744/article-27.xml v400>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181a:[<0x10000001744/article-27.xml v400>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.263 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.228+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001798 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml auth v142 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.264908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd011b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001798:[<0x10000001744/article-70.xml v142>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001798:[<0x10000001744/article-70.xml v142>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.263 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.229+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml auth v442 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.036892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd012100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182f:[<0x10000001744/article-20.xml v442>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182f:[<0x10000001744/article-20.xml v442>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.263 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.230+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml auth v64 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.020913+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd012c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176a:[<0x10000001744/article-83.xml v64>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000176a:[<0x10000001744/article-83.xml v64>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.263 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.231+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml auth v196 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.407905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd013180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b3:[<0x10000001744/article-61.xml v196>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b3:[<0x10000001744/article-61.xml v196>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.263 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.231+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml auth v316 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.719899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd013700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f0:[<0x10000001744/article-41.xml v316>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f0:[<0x10000001744/article-41.xml v316>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.445 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.200+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000455 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml auth v1469 ap=1 s=12332 n(v0 rc2024-05-20T17:35:06.013348+0000 b12332 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8798cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000455:[<0x1000000039b/article-29.xml v1469>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000455:[<0x1000000039b/article-29.xml v1469>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.201+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml auth v1447 ap=1 s=20744 n(v0 rc2024-05-20T17:35:06.225344+0000 b20744 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ae4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049d:[<0x1000000039b/article-22.xml v1447>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000049d:[<0x1000000039b/article-22.xml v1447>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.205+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml auth v1652 ap=1 s=26723 n(v0 rc2024-05-20T17:35:05.637356+0000 b26723 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8796b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a8:[<0x1000000039b/article-43.xml v1577>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a8:[<0x1000000039b/article-43.xml v1652>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.205+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000422 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml auth v1477 ap=1 s=28899 n(v0 rc2024-05-20T17:35:05.862351+0000 b28899 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8796b8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000422:[<0x1000000039b/article-33.xml v1477>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000422:[<0x1000000039b/article-33.xml v1477>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.211+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml auth v1467 ap=1 s=18666 n(v0 rc2024-05-20T17:35:06.036348+0000 b18666 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879ad8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045e:[<0x1000000039b/article-28.xml v1467>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000045e:[<0x1000000039b/article-28.xml v1467>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.216+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005be [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml auth v1403 ap=1 s=14530 n(v0 rc2024-05-20T17:35:07.108325+0000 b14530 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a2f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005be:[<0x1000000039b/article-9.xml v1403>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000005be:[<0x1000000039b/article-9.xml v1403>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.216+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg auth v1585 ap=1 s=33023 n(v0 rc2024-05-20T17:35:09.183283+0000 b33023 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f8:[<0x1000000039b/picture-83.jpg v1585>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000007f8:[<0x1000000039b/picture-83.jpg v1585>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.446 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.217+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml auth v1355 ap=1 s=4943 n(v0 rc2024-05-20T17:35:05.609356+0000 b4943 1=1+0) caps={25025=pAsLsXsFscr/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a42000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039d:[<0x1000000039b/article-44.xml v1355>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039d:[<0x1000000039b/article-44.xml v1355>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.219+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000485 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml auth v1357 ap=1 s=4571 n(v0 rc2024-05-20T17:35:06.175345+0000 b4571 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a43600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000485:[<0x1000000039b/article-24.xml v1357>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000485:[<0x1000000039b/article-24.xml v1357>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.221+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000802 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg auth v1425 ap=1 s=53318 n(v0 rc2024-05-20T17:35:09.565275+0000 b53318 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a45700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000802:[<0x1000000039b/picture-17.jpg v1425>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000802:[<0x1000000039b/picture-17.jpg v1425>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.222+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml auth v1391 ap=1 s=26070 n(v0 rc2024-05-20T17:35:07.257322+0000 b26070 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a50000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ed:[<0x1000000039b/article-3.xml v1391>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000005ed:[<0x1000000039b/article-3.xml v1391>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.222+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000634 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg auth v1453 ap=1 s=12829 n(v0 rc2024-05-20T17:35:07.533317+0000 b12829 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a50580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000634:[<0x1000000039b/picture-24.jpg v1453>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000634:[<0x1000000039b/picture-24.jpg v1453>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.222+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml auth v1399 ap=1 s=28461 n(v0 rc2024-05-20T17:35:07.159324+0000 b28461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879a50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ce:[<0x1000000039b/article-7.xml v1399>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000005ce:[<0x1000000039b/article-7.xml v1399>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.225+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg auth v1429 ap=1 s=18860 n(v0 rc2024-05-20T17:35:09.171283+0000 b18860 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879661600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f5:[<0x1000000039b/picture-18.jpg v1429>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000007f5:[<0x1000000039b/picture-18.jpg v1429>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.226+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000571 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml auth v1431 ap=1 s=21241 n(v0 rc2024-05-20T17:35:06.855331+0000 b21241 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879661b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000571:[<0x1000000039b/article-18.xml v1431>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000571:[<0x1000000039b/article-18.xml v1431>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.227+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg auth v1433 ap=1 s=59951 n(v0 rc2024-05-20T17:35:09.120284+0000 b59951 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879662680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000077d:[<0x1000000039b/picture-19.jpg v1433>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000077d:[<0x1000000039b/picture-19.jpg v1433>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.447 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.228+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml auth v1465 ap=1 s=19310 n(v0 rc2024-05-20T17:35:10.453256+0000 b19310 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879663180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097d:[<0x1000000039b/article-27.xml v1465>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000097d:[<0x1000000039b/article-27.xml v1465>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.230+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml auth v1439 ap=1 s=21491 n(v0 rc2024-05-20T17:35:06.774332+0000 b21491 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87960e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b5:[<0x1000000039b/article-20.xml v1439>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000004b5:[<0x1000000039b/article-20.xml v1439>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.231+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000908 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg auth v1413 ap=1 s=43911 n(v0 rc2024-05-20T17:35:10.388258+0000 b43911 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87960eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000908:[<0x1000000039b/picture-14.jpg v1413>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000908:[<0x1000000039b/picture-14.jpg v1413>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.231+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml auth v1485 ap=1 s=14965 n(v0 rc2024-05-20T17:35:05.684355+0000 b14965 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87960f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c2:[<0x1000000039b/article-41.xml v1485>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c2:[<0x1000000039b/article-41.xml v1485>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.232+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml auth v1473 ap=1 s=14409 n(v0 rc2024-05-20T17:35:05.922350+0000 b14409 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87960fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000437:[<0x1000000039b/article-31.xml v1473>,<0x10000000399/blog-1 v17677>,<0x10000000208/blogtest_in v343>,<0x10000000201/src v2100>,<0x10000000006/blogbench-1.0 v1814>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v34>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v52>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v60>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000437:[<0x1000000039b/article-31.xml v1473>,<0x10000000399/blog-1 v46218>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.271+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001417 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg auth v380 ap=1 s=22007 n(v0 rc2024-05-20T17:35:24.048975+0000 b22007 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879e3e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001417:[<0x10000001360/picture-13.jpg v256>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001417:[<0x10000001360/picture-13.jpg v380>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.272+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001405 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg auth v400 ap=1 s=18182 n(v0 rc2024-05-20T17:35:23.999976+0000 b18182 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879e3f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001405:[<0x10000001360/picture-18.jpg v226>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001405:[<0x10000001360/picture-18.jpg v400>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.272+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml auth v60 ap=1 s=18375 n(v0 rc2024-05-20T17:35:23.420988+0000 b18375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139f:[<0x10000001360/article-27.xml v60>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000139f:[<0x10000001360/article-27.xml v60>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.448 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.272+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml auth v118 ap=1 s=20265 n(v0 rc2024-05-20T17:35:23.717982+0000 b20265 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879e3f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c3:[<0x10000001360/article-18.xml v118>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013c3:[<0x10000001360/article-18.xml v118>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.273+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001439 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg auth v344 ap=1 s=44335 n(v0 rc2024-05-20T17:35:24.240971+0000 b44335 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001439:[<0x10000001360/picture-4.jpg v310>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001439:[<0x10000001360/picture-4.jpg v344>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.273+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001440 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg auth v336 ap=1 s=34569 n(v0 rc2024-05-20T17:35:24.276970+0000 b34569 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001440:[<0x10000001360/picture-2.jpg v322>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001440:[<0x10000001360/picture-2.jpg v336>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.274+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml auth v402 ap=1 s=7426 n(v0 rc2024-05-20T17:35:23.660983+0000 b7426 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bc:[<0x10000001360/article-20.xml v102>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013bc:[<0x10000001360/article-20.xml v402>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.274+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001414 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg auth v384 ap=1 s=28015 n(v0 rc2024-05-20T17:35:24.037975+0000 b28015 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001414:[<0x10000001360/picture-14.jpg v250>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001414:[<0x10000001360/picture-14.jpg v384>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001385 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml auth v418 ap=1 s=32062 n(v0 rc2024-05-20T17:35:22.990997+0000 b32062 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879653600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001385:[<0x10000001360/article-31.xml v30>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001385:[<0x10000001360/article-31.xml v418>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg auth v356 ap=1 s=48705 n(v0 rc2024-05-20T17:35:24.175972+0000 b48705 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142e:[<0x10000001360/picture-7.jpg v292>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000142e:[<0x10000001360/picture-7.jpg v356>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001426 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg auth v364 ap=1 s=36867 n(v0 rc2024-05-20T17:35:24.123973+0000 b36867 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001426:[<0x10000001360/picture-9.jpg v280>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001426:[<0x10000001360/picture-9.jpg v364>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001420 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg auth v368 ap=1 s=32803 n(v0 rc2024-05-20T17:35:24.102974+0000 b32803 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879ae5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001420:[<0x10000001360/picture-10.jpg v274>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001420:[<0x10000001360/picture-10.jpg v368>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.449 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001443 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg auth v332 ap=1 s=22344 n(v0 rc2024-05-20T17:35:24.294970+0000 b22344 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001443:[<0x10000001360/picture-1.jpg v328>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001443:[<0x10000001360/picture-1.jpg v332>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.275+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml auth v366 ap=1 s=4232 n(v0 rc2024-05-20T17:35:23.908978+0000 b4232 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c4a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e2:[<0x10000001360/article-9.xml v172>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013e2:[<0x10000001360/article-9.xml v366>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.276+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001432 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg auth v352 ap=1 s=40893 n(v0 rc2024-05-20T17:35:24.202971+0000 b40893 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879ad6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001432:[<0x10000001360/picture-6.jpg v298>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001432:[<0x10000001360/picture-6.jpg v352>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.276+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ae [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml auth v410 ap=1 s=17943 n(v0 rc2024-05-20T17:35:23.547985+0000 b17943 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879ad8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ae:[<0x10000001360/article-24.xml v78>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ae:[<0x10000001360/article-24.xml v410>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.276+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001408 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg auth v396 ap=1 s=46401 n(v0 rc2024-05-20T17:35:24.009975+0000 b46401 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8797c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001408:[<0x10000001360/picture-17.jpg v232>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001408:[<0x10000001360/picture-17.jpg v396>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.276+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml auth v342 ap=1 s=32239 n(v0 rc2024-05-20T17:35:23.969976+0000 b32239 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8797c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f9:[<0x10000001360/article-3.xml v208>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013f9:[<0x10000001360/article-3.xml v342>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.277+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml auth v358 ap=1 s=11150 n(v0 rc2024-05-20T17:35:23.928977+0000 b11150 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8794db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013eb:[<0x10000001360/article-7.xml v184>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013eb:[<0x10000001360/article-7.xml v358>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.277+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg auth v360 ap=1 s=28760 n(v0 rc2024-05-20T17:35:24.145973+0000 b28760 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142a:[<0x10000001360/picture-8.jpg v286>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000142a:[<0x10000001360/picture-8.jpg v360>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.277+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml auth v362 ap=1 s=13495 n(v0 rc2024-05-20T17:35:23.918977+0000 b13495 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879662100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e7:[<0x10000001360/article-8.xml v178>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013e7:[<0x10000001360/article-8.xml v362>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.277+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001379 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml auth v24 ap=1 s=16525 n(v0 rc2024-05-20T17:35:22.784001+0000 b16525 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a243080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001379:[<0x10000001360/article-32.xml v24>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001379:[<0x10000001360/article-32.xml v24>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.450 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.277+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml auth v404 ap=1 s=24341 n(v0 rc2024-05-20T17:35:23.633983+0000 b24341 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a1d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b7:[<0x10000001360/article-21.xml v96>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b7:[<0x10000001360/article-21.xml v404>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.278+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml auth v416 ap=1 s=24107 n(v0 rc2024-05-20T17:35:23.096994+0000 b24107 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8796acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138b:[<0x10000001360/article-30.xml v36>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000138b:[<0x10000001360/article-30.xml v416>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.278+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml auth v382 ap=1 s=25056 n(v0 rc2024-05-20T17:35:23.864978+0000 b25056 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d4:[<0x10000001360/article-13.xml v148>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d4:[<0x10000001360/article-13.xml v382>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.278+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml auth v354 ap=1 s=30824 n(v0 rc2024-05-20T17:35:23.938977+0000 b30824 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ee:[<0x10000001360/article-6.xml v190>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ee:[<0x10000001360/article-6.xml v354>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.278+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml auth v338 ap=1 s=19445 n(v0 rc2024-05-20T17:35:23.978976+0000 b19445 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fe:[<0x10000001360/article-2.xml v214>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013fe:[<0x10000001360/article-2.xml v338>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.278+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001371 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml auth v420 ap=1 s=24926 n(v0 rc2024-05-20T17:35:22.656004+0000 b24926 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001371:[<0x10000001360/article-33.xml v16>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001371:[<0x10000001360/article-33.xml v420>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.279+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001435 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg auth v348 ap=1 s=63450 n(v0 rc2024-05-20T17:35:24.221971+0000 b63450 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001435:[<0x10000001360/picture-5.jpg v304>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001435:[<0x10000001360/picture-5.jpg v348>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.279+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001399 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml auth v52 ap=1 s=17815 n(v0 rc2024-05-20T17:35:23.334989+0000 b17815 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a9f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001399:[<0x10000001360/article-28.xml v52>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001399:[<0x10000001360/article-28.xml v52>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.451 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.279+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000143c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg auth v340 ap=1 s=58024 n(v0 rc2024-05-20T17:35:24.258970+0000 b58024 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000143c:[<0x10000001360/picture-3.jpg v316>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000143c:[<0x10000001360/picture-3.jpg v340>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.452 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.279+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg auth v372 ap=1 s=28777 n(v0 rc2024-05-20T17:35:24.081974+0000 b28777 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141e:[<0x10000001360/picture-11.jpg v268>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000141e:[<0x10000001360/picture-11.jpg v372>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.452 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.279+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml auth v350 ap=1 s=6305 n(v0 rc2024-05-20T17:35:23.949977+0000 b6305 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a9f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f2:[<0x10000001360/article-5.xml v196>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013f2:[<0x10000001360/article-5.xml v350>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.452 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.280+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml auth v422 ap=1 s=25216 n(v0 rc2024-05-20T17:35:22.547006+0000 b25216 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c0d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136a:[<0x10000001360/article-34.xml v10>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000136a:[<0x10000001360/article-34.xml v422>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.452 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.280+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001392 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml auth v44 ap=1 s=4687 n(v0 rc2024-05-20T17:35:23.218992+0000 b4687 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c34580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001392:[<0x10000001360/article-29.xml v44>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001392:[<0x10000001360/article-29.xml v44>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.457 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.280+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml auth v406 ap=1 s=3784 n(v0 rc2024-05-20T17:35:23.612984+0000 b3784 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b4:[<0x10000001360/article-22.xml v90>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b4:[<0x10000001360/article-22.xml v406>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.280+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml auth v386 ap=1 s=28042 n(v0 rc2024-05-20T17:35:23.843979+0000 b28042 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d0:[<0x10000001360/article-14.xml v142>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d0:[<0x10000001360/article-14.xml v386>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.280+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml auth v374 ap=1 s=28955 n(v0 rc2024-05-20T17:35:23.885978+0000 b28955 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c36100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013db:[<0x10000001360/article-11.xml v160>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013db:[<0x10000001360/article-11.xml v374>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.281+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml auth v394 ap=1 s=30410 n(v0 rc2024-05-20T17:35:23.790980+0000 b30410 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c34b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ca:[<0x10000001360/article-16.xml v130>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ca:[<0x10000001360/article-16.xml v394>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.281+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml auth v414 ap=1 s=14278 n(v0 rc2024-05-20T17:35:23.490986+0000 b14278 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a036580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a6:[<0x10000001360/article-26.xml v66>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013a6:[<0x10000001360/article-26.xml v414>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.281+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001410 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg auth v388 ap=1 s=14649 n(v0 rc2024-05-20T17:35:24.028975+0000 b14649 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c87a036000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001410:[<0x10000001360/picture-15.jpg v244>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001410:[<0x10000001360/picture-15.jpg v388>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.281+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml auth v370 ap=1 s=11505 n(v0 rc2024-05-20T17:35:23.897978+0000 b11505 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013df:[<0x10000001360/article-10.xml v166>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013df:[<0x10000001360/article-10.xml v370>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.281+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg auth v376 ap=1 s=33434 n(v0 rc2024-05-20T17:35:24.059974+0000 b33434 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c60580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141a:[<0x10000001360/picture-12.jpg v262>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000141a:[<0x10000001360/picture-12.jpg v376>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.282+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml auth v346 ap=1 s=24497 n(v0 rc2024-05-20T17:35:23.958977+0000 b24497 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c62c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f6:[<0x10000001360/article-4.xml v202>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013f6:[<0x10000001360/article-4.xml v346>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.282+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013aa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml auth v412 ap=1 s=7418 n(v0 rc2024-05-20T17:35:23.521986+0000 b7418 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c61080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013aa:[<0x10000001360/article-25.xml v72>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013aa:[<0x10000001360/article-25.xml v412>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.458 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.282+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001361 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml auth v424 ap=1 s=6430 n(v0 rc2024-05-20T17:35:22.443008+0000 b6430 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001361:[<0x10000001360/article-35.xml v4>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001361:[<0x10000001360/article-35.xml v424>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.282+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml auth v390 ap=1 s=1473 n(v0 rc2024-05-20T17:35:23.819979+0000 b1473 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ce:[<0x10000001360/article-15.xml v136>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ce:[<0x10000001360/article-15.xml v390>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.282+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml auth v110 ap=1 s=22481 n(v0 rc2024-05-20T17:35:23.679982+0000 b22481 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879c3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bf:[<0x10000001360/article-19.xml v110>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013bf:[<0x10000001360/article-19.xml v110>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.283+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml auth v378 ap=1 s=22561 n(v0 rc2024-05-20T17:35:23.874978+0000 b22561 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d8:[<0x10000001360/article-12.xml v154>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d8:[<0x10000001360/article-12.xml v378>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.284+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001401 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml auth v334 ap=1 s=30062 n(v0 rc2024-05-20T17:35:23.988976+0000 b30062 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c879c40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001401:[<0x10000001360/article-1.xml v220>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001401:[<0x10000001360/article-1.xml v334>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.285+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml auth v408 ap=1 s=27840 n(v0 rc2024-05-20T17:35:23.582984+0000 b27840 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b2:[<0x10000001360/article-23.xml v84>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b2:[<0x10000001360/article-23.xml v408>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.285+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg auth v392 ap=1 s=65515 n(v0 rc2024-05-20T17:35:24.018975+0000 b65515 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140d:[<0x10000001360/picture-16.jpg v238>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000140d:[<0x10000001360/picture-16.jpg v392>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.285+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml auth v398 ap=1 s=26550 n(v0 rc2024-05-20T17:35:23.764981+0000 b26550 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c8798eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c6:[<0x10000001360/article-17.xml v124>,<0x10000000399/blog-24 v31048>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013c6:[<0x10000001360/article-17.xml v398>,<0x10000000399/blog-24 v42414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.337+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000665 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml auth v1004 ap=1 s=30441 n(v0 rc2024-05-20T17:35:07.734313+0000 b30441 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8798b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000665:[<0x10000000655/article-72.xml v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000665:[<0x10000000655/article-72.xml v1004>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.337+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg auth{0=1} v1018 ap=1 s=24686 n(v0 rc2024-05-20T17:35:08.858289+0000 b24686 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079e:[<0x10000000655/picture-21.jpg v1018>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000079e:[<0x10000000655/picture-21.jpg v1018>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.338+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml auth{0=1} v1022 ap=1 s=19326 n(v0 rc2024-05-20T17:35:08.035306+0000 b19326 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a9:[<0x10000000655/article-35.xml v1022>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006a9:[<0x10000000655/article-35.xml v1022>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.459 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.338+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml auth{0=1} v1010 ap=1 s=9651 n(v0 rc2024-05-20T17:35:07.997307+0000 b9651 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8791f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069f:[<0x10000000655/article-40.xml v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000069f:[<0x10000000655/article-40.xml v1010>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.338+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000767 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg auth{0=1} v1020 ap=1 s=22792 n(v0 rc2024-05-20T17:35:08.606295+0000 b22792 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8791f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000767:[<0x10000000655/picture-30.jpg v1020>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000767:[<0x10000000655/picture-30.jpg v1020>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.338+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000657 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml auth v1006 ap=1 s=1839 n(v0 rc2024-05-20T17:35:07.674314+0000 b1839 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8791f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000657:[<0x10000000655/article-82.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000657:[<0x10000000655/article-82.xml v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.339+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml auth{0=1} v1012 ap=1 s=8012 n(v0 rc2024-05-20T17:35:08.156304+0000 b8012 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8791f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d1:[<0x10000000655/article-15.xml v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006d1:[<0x10000000655/article-15.xml v1012>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.339+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000755 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg auth{0=1} v1024 ap=1 s=36629 n(v0 rc2024-05-20T17:35:08.554296+0000 b36629 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000755:[<0x10000000655/picture-36.jpg v1024>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000755:[<0x10000000655/picture-36.jpg v1024>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.340+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml auth{0=1} v1014 ap=1 s=21969 n(v0 rc2024-05-20T17:35:08.133304+0000 b21969 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c9:[<0x10000000655/article-19.xml v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006c9:[<0x10000000655/article-19.xml v1014>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.340+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000740 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg auth{0=1} v1028 ap=1 s=40069 n(v0 rc2024-05-20T17:35:08.489297+0000 b40069 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000740:[<0x10000000655/picture-43.jpg v1028>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000740:[<0x10000000655/picture-43.jpg v1028>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.340+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg auth{0=1} v1016 ap=1 s=27751 n(v0 rc2024-05-20T17:35:08.872289+0000 b27751 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a4:[<0x10000000655/picture-20.jpg v1016>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007a4:[<0x10000000655/picture-20.jpg v1016>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.340+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000906 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml auth v1032 ap=1 s=17546 n(v0 rc2024-05-20T17:35:10.057264+0000 b17546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8798f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000906:[<0x10000000655/article-89.xml v1032>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000906:[<0x10000000655/article-89.xml v1032>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.341+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml auth{0=1} v1026 ap=1 s=25584 n(v0 rc2024-05-20T17:35:07.980307+0000 b25584 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069b:[<0x10000000655/article-42.xml v1026>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000069b:[<0x10000000655/article-42.xml v1026>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.342+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg auth{0=1} v1008 ap=1 s=17593 n(v0 rc2024-05-20T17:35:08.536296+0000 b17593 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8798f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074f:[<0x10000000655/picture-38.jpg v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000074f:[<0x10000000655/picture-38.jpg v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.460 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.342+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000792 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg auth{0=1} v996 ap=1 s=19683 n(v0 rc2024-05-20T17:35:08.805290+0000 b19683 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8794dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000792:[<0x10000000655/picture-23.jpg v996>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000792:[<0x10000000655/picture-23.jpg v996>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.342+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg auth{0=1} v1004 ap=1 s=17562 n(v0 rc2024-05-20T17:35:08.471297+0000 b17562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879735080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073a:[<0x10000000655/picture-45.jpg v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000073a:[<0x10000000655/picture-45.jpg v1004>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.342+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml auth{0=1} v988 ap=1 s=13974 n(v0 rc2024-05-20T17:35:08.164304+0000 b13974 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879734b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d4:[<0x10000000655/article-14.xml v988>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006d4:[<0x10000000655/article-14.xml v988>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.343+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000746 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg auth{0=1} v1002 ap=1 s=35431 n(v0 rc2024-05-20T17:35:08.508297+0000 b35431 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879735600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000746:[<0x10000000655/picture-41.jpg v1002>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000746:[<0x10000000655/picture-41.jpg v1002>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.344+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg auth v1010 ap=1 s=11078 n(v0 rc2024-05-20T17:35:08.356300+0000 b11078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879736100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070d:[<0x10000000655/picture-60.jpg v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000070d:[<0x10000000655/picture-60.jpg v1010>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.345+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000693 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml auth{0=1} v962 ap=1 s=1072 n(v0 rc2024-05-20T17:35:07.938308+0000 b1072 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879736680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000693:[<0x10000000655/article-46.xml v962>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000693:[<0x10000000655/article-46.xml v962>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.346+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg auth v970 ap=1 s=21589 n(v0 rc2024-05-20T17:35:08.301301+0000 b21589 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879736c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fb:[<0x10000000655/picture-66.jpg v970>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006fb:[<0x10000000655/picture-66.jpg v970>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.347+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000691 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml auth{0=1} v1172 ap=1 s=25821 n(v0 rc2024-05-20T17:35:07.926309+0000 b25821 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879737180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000691:[<0x10000000655/article-47.xml v964>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000691:[<0x10000000655/article-47.xml v1172>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.349+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000666 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml auth v972 ap=1 s=8334 n(v0 rc2024-05-20T17:35:07.740312+0000 b8334 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879737700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000666:[<0x10000000655/article-71.xml v972>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000666:[<0x10000000655/article-71.xml v972>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.349+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000797 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg auth{0=1} v994 ap=1 s=23661 n(v0 rc2024-05-20T17:35:08.830290+0000 b23661 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879754000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000797:[<0x10000000655/picture-22.jpg v994>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000797:[<0x10000000655/picture-22.jpg v994>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.350+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml auth{0=1} v984 ap=1 s=32104 n(v0 rc2024-05-20T17:35:08.192303+0000 b32104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879754580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006dc:[<0x10000000655/article-11.xml v984>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006dc:[<0x10000000655/article-11.xml v984>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.461 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.351+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml auth{0=1} v992 ap=1 s=17045 n(v0 rc2024-05-20T17:35:08.150304+0000 b17045 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879755080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006cf:[<0x10000000655/article-16.xml v992>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006cf:[<0x10000000655/article-16.xml v992>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.353+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000683 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml auth v968 ap=1 s=9752 n(v0 rc2024-05-20T17:35:07.868310+0000 b9752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879755b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000683:[<0x10000000655/article-54.xml v968>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000683:[<0x10000000655/article-54.xml v968>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.353+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml auth{0=1} v976 ap=1 s=15782 n(v0 rc2024-05-20T17:35:08.093305+0000 b15782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879756100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006bb:[<0x10000000655/article-26.xml v976>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006bb:[<0x10000000655/article-26.xml v976>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.354+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg auth{0=1} v990 ap=1 s=33801 n(v0 rc2024-05-20T17:35:08.996286+0000 b33801 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879756680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ca:[<0x10000000655/picture-15.jpg v990>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007ca:[<0x10000000655/picture-15.jpg v990>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.354+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000719 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg auth v1008 ap=1 s=61625 n(v0 rc2024-05-20T17:35:08.388299+0000 b61625 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879756c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000719:[<0x10000000655/picture-56.jpg v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000719:[<0x10000000655/picture-56.jpg v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.355+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000734 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg auth{0=1} v1006 ap=1 s=10539 n(v0 rc2024-05-20T17:35:08.455298+0000 b10539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879757180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000734:[<0x10000000655/picture-47.jpg v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000734:[<0x10000000655/picture-47.jpg v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.355+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006de [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml auth{0=1} v982 ap=1 s=15357 n(v0 rc2024-05-20T17:35:08.205303+0000 b15357 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879757700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006de:[<0x10000000655/article-10.xml v982>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006de:[<0x10000000655/article-10.xml v982>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.356+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg auth{0=1} v986 ap=1 s=58736 n(v0 rc2024-05-20T17:35:10.073264+0000 b58736 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87976a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000090e:[<0x10000000655/picture-12.jpg v986>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000090e:[<0x10000000655/picture-12.jpg v986>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.356+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg auth{0=1} v978 ap=1 s=46863 n(v0 rc2024-05-20T17:35:08.480297+0000 b46863 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87976a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073d:[<0x10000000655/picture-44.jpg v978>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000073d:[<0x10000000655/picture-44.jpg v978>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.357+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml auth{0=1} v1174 ap=1 s=8312 n(v0 rc2024-05-20T17:35:07.916309+0000 b8312 1=1+0) caps={25025=pAsLsXsFscr/pFscr@6} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87976b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000068f:[<0x10000000655/article-48.xml v966>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000068f:[<0x10000000655/article-48.xml v1174>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.462 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.359+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml auth{0=1} v980 ap=1 s=22509 n(v0 rc2024-05-20T17:35:08.253302+0000 b22509 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87976bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006eb:[<0x10000000655/article-4.xml v980>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006eb:[<0x10000000655/article-4.xml v980>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.359+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml auth{0=1} v998 ap=1 s=16382 n(v0 rc2024-05-20T17:35:08.099305+0000 b16382 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87976c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006bd:[<0x10000000655/article-25.xml v998>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006bd:[<0x10000000655/article-25.xml v998>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.360+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000710 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg auth v974 ap=1 s=25430 n(v0 rc2024-05-20T17:35:08.365299+0000 b25430 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87976c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000710:[<0x10000000655/picture-59.jpg v974>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000710:[<0x10000000655/picture-59.jpg v974>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.361+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml auth{0=1} v1000 ap=1 s=24678 n(v0 rc2024-05-20T17:35:08.013307+0000 b24678 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87976cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a3:[<0x10000000655/article-38.xml v1000>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006a3:[<0x10000000655/article-38.xml v1000>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.363+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000681 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml auth v996 ap=1 s=8457 n(v0 rc2024-05-20T17:35:07.860310+0000 b8457 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c8797c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000681:[<0x10000000655/article-55.xml v996>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000681:[<0x10000000655/article-55.xml v996>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.364+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000787 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg auth{0=1} v1018 ap=1 s=31022 n(v0 rc2024-05-20T17:35:08.756291+0000 b31022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8797f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000787:[<0x10000000655/picture-25.jpg v1018>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000787:[<0x10000000655/picture-25.jpg v1018>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.365+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml auth{0=1} v1014 ap=1 s=27154 n(v0 rc2024-05-20T17:35:08.225302+0000 b27154 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8797f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e3:[<0x10000000655/article-8.xml v1014>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006e3:[<0x10000000655/article-8.xml v1014>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.367+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000764 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg auth{0=1} v1026 ap=1 s=44384 n(v0 rc2024-05-20T17:35:08.597295+0000 b44384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8797f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000764:[<0x10000000655/picture-31.jpg v1026>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000764:[<0x10000000655/picture-31.jpg v1026>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.368+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml auth v1000 ap=1 s=12267 n(v0 rc2024-05-20T17:35:07.755312+0000 b12267 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87992e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066a:[<0x10000000655/article-68.xml v1000>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000066a:[<0x10000000655/article-68.xml v1000>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.463 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.370+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg auth{0=1} v1028 ap=1 s=49303 n(v0 rc2024-05-20T17:35:08.439298+0000 b49303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87992eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072e:[<0x10000000655/picture-49.jpg v1028>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000072e:[<0x10000000655/picture-49.jpg v1028>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.371+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml auth v1002 ap=1 s=29995 n(v0 rc2024-05-20T17:35:07.713313+0000 b29995 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c87992f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065f:[<0x10000000655/article-76.xml v1002>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000065f:[<0x10000000655/article-76.xml v1002>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.372+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000927 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg auth{0=1} v1012 ap=1 s=18845 n(v0 rc2024-05-20T17:35:10.156262+0000 b18845 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87992f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000927:[<0x10000000655/picture-8.jpg v1012>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000927:[<0x10000000655/picture-8.jpg v1012>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.373+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000782 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg auth{0=1} v1020 ap=1 s=9564 n(v0 rc2024-05-20T17:35:08.729292+0000 b9564 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87992fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000782:[<0x10000000655/picture-26.jpg v1020>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000782:[<0x10000000655/picture-26.jpg v1020>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.375+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006af [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml auth{0=1} v1004 ap=1 s=11077 n(v0 rc2024-05-20T17:35:08.056306+0000 b11077 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879930680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006af:[<0x10000000655/article-32.xml v1004>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006af:[<0x10000000655/article-32.xml v1004>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.376+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml auth{0=1} v1006 ap=1 s=7426 n(v0 rc2024-05-20T17:35:08.121305+0000 b7426 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879931700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c5:[<0x10000000655/article-21.xml v1006>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006c5:[<0x10000000655/article-21.xml v1006>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.377+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml auth{0=1} v1210 ap=1 s=6937 n(v0 rc2024-05-20T17:35:11.736230+0000 b6937 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879938000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009db:[<0x10000000655/article-30.xml v1044>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000009db:[<0x10000000655/article-30.xml v1210>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.381+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml auth{0=1} v1016 ap=1 s=9235 n(v0 rc2024-05-20T17:35:08.173303+0000 b9235 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879939b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d7:[<0x10000000655/article-13.xml v1016>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006d7:[<0x10000000655/article-13.xml v1016>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.384+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml auth{0=1} v994 ap=1 s=17838 n(v0 rc2024-05-20T17:35:07.900309+0000 b17838 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87993b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000068b:[<0x10000000655/article-50.xml v994>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000068b:[<0x10000000655/article-50.xml v994>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.464 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.385+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml auth{0=1} v1010 ap=1 s=2353 n(v0 rc2024-05-20T17:35:08.239302+0000 b2353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87993b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e7:[<0x10000000655/article-6.xml v1010>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006e7:[<0x10000000655/article-6.xml v1010>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.385+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml auth{0=1} v1008 ap=1 s=1609 n(v0 rc2024-05-20T17:35:08.265302+0000 b1609 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879946000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ef:[<0x10000000655/article-2.xml v1008>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000006ef:[<0x10000000655/article-2.xml v1008>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.387+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg auth{0=1} v1207 ap=1 s=34514 n(v0 rc2024-05-20T17:35:08.403299+0000 b34514 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879947080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071f:[<0x10000000655/picture-54.jpg v1030>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000071f:[<0x10000000655/picture-54.jpg v1207>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.387+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg auth{0=1} v1022 ap=1 s=41100 n(v0 rc2024-05-20T17:35:08.626294+0000 b41100 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879947600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000076c:[<0x10000000655/picture-29.jpg v1022>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000076c:[<0x10000000655/picture-29.jpg v1022>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.390+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml auth v998 ap=1 s=23445 n(v0 rc2024-05-20T17:35:07.853310+0000 b23445 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879948100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067f:[<0x10000000655/article-56.xml v998>,<0x10000000399/blog-5 v17500>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000067f:[<0x10000000655/article-56.xml v998>,<0x10000000399/blog-5 v46292>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.425+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d94 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml auth{0=1} v1087 ap=1 s=17744 n(v0 rc2024-05-20T17:35:15.731147+0000 b17744 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a978c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d94:[<0x10000000d67/article-59.xml v40>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d94:[<0x10000000d67/article-59.xml v1087>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.426+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001225 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg auth{0=1} v1063 ap=1 s=33374 n(v0 rc2024-05-20T17:35:20.022058+0000 b33374 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a979180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001225:[<0x10000000d67/picture-13.jpg v912>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001225:[<0x10000000d67/picture-13.jpg v1063>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.428+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001318 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml auth{0=1} v1053 ap=1 s=4496 n(v0 rc2024-05-20T17:35:21.324031+0000 b4496 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a979700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001318:[<0x10000000d67/comment-56.xml v959>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001318:[<0x10000000d67/comment-56.xml v1053>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.429+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001075 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg auth{0=1} v1067 ap=1 s=34158 n(v0 rc2024-05-20T17:35:18.350093+0000 b34158 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001075:[<0x10000000d67/picture-18.jpg v886>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001075:[<0x10000000d67/picture-18.jpg v1067>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.431+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml auth{0=1} v1069 ap=1 s=9410 n(v0 rc2024-05-20T17:35:16.507131+0000 b9410 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8c:[<0x10000000d67/article-18.xml v286>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e8c:[<0x10000000d67/article-18.xml v1069>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.465 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.432+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml auth{0=1} v1047 ap=1 s=3631 n(v0 rc2024-05-20T17:35:24.065974+0000 b3631 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141c:[<0x10000000d67/comment-5.xml v1041>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000141c:[<0x10000000d67/comment-5.xml v1047>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.433+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001072 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg auth{0=1} v1071 ap=1 s=50348 n(v0 rc2024-05-20T17:35:18.342093+0000 b50348 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001072:[<0x10000000d67/picture-19.jpg v880>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001072:[<0x10000000d67/picture-19.jpg v1071>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.434+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml auth{0=1} v1085 ap=1 s=12626 n(v0 rc2024-05-20T17:35:15.916143+0000 b12626 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc7:[<0x10000000d67/article-51.xml v88>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dc7:[<0x10000000d67/article-51.xml v1085>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.435+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml auth{0=1} v1008 ap=1 s=7131 n(v0 rc2024-05-20T17:35:23.720981+0000 b7131 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c8797a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c4:[<0x10000000d67/comment-29.xml v1008>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013c4:[<0x10000000d67/comment-29.xml v1008>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.437+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f64 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg auth{0=1} v1095 ap=1 s=25695 n(v0 rc2024-05-20T17:35:17.280115+0000 b25695 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f64:[<0x10000000d67/picture-82.jpg v502>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f64:[<0x10000000d67/picture-82.jpg v1095>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.438+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e5f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml auth{0=1} v1075 ap=1 s=30154 n(v0 rc2024-05-20T17:35:16.341135+0000 b30154 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e5f:[<0x10000000d67/article-27.xml v232>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e5f:[<0x10000000d67/article-27.xml v1075>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.438+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg auth{0=1} v1057 ap=1 s=11578 n(v0 rc2024-05-20T17:35:20.348051+0000 b11578 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126b:[<0x10000000d67/picture-4.jpg v934>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000126b:[<0x10000000d67/picture-4.jpg v1057>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.440+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001040 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg auth{0=1} v1079 ap=1 s=48273 n(v0 rc2024-05-20T17:35:18.189096+0000 b48273 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001040:[<0x10000000d67/picture-35.jpg v784>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001040:[<0x10000000d67/picture-35.jpg v1079>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.466 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.441+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001281 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg auth{0=1} v1101 ap=1 s=57252 n(v0 rc2024-05-20T17:35:20.564047+0000 b57252 1=1+0) caps={25025=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c8797a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001281:[<0x10000000d67/picture-2.jpg v938>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001281:[<0x10000000d67/picture-2.jpg v1101>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.442+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg auth{0=1} v1097 ap=1 s=32803 n(v0 rc2024-05-20T17:35:17.413112+0000 b32803 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a958000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7f:[<0x10000000d67/picture-78.jpg v526>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f7f:[<0x10000000d67/picture-78.jpg v1097>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.442+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f08 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg auth{0=1} v1093 ap=1 s=61716 n(v0 rc2024-05-20T17:35:16.861124+0000 b61716 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a958580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f08:[<0x10000000d67/picture-93.jpg v436>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f08:[<0x10000000d67/picture-93.jpg v1093>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.445+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e82 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml auth{0=1} v1073 ap=1 s=10643 n(v0 rc2024-05-20T17:35:16.469132+0000 b10643 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a958b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e82:[<0x10000000d67/article-20.xml v274>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e82:[<0x10000000d67/article-20.xml v1073>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.446+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg auth{0=1} v1065 ap=1 s=30529 n(v0 rc2024-05-20T17:35:19.985059+0000 b30529 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a959080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121e:[<0x10000000d67/picture-14.jpg v908>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000121e:[<0x10000000d67/picture-14.jpg v1065>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.447+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg auth{0=1} v1099 ap=1 s=47589 n(v0 rc2024-05-20T17:35:16.936122+0000 b47589 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a959600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1f:[<0x10000000d67/picture-89.jpg v460>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f1f:[<0x10000000d67/picture-89.jpg v1099>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.467 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.449+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d86 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml auth{0=1} v1091 ap=1 s=5464 n(v0 rc2024-05-20T17:35:15.702148+0000 b5464 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a959b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d86:[<0x10000000d67/article-61.xml v28>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d86:[<0x10000000d67/article-61.xml v1091>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:35 smithi135 ceph-mon[32027]: pgmap v70: 97 pgs: 97 active+clean; 59 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 520 op/s 2024-05-20T17:35:35.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:35 smithi135 ceph-mon[32027]: scrub queued for path: / 2024-05-20T17:35:35.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:35 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:35.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:35 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:35.482 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.234+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml auth v292 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.660900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@16},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbe8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e4:[<0x10000001744/article-45.xml v292>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e4:[<0x10000001744/article-45.xml v292>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.482 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.235+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml auth v148 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.277908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbe8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179b:[<0x10000001744/article-69.xml v148>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000179b:[<0x10000001744/article-69.xml v148>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.482 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.243+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml auth v376 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.872895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@11},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbe9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180e:[<0x10000001744/article-31.xml v376>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180e:[<0x10000001744/article-31.xml v376>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.482 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.244+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001775 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml auth v82 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.088912+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbe9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001775:[<0x10000001744/article-80.xml v82>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001775:[<0x10000001744/article-80.xml v82>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.482 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.245+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml auth v298 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.675899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@15},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbeb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e7:[<0x10000001744/article-44.xml v298>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e7:[<0x10000001744/article-44.xml v298>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.247+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml auth v172 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.344906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a7:[<0x10000001744/article-65.xml v172>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a7:[<0x10000001744/article-65.xml v172>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.247+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml auth v190 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.393905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b0:[<0x10000001744/article-62.xml v190>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b0:[<0x10000001744/article-62.xml v190>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.248+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001823 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml auth v418 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.971893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001823:[<0x10000001744/article-24.xml v418>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001823:[<0x10000001744/article-24.xml v418>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.248+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001763 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml auth v52 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.982914+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001763:[<0x10000001744/article-85.xml v52>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001763:[<0x10000001744/article-85.xml v52>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.249+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001758 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml auth v34 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.922915+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001758:[<0x10000001744/article-88.xml v34>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001758:[<0x10000001744/article-88.xml v34>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.249+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml auth v160 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.309907+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a1:[<0x10000001744/article-67.xml v160>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a1:[<0x10000001744/article-67.xml v160>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.251+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml auth v232 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.509903+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbf5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c5:[<0x10000001744/article-55.xml v232>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c5:[<0x10000001744/article-55.xml v232>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.483 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.253+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml auth v154 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.292907+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc02b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179e:[<0x10000001744/article-68.xml v154>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000179e:[<0x10000001744/article-68.xml v154>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.254+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001785 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml auth v106 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.169910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc03080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001785:[<0x10000001744/article-76.xml v106>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001785:[<0x10000001744/article-76.xml v106>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.256+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml auth v370 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.859896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@11},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc04100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180b:[<0x10000001744/article-32.xml v370>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180b:[<0x10000001744/article-32.xml v370>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.256+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml auth v436 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.022892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc04680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182c:[<0x10000001744/article-21.xml v436>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182c:[<0x10000001744/article-21.xml v436>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.257+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001811 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml auth v382 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.887895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc04c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001811:[<0x10000001744/article-30.xml v382>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001811:[<0x10000001744/article-30.xml v382>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.257+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001845 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml auth v484 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.158889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc05180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001845:[<0x10000001744/article-13.xml v484>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001845:[<0x10000001744/article-13.xml v484>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.258+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml auth v262 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.590901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@10},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc05700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d5:[<0x10000001744/article-50.xml v262>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d5:[<0x10000001744/article-50.xml v262>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.260+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001750 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml auth v22 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.872916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001750:[<0x10000001744/article-90.xml v22>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001750:[<0x10000001744/article-90.xml v22>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.261+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml auth v226 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.493903+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c2:[<0x10000001744/article-56.xml v226>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c2:[<0x10000001744/article-56.xml v226>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.261+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ea [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml auth v304 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.688899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@15},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc13600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ea:[<0x10000001744/article-43.xml v304>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ea:[<0x10000001744/article-43.xml v304>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.262+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001808 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml auth v364 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.844896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001808:[<0x10000001744/article-33.xml v364>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001808:[<0x10000001744/article-33.xml v364>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.484 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.263+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml auth v220 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.478904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bf:[<0x10000001744/article-57.xml v220>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017bf:[<0x10000001744/article-57.xml v220>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.264+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001779 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml auth v88 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.104911+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc14c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001779:[<0x10000001744/article-79.xml v88>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001779:[<0x10000001744/article-79.xml v88>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.264+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml auth v214 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.460904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bc:[<0x10000001744/article-58.xml v214>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017bc:[<0x10000001744/article-58.xml v214>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.265+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml auth v244 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.546902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc15700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cb:[<0x10000001744/article-53.xml v244>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017cb:[<0x10000001744/article-53.xml v244>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.266+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001817 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml auth v394 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.912895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda23b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001817:[<0x10000001744/article-28.xml v394>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001817:[<0x10000001744/article-28.xml v394>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.266+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml auth v250 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.564902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd299700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ce:[<0x10000001744/article-52.xml v250>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ce:[<0x10000001744/article-52.xml v250>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.269+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001805 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml auth v358 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.827896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd402000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001805:[<0x10000001744/article-34.xml v358>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001805:[<0x10000001744/article-34.xml v358>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.270+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001771 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml auth v76 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.067912+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd402580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001771:[<0x10000001744/article-81.xml v76>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001771:[<0x10000001744/article-81.xml v76>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.270+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml auth v94 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.124911+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd402b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177d:[<0x10000001744/article-78.xml v94>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000177d:[<0x10000001744/article-78.xml v94>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.270+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001814 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml auth v388 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.899895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd403080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001814:[<0x10000001744/article-29.xml v388>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001814:[<0x10000001744/article-29.xml v388>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.485 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.271+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml auth v202 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.426905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd403600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b6:[<0x10000001744/article-60.xml v202>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b6:[<0x10000001744/article-60.xml v202>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.271+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001829 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml auth v430 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.005893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd403b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001829:[<0x10000001744/article-22.xml v430>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001829:[<0x10000001744/article-22.xml v430>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.271+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml auth v268 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.603901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd404100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d8:[<0x10000001744/article-49.xml v268>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d8:[<0x10000001744/article-49.xml v268>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.272+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001842 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml auth v478 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.144890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd404c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001842:[<0x10000001744/article-14.xml v478>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001842:[<0x10000001744/article-14.xml v478>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.273+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001766 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml auth v58 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.002913+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd405180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001766:[<0x10000001744/article-84.xml v58>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001766:[<0x10000001744/article-84.xml v58>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.273+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml auth v286 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.645900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@15},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd405700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e1:[<0x10000001744/article-46.xml v286>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e1:[<0x10000001744/article-46.xml v286>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.273+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml auth v16 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.854916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174d:[<0x10000001744/article-91.xml v16>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000174d:[<0x10000001744/article-91.xml v16>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.274+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017de [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml auth v280 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.630900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017de:[<0x10000001744/article-47.xml v280>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017de:[<0x10000001744/article-47.xml v280>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.274+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001794 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml auth v136 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.249908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001794:[<0x10000001744/article-71.xml v136>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001794:[<0x10000001744/article-71.xml v136>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.275+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml auth v496 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.205888+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184b:[<0x10000001744/article-11.xml v496>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184b:[<0x10000001744/article-11.xml v496>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.486 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.276+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml auth v466 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.111890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183c:[<0x10000001744/article-16.xml v466>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183c:[<0x10000001744/article-16.xml v466>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.276+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml auth v238 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.529902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c8:[<0x10000001744/article-54.xml v238>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c8:[<0x10000001744/article-54.xml v238>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.277+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml auth v406 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.940894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181d:[<0x10000001744/article-26.xml v406>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181d:[<0x10000001744/article-26.xml v406>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.278+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001745 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml auth v4 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.813917+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001745:[<0x10000001744/article-93.xml v4>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001745:[<0x10000001744/article-93.xml v4>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.279+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml auth v502 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.226888+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc2d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184e:[<0x10000001744/article-10.xml v502>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184e:[<0x10000001744/article-10.xml v502>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.280+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml auth v274 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.615901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017db:[<0x10000001744/article-48.xml v274>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017db:[<0x10000001744/article-48.xml v274>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.281+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001820 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml auth v412 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.955894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001820:[<0x10000001744/article-25.xml v412>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001820:[<0x10000001744/article-25.xml v412>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.282+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml auth v334 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.763898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f9:[<0x10000001744/article-38.xml v334>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f9:[<0x10000001744/article-38.xml v334>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.283+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001791 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml auth v130 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.234909+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001791:[<0x10000001744/article-72.xml v130>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001791:[<0x10000001744/article-72.xml v130>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.284+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001802 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml auth v352 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.811897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@12},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001802:[<0x10000001744/article-35.xml v352>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001802:[<0x10000001744/article-35.xml v352>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.285+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml auth v46 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.963914+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175f:[<0x10000001744/article-86.xml v46>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000175f:[<0x10000001744/article-86.xml v46>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.487 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.286+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml auth v322 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.734898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f3:[<0x10000001744/article-40.xml v322>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f3:[<0x10000001744/article-40.xml v322>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.287+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml auth v70 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.044913+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc3f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176e:[<0x10000001744/article-82.xml v70>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000176e:[<0x10000001744/article-82.xml v70>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.288+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml auth v472 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.128890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc48000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183f:[<0x10000001744/article-15.xml v472>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183f:[<0x10000001744/article-15.xml v472>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.288+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001831 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml auth v448 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.057892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001831:[<0x10000001744/article-19.xml v448>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001831:[<0x10000001744/article-19.xml v448>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.289+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001754 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml auth v28 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.894916+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001754:[<0x10000001744/article-89.xml v28>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001754:[<0x10000001744/article-89.xml v28>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.290+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml auth v310 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.702899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@15},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ed:[<0x10000001744/article-42.xml v310>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ed:[<0x10000001744/article-42.xml v310>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.290+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017aa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml auth v178 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.360906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017aa:[<0x10000001744/article-64.xml v178>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017aa:[<0x10000001744/article-64.xml v178>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.291+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml auth v40 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.943915+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175b:[<0x10000001744/article-87.xml v40>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000175b:[<0x10000001744/article-87.xml v40>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.291+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001788 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml auth v112 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.186910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001788:[<0x10000001744/article-75.xml v112>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001788:[<0x10000001744/article-75.xml v112>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.488 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.292+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml auth v340 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.776897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@11},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fc:[<0x10000001744/article-37.xml v340>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017fc:[<0x10000001744/article-37.xml v340>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.293+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml auth v124 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.220909+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc4b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178e:[<0x10000001744/article-73.xml v124>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000178e:[<0x10000001744/article-73.xml v124>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.294+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml auth v328 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.749898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f6:[<0x10000001744/article-39.xml v328>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f6:[<0x10000001744/article-39.xml v328>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.295+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml auth v346 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.795897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc5e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ff:[<0x10000001744/article-36.xml v346>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ff:[<0x10000001744/article-36.xml v346>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.296+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001848 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml auth v490 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.177889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001848:[<0x10000001744/article-12.xml v490>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001848:[<0x10000001744/article-12.xml v490>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.298+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml auth v166 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.325907+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc5f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a4:[<0x10000001744/article-66.xml v166>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a4:[<0x10000001744/article-66.xml v166>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.299+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001781 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml auth v100 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.144910+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc5fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001781:[<0x10000001744/article-77.xml v100>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001781:[<0x10000001744/article-77.xml v100>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.300+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001826 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml auth v424 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.989893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc60100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001826:[<0x10000001744/article-23.xml v424>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001826:[<0x10000001744/article-23.xml v424>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.301+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001839 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml auth v460 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.098891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001839:[<0x10000001744/article-17.xml v460>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001839:[<0x10000001744/article-17.xml v460>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.489 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.301+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml auth v184 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.375906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdc60c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ad:[<0x10000001744/article-63.xml v184>,<0x10000000399/blog-31 v38648>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ad:[<0x10000001744/article-63.xml v184>,<0x10000000399/blog-31 v46322>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.353+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml auth v64 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.421905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd460b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b5:[<0x10000001795/article-59.xml v64>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b5:[<0x10000001795/article-59.xml v64>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.355+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001833 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml auth v310 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.068891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd462680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001833:[<0x10000001795/article-18.xml v310>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001833:[<0x10000001795/article-18.xml v310>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.355+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml auth v112 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.558902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd463180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cd:[<0x10000001795/article-51.xml v112>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017cd:[<0x10000001795/article-51.xml v112>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.356+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001815 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml auth v256 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.909895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd463700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001815:[<0x10000001795/article-27.xml v256>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001815:[<0x10000001795/article-27.xml v256>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.358+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml auth v298 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.016892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda53080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182a:[<0x10000001795/article-20.xml v298>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182a:[<0x10000001795/article-20.xml v298>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.359+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017af [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml auth v52 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.386905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda53b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017af:[<0x10000001795/article-61.xml v52>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017af:[<0x10000001795/article-61.xml v52>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.359+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml auth v172 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.698899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda54100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017eb:[<0x10000001795/article-41.xml v172>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017eb:[<0x10000001795/article-41.xml v172>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.360+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml auth v148 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.641900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda54680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017df:[<0x10000001795/article-45.xml v148>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017df:[<0x10000001795/article-45.xml v148>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.360+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001797 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml auth v4 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.259908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda54c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001797:[<0x10000001795/article-69.xml v4>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001797:[<0x10000001795/article-69.xml v4>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.490 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.362+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001809 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml auth v232 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.854896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda5e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001809:[<0x10000001795/article-31.xml v232>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001809:[<0x10000001795/article-31.xml v232>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.365+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml auth v364 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.229888+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda5fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184f:[<0x10000001795/article-9.xml v364>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184f:[<0x10000001795/article-9.xml v364>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.366+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml auth v154 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.655900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda60100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e2:[<0x10000001795/article-44.xml v154>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e2:[<0x10000001795/article-44.xml v154>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.367+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml auth v28 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.319907+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda60c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a3:[<0x10000001795/article-65.xml v28>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a3:[<0x10000001795/article-65.xml v28>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.368+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ac [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml auth v46 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.371906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ac:[<0x10000001795/article-62.xml v46>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ac:[<0x10000001795/article-62.xml v46>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.369+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml auth v274 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.949894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cda61700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181e:[<0x10000001795/article-24.xml v274>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181e:[<0x10000001795/article-24.xml v274>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.370+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml auth v16 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.287908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179d:[<0x10000001795/article-67.xml v16>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000179d:[<0x10000001795/article-67.xml v16>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.377+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml auth v88 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.489903+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb26580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c1:[<0x10000001795/article-55.xml v88>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c1:[<0x10000001795/article-55.xml v88>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.379+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml auth v10 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.273908+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb27b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179a:[<0x10000001795/article-68.xml v10>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000179a:[<0x10000001795/article-68.xml v10>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.381+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001806 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml auth v226 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.839896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb29180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001806:[<0x10000001795/article-32.xml v226>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001806:[<0x10000001795/article-32.xml v226>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.491 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.382+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001827 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml auth v292 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.001893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb29700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001827:[<0x10000001795/article-21.xml v292>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001827:[<0x10000001795/article-21.xml v292>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.383+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml auth v238 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.867895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180c:[<0x10000001795/article-30.xml v238>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180c:[<0x10000001795/article-30.xml v238>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.383+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001843 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml auth v340 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.146890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb30580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001843:[<0x10000001795/article-13.xml v340>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001843:[<0x10000001795/article-13.xml v340>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.383+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml auth v118 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.574902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb30b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d0:[<0x10000001795/article-50.xml v118>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d0:[<0x10000001795/article-50.xml v118>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.386+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017be [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml auth v82 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.471904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017be:[<0x10000001795/article-56.xml v82>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017be:[<0x10000001795/article-56.xml v82>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.386+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml auth v160 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.670900+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb32c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e5:[<0x10000001795/article-43.xml v160>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e5:[<0x10000001795/article-43.xml v160>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.387+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001803 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml auth v220 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.822896+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb33180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001803:[<0x10000001795/article-33.xml v220>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001803:[<0x10000001795/article-33.xml v220>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.389+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml auth v76 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.453904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bb:[<0x10000001795/article-57.xml v76>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017bb:[<0x10000001795/article-57.xml v76>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.390+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml auth v70 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.439904+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb3b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b8:[<0x10000001795/article-58.xml v70>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b8:[<0x10000001795/article-58.xml v70>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.390+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml auth v100 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.521903+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb3bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c7:[<0x10000001795/article-53.xml v100>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c7:[<0x10000001795/article-53.xml v100>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.492 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.391+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001812 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml auth v250 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.895895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001812:[<0x10000001795/article-28.xml v250>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001812:[<0x10000001795/article-28.xml v250>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.392+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml auth v106 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.540902+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb3c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ca:[<0x10000001795/article-52.xml v106>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ca:[<0x10000001795/article-52.xml v106>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.397+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001800 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml auth v214 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.805897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001800:[<0x10000001795/article-34.xml v214>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001800:[<0x10000001795/article-34.xml v214>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.398+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml auth v244 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.882895+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180f:[<0x10000001795/article-29.xml v244>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000180f:[<0x10000001795/article-29.xml v244>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.398+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml auth v58 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.402905+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb4b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b2:[<0x10000001795/article-60.xml v58>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017b2:[<0x10000001795/article-60.xml v58>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.400+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001824 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml auth v286 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.982893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb7a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001824:[<0x10000001795/article-22.xml v286>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001824:[<0x10000001795/article-22.xml v286>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.401+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml auth v124 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.586901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb7ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d3:[<0x10000001795/article-49.xml v124>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d3:[<0x10000001795/article-49.xml v124>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.402+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001840 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml auth v334 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.130890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb7b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001840:[<0x10000001795/article-14.xml v334>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001840:[<0x10000001795/article-14.xml v334>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.403+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml auth v142 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.624901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb7cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017dc:[<0x10000001795/article-46.xml v142>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017dc:[<0x10000001795/article-46.xml v142>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.493 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.404+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml auth v136 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.611901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb7d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d9:[<0x10000001795/article-47.xml v136>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d9:[<0x10000001795/article-47.xml v136>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.405+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001849 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml auth v352 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.181889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001849:[<0x10000001795/article-11.xml v352>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001849:[<0x10000001795/article-11.xml v352>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.406+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml auth v322 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.100891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb86b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183a:[<0x10000001795/article-16.xml v322>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183a:[<0x10000001795/article-16.xml v322>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.406+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml auth v94 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.502903+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@17},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c4:[<0x10000001795/article-54.xml v94>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017c4:[<0x10000001795/article-54.xml v94>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.407+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001818 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml auth v262 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.923894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb87600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001818:[<0x10000001795/article-26.xml v262>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001818:[<0x10000001795/article-26.xml v262>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.409+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml auth v358 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.207888+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb88c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184c:[<0x10000001795/article-10.xml v358>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000184c:[<0x10000001795/article-10.xml v358>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.411+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml auth v130 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.599901+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d6:[<0x10000001795/article-48.xml v130>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017d6:[<0x10000001795/article-48.xml v130>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.412+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml auth v268 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.936894+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181b:[<0x10000001795/article-25.xml v268>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000181b:[<0x10000001795/article-25.xml v268>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.414+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml auth v190 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.745898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f4:[<0x10000001795/article-38.xml v190>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f4:[<0x10000001795/article-38.xml v190>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.415+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml auth v208 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.788897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fd:[<0x10000001795/article-35.xml v208>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017fd:[<0x10000001795/article-35.xml v208>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.494 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.416+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml auth v178 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.713899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdb9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ee:[<0x10000001795/article-40.xml v178>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017ee:[<0x10000001795/article-40.xml v178>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.417+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml auth v328 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.113890+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdba2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183d:[<0x10000001795/article-15.xml v328>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000183d:[<0x10000001795/article-15.xml v328>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.419+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml auth v304 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.038892+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdba3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182d:[<0x10000001795/article-19.xml v304>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000182d:[<0x10000001795/article-19.xml v304>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.421+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml auth v166 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.683899+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdba4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e8:[<0x10000001795/article-42.xml v166>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017e8:[<0x10000001795/article-42.xml v166>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.423+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml auth v34 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.338906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdba4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a6:[<0x10000001795/article-64.xml v34>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a6:[<0x10000001795/article-64.xml v34>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.423+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml auth v196 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.758898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdba5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f7:[<0x10000001795/article-37.xml v196>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f7:[<0x10000001795/article-37.xml v196>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.425+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml auth v184 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.729898+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbb8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f1:[<0x10000001795/article-39.xml v184>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017f1:[<0x10000001795/article-39.xml v184>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.425+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml auth v202 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.771897+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbb8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fa:[<0x10000001795/article-36.xml v202>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017fa:[<0x10000001795/article-36.xml v202>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.426+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001846 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml auth v346 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.158889+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbb8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001846:[<0x10000001795/article-12.xml v346>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001846:[<0x10000001795/article-12.xml v346>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.429+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml auth v22 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.305907+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbbac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a0:[<0x10000001795/article-66.xml v22>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a0:[<0x10000001795/article-66.xml v22>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.495 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.430+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001821 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml auth v280 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.966893+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbc8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001821:[<0x10000001795/article-23.xml v280>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001821:[<0x10000001795/article-23.xml v280>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.497 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.431+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001837 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml auth v316 ap=1 s=0 n(v0 rc2024-05-20T17:35:28.084891+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbc8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001837:[<0x10000001795/article-17.xml v316>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001837:[<0x10000001795/article-17.xml v316>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.497 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.432+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml auth v40 ap=1 s=0 n(v0 rc2024-05-20T17:35:27.355906+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdbc9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a9:[<0x10000001795/article-63.xml v40>,<0x10000000399/blog-32 v39386>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000017a9:[<0x10000001795/article-63.xml v40>,<0x10000000399/blog-32 v46354>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.497 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.433+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml auth v620 ap=1 s=32644 n(v0 rc2024-05-20T17:35:24.965956+0000 b32644 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdebcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fd:[<0x10000001453/article-59.xml v214>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014fd:[<0x10000001453/article-59.xml v620>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.497 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.434+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml auth v684 ap=1 s=9620 n(v0 rc2024-05-20T17:35:24.485966+0000 b9620 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdebd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145f:[<0x10000001453/article-92.xml v16>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000145f:[<0x10000001453/article-92.xml v684>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.497 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.434+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml auth v648 ap=1 s=5011 n(v0 rc2024-05-20T17:35:24.771960+0000 b5011 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdebd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b2:[<0x10000001453/article-74.xml v124>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014b2:[<0x10000001453/article-74.xml v648>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.435+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml auth v460 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.704940+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c1:[<0x10000001453/article-18.xml v460>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015c1:[<0x10000001453/article-18.xml v460>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.435+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001525 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml auth v604 ap=1 s=29684 n(v0 rc2024-05-20T17:35:25.042954+0000 b29684 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cd6e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001525:[<0x10000001453/article-51.xml v262>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001525:[<0x10000001453/article-51.xml v604>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.436+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001597 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml auth v406 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.522944+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd501600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001597:[<0x10000001453/article-27.xml v406>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001597:[<0x10000001453/article-27.xml v406>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.436+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg auth v574 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.927936+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd545700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161a:[<0x10000001453/picture-4.jpg v574>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000161a:[<0x10000001453/picture-4.jpg v574>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.437+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001623 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg auth v586 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.950935+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001623:[<0x10000001453/picture-2.jpg v586>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001623:[<0x10000001453/picture-2.jpg v586>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.437+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml auth v640 ap=1 s=4074 n(v0 rc2024-05-20T17:35:24.832958+0000 b4074 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cd5c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c5:[<0x10000001453/article-70.xml v148>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014c5:[<0x10000001453/article-70.xml v640>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.438+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml auth v448 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.682941+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b8:[<0x10000001453/article-20.xml v448>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015b8:[<0x10000001453/article-20.xml v448>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.438+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001488 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml auth v666 ap=1 s=20233 n(v0 rc2024-05-20T17:35:24.643962+0000 b20233 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cd5bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001488:[<0x10000001453/article-83.xml v70>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001488:[<0x10000001453/article-83.xml v666>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.498 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.439+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml auth v624 ap=1 s=16132 n(v0 rc2024-05-20T17:35:24.945956+0000 b16132 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cd86c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f3:[<0x10000001453/article-61.xml v202>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014f3:[<0x10000001453/article-61.xml v624>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.439+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001556 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml auth v322 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.222950+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001556:[<0x10000001453/article-41.xml v322>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001556:[<0x10000001453/article-41.xml v322>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.440+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001543 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml auth v298 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.133952+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001543:[<0x10000001453/article-45.xml v298>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001543:[<0x10000001453/article-45.xml v298>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.440+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml auth v638 ap=1 s=30895 n(v0 rc2024-05-20T17:35:24.843958+0000 b30895 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf0ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c9:[<0x10000001453/article-69.xml v154>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014c9:[<0x10000001453/article-69.xml v638>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.441+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001585 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml auth v382 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.421946+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001585:[<0x10000001453/article-31.xml v382>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001585:[<0x10000001453/article-31.xml v382>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.442+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001496 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml auth v660 ap=1 s=24886 n(v0 rc2024-05-20T17:35:24.685961+0000 b24886 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf0b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001496:[<0x10000001453/article-80.xml v88>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001496:[<0x10000001453/article-80.xml v660>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.443+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001627 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg auth v592 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.960935+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001627:[<0x10000001453/picture-1.jpg v592>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001627:[<0x10000001453/picture-1.jpg v592>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.443+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml auth v514 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.805938+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015eb:[<0x10000001453/article-9.xml v514>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015eb:[<0x10000001453/article-9.xml v514>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.444+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001548 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml auth v304 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.155952+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001548:[<0x10000001453/article-44.xml v304>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001548:[<0x10000001453/article-44.xml v304>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.445+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml auth v632 ap=1 s=19660 n(v0 rc2024-05-20T17:35:24.899957+0000 b19660 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf0cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dc:[<0x10000001453/article-65.xml v178>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014dc:[<0x10000001453/article-65.xml v632>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.445+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml auth v626 ap=1 s=22145 n(v0 rc2024-05-20T17:35:24.934956+0000 b22145 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf0d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ed:[<0x10000001453/article-62.xml v196>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ed:[<0x10000001453/article-62.xml v626>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.446+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml auth v424 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.606942+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf0d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a5:[<0x10000001453/article-24.xml v424>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015a5:[<0x10000001453/article-24.xml v424>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.499 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.447+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml auth v670 ap=1 s=10829 n(v0 rc2024-05-20T17:35:24.618963+0000 b10829 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147f:[<0x10000001453/article-85.xml v58>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000147f:[<0x10000001453/article-85.xml v670>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.447+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001471 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml auth v676 ap=1 s=18124 n(v0 rc2024-05-20T17:35:24.561964+0000 b18124 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001471:[<0x10000001453/article-88.xml v40>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001471:[<0x10000001453/article-88.xml v676>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.448+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml auth v596 ap=1 s=31539 n(v0 rc2024-05-20T17:35:24.866958+0000 b31539 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d3:[<0x10000001453/article-67.xml v166>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014d3:[<0x10000001453/article-67.xml v596>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.448+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001608 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml auth v550 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.880937+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf1b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001608:[<0x10000001453/article-3.xml v550>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001608:[<0x10000001453/article-3.xml v550>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.449+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml auth v526 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.829938+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf1b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f5:[<0x10000001453/article-7.xml v526>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015f5:[<0x10000001453/article-7.xml v526>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.450+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001511 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml auth v612 ap=1 s=25853 n(v0 rc2024-05-20T17:35:25.004955+0000 b25853 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001511:[<0x10000001453/article-55.xml v238>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001511:[<0x10000001453/article-55.xml v612>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.450+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml auth v520 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.817938+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf1c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f0:[<0x10000001453/article-8.xml v520>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015f0:[<0x10000001453/article-8.xml v520>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.451+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml auth v636 ap=1 s=5003 n(v0 rc2024-05-20T17:35:24.854958+0000 b5003 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ce:[<0x10000001453/article-68.xml v160>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ce:[<0x10000001453/article-68.xml v636>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.451+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml auth v652 ap=1 s=5505 n(v0 rc2024-05-20T17:35:24.747960+0000 b5505 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf1cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a9:[<0x10000001453/article-76.xml v112>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014a9:[<0x10000001453/article-76.xml v652>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.452+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001580 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml auth v376 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.400947+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf1d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001580:[<0x10000001453/article-32.xml v376>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001580:[<0x10000001453/article-32.xml v376>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.500 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.453+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml auth v442 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.671941+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf1d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b3:[<0x10000001453/article-21.xml v442>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015b3:[<0x10000001453/article-21.xml v442>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.453+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001589 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml auth v388 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.445946+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf34000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001589:[<0x10000001453/article-30.xml v388>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001589:[<0x10000001453/article-30.xml v388>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.454+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001457 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml auth v688 ap=1 s=21695 n(v0 rc2024-05-20T17:35:24.417967+0000 b21695 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf34580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001457:[<0x10000001453/article-94.xml v4>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001457:[<0x10000001453/article-94.xml v688>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.455+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml auth v490 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.760939+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf34b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d9:[<0x10000001453/article-13.xml v490>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015d9:[<0x10000001453/article-13.xml v490>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.456+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml auth v602 ap=1 s=31267 n(v0 rc2024-05-20T17:35:25.051954+0000 b31267 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf35080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152a:[<0x10000001453/article-50.xml v268>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000152a:[<0x10000001453/article-50.xml v602>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.456+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml auth v532 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.841937+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf35600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f9:[<0x10000001453/article-6.xml v532>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015f9:[<0x10000001453/article-6.xml v532>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.457+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml auth v556 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.891936+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf35b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160c:[<0x10000001453/article-2.xml v556>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000160c:[<0x10000001453/article-2.xml v556>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.458+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001466 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml auth v680 ap=1 s=7350 n(v0 rc2024-05-20T17:35:24.523965+0000 b7350 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf36100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001466:[<0x10000001453/article-90.xml v28>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001466:[<0x10000001453/article-90.xml v680>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.459+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml auth v614 ap=1 s=7755 n(v0 rc2024-05-20T17:35:24.995955+0000 b7755 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf36680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150c:[<0x10000001453/article-56.xml v232>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000150c:[<0x10000001453/article-56.xml v614>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.459+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000154d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml auth v310 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.179951+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf36c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000154d:[<0x10000001453/article-43.xml v310>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000154d:[<0x10000001453/article-43.xml v310>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.460+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000157b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml auth v370 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.379947+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000157b:[<0x10000001453/article-33.xml v370>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000157b:[<0x10000001453/article-33.xml v370>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.461+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001615 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg auth v568 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.914936+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001615:[<0x10000001453/picture-5.jpg v568>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001615:[<0x10000001453/picture-5.jpg v568>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.501 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.462+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001507 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml auth v616 ap=1 s=22003 n(v0 rc2024-05-20T17:35:24.985955+0000 b22003 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf40000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001507:[<0x10000001453/article-57.xml v226>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001507:[<0x10000001453/article-57.xml v616>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.462+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml auth v658 ap=1 s=18177 n(v0 rc2024-05-20T17:35:24.701961+0000 b18177 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149b:[<0x10000001453/article-79.xml v94>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000149b:[<0x10000001453/article-79.xml v658>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.463+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001502 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml auth v618 ap=1 s=8557 n(v0 rc2024-05-20T17:35:24.976955+0000 b8557 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf40b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001502:[<0x10000001453/article-58.xml v220>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001502:[<0x10000001453/article-58.xml v618>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.463+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml auth v608 ap=1 s=4238 n(v0 rc2024-05-20T17:35:25.022954+0000 b4238 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151b:[<0x10000001453/article-53.xml v250>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000151b:[<0x10000001453/article-53.xml v608>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.464+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001593 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml auth v400 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.493945+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001593:[<0x10000001453/article-28.xml v400>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001593:[<0x10000001453/article-28.xml v400>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.465+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001520 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml auth v606 ap=1 s=2567 n(v0 rc2024-05-20T17:35:25.031954+0000 b2567 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001520:[<0x10000001453/article-52.xml v256>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001520:[<0x10000001453/article-52.xml v606>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.466+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg auth v580 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.938935+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161e:[<0x10000001453/picture-3.jpg v580>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000161e:[<0x10000001453/picture-3.jpg v580>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.467+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml auth v538 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.854937+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fe:[<0x10000001453/article-5.xml v538>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015fe:[<0x10000001453/article-5.xml v538>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.468+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001577 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml auth v364 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.356948+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf42c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001577:[<0x10000001453/article-34.xml v364>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001577:[<0x10000001453/article-34.xml v364>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.502 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.469+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001491 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml auth v662 ap=1 s=16899 n(v0 rc2024-05-20T17:35:24.670962+0000 b16899 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001491:[<0x10000001453/article-81.xml v82>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001491:[<0x10000001453/article-81.xml v662>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.469+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml auth v656 ap=1 s=6415 n(v0 rc2024-05-20T17:35:24.720961+0000 b6415 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf43700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149f:[<0x10000001453/article-78.xml v100>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000149f:[<0x10000001453/article-78.xml v656>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.470+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000158e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml auth v394 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.468945+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000158e:[<0x10000001453/article-29.xml v394>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000158e:[<0x10000001453/article-29.xml v394>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.470+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml auth v622 ap=1 s=11376 n(v0 rc2024-05-20T17:35:24.956956+0000 b11376 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f8:[<0x10000001453/article-60.xml v208>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014f8:[<0x10000001453/article-60.xml v622>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.470+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015af [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml auth v436 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.655941+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015af:[<0x10000001453/article-22.xml v436>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015af:[<0x10000001453/article-22.xml v436>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.471+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml auth v600 ap=1 s=11889 n(v0 rc2024-05-20T17:35:25.060954+0000 b11889 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152f:[<0x10000001453/article-49.xml v274>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000152f:[<0x10000001453/article-49.xml v600>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.472+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml auth v484 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.748939+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d4:[<0x10000001453/article-14.xml v484>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015d4:[<0x10000001453/article-14.xml v484>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.473+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001483 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml auth v668 ap=1 s=21869 n(v0 rc2024-05-20T17:35:24.633963+0000 b21869 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001483:[<0x10000001453/article-84.xml v64>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001483:[<0x10000001453/article-84.xml v668>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.474+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml auth v292 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.113953+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153f:[<0x10000001453/article-46.xml v292>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000153f:[<0x10000001453/article-46.xml v292>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.474+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001462 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml auth v682 ap=1 s=12952 n(v0 rc2024-05-20T17:35:24.503965+0000 b12952 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf4e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001462:[<0x10000001453/article-91.xml v22>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001462:[<0x10000001453/article-91.xml v682>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.475+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml auth v286 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.095953+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153a:[<0x10000001453/article-47.xml v286>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000153a:[<0x10000001453/article-47.xml v286>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.475+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml auth v642 ap=1 s=17319 n(v0 rc2024-05-20T17:35:24.818959+0000 b17319 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c0:[<0x10000001453/article-71.xml v142>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014c0:[<0x10000001453/article-71.xml v642>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.476+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml auth v502 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.782939+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf4f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e2:[<0x10000001453/article-11.xml v502>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015e2:[<0x10000001453/article-11.xml v502>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.477+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml auth v472 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.726940+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cb:[<0x10000001453/article-16.xml v472>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015cb:[<0x10000001453/article-16.xml v472>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.478+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001516 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml auth v610 ap=1 s=28526 n(v0 rc2024-05-20T17:35:25.014955+0000 b28526 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf5c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001516:[<0x10000001453/article-54.xml v244>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001516:[<0x10000001453/article-54.xml v610>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.607 INFO:tasks.workunit.client.0.smithi135.stdout: 39 161927 674 107036 571 68333 710 2024-05-20T17:35:35.692 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.453+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e07 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml auth{0=1} v1081 ap=1 s=3854 n(v0 rc2024-05-20T17:35:16.101139+0000 b3854 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a95a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e07:[<0x10000000d67/article-41.xml v148>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e07:[<0x10000000d67/article-41.xml v1081>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.692 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.454+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml auth{0=1} v1083 ap=1 s=30863 n(v0 rc2024-05-20T17:35:16.043141+0000 b30863 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a95a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dee:[<0x10000000d67/article-45.xml v124>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dee:[<0x10000000d67/article-45.xml v1083>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.455+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg auth{0=1} v1089 ap=1 s=62306 n(v0 rc2024-05-20T17:35:17.831104+0000 b62306 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a95ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe8:[<0x10000000d67/picture-61.jpg v628>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fe8:[<0x10000000d67/picture-61.jpg v1089>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.456+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001250 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg auth{0=1} v1059 ap=1 s=48262 n(v0 rc2024-05-20T17:35:20.218054+0000 b48262 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a95b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001250:[<0x10000000d67/picture-7.jpg v926>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001250:[<0x10000000d67/picture-7.jpg v1059>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.458+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e44 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml auth{0=1} v1077 ap=1 s=26872 n(v0 rc2024-05-20T17:35:16.286136+0000 b26872 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a95b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e44:[<0x10000000d67/article-31.xml v208>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e44:[<0x10000000d67/article-31.xml v1077>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.460+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001243 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg auth{0=1} v1061 ap=1 s=25420 n(v0 rc2024-05-20T17:35:20.160055+0000 b25420 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001243:[<0x10000000d67/picture-9.jpg v920>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001243:[<0x10000000d67/picture-9.jpg v1061>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.461+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001406 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml auth{0=1} v1049 ap=1 s=8416 n(v0 rc2024-05-20T17:35:24.000976+0000 b8416 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001406:[<0x10000000d67/comment-11.xml v1022>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001406:[<0x10000000d67/comment-11.xml v1049>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.462+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml auth{0=1} v1051 ap=1 s=6654 n(v0 rc2024-05-20T17:35:23.909978+0000 b6654 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e3:[<0x10000000d67/comment-20.xml v1020>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013e3:[<0x10000000d67/comment-20.xml v1051>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.464+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fde [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg auth{0=1} v1096 ap=1 s=42982 n(v0 rc2024-05-20T17:35:17.786105+0000 b42982 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a332c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fde:[<0x10000000d67/picture-64.jpg v610>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fde:[<0x10000000d67/picture-64.jpg v1096>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.693 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.465+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml auth{0=1} v982 ap=1 s=9751 n(v0 rc2024-05-20T17:35:23.460987+0000 b9751 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87a333180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a3:[<0x10000000d67/comment-37.xml v982>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013a3:[<0x10000000d67/comment-37.xml v982>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.694 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.466+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml auth{0=1} v1058 ap=1 s=2665 n(v0 rc2024-05-20T17:35:20.795042+0000 b2665 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a333700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b7:[<0x10000000d67/comment-71.xml v950>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012b7:[<0x10000000d67/comment-71.xml v1058>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.466+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg auth{0=1} v1072 ap=1 s=54206 n(v0 rc2024-05-20T17:35:20.114056+0000 b54206 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a116000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123a:[<0x10000000d67/picture-10.jpg v913>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000123a:[<0x10000000d67/picture-10.jpg v1072>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.469+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg auth{0=1} v1108 ap=1 s=34289 n(v0 rc2024-05-20T17:35:20.650045+0000 b34289 1=1+0) caps={25025=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a116580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128d:[<0x10000000d67/picture-1.jpg v944>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000128d:[<0x10000000d67/picture-1.jpg v1108>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.470+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml auth{0=1} v1044 ap=1 s=8390 n(v0 rc2024-05-20T17:35:23.949977+0000 b8390 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a116b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f3:[<0x10000000d67/comment-16.xml v1034>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013f3:[<0x10000000d67/comment-16.xml v1044>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.472+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml auth{0=1} v1070 ap=1 s=16342 n(v0 rc2024-05-20T17:35:16.641128+0000 b16342 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a117080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb8:[<0x10000000d67/article-9.xml v340>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000eb8:[<0x10000000d67/article-9.xml v1070>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.472+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg auth{0=1} v1104 ap=1 s=41580 n(v0 rc2024-05-20T17:35:17.242116+0000 b41580 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a117600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5c:[<0x10000000d67/picture-83.jpg v496>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f5c:[<0x10000000d67/picture-83.jpg v1104>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.475+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml auth{0=1} v1090 ap=1 s=23706 n(v0 rc2024-05-20T17:35:16.054140+0000 b23706 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a117b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df5:[<0x10000000d67/article-44.xml v130>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000df5:[<0x10000000d67/article-44.xml v1090>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.476+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001259 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg auth{0=1} v1066 ap=1 s=30143 n(v0 rc2024-05-20T17:35:20.269053+0000 b30143 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a118100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001259:[<0x10000000d67/picture-6.jpg v921>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001259:[<0x10000000d67/picture-6.jpg v1066>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.479+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d6b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml auth{0=1} v1098 ap=1 s=9133 n(v0 rc2024-05-20T17:35:15.625149+0000 b9133 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a118680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d6b:[<0x10000000d67/article-65.xml v4>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d6b:[<0x10000000d67/article-65.xml v1098>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.698 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.479+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml auth{0=1} v1056 ap=1 s=4048 n(v0 rc2024-05-20T17:35:21.236033+0000 b4048 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a118c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130b:[<0x10000000d67/comment-58.xml v956>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000130b:[<0x10000000d67/comment-58.xml v1056>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.699 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.481+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d80 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml auth{0=1} v1094 ap=1 s=6081 n(v0 rc2024-05-20T17:35:15.685148+0000 b6081 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a119180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d80:[<0x10000000d67/article-62.xml v22>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d80:[<0x10000000d67/article-62.xml v1094>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.699 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.483+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml auth{0=1} v1054 ap=1 s=6879 n(v0 rc2024-05-20T17:35:21.348031+0000 b6879 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a119700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131f:[<0x10000000d67/comment-55.xml v962>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000131f:[<0x10000000d67/comment-55.xml v1054>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.699 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.484+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e6e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml auth{0=1} v1078 ap=1 s=7847 n(v0 rc2024-05-20T17:35:16.391133+0000 b7847 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a650000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e6e:[<0x10000000d67/article-24.xml v250>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e6e:[<0x10000000d67/article-24.xml v1078>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.701 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.484+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013af [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml auth{0=1} v992 ap=1 s=6658 n(v0 rc2024-05-20T17:35:23.572985+0000 b6658 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87a650580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013af:[<0x10000000d67/comment-34.xml v992>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013af:[<0x10000000d67/comment-34.xml v992>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.701 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.486+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml auth{0=1} v1050 ap=1 s=6033 n(v0 rc2024-05-20T17:35:23.845979+0000 b6033 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a650b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d1:[<0x10000000d67/comment-25.xml v1008>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d1:[<0x10000000d67/comment-25.xml v1050>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.701 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.487+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001056 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg auth{0=1} v1080 ap=1 s=52765 n(v0 rc2024-05-20T17:35:18.261095+0000 b52765 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a651080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001056:[<0x10000000d67/picture-28.jpg v826>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001056:[<0x10000000d67/picture-28.jpg v1080>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.488+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg auth{0=1} v1100 ap=1 s=16752 n(v0 rc2024-05-20T17:35:16.877123+0000 b16752 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a651600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0d:[<0x10000000d67/picture-92.jpg v442>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f0d:[<0x10000000d67/picture-92.jpg v1100>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.489+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001381 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml auth{0=1} v1052 ap=1 s=4611 n(v0 rc2024-05-20T17:35:23.009996+0000 b4611 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a651b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001381:[<0x10000000d67/comment-41.xml v976>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001381:[<0x10000000d67/comment-41.xml v1052>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.490+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml auth{0=1} v1060 ap=1 s=5818 n(v0 rc2024-05-20T17:35:20.696044+0000 b5818 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a652100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129b:[<0x10000000d67/comment-75.xml v948>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000129b:[<0x10000000d67/comment-75.xml v1060>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.491+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg auth{0=1} v1084 ap=1 s=41280 n(v0 rc2024-05-20T17:35:18.169097+0000 b41280 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a652680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103a:[<0x10000000d67/picture-37.jpg v772>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000103a:[<0x10000000d67/picture-37.jpg v1084>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.493+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001078 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg auth{0=1} v1074 ap=1 s=55852 n(v0 rc2024-05-20T17:35:18.359093+0000 b55852 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a652c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001078:[<0x10000000d67/picture-17.jpg v892>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001078:[<0x10000000d67/picture-17.jpg v1074>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.494+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f49 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg auth{0=1} v1106 ap=1 s=52557 n(v0 rc2024-05-20T17:35:17.163117+0000 b52557 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a653180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f49:[<0x10000000d67/picture-85.jpg v484>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f49:[<0x10000000d67/picture-85.jpg v1106>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.495+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml auth{0=1} v1064 ap=1 s=29455 n(v0 rc2024-05-20T17:35:16.721127+0000 b29455 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a653700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed6:[<0x10000000d67/article-3.xml v376>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ed6:[<0x10000000d67/article-3.xml v1064>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.702 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.496+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001062 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg auth{0=1} v1076 ap=1 s=61061 n(v0 rc2024-05-20T17:35:18.298094+0000 b61061 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001062:[<0x10000000d67/picture-24.jpg v850>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001062:[<0x10000000d67/picture-24.jpg v1076>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.497+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001047 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg auth{0=1} v1082 ap=1 s=38095 n(v0 rc2024-05-20T17:35:18.207096+0000 b38095 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001047:[<0x10000000d67/picture-33.jpg v796>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001047:[<0x10000000d67/picture-33.jpg v1082>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.498+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg auth{0=1} v1092 ap=1 s=19565 n(v0 rc2024-05-20T17:35:17.875103+0000 b19565 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff6:[<0x10000000d67/picture-57.jpg v652>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ff6:[<0x10000000d67/picture-57.jpg v1092>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.499+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml auth{0=1} v1068 ap=1 s=4682 n(v0 rc2024-05-20T17:35:16.668128+0000 b4682 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec2:[<0x10000000d67/article-7.xml v352>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ec2:[<0x10000000d67/article-7.xml v1068>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.499+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg auth{0=1} v1088 ap=1 s=61451 n(v0 rc2024-05-20T17:35:18.089098+0000 b61451 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102b:[<0x10000000d67/picture-42.jpg v742>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000102b:[<0x10000000d67/picture-42.jpg v1088>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.500+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fba [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg auth{0=1} v1102 ap=1 s=10371 n(v0 rc2024-05-20T17:35:17.675107+0000 b10371 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fba:[<0x10000000d67/picture-68.jpg v586>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fba:[<0x10000000d67/picture-68.jpg v1102>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.500+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001034 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg auth{0=1} v1086 ap=1 s=25376 n(v0 rc2024-05-20T17:35:18.149097+0000 b25376 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001034:[<0x10000000d67/picture-39.jpg v760>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001034:[<0x10000000d67/picture-39.jpg v1086>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.500+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml auth{0=1} v1046 ap=1 s=3636 n(v0 rc2024-05-20T17:35:23.875978+0000 b3636 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d9:[<0x10000000d67/comment-23.xml v1014>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d9:[<0x10000000d67/comment-23.xml v1046>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.500+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml auth{0=1} v1048 ap=1 s=4313 n(v0 rc2024-05-20T17:35:23.865978+0000 b4313 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d5:[<0x10000000d67/comment-24.xml v1012>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013d5:[<0x10000000d67/comment-24.xml v1048>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.703 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.501+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml auth{0=1} v1102 ap=1 s=29765 n(v0 rc2024-05-20T17:35:15.820145+0000 b29765 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db0:[<0x10000000d67/article-55.xml v64>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000db0:[<0x10000000d67/article-55.xml v1102>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.504+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg auth{0=1} v1084 ap=1 s=48722 n(v0 rc2024-05-20T17:35:18.289094+0000 b48722 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a34f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105f:[<0x10000000d67/picture-25.jpg v844>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000105f:[<0x10000000d67/picture-25.jpg v1084>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.506+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml auth{0=1} v1078 ap=1 s=23980 n(v0 rc2024-05-20T17:35:16.654128+0000 b23980 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebd:[<0x10000000d67/article-8.xml v346>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ebd:[<0x10000000d67/article-8.xml v1078>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.506+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001356 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml auth{0=1} v1052 ap=1 s=9124 n(v0 rc2024-05-20T17:35:22.096015+0000 b9124 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001356:[<0x10000000d67/comment-47.xml v971>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001356:[<0x10000000d67/comment-47.xml v1052>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.508+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml auth{0=1} v1050 ap=1 s=10228 n(v0 rc2024-05-20T17:35:22.320011+0000 b10228 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135d:[<0x10000000d67/comment-46.xml v973>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000135d:[<0x10000000d67/comment-46.xml v1050>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.509+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg auth{0=1} v1092 ap=1 s=59675 n(v0 rc2024-05-20T17:35:18.228095+0000 b59675 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104d:[<0x10000000d67/picture-31.jpg v808>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000104d:[<0x10000000d67/picture-31.jpg v1092>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.511+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml auth{0=1} v1060 ap=1 s=4423 n(v0 rc2024-05-20T17:35:20.846041+0000 b4423 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bd:[<0x10000000d67/comment-70.xml v946>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012bd:[<0x10000000d67/comment-70.xml v1060>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.704 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.512+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001012 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg auth{0=1} v1096 ap=1 s=18775 n(v0 rc2024-05-20T17:35:17.979101+0000 b18775 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001012:[<0x10000000d67/picture-49.jpg v700>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001012:[<0x10000000d67/picture-49.jpg v1096>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.512+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg auth{0=1} v1076 ap=1 s=39774 n(v0 rc2024-05-20T17:35:20.189055+0000 b39774 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124c:[<0x10000000d67/picture-8.jpg v923>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000124c:[<0x10000000d67/picture-8.jpg v1076>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.512+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f26 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg auth{0=1} v1106 ap=1 s=10162 n(v0 rc2024-05-20T17:35:16.994121+0000 b10162 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f26:[<0x10000000d67/picture-88.jpg v466>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f26:[<0x10000000d67/picture-88.jpg v1106>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.514+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg auth{0=1} v1086 ap=1 s=18034 n(v0 rc2024-05-20T17:35:18.280094+0000 b18034 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105c:[<0x10000000d67/picture-26.jpg v838>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000105c:[<0x10000000d67/picture-26.jpg v1086>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.514+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001713 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg auth v124 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.561923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87976d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001713:[<0x100000016cb/picture-13.jpg v124>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001713:[<0x100000016cb/picture-13.jpg v124>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.514+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001702 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg auth v94 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.524923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879576580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001702:[<0x100000016cb/picture-18.jpg v94>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001702:[<0x100000016cb/picture-18.jpg v94>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.514+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg auth v88 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.517923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879577080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fe:[<0x100000016cb/picture-19.jpg v88>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016fe:[<0x100000016cb/picture-19.jpg v88>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.515+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml auth{0=1} v1094 ap=1 s=19067 n(v0 rc2024-05-20T17:35:16.260136+0000 b19067 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3e:[<0x10000000d67/article-32.xml v202>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e3e:[<0x10000000d67/article-32.xml v1094>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.705 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.515+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001735 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg auth v178 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.712919+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879577b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001735:[<0x100000016cb/picture-4.jpg v178>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001735:[<0x100000016cb/picture-4.jpg v178>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.515+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg auth v190 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.753919+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879578680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173d:[<0x100000016cb/picture-2.jpg v190>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000173d:[<0x100000016cb/picture-2.jpg v190>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.515+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg auth v118 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.552923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879578c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170f:[<0x100000016cb/picture-14.jpg v118>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000170f:[<0x100000016cb/picture-14.jpg v118>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.516+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg auth v160 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.654921+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879579180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172a:[<0x100000016cb/picture-7.jpg v160>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000172a:[<0x100000016cb/picture-7.jpg v160>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.516+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001722 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg auth v148 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.613921+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c879579700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001722:[<0x100000016cb/picture-9.jpg v148>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001722:[<0x100000016cb/picture-9.jpg v148>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.516+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000171e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg auth v142 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.596922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a691080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000171e:[<0x100000016cb/picture-10.jpg v142>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000171e:[<0x100000016cb/picture-10.jpg v142>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.517+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001740 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg auth v196 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.777918+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a691600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001740:[<0x100000016cb/picture-1.jpg v196>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001740:[<0x100000016cb/picture-1.jpg v196>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.517+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg auth v166 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.679920+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a692100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172e:[<0x100000016cb/picture-6.jpg v166>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000172e:[<0x100000016cb/picture-6.jpg v166>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.517+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001253 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml auth{0=1} v1066 ap=1 s=4233 n(v0 rc2024-05-20T17:35:20.243054+0000 b4233 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a0a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001253:[<0x10000000d67/comment-83.xml v925>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001253:[<0x10000000d67/comment-83.xml v1066>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.518+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg auth v34 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.442925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a742000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016df:[<0x100000016cb/picture-28.jpg v34>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016df:[<0x100000016cb/picture-28.jpg v34>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.706 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.518+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml auth{0=1} v1058 ap=1 s=10062 n(v0 rc2024-05-20T17:35:20.871041+0000 b10062 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a726000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c4:[<0x10000000d67/comment-69.xml v953>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012c4:[<0x10000000d67/comment-69.xml v1058>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.518+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001705 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg auth v100 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.532923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a742b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001705:[<0x100000016cb/picture-17.jpg v100>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001705:[<0x100000016cb/picture-17.jpg v100>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.519+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg auth v58 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.482924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a743080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ed:[<0x100000016cb/picture-24.jpg v58>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ed:[<0x100000016cb/picture-24.jpg v58>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.519+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ea [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg auth v52 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.476924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a744100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ea:[<0x100000016cb/picture-25.jpg v52>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ea:[<0x100000016cb/picture-25.jpg v52>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.520+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg auth v16 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.411926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a745180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d5:[<0x100000016cb/picture-31.jpg v16>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d5:[<0x100000016cb/picture-31.jpg v16>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.520+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg auth{0=1} v1108 ap=1 s=23601 n(v0 rc2024-05-20T17:35:16.832124+0000 b23601 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a726580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000efe:[<0x10000000d67/picture-95.jpg v424>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000efe:[<0x10000000d67/picture-95.jpg v1108>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.520+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001726 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg auth v154 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.634921+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a745700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001726:[<0x100000016cb/picture-8.jpg v154>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001726:[<0x100000016cb/picture-8.jpg v154>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.707 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.521+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg auth v46 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.464925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a318000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e6:[<0x100000016cb/picture-26.jpg v46>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016e6:[<0x100000016cb/picture-26.jpg v46>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.719 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.521+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml auth{0=1} v1082 ap=1 s=28993 n(v0 rc2024-05-20T17:35:16.448132+0000 b28993 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a726b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7d:[<0x10000000d67/article-21.xml v268>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e7d:[<0x10000000d67/article-21.xml v1082>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.719 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.521+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml auth{0=1} v1090 ap=1 s=13023 n(v0 rc2024-05-20T17:35:16.301135+0000 b13023 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a727080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4f:[<0x10000000d67/article-30.xml v214>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e4f:[<0x10000000d67/article-30.xml v1090>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.719 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.522+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml auth v4 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.394926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a319600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ce:[<0x100000016cb/article-2.xml v4>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016ce:[<0x100000016cb/article-2.xml v4>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.522+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg auth v28 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.432925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a31a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016dc:[<0x100000016cb/picture-29.jpg v28>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016dc:[<0x100000016cb/picture-29.jpg v28>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.523+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001222 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml auth{0=1} v1068 ap=1 s=8633 n(v0 rc2024-05-20T17:35:20.011058+0000 b8633 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a727600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001222:[<0x10000000d67/comment-89.xml v907>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001222:[<0x10000000d67/comment-89.xml v1068>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.523+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001732 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg auth v172 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.693920+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a2ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001732:[<0x100000016cb/picture-5.jpg v172>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001732:[<0x100000016cb/picture-5.jpg v172>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.524+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml auth{0=1} v1064 ap=1 s=5137 n(v0 rc2024-05-20T17:35:20.720044+0000 b5137 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a727b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a2:[<0x10000000d67/comment-74.xml v931>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012a2:[<0x10000000d67/comment-74.xml v1064>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.524+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml auth{0=1} v1070 ap=1 s=4398 n(v0 rc2024-05-20T17:35:19.972059+0000 b4398 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a728100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121b:[<0x10000000d67/comment-90.xml v905>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000121b:[<0x10000000d67/comment-90.xml v1070>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.525+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001739 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg auth v184 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.735919+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a2f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001739:[<0x100000016cb/picture-3.jpg v184>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001739:[<0x100000016cb/picture-3.jpg v184>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.526+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml auth{0=1} v1048 ap=1 s=4646 n(v0 rc2024-05-20T17:35:23.505986+0000 b4646 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a728680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a8:[<0x10000000d67/comment-36.xml v985>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013a8:[<0x10000000d67/comment-36.xml v1048>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.526+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml auth{0=1} v1080 ap=1 s=31658 n(v0 rc2024-05-20T17:35:16.588129+0000 b31658 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a728c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea4:[<0x10000000d67/article-13.xml v316>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ea4:[<0x10000000d67/article-13.xml v1080>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.526+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000171a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg auth v136 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.578922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a336b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000171a:[<0x100000016cb/picture-11.jpg v136>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000171a:[<0x100000016cb/picture-11.jpg v136>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.720 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.529+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg auth v64 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.489924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a339180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f0:[<0x100000016cb/picture-23.jpg v64>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f0:[<0x100000016cb/picture-23.jpg v64>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.530+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml auth{0=1} v1054 ap=1 s=9355 n(v0 rc2024-05-20T17:35:20.959039+0000 b9355 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a729180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e4:[<0x10000000d67/comment-64.xml v957>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012e4:[<0x10000000d67/comment-64.xml v1054>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.530+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg auth v70 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.496924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a312580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f4:[<0x100000016cb/picture-22.jpg v70>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f4:[<0x100000016cb/picture-22.jpg v70>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.531+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml auth{0=1} v1062 ap=1 s=6974 n(v0 rc2024-05-20T17:35:20.767043+0000 b6974 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a729700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b0:[<0x10000000d67/comment-72.xml v944>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012b0:[<0x10000000d67/comment-72.xml v1062>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.531+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml auth{0=1} v1042 ap=1 s=9338 n(v0 rc2024-05-20T17:35:24.086974+0000 b9338 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141f:[<0x10000000d67/comment-4.xml v1040>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000141f:[<0x10000000d67/comment-4.xml v1042>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.531+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml auth{0=1} v1098 ap=1 s=13323 n(v0 rc2024-05-20T17:35:15.938143+0000 b13323 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcf:[<0x10000000d67/article-50.xml v94>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dcf:[<0x10000000d67/article-50.xml v1098>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.532+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001716 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg auth v130 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.569922+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a313600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001716:[<0x100000016cb/picture-12.jpg v130>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001716:[<0x100000016cb/picture-12.jpg v130>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.532+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg auth v112 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.545923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a313080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170c:[<0x100000016cb/picture-15.jpg v112>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000170c:[<0x100000016cb/picture-15.jpg v112>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.533+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg auth v76 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.503924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a314c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f7:[<0x100000016cb/picture-21.jpg v76>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016f7:[<0x100000016cb/picture-21.jpg v76>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.533+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml auth{0=1} v1074 ap=1 s=6939 n(v0 rc2024-05-20T17:35:16.681127+0000 b6939 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec7:[<0x10000000d67/article-6.xml v358>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ec7:[<0x10000000d67/article-6.xml v1074>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.533+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg auth v22 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.422925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a634000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d8:[<0x100000016cb/picture-30.jpg v22>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d8:[<0x100000016cb/picture-30.jpg v22>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.721 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.534+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg auth v82 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.510924+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a635600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fb:[<0x100000016cb/picture-20.jpg v82>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016fb:[<0x100000016cb/picture-20.jpg v82>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.535+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml auth{0=1} v1072 ap=1 s=12253 n(v0 rc2024-05-20T17:35:16.735126+0000 b12253 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edb:[<0x10000000d67/article-2.xml v382>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000edb:[<0x10000000d67/article-2.xml v1072>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.536+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml auth{0=1} v1044 ap=1 s=3494 n(v0 rc2024-05-20T17:35:23.970976+0000 b3494 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fa:[<0x10000000d67/comment-14.xml v1026>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013fa:[<0x10000000d67/comment-14.xml v1044>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.536+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg auth v40 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.453925+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a368000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e3:[<0x100000016cb/picture-27.jpg v40>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016e3:[<0x100000016cb/picture-27.jpg v40>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.536+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml auth v10 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.403926+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a368580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d1:[<0x100000016cb/article-1.xml v10>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000016d1:[<0x100000016cb/article-1.xml v10>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.537+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001708 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg auth v106 ap=1 s=0 n(v0 rc2024-05-20T17:35:26.538923+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55c87a369b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001708:[<0x100000016cb/picture-16.jpg v106>,<0x10000000399/blog-30 v36026>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001708:[<0x100000016cb/picture-16.jpg v106>,<0x10000000399/blog-30 v46402>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.537+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml auth{0=1} v1056 ap=1 s=2805 n(v0 rc2024-05-20T17:35:20.902040+0000 b2805 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d1:[<0x10000000d67/comment-67.xml v955>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012d1:[<0x10000000d67/comment-67.xml v1056>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.539+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg auth{0=1} v1100 ap=1 s=42423 n(v0 rc2024-05-20T17:35:17.909102+0000 b42423 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fff:[<0x10000000d67/picture-54.jpg v670>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fff:[<0x10000000d67/picture-54.jpg v1100>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.542+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001053 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg auth{0=1} v1088 ap=1 s=19738 n(v0 rc2024-05-20T17:35:18.249095+0000 b19738 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001053:[<0x10000000d67/picture-29.jpg v820>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001053:[<0x10000000d67/picture-29.jpg v1088>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.543+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml auth{0=1} v1046 ap=1 s=8141 n(v0 rc2024-05-20T17:35:23.919977+0000 b8141 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e8:[<0x10000000d67/comment-19.xml v1024>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013e8:[<0x10000000d67/comment-19.xml v1046>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.722 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.544+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml auth{0=1} v1104 ap=1 s=18791 n(v0 rc2024-05-20T17:35:15.797146+0000 b18791 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da9:[<0x10000000d67/article-56.xml v58>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000da9:[<0x10000000d67/article-56.xml v1104>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.545+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml auth{0=1} v1058 ap=1 s=6789 n(v0 rc2024-05-20T17:35:23.886978+0000 b6789 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013dc:[<0x10000000d67/comment-22.xml v1016>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013dc:[<0x10000000d67/comment-22.xml v1058>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.548+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001427 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml auth{0=1} v1048 ap=1 s=4354 n(v0 rc2024-05-20T17:35:24.129973+0000 b4354 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a664c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001427:[<0x10000000d67/comment-2.xml v1044>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001427:[<0x10000000d67/comment-2.xml v1048>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.548+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg auth{0=1} v1079 ap=1 s=50588 n(v0 rc2024-05-20T17:35:06.469339+0000 b50588 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879784000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fd:[<0x1000000039e/picture-21.jpg v1079>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004fd:[<0x1000000039e/picture-21.jpg v1079>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.548+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg auth{0=1} v1106 ap=1 s=19358 n(v0 rc2024-05-20T17:35:17.106119+0000 b19358 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a665180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3d:[<0x10000000d67/picture-86.jpg v478>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f3d:[<0x10000000d67/picture-86.jpg v1106>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.548+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000420 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml auth{0=1} v1059 ap=1 s=7840 n(v0 rc2024-05-20T17:35:05.842352+0000 b7840 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879784580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000420:[<0x1000000039e/article-35.xml v1059>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000420:[<0x1000000039e/article-35.xml v1059>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.548+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml auth{0=1} v1064 ap=1 s=5749 n(v0 rc2024-05-20T17:35:22.569005+0000 b5749 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a665700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136c:[<0x10000000d67/comment-44.xml v972>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000136c:[<0x10000000d67/comment-44.xml v1064>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.549+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000817 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml auth{0=1} v1071 ap=1 s=8141 n(v0 rc2024-05-20T17:35:09.259281+0000 b8141 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879784b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000817:[<0x1000000039e/comment-73.xml v1071>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000817:[<0x1000000039e/comment-73.xml v1071>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.549+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000808 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml auth{0=1} v1103 ap=1 s=4190 n(v0 rc2024-05-20T17:35:09.204282+0000 b4190 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879785600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000808:[<0x1000000039e/comment-78.xml v1103>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000808:[<0x1000000039e/comment-78.xml v1103>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.723 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.550+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml auth{0=1} v1069 ap=1 s=6721 n(v0 rc2024-05-20T17:35:09.891268+0000 b6721 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879785b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008db:[<0x1000000039e/comment-1.xml v1069>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008db:[<0x1000000039e/comment-1.xml v1069>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.550+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml auth v1081 ap=1 s=4082 n(v0 rc2024-05-20T17:35:08.950287+0000 b4082 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879786100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bc:[<0x1000000039e/comment-96.xml v1081>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007bc:[<0x1000000039e/comment-96.xml v1081>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.550+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg auth{0=1} v1063 ap=1 s=64465 n(v0 rc2024-05-20T17:35:06.416340+0000 b64465 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879786c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004eb:[<0x1000000039e/picture-30.jpg v1063>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004eb:[<0x1000000039e/picture-30.jpg v1063>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.550+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000412 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml auth{0=1} v1061 ap=1 s=6963 n(v0 rc2024-05-20T17:35:05.807352+0000 b6963 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879786680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000412:[<0x1000000039e/article-40.xml v1061>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000412:[<0x1000000039e/article-40.xml v1061>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.551+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg auth{0=1} v1108 ap=1 s=63600 n(v0 rc2024-05-20T17:35:16.819125+0000 b63600 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef9:[<0x10000000d67/picture-96.jpg v418>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ef9:[<0x10000000d67/picture-96.jpg v1108>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.551+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f03 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg auth{0=1} v1102 ap=1 s=36792 n(v0 rc2024-05-20T17:35:16.847124+0000 b36792 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f03:[<0x10000000d67/picture-94.jpg v430>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f03:[<0x10000000d67/picture-94.jpg v1102>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.551+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml auth{0=1} v1111 ap=1 s=8512 n(v0 rc2024-05-20T17:35:09.077285+0000 b8512 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879787180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e5:[<0x1000000039e/comment-88.xml v1091>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007e5:[<0x1000000039e/comment-88.xml v1111>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.551+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml auth{0=1} v1087 ap=1 s=17173 n(v0 rc2024-05-20T17:35:06.018348+0000 b17173 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879787700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045c:[<0x1000000039e/article-15.xml v1087>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000045c:[<0x1000000039e/article-15.xml v1087>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.552+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000804 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml auth{0=1} v1109 ap=1 s=8458 n(v0 rc2024-05-20T17:35:09.191282+0000 b8458 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879790000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000804:[<0x1000000039e/comment-79.xml v1109>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000804:[<0x1000000039e/comment-79.xml v1109>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.552+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml auth{0=1} v1099 ap=1 s=4020 n(v0 rc2024-05-20T17:35:09.577274+0000 b4020 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879790580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087c:[<0x1000000039e/comment-40.xml v1099>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000087c:[<0x1000000039e/comment-40.xml v1099>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.724 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.552+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000880 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml auth{0=1} v1095 ap=1 s=4842 n(v0 rc2024-05-20T17:35:09.591274+0000 b4842 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879791600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000880:[<0x1000000039e/comment-39.xml v1095>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000880:[<0x1000000039e/comment-39.xml v1095>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.552+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dfa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml auth{0=1} v1082 ap=1 s=13884 n(v0 rc2024-05-20T17:35:16.071140+0000 b13884 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dfa:[<0x10000000d67/article-43.xml v136>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dfa:[<0x10000000d67/article-43.xml v1082>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.552+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml auth{0=1} v1073 ap=1 s=9273 n(v0 rc2024-05-20T17:35:09.097284+0000 b9273 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879791b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007eb:[<0x1000000039e/comment-86.xml v1073>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007eb:[<0x1000000039e/comment-86.xml v1073>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.553+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg auth{0=1} v1101 ap=1 s=41933 n(v0 rc2024-05-20T17:35:06.378341+0000 b41933 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879792100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004df:[<0x1000000039e/picture-36.jpg v1101>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004df:[<0x1000000039e/picture-36.jpg v1101>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.553+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg auth{0=1} v1083 ap=1 s=56323 n(v0 rc2024-05-20T17:35:06.337341+0000 b56323 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879792680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d1:[<0x1000000039e/picture-43.jpg v1083>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d1:[<0x1000000039e/picture-43.jpg v1083>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.553+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000450 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml auth{0=1} v1057 ap=1 s=7793 n(v0 rc2024-05-20T17:35:05.982349+0000 b7793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879792c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000450:[<0x1000000039e/article-19.xml v1057>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000450:[<0x1000000039e/article-19.xml v1057>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.553+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg auth{0=1} v1067 ap=1 s=16106 n(v0 rc2024-05-20T17:35:06.475339+0000 b16106 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879793180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ff:[<0x1000000039e/picture-20.jpg v1067>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ff:[<0x1000000039e/picture-20.jpg v1067>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.553+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml auth{0=1} v1055 ap=1 s=8705 n(v0 rc2024-05-20T17:35:09.151283+0000 b8705 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879793700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fa:[<0x1000000039e/comment-82.xml v1055>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007fa:[<0x1000000039e/comment-82.xml v1055>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.554+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000835 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml auth{0=1} v1093 ap=1 s=7557 n(v0 rc2024-05-20T17:35:09.361279+0000 b7557 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879798580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000835:[<0x1000000039e/comment-63.xml v1093>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000835:[<0x1000000039e/comment-63.xml v1093>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.725 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.554+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000850 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml auth{0=1,1=1} v1171 ap=4 s=9800 n(v0 rc2024-05-20T17:35:09.447277+0000 b9800 1=1+0) (ilink xlock x=1 by request(client.25025:28195 nref=9 cr=0x55c87a114380)) (iversion lock w=1 last_client=25025) (iquiesce lock w=1 last_client=25025) caps={25025=pAsXsFscr/pFscr@3},l=25025 | ptrwaiter=0 request=1 lock=4 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55c879798b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000850:[<0x1000000039e/comment-54.xml v1105>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000850:[<0x1000000039e/comment-54.xml v1171>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.554+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml auth{0=1} v1075 ap=1 s=21898 n(v0 rc2024-05-20T17:35:05.797353+0000 b21898 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879799080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040a:[<0x1000000039e/article-42.xml v1075>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000040a:[<0x1000000039e/article-42.xml v1075>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.555+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml auth v1065 ap=1 s=7287 n(v0 rc2024-05-20T17:35:09.049285+0000 b7287 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c879799600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007dc:[<0x1000000039e/comment-91.xml v1065>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007dc:[<0x1000000039e/comment-91.xml v1065>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.555+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg auth{0=1} v1089 ap=1 s=53005 n(v0 rc2024-05-20T17:35:06.366341+0000 b53005 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879799b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004db:[<0x1000000039e/picture-38.jpg v1089>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004db:[<0x1000000039e/picture-38.jpg v1089>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.555+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e38 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml auth{0=1} v1080 ap=1 s=18510 n(v0 rc2024-05-20T17:35:16.247136+0000 b18510 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e38:[<0x10000000d67/article-33.xml v196>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e38:[<0x10000000d67/article-33.xml v1080>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.557+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f6a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg auth{0=1} v1112 ap=1 s=59502 n(v0 rc2024-05-20T17:35:17.310114+0000 b59502 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f6a:[<0x10000000d67/picture-81.jpg v508>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f6a:[<0x10000000d67/picture-81.jpg v1112>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.557+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001261 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg auth{0=1} v1076 ap=1 s=63276 n(v0 rc2024-05-20T17:35:20.320052+0000 b63276 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001261:[<0x10000000d67/picture-5.jpg v926>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001261:[<0x10000000d67/picture-5.jpg v1076>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.559+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml auth{0=1} v1060 ap=1 s=9957 n(v0 rc2024-05-20T17:35:23.793980+0000 b9957 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013cb:[<0x10000000d67/comment-27.xml v1000>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013cb:[<0x10000000d67/comment-27.xml v1060>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.559+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg auth{0=1} v1086 ap=1 s=25001 n(v0 rc2024-05-20T17:35:17.964101+0000 b25001 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100e:[<0x10000000d67/picture-50.jpg v694>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000100e:[<0x10000000d67/picture-50.jpg v1086>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.561+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001293 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml auth{0=1} v1072 ap=1 s=8478 n(v0 rc2024-05-20T17:35:20.666045+0000 b8478 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001293:[<0x10000000d67/comment-76.xml v932>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001293:[<0x10000000d67/comment-76.xml v1072>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.564+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg auth{0=1} v1094 ap=1 s=56946 n(v0 rc2024-05-20T17:35:17.863103+0000 b56946 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff1:[<0x10000000d67/picture-58.jpg v646>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ff1:[<0x10000000d67/picture-58.jpg v1094>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.726 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.564+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml auth{0=1} v1046 ap=1 s=1802 n(v0 rc2024-05-20T17:35:15.773146+0000 b1802 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87954d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da2:[<0x10000000d67/article-57.xml v52>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000da2:[<0x10000000d67/article-57.xml v1046>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.565+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001332 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml auth{0=1} v1068 ap=1 s=7972 n(v0 rc2024-05-20T17:35:21.579026+0000 b7972 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001332:[<0x10000000d67/comment-52.xml v968>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001332:[<0x10000000d67/comment-52.xml v1068>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.566+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml auth{0=1} v1070 ap=1 s=3317 n(v0 rc2024-05-20T17:35:20.918040+0000 b3317 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d7:[<0x10000000d67/comment-66.xml v936>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012d7:[<0x10000000d67/comment-66.xml v1070>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.566+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg auth{0=1} v1100 ap=1 s=46852 n(v0 rc2024-05-20T17:35:17.777105+0000 b46852 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdb:[<0x10000000d67/picture-65.jpg v604>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fdb:[<0x10000000d67/picture-65.jpg v1100>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.567+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001415 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml auth{0=1} v1050 ap=1 s=5640 n(v0 rc2024-05-20T17:35:24.038975+0000 b5640 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001415:[<0x10000000d67/comment-7.xml v1037>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001415:[<0x10000000d67/comment-7.xml v1050>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.569+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml auth{0=1} v1054 ap=1 s=7121 n(v0 rc2024-05-20T17:35:23.959977+0000 b7121 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f7:[<0x10000000d67/comment-15.xml v1023>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013f7:[<0x10000000d67/comment-15.xml v1054>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.569+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml auth{0=1} v1096 ap=1 s=32650 n(v0 rc2024-05-20T17:35:15.748147+0000 b32650 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9b:[<0x10000000d67/article-58.xml v46>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d9b:[<0x10000000d67/article-58.xml v1096>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.570+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml auth{0=1} v1092 ap=1 s=2771 n(v0 rc2024-05-20T17:35:15.867144+0000 b2771 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbc:[<0x10000000d67/article-53.xml v76>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dbc:[<0x10000000d67/article-53.xml v1092>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.571+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001373 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml auth{0=1} v1062 ap=1 s=4062 n(v0 rc2024-05-20T17:35:22.679003+0000 b4062 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001373:[<0x10000000d67/comment-43.xml v974>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001373:[<0x10000000d67/comment-43.xml v1062>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.572+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml auth{0=1} v1056 ap=1 s=6238 n(v0 rc2024-05-20T17:35:23.939977+0000 b6238 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ef:[<0x10000000d67/comment-17.xml v1021>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ef:[<0x10000000d67/comment-17.xml v1056>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.576+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e5a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml auth{0=1} v1078 ap=1 s=28905 n(v0 rc2024-05-20T17:35:16.329135+0000 b28905 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e5a:[<0x10000000d67/article-28.xml v226>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e5a:[<0x10000000d67/article-28.xml v1078>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.727 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.576+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml auth{0=1} v1052 ap=1 s=4025 n(v0 rc2024-05-20T17:35:24.019975+0000 b4025 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a2ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140e:[<0x10000000d67/comment-9.xml v1029>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000140e:[<0x10000000d67/comment-9.xml v1052>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.576+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml auth{0=1} v1090 ap=1 s=16087 n(v0 rc2024-05-20T17:35:15.892144+0000 b16087 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a330000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc3:[<0x10000000d67/article-52.xml v82>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dc3:[<0x10000000d67/article-52.xml v1090>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.576+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f86 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg auth{0=1} v1110 ap=1 s=8286 n(v0 rc2024-05-20T17:35:17.448112+0000 b8286 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a330580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f86:[<0x10000000d67/picture-77.jpg v532>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f86:[<0x10000000d67/picture-77.jpg v1110>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.578+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg auth{0=1} v1104 ap=1 s=64936 n(v0 rc2024-05-20T17:35:17.654107+0000 b64936 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a330b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb3:[<0x10000000d67/picture-69.jpg v580>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fb3:[<0x10000000d67/picture-69.jpg v1104>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.580+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg auth{0=1} v1088 ap=1 s=12848 n(v0 rc2024-05-20T17:35:17.948101+0000 b12848 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a331080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100a:[<0x10000000d67/picture-51.jpg v688>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000100a:[<0x10000000d67/picture-51.jpg v1088>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.580+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001363 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml auth{0=1} v1066 ap=1 s=6604 n(v0 rc2024-05-20T17:35:22.462008+0000 b6604 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a331600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001363:[<0x10000000d67/comment-45.xml v970>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001363:[<0x10000000d67/comment-45.xml v1066>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.580+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg auth{0=1} v1098 ap=1 s=19820 n(v0 rc2024-05-20T17:35:17.808104+0000 b19820 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a331b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe5:[<0x10000000d67/picture-62.jpg v622>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fe5:[<0x10000000d67/picture-62.jpg v1098>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.581+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001246 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml auth{0=1} v1074 ap=1 s=5311 n(v0 rc2024-05-20T17:35:20.178055+0000 b5311 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a332100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001246:[<0x10000000d67/comment-84.xml v918>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001246:[<0x10000000d67/comment-84.xml v1074>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.582+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg auth{0=1} v1084 ap=1 s=25075 n(v0 rc2024-05-20T17:35:18.024100+0000 b25075 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a332680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101e:[<0x10000000d67/picture-46.jpg v718>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000101e:[<0x10000000d67/picture-46.jpg v1084>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.582+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001266 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml auth{0=1} v1059 ap=1 s=5236 n(v0 rc2024-05-20T17:35:20.331052+0000 b5236 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001266:[<0x10000000d67/comment-81.xml v929>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001266:[<0x10000000d67/comment-81.xml v1059>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.728 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.582+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001409 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml auth{0=1} v1041 ap=1 s=7032 n(v0 rc2024-05-20T17:35:24.010975+0000 b7032 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001409:[<0x10000000d67/comment-10.xml v1023>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001409:[<0x10000000d67/comment-10.xml v1041>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.583+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001274 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg auth{0=1} v1063 ap=1 s=54525 n(v0 rc2024-05-20T17:35:20.398050+0000 b54525 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001274:[<0x10000000d67/picture-3.jpg v935>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001274:[<0x10000000d67/picture-3.jpg v1063>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.584+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml auth{0=1} v1049 ap=1 s=2384 n(v0 rc2024-05-20T17:35:21.485028+0000 b2384 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132c:[<0x10000000d67/comment-53.xml v965>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000132c:[<0x10000000d67/comment-53.xml v1049>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.585+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001418 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml auth{0=1} v1037 ap=1 s=7308 n(v0 rc2024-05-20T17:35:24.048975+0000 b7308 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001418:[<0x10000000d67/comment-6.xml v1035>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001418:[<0x10000000d67/comment-6.xml v1037>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.588+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg auth{0=1} v1079 ap=1 s=13462 n(v0 rc2024-05-20T17:35:17.900102+0000 b13462 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffc:[<0x10000000d67/picture-55.jpg v664>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ffc:[<0x10000000d67/picture-55.jpg v1079>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.588+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml auth{0=1} v1061 ap=1 s=9588 n(v0 rc2024-05-20T17:35:20.140056+0000 b9588 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123f:[<0x10000000d67/comment-85.xml v918>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000123f:[<0x10000000d67/comment-85.xml v1061>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.589+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001232 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg auth{0=1} v1067 ap=1 s=15199 n(v0 rc2024-05-20T17:35:20.081057+0000 b15199 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001232:[<0x10000000d67/picture-11.jpg v908>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001232:[<0x10000000d67/picture-11.jpg v1067>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.589+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fac [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg auth{0=1} v1087 ap=1 s=9209 n(v0 rc2024-05-20T17:35:17.630108+0000 b9209 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fac:[<0x10000000d67/picture-70.jpg v574>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fac:[<0x10000000d67/picture-70.jpg v1087>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.590+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml auth{0=1} v1065 ap=1 s=23643 n(v0 rc2024-05-20T17:35:16.695127+0000 b23643 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ecc:[<0x10000000d67/article-5.xml v364>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ecc:[<0x10000000d67/article-5.xml v1065>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.590+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e32 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml auth{0=1} v1073 ap=1 s=2617 n(v0 rc2024-05-20T17:35:16.234137+0000 b2617 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e32:[<0x10000000d67/article-34.xml v190>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e32:[<0x10000000d67/article-34.xml v1073>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.593+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml auth{0=1} v1045 ap=1 s=4598 n(v0 rc2024-05-20T17:35:23.539985+0000 b4598 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ad:[<0x10000000d67/comment-35.xml v989>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ad:[<0x10000000d67/comment-35.xml v1045>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.729 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.594+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml auth{0=1} v1043 ap=1 s=5584 n(v0 rc2024-05-20T17:35:23.766981+0000 b5584 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c7:[<0x10000000d67/comment-28.xml v997>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013c7:[<0x10000000d67/comment-28.xml v1043>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.597+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001312 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml auth{0=1} v1051 ap=1 s=7862 n(v0 rc2024-05-20T17:35:21.280032+0000 b7862 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001312:[<0x10000000d67/comment-57.xml v956>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001312:[<0x10000000d67/comment-57.xml v1051>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.597+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eea [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg auth{0=1} v1093 ap=1 s=15846 n(v0 rc2024-05-20T17:35:16.777125+0000 b15846 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eea:[<0x10000000d67/picture-99.jpg v400>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000eea:[<0x10000000d67/picture-99.jpg v1093>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.598+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg auth{0=1} v1085 ap=1 s=36426 n(v0 rc2024-05-20T17:35:17.606108+0000 b36426 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa3:[<0x10000000d67/picture-71.jpg v568>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fa3:[<0x10000000d67/picture-71.jpg v1085>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.599+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e55 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml auth{0=1} v1071 ap=1 s=3826 n(v0 rc2024-05-20T17:35:16.314135+0000 b3826 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e55:[<0x10000000d67/article-29.xml v220>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e55:[<0x10000000d67/article-29.xml v1071>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.600+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml auth{0=1} v1081 ap=1 s=10953 n(v0 rc2024-05-20T17:35:15.716147+0000 b10953 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8e:[<0x10000000d67/article-60.xml v34>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d8e:[<0x10000000d67/article-60.xml v1081>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.601+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg auth{0=1} v1083 ap=1 s=48973 n(v0 rc2024-05-20T17:35:17.797104+0000 b48973 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe1:[<0x10000000d67/picture-63.jpg v616>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fe1:[<0x10000000d67/picture-63.jpg v1083>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.603+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001031 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg auth{0=1} v1075 ap=1 s=46829 n(v0 rc2024-05-20T17:35:18.129097+0000 b46829 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001031:[<0x10000000d67/picture-40.jpg v754>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001031:[<0x10000000d67/picture-40.jpg v1075>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.604+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml auth{0=1} v1053 ap=1 s=3460 n(v0 rc2024-05-20T17:35:21.047037+0000 b3460 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f8:[<0x10000000d67/comment-61.xml v954>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012f8:[<0x10000000d67/comment-61.xml v1053>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.605+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e78 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml auth{0=1} v1069 ap=1 s=29868 n(v0 rc2024-05-20T17:35:16.430133+0000 b29868 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a976000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e78:[<0x10000000d67/article-22.xml v262>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e78:[<0x10000000d67/article-22.xml v1069>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.730 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.606+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml auth{0=1} v1047 ap=1 s=2266 n(v0 rc2024-05-20T17:35:23.403988+0000 b2266 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a976580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139c:[<0x10000000d67/comment-38.xml v979>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000139c:[<0x10000000d67/comment-38.xml v1047>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.606+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml auth{0=1} v1055 ap=1 s=6300 n(v0 rc2024-05-20T17:35:20.886040+0000 b6300 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a976b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ca:[<0x10000000d67/comment-68.xml v948>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012ca:[<0x10000000d67/comment-68.xml v1055>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.607+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f31 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg auth{0=1} v1091 ap=1 s=64231 n(v0 rc2024-05-20T17:35:17.052120+0000 b64231 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a977080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f31:[<0x10000000d67/picture-87.jpg v472>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f31:[<0x10000000d67/picture-87.jpg v1091>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.609+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f52 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg auth{0=1} v1089 ap=1 s=21876 n(v0 rc2024-05-20T17:35:17.200117+0000 b21876 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a977600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f52:[<0x10000000d67/picture-84.jpg v490>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f52:[<0x10000000d67/picture-84.jpg v1089>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.609+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml auth{0=1} v1077 ap=1 s=21140 n(v0 rc2024-05-20T17:35:15.968142+0000 b21140 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a977b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd5:[<0x10000000d67/article-49.xml v100>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dd5:[<0x10000000d67/article-49.xml v1077>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.611+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001411 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml auth{0=1} v1039 ap=1 s=5554 n(v0 rc2024-05-20T17:35:24.029975+0000 b5554 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a978100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001411:[<0x10000000d67/comment-8.xml v1031>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001411:[<0x10000000d67/comment-8.xml v1039>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.612+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml auth{0=1} v1057 ap=1 s=6898 n(v0 rc2024-05-20T17:35:20.371051+0000 b6898 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a978680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126f:[<0x10000000d67/comment-80.xml v931>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000126f:[<0x10000000d67/comment-80.xml v1057>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.612+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001065 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg auth{0=1} v1042 ap=1 s=50270 n(v0 rc2024-05-20T17:35:18.307094+0000 b50270 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a6f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001065:[<0x10000000d67/picture-23.jpg v856>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001065:[<0x10000000d67/picture-23.jpg v1042>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.613+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f78 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg auth{0=1} v1078 ap=1 s=41434 n(v0 rc2024-05-20T17:35:17.370113+0000 b41434 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a762000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f78:[<0x10000000d67/picture-79.jpg v520>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f78:[<0x10000000d67/picture-79.jpg v1078>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.613+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml auth{0=1} v1034 ap=1 s=30119 n(v0 rc2024-05-20T17:35:16.576130+0000 b30119 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a762580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9f:[<0x10000000d67/article-14.xml v310>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e9f:[<0x10000000d67/article-14.xml v1034>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.614+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001022 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg auth{0=1} v1054 ap=1 s=50729 n(v0 rc2024-05-20T17:35:18.043099+0000 b50729 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a762b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001022:[<0x10000000d67/picture-45.jpg v724>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001022:[<0x10000000d67/picture-45.jpg v1054>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.731 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.614+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg auth{0=1} v1050 ap=1 s=34201 n(v0 rc2024-05-20T17:35:18.105098+0000 b34201 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a763080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102e:[<0x10000000d67/picture-41.jpg v748>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000102e:[<0x10000000d67/picture-41.jpg v1050>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.616+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml auth{0=1} v1022 ap=1 s=9648 n(v0 rc2024-05-20T17:35:21.012038+0000 b9648 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a763600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f1:[<0x10000000d67/comment-62.xml v949>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012f1:[<0x10000000d67/comment-62.xml v1022>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.617+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000feb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg auth{0=1} v1070 ap=1 s=22461 n(v0 rc2024-05-20T17:35:17.843103+0000 b22461 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a763b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000feb:[<0x10000000d67/picture-60.jpg v634>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000feb:[<0x10000000d67/picture-60.jpg v1070>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.619+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml auth{0=1} v1056 ap=1 s=22104 n(v0 rc2024-05-20T17:35:16.026141+0000 b22104 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a764100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de9:[<0x10000000d67/article-46.xml v118>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000de9:[<0x10000000d67/article-46.xml v1056>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.620+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg auth{0=1} v1072 ap=1 s=64204 n(v0 rc2024-05-20T17:35:17.768105+0000 b64204 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a764680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd8:[<0x10000000d67/picture-66.jpg v598>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fd8:[<0x10000000d67/picture-66.jpg v1072>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.620+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f70 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg auth{0=1} v1076 ap=1 s=13707 n(v0 rc2024-05-20T17:35:17.340114+0000 b13707 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a764c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f70:[<0x10000000d67/picture-80.jpg v514>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f70:[<0x10000000d67/picture-80.jpg v1076>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.621+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml auth{0=1} v1060 ap=1 s=25252 n(v0 rc2024-05-20T17:35:16.012141+0000 b25252 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a765180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de1:[<0x10000000d67/article-47.xml v112>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000de1:[<0x10000000d67/article-47.xml v1060>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.621+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f12 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg auth{0=1} v1080 ap=1 s=59558 n(v0 rc2024-05-20T17:35:16.893123+0000 b59558 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a765700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f12:[<0x10000000d67/picture-91.jpg v448>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f12:[<0x10000000d67/picture-91.jpg v1080>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.622+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001068 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg auth{0=1} v1040 ap=1 s=58034 n(v0 rc2024-05-20T17:35:18.315094+0000 b58034 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001068:[<0x10000000d67/picture-22.jpg v862>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001068:[<0x10000000d67/picture-22.jpg v1040>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.622+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eae [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml auth{0=1} v1030 ap=1 s=13547 n(v0 rc2024-05-20T17:35:16.614129+0000 b13547 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eae:[<0x10000000d67/article-11.xml v328>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000eae:[<0x10000000d67/article-11.xml v1030>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.624+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001305 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml auth{0=1} v1020 ap=1 s=6798 n(v0 rc2024-05-20T17:35:21.170034+0000 b6798 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001305:[<0x10000000d67/comment-59.xml v953>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001305:[<0x10000000d67/comment-59.xml v1020>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.732 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.625+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg auth{0=1} v1074 ap=1 s=49030 n(v0 rc2024-05-20T17:35:16.805125+0000 b49030 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef4:[<0x10000000d67/picture-97.jpg v412>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ef4:[<0x10000000d67/picture-97.jpg v1074>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.626+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e96 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml auth{0=1} v1038 ap=1 s=18098 n(v0 rc2024-05-20T17:35:16.545130+0000 b18098 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e96:[<0x10000000d67/article-16.xml v298>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e96:[<0x10000000d67/article-16.xml v1038>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.626+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001288 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml auth{0=1} v1024 ap=1 s=4777 n(v0 rc2024-05-20T17:35:20.617046+0000 b4777 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001288:[<0x10000000d67/comment-77.xml v940>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001288:[<0x10000000d67/comment-77.xml v1024>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.627+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml auth{0=1} v1064 ap=1 s=9628 n(v0 rc2024-05-20T17:35:15.843145+0000 b9628 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db7:[<0x10000000d67/article-54.xml v70>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000db7:[<0x10000000d67/article-54.xml v1064>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.628+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e64 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml auth{0=1} v1046 ap=1 s=7376 n(v0 rc2024-05-20T17:35:16.358134+0000 b7376 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e64:[<0x10000000d67/article-26.xml v238>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e64:[<0x10000000d67/article-26.xml v1046>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.629+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg auth{0=1} v1036 ap=1 s=57897 n(v0 rc2024-05-20T17:35:18.376092+0000 b57897 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107e:[<0x10000000d67/picture-15.jpg v904>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000107e:[<0x10000000d67/picture-15.jpg v1036>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.630+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg auth{0=1} v1066 ap=1 s=29153 n(v0 rc2024-05-20T17:35:17.890102+0000 b29153 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff9:[<0x10000000d67/picture-56.jpg v658>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ff9:[<0x10000000d67/picture-56.jpg v1066>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.631+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg auth{0=1} v1058 ap=1 s=33045 n(v0 rc2024-05-20T17:35:18.009100+0000 b33045 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a78f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101a:[<0x10000000d67/picture-47.jpg v712>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000101a:[<0x10000000d67/picture-47.jpg v1058>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.633+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml auth{0=1} v1028 ap=1 s=8251 n(v0 rc2024-05-20T17:35:16.628129+0000 b8251 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb3:[<0x10000000d67/article-10.xml v334>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000eb3:[<0x10000000d67/article-10.xml v1028>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.634+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg auth{0=1} v1032 ap=1 s=32589 n(v0 rc2024-05-20T17:35:20.053058+0000 b32589 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122b:[<0x10000000d67/picture-12.jpg v912>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000122b:[<0x10000000d67/picture-12.jpg v1032>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.634+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001025 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg auth{0=1} v1052 ap=1 s=29808 n(v0 rc2024-05-20T17:35:18.062099+0000 b29808 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001025:[<0x10000000d67/picture-44.jpg v730>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001025:[<0x10000000d67/picture-44.jpg v1052>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.733 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.634+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001340 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml auth{0=1} v1018 ap=1 s=7438 n(v0 rc2024-05-20T17:35:21.784022+0000 b7438 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001340:[<0x10000000d67/comment-50.xml v963>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001340:[<0x10000000d67/comment-50.xml v1018>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.634+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml auth{0=1} v1062 ap=1 s=5931 n(v0 rc2024-05-20T17:35:15.994142+0000 b5931 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddc:[<0x10000000d67/article-48.xml v106>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ddc:[<0x10000000d67/article-48.xml v1062>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.635+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml auth{0=1} v1016 ap=1 s=7811 n(v0 rc2024-05-20T17:35:21.996017+0000 b7811 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a76fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134f:[<0x10000000d67/comment-48.xml v968>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000134f:[<0x10000000d67/comment-48.xml v1016>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.636+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml auth{0=1} v1026 ap=1 s=12543 n(v0 rc2024-05-20T17:35:16.708127+0000 b12543 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a770100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed1:[<0x10000000d67/article-4.xml v370>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ed1:[<0x10000000d67/article-4.xml v1026>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.637+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e69 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml auth{0=1} v1044 ap=1 s=18508 n(v0 rc2024-05-20T17:35:16.374134+0000 b18508 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a770680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e69:[<0x10000000d67/article-25.xml v244>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e69:[<0x10000000d67/article-25.xml v1044>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.638+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg auth{0=1} v1082 ap=1 s=29708 n(v0 rc2024-05-20T17:35:17.564109+0000 b29708 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a770c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9f:[<0x10000000d67/picture-72.jpg v562>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f9f:[<0x10000000d67/picture-72.jpg v1082>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.639+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg auth{0=1} v1068 ap=1 s=39520 n(v0 rc2024-05-20T17:35:17.853103+0000 b39520 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a771180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fee:[<0x10000000d67/picture-59.jpg v640>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fee:[<0x10000000d67/picture-59.jpg v1068>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.640+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml auth{0=1} v1048 ap=1 s=8165 n(v0 rc2024-05-20T17:35:16.164138+0000 b8165 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a771700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1b:[<0x10000000d67/article-38.xml v166>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e1b:[<0x10000000d67/article-38.xml v1048>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.641+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml auth{0=1} v1014 ap=1 s=4201 n(v0 rc2024-05-20T17:35:23.662983+0000 b4201 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a9b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bd:[<0x10000000d67/comment-31.xml v998>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013bd:[<0x10000000d67/comment-31.xml v1014>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.642+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg auth{0=1} v1096 ap=1 s=8413 n(v0 rc2024-05-20T17:35:17.548109+0000 b8413 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9b:[<0x10000000d67/picture-73.jpg v556>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f9b:[<0x10000000d67/picture-73.jpg v1096>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.642+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg auth{0=1} v1080 ap=1 s=10338 n(v0 rc2024-05-20T17:35:18.324093+0000 b10338 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106b:[<0x10000000d67/picture-21.jpg v868>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000106b:[<0x10000000d67/picture-21.jpg v1080>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.734 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.644+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml auth{0=1} v1084 ap=1 s=8056 n(v0 rc2024-05-20T17:35:16.222137+0000 b8056 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2d:[<0x10000000d67/article-35.xml v184>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e2d:[<0x10000000d67/article-35.xml v1084>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.645+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml auth{0=1} v1062 ap=1 s=3662 n(v0 rc2024-05-20T17:35:20.742043+0000 b3662 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a9:[<0x10000000d67/comment-73.xml v941>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012a9:[<0x10000000d67/comment-73.xml v1062>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.646+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml auth{0=1} v1058 ap=1 s=4919 n(v0 rc2024-05-20T17:35:21.086036+0000 b4919 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fe:[<0x10000000d67/comment-60.xml v955>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012fe:[<0x10000000d67/comment-60.xml v1058>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.648+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f93 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg auth{0=1} v1100 ap=1 s=29384 n(v0 rc2024-05-20T17:35:17.508110+0000 b29384 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f93:[<0x10000000d67/picture-75.jpg v544>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f93:[<0x10000000d67/picture-75.jpg v1100>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.649+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml auth{0=1} v1064 ap=1 s=5039 n(v0 rc2024-05-20T17:35:20.547047+0000 b5039 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127d:[<0x10000000d67/comment-78.xml v936>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000127d:[<0x10000000d67/comment-78.xml v1064>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.649+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg auth{0=1} v1102 ap=1 s=53532 n(v0 rc2024-05-20T17:35:16.762126+0000 b53532 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee5:[<0x10000000d67/picture-100.jpg v394>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ee5:[<0x10000000d67/picture-100.jpg v1102>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.650+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml auth{0=1} v1050 ap=1 s=2974 n(v0 rc2024-05-20T17:35:24.157972+0000 b2974 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142b:[<0x10000000d67/comment-1.xml v1048>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000142b:[<0x10000000d67/comment-1.xml v1050>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.651+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e0d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml auth{0=1} v1090 ap=1 s=2255 n(v0 rc2024-05-20T17:35:16.118139+0000 b2255 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e0d:[<0x10000000d67/article-40.xml v154>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e0d:[<0x10000000d67/article-40.xml v1090>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.652+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001050 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg auth{0=1} v1082 ap=1 s=55377 n(v0 rc2024-05-20T17:35:18.241095+0000 b55377 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001050:[<0x10000000d67/picture-30.jpg v814>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001050:[<0x10000000d67/picture-30.jpg v1082>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.735 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.653+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001228 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml auth{0=1} v1072 ap=1 s=3674 n(v0 rc2024-05-20T17:35:20.044058+0000 b3674 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001228:[<0x10000000d67/comment-88.xml v905>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001228:[<0x10000000d67/comment-88.xml v1072>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.654+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml auth{0=1} v1074 ap=1 s=17679 n(v0 rc2024-05-20T17:35:16.563130+0000 b17679 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9b:[<0x10000000d67/article-15.xml v304>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e9b:[<0x10000000d67/article-15.xml v1074>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.655+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001277 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml auth{0=1} v1066 ap=1 s=2552 n(v0 rc2024-05-20T17:35:20.423050+0000 b2552 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001277:[<0x10000000d67/comment-79.xml v934>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001277:[<0x10000000d67/comment-79.xml v1066>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.656+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml auth{0=1} v979 ap=1 s=6642 n(v0 rc2024-05-20T17:35:23.159993+0000 b6642 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87a8e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138d:[<0x10000000d67/comment-40.xml v979>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000138d:[<0x10000000d67/comment-40.xml v979>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.656+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml auth{0=1} v1054 ap=1 s=7740 n(v0 rc2024-05-20T17:35:23.613984+0000 b7740 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b5:[<0x10000000d67/comment-33.xml v993>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b5:[<0x10000000d67/comment-33.xml v1054>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.657+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg auth{0=1} v1098 ap=1 s=61972 n(v0 rc2024-05-20T17:35:16.790125+0000 b61972 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eef:[<0x10000000d67/picture-98.jpg v406>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000eef:[<0x10000000d67/picture-98.jpg v1098>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.658+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001394 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml auth{0=1} v985 ap=1 s=9130 n(v0 rc2024-05-20T17:35:23.307990+0000 b9130 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87a8ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001394:[<0x10000000d67/comment-39.xml v985>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001394:[<0x10000000d67/comment-39.xml v985>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.659+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001236 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml auth{0=1} v1070 ap=1 s=4177 n(v0 rc2024-05-20T17:35:20.103056+0000 b4177 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001236:[<0x10000000d67/comment-86.xml v911>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001236:[<0x10000000d67/comment-86.xml v1070>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.659+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg auth{0=1} v1086 ap=1 s=9085 n(v0 rc2024-05-20T17:35:18.178096+0000 b9085 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103d:[<0x10000000d67/picture-36.jpg v778>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000103d:[<0x10000000d67/picture-36.jpg v1086>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.661+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001028 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg auth{0=1} v1094 ap=1 s=47784 n(v0 rc2024-05-20T17:35:18.075099+0000 b47784 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001028:[<0x10000000d67/picture-43.jpg v736>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001028:[<0x10000000d67/picture-43.jpg v1094>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.662+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e87 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml auth{0=1} v1076 ap=1 s=21481 n(v0 rc2024-05-20T17:35:16.487131+0000 b21481 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e87:[<0x10000000d67/article-19.xml v280>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e87:[<0x10000000d67/article-19.xml v1076>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.736 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.664+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg auth{0=1} v1078 ap=1 s=9201 n(v0 rc2024-05-20T17:35:18.333093+0000 b9201 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106e:[<0x10000000d67/picture-20.jpg v874>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000106e:[<0x10000000d67/picture-20.jpg v1078>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.664+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml auth{0=1} v1068 ap=1 s=8970 n(v0 rc2024-05-20T17:35:20.297052+0000 b8970 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125d:[<0x10000000d67/comment-82.xml v928>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000125d:[<0x10000000d67/comment-82.xml v1068>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.665+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml auth{0=1} v1052 ap=1 s=7484 n(v0 rc2024-05-20T17:35:23.637983+0000 b7484 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b8:[<0x10000000d67/comment-32.xml v995>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b8:[<0x10000000d67/comment-32.xml v1052>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.665+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml auth{0=1} v1060 ap=1 s=2915 n(v0 rc2024-05-20T17:35:20.982038+0000 b2915 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012eb:[<0x10000000d67/comment-63.xml v951>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012eb:[<0x10000000d67/comment-63.xml v1060>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.667+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001325 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml auth{0=1} v1056 ap=1 s=3619 n(v0 rc2024-05-20T17:35:21.394030+0000 b3619 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001325:[<0x10000000d67/comment-54.xml v960>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001325:[<0x10000000d67/comment-54.xml v1056>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.668+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e01 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml auth{0=1} v1092 ap=1 s=9103 n(v0 rc2024-05-20T17:35:16.084140+0000 b9103 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e01:[<0x10000000d67/article-42.xml v142>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e01:[<0x10000000d67/article-42.xml v1092>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.670+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001037 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg auth{0=1} v1088 ap=1 s=37558 n(v0 rc2024-05-20T17:35:18.159097+0000 b37558 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001037:[<0x10000000d67/picture-38.jpg v766>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001037:[<0x10000000d67/picture-38.jpg v1088>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.671+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d72 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml auth{0=1} v1103 ap=1 s=3753 n(v0 rc2024-05-20T17:35:15.648149+0000 b3753 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a990680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d72:[<0x10000000d67/article-64.xml v10>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d72:[<0x10000000d67/article-64.xml v1103>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.671+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ff [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml auth{0=1} v1055 ap=1 s=3503 n(v0 rc2024-05-20T17:35:23.979976+0000 b3503 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a990100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ff:[<0x10000000d67/comment-13.xml v1039>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ff:[<0x10000000d67/comment-13.xml v1055>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.673+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml auth{0=1} v1059 ap=1 s=7593 n(v0 rc2024-05-20T17:35:23.898978+0000 b7593 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e0:[<0x10000000d67/comment-21.xml v1017>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013e0:[<0x10000000d67/comment-21.xml v1059>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.674+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml auth{0=1} v1061 ap=1 s=8868 n(v0 rc2024-05-20T17:35:23.820979+0000 b8868 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013cf:[<0x10000000d67/comment-26.xml v1011>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013cf:[<0x10000000d67/comment-26.xml v1061>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.737 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.675+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e21 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml auth{0=1} v1091 ap=1 s=4404 n(v0 rc2024-05-20T17:35:16.186138+0000 b4404 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e21:[<0x10000000d67/article-37.xml v172>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e21:[<0x10000000d67/article-37.xml v1091>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.675+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001059 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg auth{0=1} v1083 ap=1 s=41356 n(v0 rc2024-05-20T17:35:18.270095+0000 b41356 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001059:[<0x10000000d67/picture-27.jpg v832>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001059:[<0x10000000d67/picture-27.jpg v1083>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.677+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e12 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml auth{0=1} v1093 ap=1 s=8551 n(v0 rc2024-05-20T17:35:16.144139+0000 b8551 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e12:[<0x10000000d67/article-39.xml v160>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e12:[<0x10000000d67/article-39.xml v1093>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.678+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e27 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml auth{0=1} v1089 ap=1 s=4095 n(v0 rc2024-05-20T17:35:16.208137+0000 b4095 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e27:[<0x10000000d67/article-36.xml v178>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e27:[<0x10000000d67/article-36.xml v1089>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.679+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml auth{0=1} v1075 ap=1 s=26344 n(v0 rc2024-05-20T17:35:16.601129+0000 b26344 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a1fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea9:[<0x10000000d67/article-12.xml v322>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ea9:[<0x10000000d67/article-12.xml v1075>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.680+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001006 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg auth{0=1} v1097 ap=1 s=17551 n(v0 rc2024-05-20T17:35:17.933101+0000 b17551 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001006:[<0x10000000d67/picture-52.jpg v682>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001006:[<0x10000000d67/picture-52.jpg v1097>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.681+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml auth{0=1} v1073 ap=1 s=15738 n(v0 rc2024-05-20T17:35:16.749126+0000 b15738 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a20680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee0:[<0x10000000d67/article-1.xml v388>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000ee0:[<0x10000000d67/article-1.xml v1073>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.681+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml auth{0=1} v1003 ap=1 s=6582 n(v0 rc2024-05-20T17:35:23.682982+0000 b6582 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c879a20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c0:[<0x10000000d67/comment-30.xml v1003>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013c0:[<0x10000000d67/comment-30.xml v1003>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.683+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001044 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg auth{0=1} v1087 ap=1 s=56853 n(v0 rc2024-05-20T17:35:18.197096+0000 b56853 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a21180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001044:[<0x10000000d67/picture-34.jpg v790>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001044:[<0x10000000d67/picture-34.jpg v1087>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.684+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001002 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg auth{0=1} v1099 ap=1 s=12203 n(v0 rc2024-05-20T17:35:17.919102+0000 b12203 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879a21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001002:[<0x10000000d67/picture-53.jpg v676>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001002:[<0x10000000d67/picture-53.jpg v1099>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.685+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg auth{0=1} v1109 ap=1 s=18303 n(v0 rc2024-05-20T17:35:17.761105+0000 b18303 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbf:[<0x10000000d67/picture-67.jpg v592>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000fbf:[<0x10000000d67/picture-67.jpg v1109>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.738 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.685+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f19 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg auth{0=1} v1107 ap=1 s=54481 n(v0 rc2024-05-20T17:35:16.911123+0000 b54481 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f19:[<0x10000000d67/picture-90.jpg v454>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f19:[<0x10000000d67/picture-90.jpg v1107>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.686+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001422 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml auth{0=1} v1051 ap=1 s=9327 n(v0 rc2024-05-20T17:35:24.107973+0000 b9327 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001422:[<0x10000000d67/comment-3.xml v1045>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001422:[<0x10000000d67/comment-3.xml v1051>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.686+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ec [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml auth{0=1} v1057 ap=1 s=7233 n(v0 rc2024-05-20T17:35:23.929977+0000 b7233 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ec:[<0x10000000d67/comment-18.xml v1029>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013ec:[<0x10000000d67/comment-18.xml v1057>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.686+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg auth{0=1} v1077 ap=1 s=14410 n(v0 rc2024-05-20T17:35:18.368092+0000 b14410 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107b:[<0x10000000d67/picture-16.jpg v898>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000107b:[<0x10000000d67/picture-16.jpg v1077>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.687+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001402 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml auth{0=1} v1053 ap=1 s=8036 n(v0 rc2024-05-20T17:35:23.989976+0000 b8036 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a65fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001402:[<0x10000000d67/comment-12.xml v1043>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001402:[<0x10000000d67/comment-12.xml v1053>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.687+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f96 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg auth{0=1} v1105 ap=1 s=34313 n(v0 rc2024-05-20T17:35:17.523110+0000 b34313 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a660100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f96:[<0x10000000d67/picture-74.jpg v550>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f96:[<0x10000000d67/picture-74.jpg v1105>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.688+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001347 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml auth{0=1} v1065 ap=1 s=5208 n(v0 rc2024-05-20T17:35:21.892019+0000 b5208 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a660680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001347:[<0x10000000d67/comment-49.xml v968>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001347:[<0x10000000d67/comment-49.xml v1065>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.690+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml auth{0=1} v1071 ap=1 s=7219 n(v0 rc2024-05-20T17:35:20.073057+0000 b7219 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a660c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122f:[<0x10000000d67/comment-87.xml v909>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000122f:[<0x10000000d67/comment-87.xml v1071>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.690+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml auth{0=1} v1063 ap=1 s=3872 n(v0 rc2024-05-20T17:35:22.858999+0000 b3872 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a661180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137b:[<0x10000000d67/comment-42.xml v976>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000137b:[<0x10000000d67/comment-42.xml v1063>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.690+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012de [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml auth{0=1} v1069 ap=1 s=5620 n(v0 rc2024-05-20T17:35:20.939039+0000 b5620 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a661700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012de:[<0x10000000d67/comment-65.xml v941>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000012de:[<0x10000000d67/comment-65.xml v1069>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.691+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e73 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml auth{0=1} v1081 ap=1 s=6505 n(v0 rc2024-05-20T17:35:16.410133+0000 b6505 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a662000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e73:[<0x10000000d67/article-23.xml v256>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000e73:[<0x10000000d67/article-23.xml v1081>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.691+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001386 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml auth{0=1} v1079 ap=1 s=29187 n(v0 rc2024-05-20T17:35:23.115994+0000 b29187 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a662580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001386:[<0x10000000d67/article-17.xml v980>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001386:[<0x10000000d67/article-17.xml v1079>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.739 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.691+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg auth{0=1} v1111 ap=1 s=43547 n(v0 rc2024-05-20T17:35:17.479111+0000 b43547 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a662b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8c:[<0x10000000d67/picture-76.jpg v538>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000f8c:[<0x10000000d67/picture-76.jpg v1111>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.740 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.692+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg auth{0=1} v1085 ap=1 s=22333 n(v0 rc2024-05-20T17:35:18.218096+0000 b22333 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a663080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104a:[<0x10000000d67/picture-32.jpg v802>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000104a:[<0x10000000d67/picture-32.jpg v1085>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.740 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.695+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d78 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml auth{0=1} v1101 ap=1 s=18626 n(v0 rc2024-05-20T17:35:15.671148+0000 b18626 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a663600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d78:[<0x10000000d67/article-63.xml v16>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d78:[<0x10000000d67/article-63.xml v1101>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.740 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.697+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001016 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg auth{0=1} v1095 ap=1 s=62807 n(v0 rc2024-05-20T17:35:17.994100+0000 b62807 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a663b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001016:[<0x10000000d67/picture-48.jpg v706>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001016:[<0x10000000d67/picture-48.jpg v1095>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.740 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:35.698+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml auth{0=1} v1067 ap=1 s=5763 n(v0 rc2024-05-20T17:35:21.678024+0000 b5763 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a664100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133a:[<0x10000000d67/comment-51.xml v964>,<0x10000000399/blog-16 v30862>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000133a:[<0x10000000d67/comment-51.xml v1067>,<0x10000000399/blog-16 v44258>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.479+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml auth v412 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.550944+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159c:[<0x10000001453/article-26.xml v412>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000159c:[<0x10000001453/article-26.xml v412>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.479+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml auth v686 ap=1 s=19347 n(v0 rc2024-05-20T17:35:24.460966+0000 b19347 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf5d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145b:[<0x10000001453/article-93.xml v10>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000145b:[<0x10000001453/article-93.xml v686>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.480+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml auth v508 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.794938+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e7:[<0x10000001453/article-10.xml v508>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015e7:[<0x10000001453/article-10.xml v508>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.481+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001534 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml auth v598 ap=1 s=27051 n(v0 rc2024-05-20T17:35:25.072953+0000 b27051 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf5db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001534:[<0x10000001453/article-48.xml v280>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001534:[<0x10000001453/article-48.xml v598>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.482+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001603 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml auth v544 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.867937+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001603:[<0x10000001453/article-4.xml v544>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001603:[<0x10000001453/article-4.xml v544>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.483+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml auth v418 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.577943+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a1:[<0x10000001453/article-25.xml v418>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015a1:[<0x10000001453/article-25.xml v418>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.484+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001564 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml auth v340 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.282949+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001564:[<0x10000001453/article-38.xml v340>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001564:[<0x10000001453/article-38.xml v340>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.484+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml auth v644 ap=1 s=12726 n(v0 rc2024-05-20T17:35:24.801959+0000 b12726 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014bb:[<0x10000001453/article-72.xml v136>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014bb:[<0x10000001453/article-72.xml v644>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.844 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.485+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001572 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml auth v358 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.338948+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001572:[<0x10000001453/article-35.xml v358>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001572:[<0x10000001453/article-35.xml v358>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.486+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml auth v672 ap=1 s=24108 n(v0 rc2024-05-20T17:35:24.600963+0000 b24108 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf72000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147a:[<0x10000001453/article-86.xml v52>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000147a:[<0x10000001453/article-86.xml v672>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.487+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000155b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml auth v328 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.242950+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000155b:[<0x10000001453/article-40.xml v328>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000155b:[<0x10000001453/article-40.xml v328>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.487+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml auth v664 ap=1 s=27943 n(v0 rc2024-05-20T17:35:24.654962+0000 b27943 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf72b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148d:[<0x10000001453/article-82.xml v76>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000148d:[<0x10000001453/article-82.xml v664>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.488+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml auth v478 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.737940+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf73080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cf:[<0x10000001453/article-15.xml v478>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015cf:[<0x10000001453/article-15.xml v478>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.489+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml auth v454 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.693941+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf73600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015bd:[<0x10000001453/article-19.xml v454>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015bd:[<0x10000001453/article-19.xml v454>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.489+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml auth v678 ap=1 s=28007 n(v0 rc2024-05-20T17:35:24.542964+0000 b28007 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf73b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146c:[<0x10000001453/article-89.xml v34>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000146c:[<0x10000001453/article-89.xml v678>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.490+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001551 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml auth v316 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.204951+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf74100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001551:[<0x10000001453/article-42.xml v316>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001551:[<0x10000001453/article-42.xml v316>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.491+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml auth v630 ap=1 s=1716 n(v0 rc2024-05-20T17:35:24.911957+0000 b1716 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf74680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e2:[<0x10000001453/article-64.xml v184>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014e2:[<0x10000001453/article-64.xml v630>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.845 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.491+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001475 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml auth v674 ap=1 s=22397 n(v0 rc2024-05-20T17:35:24.581964+0000 b22397 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf74c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001475:[<0x10000001453/article-87.xml v46>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001475:[<0x10000001453/article-87.xml v674>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.492+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml auth v650 ap=1 s=8033 n(v0 rc2024-05-20T17:35:24.759960+0000 b8033 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf75180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ad:[<0x10000001453/article-75.xml v118>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014ad:[<0x10000001453/article-75.xml v650>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.492+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001569 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml auth v346 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.300949+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001569:[<0x10000001453/article-37.xml v346>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001569:[<0x10000001453/article-37.xml v346>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.493+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml auth v646 ap=1 s=2439 n(v0 rc2024-05-20T17:35:24.785959+0000 b2439 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b7:[<0x10000001453/article-73.xml v130>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014b7:[<0x10000001453/article-73.xml v646>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.493+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000155f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml auth v334 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.261950+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000155f:[<0x10000001453/article-39.xml v334>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000155f:[<0x10000001453/article-39.xml v334>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.494+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000156d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml auth v352 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.319948+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000156d:[<0x10000001453/article-36.xml v352>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x1000000156d:[<0x10000001453/article-36.xml v352>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.495+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015dd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml auth v496 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.771939+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015dd:[<0x10000001453/article-12.xml v496>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015dd:[<0x10000001453/article-12.xml v496>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.495+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001611 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml auth v562 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.902936+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf7f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001611:[<0x10000001453/article-1.xml v562>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000001611:[<0x10000001453/article-1.xml v562>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.496+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml auth v634 ap=1 s=24484 n(v0 rc2024-05-20T17:35:24.884957+0000 b24484 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d7:[<0x10000001453/article-66.xml v172>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014d7:[<0x10000001453/article-66.xml v634>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.497+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml auth v654 ap=1 s=1112 n(v0 rc2024-05-20T17:35:24.736960+0000 b1112 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a4:[<0x10000001453/article-77.xml v106>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014a4:[<0x10000001453/article-77.xml v654>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.846 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.497+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015aa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml auth v430 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.632942+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015aa:[<0x10000001453/article-23.xml v430>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015aa:[<0x10000001453/article-23.xml v430>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.498+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml auth v466 ap=1 s=0 n(v0 rc2024-05-20T17:35:25.715940+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=25025 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cdf80c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c6:[<0x10000001453/article-17.xml v466>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000015c6:[<0x10000001453/article-17.xml v466>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.499+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml auth v628 ap=1 s=8243 n(v0 rc2024-05-20T17:35:24.922957+0000 b8243 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f0cdf81180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e7:[<0x10000001453/article-63.xml v190>,<0x10000000399/blog-27 v34266>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000014e7:[<0x10000001453/article-63.xml v628>,<0x10000000399/blog-27 v46414>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.499+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml auth v1089 ap=1 s=24015 n(v0 rc2024-05-20T17:35:05.688355+0000 b24015 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c9:[<0x1000000039e/article-64.xml v1089>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c9:[<0x1000000039e/article-64.xml v1089>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.500+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml auth v1073 ap=1 s=5776 n(v0 rc2024-05-20T17:35:09.798270+0000 b5776 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c3:[<0x1000000039e/comment-13.xml v1073>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008c3:[<0x1000000039e/comment-13.xml v1073>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.501+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml auth v1083 ap=1 s=3170 n(v0 rc2024-05-20T17:35:09.752271+0000 b3170 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b3:[<0x1000000039e/comment-21.xml v1083>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008b3:[<0x1000000039e/comment-21.xml v1083>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.501+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml auth v1109 ap=1 s=9625 n(v0 rc2024-05-20T17:35:09.724271+0000 b9625 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a9:[<0x1000000039e/comment-26.xml v1109>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008a9:[<0x1000000039e/comment-26.xml v1109>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.502+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml auth v1103 ap=1 s=23076 n(v0 rc2024-05-20T17:35:05.629356+0000 b23076 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a9:[<0x1000000039e/article-75.xml v1103>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003a9:[<0x1000000039e/article-75.xml v1103>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.502+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml auth v1081 ap=1 s=4640 n(v0 rc2024-05-20T17:35:05.825352+0000 b4640 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041a:[<0x1000000039e/article-37.xml v1081>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000041a:[<0x1000000039e/article-37.xml v1081>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.503+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg auth v1113 ap=1 s=54882 n(v0 rc2024-05-20T17:35:06.434339+0000 b54882 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f1:[<0x1000000039e/picture-27.jpg v1113>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f1:[<0x1000000039e/picture-27.jpg v1113>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.847 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.504+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml auth v1065 ap=1 s=30178 n(v0 rc2024-05-20T17:35:05.640356+0000 b30178 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ad:[<0x1000000039e/article-73.xml v1065>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ad:[<0x1000000039e/article-73.xml v1065>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.504+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000414 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml auth v1091 ap=1 s=20823 n(v0 rc2024-05-20T17:35:05.813352+0000 b20823 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000414:[<0x1000000039e/article-39.xml v1091>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000414:[<0x1000000039e/article-39.xml v1091>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.505+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml auth v1085 ap=1 s=1865 n(v0 rc2024-05-20T17:35:05.833352+0000 b1865 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041e:[<0x1000000039e/article-36.xml v1085>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000041e:[<0x1000000039e/article-36.xml v1085>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.506+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000465 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml auth v1093 ap=1 s=28769 n(v0 rc2024-05-20T17:35:06.046347+0000 b28769 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@19},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000465:[<0x1000000039e/article-12.xml v1093>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000465:[<0x1000000039e/article-12.xml v1093>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.506+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg auth v1097 ap=1 s=27343 n(v0 rc2024-05-20T17:35:06.283343+0000 b27343 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bf:[<0x1000000039e/picture-52.jpg v1097>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004bf:[<0x1000000039e/picture-52.jpg v1097>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.507+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000486 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml auth{0=1} v1127 ap=1 s=27450 n(v0 rc2024-05-20T17:35:06.156345+0000 b27450 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd52ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000486:[<0x1000000039e/article-1.xml v1069>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000486:[<0x1000000039e/article-1.xml v1127>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.508+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml auth v1105 ap=1 s=2878 n(v0 rc2024-05-20T17:35:09.690272+0000 b2878 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089f:[<0x1000000039e/comment-30.xml v1105>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000089f:[<0x1000000039e/comment-30.xml v1105>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.508+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg auth v1087 ap=1 s=10517 n(v0 rc2024-05-20T17:35:06.389340+0000 b10517 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd52f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e3:[<0x1000000039e/picture-34.jpg v1087>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e3:[<0x1000000039e/picture-34.jpg v1087>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.509+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg auth v1079 ap=1 s=18333 n(v0 rc2024-05-20T17:35:06.278343+0000 b18333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd538000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bd:[<0x1000000039e/picture-53.jpg v1079>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004bd:[<0x1000000039e/picture-53.jpg v1079>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.509+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000495 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg auth v1107 ap=1 s=18712 n(v0 rc2024-05-20T17:35:06.201344+0000 b18712 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd538580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000495:[<0x1000000039e/picture-67.jpg v1107>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000495:[<0x1000000039e/picture-67.jpg v1107>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.510+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml auth{0=1} v1125 ap=1 s=4106 n(v0 rc2024-05-20T17:35:09.876268+0000 b4106 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd538b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d7:[<0x1000000039e/comment-3.xml v1099>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008d7:[<0x1000000039e/comment-3.xml v1125>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.848 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.511+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml auth v1071 ap=1 s=4857 n(v0 rc2024-05-20T17:35:09.770270+0000 b4857 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd539080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b9:[<0x1000000039e/comment-18.xml v1071>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008b9:[<0x1000000039e/comment-18.xml v1071>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.511+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml auth v1063 ap=1 s=31851 n(v0 rc2024-05-20T17:35:05.678355+0000 b31851 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd539600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c3:[<0x1000000039e/article-66.xml v1063>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c3:[<0x1000000039e/article-66.xml v1063>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.512+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000507 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg auth v1095 ap=1 s=59917 n(v0 rc2024-05-20T17:35:06.498338+0000 b59917 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd539b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000507:[<0x1000000039e/picture-16.jpg v1095>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000507:[<0x1000000039e/picture-16.jpg v1095>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.513+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml auth v1055 ap=1 s=5429 n(v0 rc2024-05-20T17:35:05.618356+0000 b5429 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd53a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a2:[<0x1000000039e/article-77.xml v1055>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003a2:[<0x1000000039e/article-77.xml v1055>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.514+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml auth v1075 ap=1 s=2485 n(v0 rc2024-05-20T17:35:09.804270+0000 b2485 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd53a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c5:[<0x1000000039e/comment-12.xml v1075>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008c5:[<0x1000000039e/comment-12.xml v1075>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.515+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000860 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml auth v1111 ap=1 s=2870 n(v0 rc2024-05-20T17:35:09.496276+0000 b2870 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd53ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000860:[<0x1000000039e/comment-49.xml v1111>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000860:[<0x1000000039e/comment-49.xml v1111>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.515+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml auth v1115 ap=1 s=8512 n(v0 rc2024-05-20T17:35:09.087285+0000 b8512 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd53b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e8:[<0x1000000039e/comment-87.xml v1115>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007e8:[<0x1000000039e/comment-87.xml v1115>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.516+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000875 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml auth v1101 ap=1 s=3539 n(v0 rc2024-05-20T17:35:09.559275+0000 b3539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd53b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000875:[<0x1000000039e/comment-42.xml v1101>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000875:[<0x1000000039e/comment-42.xml v1101>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.517+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml auth v1119 ap=1 s=9036 n(v0 rc2024-05-20T17:35:09.337279+0000 b9036 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd542000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082f:[<0x1000000039e/comment-65.xml v1119>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000082f:[<0x1000000039e/comment-65.xml v1119>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.518+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000444 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml auth v1067 ap=1 s=28078 n(v0 rc2024-05-20T17:35:05.948349+0000 b28078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd542580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000444:[<0x1000000039e/article-23.xml v1067>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000444:[<0x1000000039e/article-23.xml v1067>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.849 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.518+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000456 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml auth v1057 ap=1 s=5870 n(v0 rc2024-05-20T17:35:06.001348+0000 b5870 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd542b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000456:[<0x1000000039e/article-17.xml v1057>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000456:[<0x1000000039e/article-17.xml v1057>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.519+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg auth v1061 ap=1 s=22004 n(v0 rc2024-05-20T17:35:06.404340+0000 b22004 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd543080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e7:[<0x1000000039e/picture-32.jpg v1061>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e7:[<0x1000000039e/picture-32.jpg v1061>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.519+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml auth v1059 ap=1 s=13561 n(v0 rc2024-05-20T17:35:05.693355+0000 b13561 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd543600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cc:[<0x1000000039e/article-63.xml v1059>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003cc:[<0x1000000039e/article-63.xml v1059>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.520+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg auth v1077 ap=1 s=33053 n(v0 rc2024-05-20T17:35:06.308342+0000 b33053 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd543b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c7:[<0x1000000039e/picture-48.jpg v1077>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c7:[<0x1000000039e/picture-48.jpg v1077>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.520+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000859 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml auth v1117 ap=1 s=3270 n(v0 rc2024-05-20T17:35:09.478276+0000 b3270 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd544100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000859:[<0x1000000039e/comment-51.xml v1117>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000859:[<0x1000000039e/comment-51.xml v1117>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.521+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg auth{0=1} v1032 ap=1 s=30870 n(v0 rc2024-05-20T17:35:06.457339+0000 b30870 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd85f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f9:[<0x1000000039e/picture-23.jpg v1032>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f9:[<0x1000000039e/picture-23.jpg v1032>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.522+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml auth{0=1} v1064 ap=1 s=8491 n(v0 rc2024-05-20T17:35:06.029348+0000 b8491 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd85f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045f:[<0x1000000039e/article-14.xml v1064>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000045f:[<0x1000000039e/article-14.xml v1064>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.522+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg auth{0=1} v1030 ap=1 s=45264 n(v0 rc2024-05-20T17:35:06.325342+0000 b45264 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd85fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cd:[<0x1000000039e/picture-45.jpg v1030>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004cd:[<0x1000000039e/picture-45.jpg v1030>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.523+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg auth{0=1} v1014 ap=1 s=65398 n(v0 rc2024-05-20T17:35:06.348341+0000 b65398 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd860100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d5:[<0x1000000039e/picture-41.jpg v1014>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d5:[<0x1000000039e/picture-41.jpg v1014>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.523+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000838 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml auth{0=1} v1018 ap=1 s=4344 n(v0 rc2024-05-20T17:35:09.373279+0000 b4344 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd860680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000838:[<0x1000000039e/comment-62.xml v1018>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000838:[<0x1000000039e/comment-62.xml v1018>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.850 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.524+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004aa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg auth v1028 ap=1 s=50108 n(v0 rc2024-05-20T17:35:06.240343+0000 b50108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@50},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd860c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004aa:[<0x1000000039e/picture-60.jpg v1028>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004aa:[<0x1000000039e/picture-60.jpg v1028>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.525+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fe [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml auth{0=1} v1066 ap=1 s=13792 n(v0 rc2024-05-20T17:35:05.776353+0000 b13792 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd861180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fe:[<0x1000000039e/article-46.xml v1066>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003fe:[<0x1000000039e/article-46.xml v1066>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.525+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000498 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg auth v1056 ap=1 s=63337 n(v0 rc2024-05-20T17:35:06.208344+0000 b63337 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd861700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000498:[<0x1000000039e/picture-66.jpg v1056>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000498:[<0x1000000039e/picture-66.jpg v1056>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.526+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml auth{0=1} v1016 ap=1 s=26928 n(v0 rc2024-05-20T17:35:05.771353+0000 b26928 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd500000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fc:[<0x1000000039e/article-47.xml v1016>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003fc:[<0x1000000039e/article-47.xml v1016>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.526+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml auth v1020 ap=1 s=14663 n(v0 rc2024-05-20T17:35:05.652356+0000 b14663 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@81},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd500580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b5:[<0x1000000039e/article-71.xml v1020>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003b5:[<0x1000000039e/article-71.xml v1020>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.526+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg auth{0=1} v1040 ap=1 s=54709 n(v0 rc2024-05-20T17:35:06.463339+0000 b54709 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd500b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fb:[<0x1000000039e/picture-22.jpg v1040>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004fb:[<0x1000000039e/picture-22.jpg v1040>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.527+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000468 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml auth{0=1} v1060 ap=1 s=12316 n(v0 rc2024-05-20T17:35:06.054347+0000 b12316 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd501080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000468:[<0x1000000039e/article-11.xml v1060>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000468:[<0x1000000039e/article-11.xml v1060>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.528+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000459 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml auth{0=1} v1044 ap=1 s=24703 n(v0 rc2024-05-20T17:35:06.010348+0000 b24703 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd501b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000459:[<0x1000000039e/article-16.xml v1044>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000459:[<0x1000000039e/article-16.xml v1044>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.528+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml auth{0=1} v1038 ap=1 s=9986 n(v0 rc2024-05-20T17:35:09.216282+0000 b9986 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd502100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080b:[<0x1000000039e/comment-77.xml v1038>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000080b:[<0x1000000039e/comment-77.xml v1038>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.529+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml auth v1042 ap=1 s=31323 n(v0 rc2024-05-20T17:35:05.738354+0000 b31323 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd502680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e7:[<0x1000000039e/article-54.xml v1042>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003e7:[<0x1000000039e/article-54.xml v1042>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.851 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.531+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml auth{0=1} v1062 ap=1 s=24907 n(v0 rc2024-05-20T17:35:05.919350+0000 b24907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd502c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043c:[<0x1000000039e/article-26.xml v1062>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000043c:[<0x1000000039e/article-26.xml v1062>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.531+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000509 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg auth{0=1} v1026 ap=1 s=51638 n(v0 rc2024-05-20T17:35:06.503338+0000 b51638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd503180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000509:[<0x1000000039e/picture-15.jpg v1026>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000509:[<0x1000000039e/picture-15.jpg v1026>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.532+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg auth v1034 ap=1 s=24019 n(v0 rc2024-05-20T17:35:06.263343+0000 b24019 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd503700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b6:[<0x1000000039e/picture-56.jpg v1034>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004b6:[<0x1000000039e/picture-56.jpg v1034>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.533+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg auth{0=1} v1024 ap=1 s=21634 n(v0 rc2024-05-20T17:35:06.314342+0000 b21634 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c9:[<0x1000000039e/picture-47.jpg v1024>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c9:[<0x1000000039e/picture-47.jpg v1024>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.534+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml auth{0=1} v1010 ap=1 s=21595 n(v0 rc2024-05-20T17:35:06.063347+0000 b21595 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046c:[<0x1000000039e/article-10.xml v1010>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000046c:[<0x1000000039e/article-10.xml v1010>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.534+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000510 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg auth{0=1} v1012 ap=1 s=38135 n(v0 rc2024-05-20T17:35:06.520338+0000 b38135 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000510:[<0x1000000039e/picture-12.jpg v1012>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000510:[<0x1000000039e/picture-12.jpg v1012>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.535+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg auth{0=1} v1046 ap=1 s=23782 n(v0 rc2024-05-20T17:35:06.331342+0000 b23782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cf:[<0x1000000039e/picture-44.jpg v1046>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004cf:[<0x1000000039e/picture-44.jpg v1046>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.535+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml auth{0=1} v1070 ap=1 s=8345 n(v0 rc2024-05-20T17:35:09.487276+0000 b8345 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085d:[<0x1000000039e/comment-50.xml v1070>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000085d:[<0x1000000039e/comment-50.xml v1070>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.536+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fa [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml auth{0=1} v1072 ap=1 s=12981 n(v0 rc2024-05-20T17:35:05.766353+0000 b12981 1=1+0) caps={25025=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd4ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fa:[<0x1000000039e/article-48.xml v1048>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003fa:[<0x1000000039e/article-48.xml v1072>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.537+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000863 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml auth{0=1} v1050 ap=1 s=6472 n(v0 rc2024-05-20T17:35:09.506276+0000 b6472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000863:[<0x1000000039e/comment-48.xml v1050>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000863:[<0x1000000039e/comment-48.xml v1050>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.852 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.537+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml auth{0=1} v1022 ap=1 s=5492 n(v0 rc2024-05-20T17:35:06.124346+0000 b5492 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047d:[<0x1000000039e/article-4.xml v1022>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000047d:[<0x1000000039e/article-4.xml v1022>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.538+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml auth{0=1} v1054 ap=1 s=16429 n(v0 rc2024-05-20T17:35:05.929350+0000 b16429 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043e:[<0x1000000039e/article-25.xml v1054>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000043e:[<0x1000000039e/article-25.xml v1054>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.538+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg auth v1052 ap=1 s=24391 n(v0 rc2024-05-20T17:35:06.246343+0000 b24391 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd4df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ad:[<0x1000000039e/picture-59.jpg v1052>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ad:[<0x1000000039e/picture-59.jpg v1052>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.539+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000416 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml auth{0=1} v1058 ap=1 s=10480 n(v0 rc2024-05-20T17:35:05.818352+0000 b10480 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd4df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000416:[<0x1000000039e/article-38.xml v1058>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000416:[<0x1000000039e/article-38.xml v1058>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.540+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml auth v1096 ap=1 s=2939 n(v0 rc2024-05-20T17:35:09.167283+0000 b2939 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fd:[<0x1000000039e/comment-81.xml v1096>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007fd:[<0x1000000039e/comment-81.xml v1096>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.540+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml auth v1054 ap=1 s=6319 n(v0 rc2024-05-20T17:35:09.821269+0000 b6319 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c9:[<0x1000000039e/comment-10.xml v1054>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008c9:[<0x1000000039e/comment-10.xml v1054>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.541+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000522 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg auth{0=1} v1104 ap=1 s=28945 n(v0 rc2024-05-20T17:35:06.570337+0000 b28945 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f0cd6b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000522:[<0x1000000039e/picture-3.jpg v1074>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000522:[<0x1000000039e/picture-3.jpg v1104>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.542+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml auth v1088 ap=1 s=2765 n(v0 rc2024-05-20T17:35:09.459277+0000 b2765 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x1000000039e/comment-53.xml v1088>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000853:[<0x1000000039e/comment-53.xml v1088>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.542+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml auth{0=1} v1102 ap=1 s=3709 n(v0 rc2024-05-20T17:35:09.853269+0000 b3709 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f0cd6ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d1:[<0x1000000039e/comment-6.xml v1062>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008d1:[<0x1000000039e/comment-6.xml v1102>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.853 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.543+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg auth v1068 ap=1 s=18275 n(v0 rc2024-05-20T17:35:06.269343+0000 b18275 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b9:[<0x1000000039e/picture-55.jpg v1068>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004b9:[<0x1000000039e/picture-55.jpg v1068>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.543+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml auth v1082 ap=1 s=3637 n(v0 rc2024-05-20T17:35:09.110284+0000 b3637 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ef:[<0x1000000039e/comment-85.xml v1082>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007ef:[<0x1000000039e/comment-85.xml v1082>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.544+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000512 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg auth v1050 ap=1 s=61099 n(v0 rc2024-05-20T17:35:06.525338+0000 b61099 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@39},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000512:[<0x1000000039e/picture-11.jpg v1050>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000512:[<0x1000000039e/picture-11.jpg v1050>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.544+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg auth v1080 ap=1 s=35705 n(v0 rc2024-05-20T17:35:06.176345+0000 b35705 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048d:[<0x1000000039e/picture-70.jpg v1080>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000048d:[<0x1000000039e/picture-70.jpg v1080>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.545+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml auth v1060 ap=1 s=21642 n(v0 rc2024-05-20T17:35:06.112346+0000 b21642 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@48},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047b:[<0x1000000039e/article-5.xml v1060>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000047b:[<0x1000000039e/article-5.xml v1060>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.546+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000423 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml auth v1052 ap=1 s=18503 n(v0 rc2024-05-20T17:35:05.851351+0000 b18503 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000423:[<0x1000000039e/article-34.xml v1052>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000423:[<0x1000000039e/article-34.xml v1052>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.547+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml auth v1094 ap=1 s=5850 n(v0 rc2024-05-20T17:35:09.709272+0000 b5850 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a4:[<0x1000000039e/comment-28.xml v1094>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008a4:[<0x1000000039e/comment-28.xml v1094>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.548+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml auth v1058 ap=1 s=19156 n(v0 rc2024-05-20T17:35:05.613356+0000 b19156 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039f:[<0x1000000039e/article-78.xml v1058>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000039f:[<0x1000000039e/article-78.xml v1058>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.548+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg auth v1048 ap=1 s=54164 n(v0 rc2024-05-20T17:35:06.166345+0000 b54164 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@81},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048a:[<0x1000000039e/picture-71.jpg v1048>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000048a:[<0x1000000039e/picture-71.jpg v1048>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.854 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.549+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000432 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml auth v1076 ap=1 s=31229 n(v0 rc2024-05-20T17:35:05.893351+0000 b31229 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000432:[<0x1000000039e/article-29.xml v1076>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000432:[<0x1000000039e/article-29.xml v1076>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.549+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml auth v1078 ap=1 s=16202 n(v0 rc2024-05-20T17:35:05.708354+0000 b16202 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@50},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d5:[<0x1000000039e/article-60.xml v1078>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d5:[<0x1000000039e/article-60.xml v1078>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.550+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg auth v1056 ap=1 s=44405 n(v0 rc2024-05-20T17:35:06.223344+0000 b44405 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a1:[<0x1000000039e/picture-63.jpg v1056>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004a1:[<0x1000000039e/picture-63.jpg v1056>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.551+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg auth v1046 ap=1 s=43263 n(v0 rc2024-05-20T17:35:06.354341+0000 b43263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d7:[<0x1000000039e/picture-40.jpg v1046>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d7:[<0x1000000039e/picture-40.jpg v1046>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.552+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000448 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml auth v1092 ap=1 s=10309 n(v0 rc2024-05-20T17:35:05.956349+0000 b10309 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000448:[<0x1000000039e/article-22.xml v1092>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000448:[<0x1000000039e/article-22.xml v1092>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.553+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000826 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml auth v1064 ap=1 s=7570 n(v0 rc2024-05-20T17:35:09.305280+0000 b7570 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000826:[<0x1000000039e/comment-68.xml v1064>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000826:[<0x1000000039e/comment-68.xml v1064>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.553+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml auth v1044 ap=1 s=28872 n(v0 rc2024-05-20T17:35:05.762353+0000 b28872 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f6:[<0x1000000039e/article-49.xml v1044>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003f6:[<0x1000000039e/article-49.xml v1044>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.554+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml auth v1090 ap=1 s=7966 n(v0 rc2024-05-20T17:35:09.837269+0000 b7966 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cd:[<0x1000000039e/comment-8.xml v1090>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008cd:[<0x1000000039e/comment-8.xml v1090>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.554+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000800 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml auth v1084 ap=1 s=9602 n(v0 rc2024-05-20T17:35:09.179283+0000 b9602 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000800:[<0x1000000039e/comment-80.xml v1084>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000800:[<0x1000000039e/comment-80.xml v1084>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.555+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml auth v1073 ap=1 s=2672 n(v0 rc2024-05-20T17:35:09.746271+0000 b2672 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd615600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b1:[<0x1000000039e/comment-22.xml v1073>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008b1:[<0x1000000039e/comment-22.xml v1073>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.855 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.556+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml auth{0=1} v1101 ap=1 s=5331 n(v0 rc2024-05-20T17:35:09.883268+0000 b5331 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd615b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d9:[<0x1000000039e/comment-2.xml v1101>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008d9:[<0x1000000039e/comment-2.xml v1101>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.556+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml auth v1057 ap=1 s=5786 n(v0 rc2024-05-20T17:35:09.542275+0000 b5786 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd616100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086f:[<0x1000000039e/comment-44.xml v1057>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000086f:[<0x1000000039e/comment-44.xml v1057>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.557+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000408 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml auth v1047 ap=1 s=26058 n(v0 rc2024-05-20T17:35:05.791353+0000 b26058 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd616680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000408:[<0x1000000039e/article-43.xml v1047>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000408:[<0x1000000039e/article-43.xml v1047>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.557+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000426 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml auth v1055 ap=1 s=11793 n(v0 rc2024-05-20T17:35:05.859351+0000 b11793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd616c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000426:[<0x1000000039e/article-33.xml v1055>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000426:[<0x1000000039e/article-33.xml v1055>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.558+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ce [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml auth v1105 ap=1 s=9819 n(v0 rc2024-05-20T17:35:09.011286+0000 b9819 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd617180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ce:[<0x1000000039e/comment-93.xml v1105>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007ce:[<0x1000000039e/comment-93.xml v1105>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.558+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg auth v1053 ap=1 s=56511 n(v0 rc2024-05-20T17:35:06.558337+0000 b56511 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@48},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd617700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051e:[<0x1000000039e/picture-5.jpg v1053>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000051e:[<0x1000000039e/picture-5.jpg v1053>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.559+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml auth v1107 ap=1 s=6324 n(v0 rc2024-05-20T17:35:09.718272+0000 b6324 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd696000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a7:[<0x1000000039e/comment-27.xml v1107>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008a7:[<0x1000000039e/comment-27.xml v1107>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.560+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml auth v1069 ap=1 s=8120 n(v0 rc2024-05-20T17:35:09.226282+0000 b8120 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd696b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080e:[<0x1000000039e/comment-76.xml v1069>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000080e:[<0x1000000039e/comment-76.xml v1069>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.561+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg auth v1063 ap=1 s=61854 n(v0 rc2024-05-20T17:35:06.251343+0000 b61854 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd697080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b0:[<0x1000000039e/picture-58.jpg v1063>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004b0:[<0x1000000039e/picture-58.jpg v1063>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.561+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003de [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml auth v1051 ap=1 s=28096 n(v0 rc2024-05-20T17:35:05.723354+0000 b28096 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd697600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003de:[<0x1000000039e/article-57.xml v1051>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003de:[<0x1000000039e/article-57.xml v1051>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.856 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.562+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000856 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml auth v1065 ap=1 s=7275 n(v0 rc2024-05-20T17:35:09.468277+0000 b7275 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd697b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000856:[<0x1000000039e/comment-52.xml v1065>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000856:[<0x1000000039e/comment-52.xml v1065>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.563+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml auth v1079 ap=1 s=4570 n(v0 rc2024-05-20T17:35:09.326280+0000 b4570 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd698100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082c:[<0x1000000039e/comment-66.xml v1079>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000082c:[<0x1000000039e/comment-66.xml v1079>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.563+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg auth v1049 ap=1 s=8413 n(v0 rc2024-05-20T17:35:06.213344+0000 b8413 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd698680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049b:[<0x1000000039e/picture-65.jpg v1049>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000049b:[<0x1000000039e/picture-65.jpg v1049>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.564+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml auth v1087 ap=1 s=8046 n(v0 rc2024-05-20T17:35:09.845269+0000 b8046 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd698c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cf:[<0x1000000039e/comment-7.xml v1087>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008cf:[<0x1000000039e/comment-7.xml v1087>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.565+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml auth v1093 ap=1 s=7418 n(v0 rc2024-05-20T17:35:09.787270+0000 b7418 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd699180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bf:[<0x1000000039e/comment-15.xml v1093>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008bf:[<0x1000000039e/comment-15.xml v1093>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.566+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003db [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml auth v1077 ap=1 s=21993 n(v0 rc2024-05-20T17:35:05.718354+0000 b21993 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd699700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003db:[<0x1000000039e/article-58.xml v1077>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003db:[<0x1000000039e/article-58.xml v1077>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.567+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003eb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml auth v1081 ap=1 s=13275 n(v0 rc2024-05-20T17:35:05.742354+0000 b13275 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003eb:[<0x1000000039e/article-53.xml v1081>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003eb:[<0x1000000039e/article-53.xml v1081>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.567+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000872 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml auth v1083 ap=1 s=6504 n(v0 rc2024-05-20T17:35:09.550275+0000 b6504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000872:[<0x1000000039e/comment-43.xml v1083>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000872:[<0x1000000039e/comment-43.xml v1083>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.568+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml auth v1067 ap=1 s=8577 n(v0 rc2024-05-20T17:35:09.775270+0000 b8577 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bb:[<0x1000000039e/comment-17.xml v1067>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008bb:[<0x1000000039e/comment-17.xml v1067>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.857 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.569+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml auth v1103 ap=1 s=5473 n(v0 rc2024-05-20T17:35:09.829269+0000 b5473 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cb:[<0x1000000039e/comment-9.xml v1103>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008cb:[<0x1000000039e/comment-9.xml v1103>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.570+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ee [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml auth v1089 ap=1 s=24381 n(v0 rc2024-05-20T17:35:05.747354+0000 b24381 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd69fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ee:[<0x1000000039e/article-52.xml v1089>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ee:[<0x1000000039e/article-52.xml v1089>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.571+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg auth v1061 ap=1 s=48010 n(v0 rc2024-05-20T17:35:06.189344+0000 b48010 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048f:[<0x1000000039e/picture-69.jpg v1061>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000048f:[<0x1000000039e/picture-69.jpg v1061>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.571+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml auth v1095 ap=1 s=9700 n(v0 rc2024-05-20T17:35:08.893289+0000 b9700 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@31},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a8:[<0x1000000039e/comment-99.xml v1095>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007a8:[<0x1000000039e/comment-99.xml v1095>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.572+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg auth v1085 ap=1 s=38087 n(v0 rc2024-05-20T17:35:06.289342+0000 b38087 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c1:[<0x1000000039e/picture-51.jpg v1085>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c1:[<0x1000000039e/picture-51.jpg v1085>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.572+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml auth v1071 ap=1 s=6226 n(v0 rc2024-05-20T17:35:09.533275+0000 b6226 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@8},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086c:[<0x1000000039e/comment-45.xml v1071>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000086c:[<0x1000000039e/comment-45.xml v1071>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.573+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg auth v1059 ap=1 s=42158 n(v0 rc2024-05-20T17:35:06.229344+0000 b42158 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a4:[<0x1000000039e/picture-62.jpg v1059>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004a4:[<0x1000000039e/picture-62.jpg v1059>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.573+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml auth v1097 ap=1 s=7706 n(v0 rc2024-05-20T17:35:09.122284+0000 b7706 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f2:[<0x1000000039e/comment-84.xml v1097>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007f2:[<0x1000000039e/comment-84.xml v1097>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.574+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg auth v1075 ap=1 s=21095 n(v0 rc2024-05-20T17:35:06.319342+0000 b21095 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd6b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cb:[<0x1000000039e/picture-46.jpg v1075>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004cb:[<0x1000000039e/picture-46.jpg v1075>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.575+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg auth{0=1} v1106 ap=1 s=62841 n(v0 rc2024-05-20T17:35:06.445339+0000 b62841 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f5:[<0x1000000039e/picture-25.jpg v1106>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f5:[<0x1000000039e/picture-25.jpg v1106>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.858 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.576+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml auth{0=1} v1121 ap=1 s=7698 n(v0 rc2024-05-20T17:35:08.932288+0000 b7698 1=1+0) caps={25025=pAsLsXsFscr/pFscr@6} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd8b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b7:[<0x1000000039e/comment-97.xml v1074>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007b7:[<0x1000000039e/comment-97.xml v1121>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.576+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000471 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml auth{0=1} v1090 ap=1 s=16401 n(v0 rc2024-05-20T17:35:06.082347+0000 b16401 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000471:[<0x1000000039e/article-8.xml v1090>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000471:[<0x1000000039e/article-8.xml v1090>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.576+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000866 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml auth{0=1} v1062 ap=1 s=6483 n(v0 rc2024-05-20T17:35:09.515276+0000 b6483 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000866:[<0x1000000039e/comment-47.xml v1062>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000866:[<0x1000000039e/comment-47.xml v1062>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.577+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000869 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml auth{0=1} v1100 ap=1 s=8208 n(v0 rc2024-05-20T17:35:09.524276+0000 b8208 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000869:[<0x1000000039e/comment-46.xml v1100>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000869:[<0x1000000039e/comment-46.xml v1100>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.578+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg auth{0=1} v1058 ap=1 s=24221 n(v0 rc2024-05-20T17:35:06.410340+0000 b24221 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e9:[<0x1000000039e/picture-31.jpg v1058>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e9:[<0x1000000039e/picture-31.jpg v1058>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.579+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml auth v1056 ap=1 s=31606 n(v0 rc2024-05-20T17:35:05.667355+0000 b31606 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd8b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bd:[<0x1000000039e/article-68.xml v1056>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003bd:[<0x1000000039e/article-68.xml v1056>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.579+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000820 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml auth{0=1} v1110 ap=1 s=6004 n(v0 rc2024-05-20T17:35:09.288280+0000 b6004 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd8b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000820:[<0x1000000039e/comment-70.xml v1110>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000820:[<0x1000000039e/comment-70.xml v1110>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.579+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg auth{0=1} v1125 ap=1 s=30568 n(v0 rc2024-05-20T17:35:06.301342+0000 b30568 1=1+0) caps={25025=pAsLsXsFscr/pFscr@8} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd8b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c5:[<0x1000000039e/picture-49.jpg v1096>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004c5:[<0x1000000039e/picture-49.jpg v1125>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.580+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml auth v1086 ap=1 s=14535 n(v0 rc2024-05-20T17:35:05.624356+0000 b14535 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd8b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a6:[<0x1000000039e/article-76.xml v1086>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003a6:[<0x1000000039e/article-76.xml v1086>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.580+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg auth{0=1} v1044 ap=1 s=27768 n(v0 rc2024-05-20T17:35:06.542337+0000 b27768 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd88e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000518:[<0x1000000039e/picture-8.jpg v1044>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000518:[<0x1000000039e/picture-8.jpg v1044>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.859 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.580+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg auth{0=1} v1104 ap=1 s=48183 n(v0 rc2024-05-20T17:35:06.440339+0000 b48183 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd88e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f3:[<0x1000000039e/picture-26.jpg v1104>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f3:[<0x1000000039e/picture-26.jpg v1104>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.581+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml auth v1078 ap=1 s=5184 n(v0 rc2024-05-20T17:35:08.909288+0000 b5184 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@31},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd88eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b0:[<0x1000000039e/comment-98.xml v1078>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007b0:[<0x1000000039e/comment-98.xml v1078>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.582+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000429 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml auth{0=1} v1064 ap=1 s=3224 n(v0 rc2024-05-20T17:35:05.868351+0000 b3224 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd88f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000429:[<0x1000000039e/article-32.xml v1064>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000429:[<0x1000000039e/article-32.xml v1064>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.582+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml auth{0=1} v1054 ap=1 s=5802 n(v0 rc2024-05-20T17:35:09.136284+0000 b5802 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd88f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f6:[<0x1000000039e/comment-83.xml v1054>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007f6:[<0x1000000039e/comment-83.xml v1054>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.583+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000823 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml auth{0=1} v1072 ap=1 s=2247 n(v0 rc2024-05-20T17:35:09.296280+0000 b2247 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd88fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000823:[<0x1000000039e/comment-69.xml v1072>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000823:[<0x1000000039e/comment-69.xml v1072>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.583+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044b [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml auth{0=1} v1092 ap=1 s=19846 n(v0 rc2024-05-20T17:35:05.965349+0000 b19846 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd890100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044b:[<0x1000000039e/article-21.xml v1092>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000044b:[<0x1000000039e/article-21.xml v1092>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.584+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml auth{0=1} v1050 ap=1 s=24488 n(v0 rc2024-05-20T17:35:05.885351+0000 b24488 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd890680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042f:[<0x1000000039e/article-30.xml v1050>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000042f:[<0x1000000039e/article-30.xml v1050>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.585+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml auth{0=1} v1098 ap=1 s=8933 n(v0 rc2024-05-20T17:35:09.068285+0000 b8933 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd890c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e2:[<0x1000000039e/comment-89.xml v1098>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007e2:[<0x1000000039e/comment-89.xml v1098>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.586+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000814 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml auth{0=1} v1102 ap=1 s=6370 n(v0 rc2024-05-20T17:35:09.248281+0000 b6370 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd891180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000814:[<0x1000000039e/comment-74.xml v1102>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000814:[<0x1000000039e/comment-74.xml v1102>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.587+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007df [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml auth{0=1} v1123 ap=1 s=5008 n(v0 rc2024-05-20T17:35:09.059285+0000 b5008 1=1+0) caps={25025=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f0cd891700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007df:[<0x1000000039e/comment-90.xml v1080>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007df:[<0x1000000039e/comment-90.xml v1123>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.588+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000462 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml auth{0=1} v1060 ap=1 s=19335 n(v0 rc2024-05-20T17:35:06.037348+0000 b19335 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000462:[<0x1000000039e/article-13.xml v1060>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000462:[<0x1000000039e/article-13.xml v1060>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.860 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.588+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000832 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml auth{0=1} v1094 ap=1 s=9064 n(v0 rc2024-05-20T17:35:09.348279+0000 b9064 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000832:[<0x1000000039e/comment-64.xml v1094>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000832:[<0x1000000039e/comment-64.xml v1094>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.589+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml auth{0=1} v1112 ap=1 s=9033 n(v0 rc2024-05-20T17:35:09.270281+0000 b9033 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081a:[<0x1000000039e/comment-72.xml v1112>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000081a:[<0x1000000039e/comment-72.xml v1112>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.590+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml auth{0=1} v1076 ap=1 s=5921 n(v0 rc2024-05-20T17:35:09.868268+0000 b5921 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d5:[<0x1000000039e/comment-4.xml v1076>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008d5:[<0x1000000039e/comment-4.xml v1076>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.590+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml auth v1052 ap=1 s=26700 n(v0 rc2024-05-20T17:35:05.757353+0000 b26700 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd86db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f2:[<0x1000000039e/article-50.xml v1052>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003f2:[<0x1000000039e/article-50.xml v1052>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.591+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000477 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml auth{0=1} v1082 ap=1 s=14176 n(v0 rc2024-05-20T17:35:06.102346+0000 b14176 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000477:[<0x1000000039e/article-6.xml v1082>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000477:[<0x1000000039e/article-6.xml v1082>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.591+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000483 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml auth{0=1} v1046 ap=1 s=24349 n(v0 rc2024-05-20T17:35:06.144345+0000 b24349 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000483:[<0x1000000039e/article-2.xml v1046>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000483:[<0x1000000039e/article-2.xml v1046>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.592+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml auth{0=1} v1068 ap=1 s=6631 n(v0 rc2024-05-20T17:35:09.793270+0000 b6631 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c1:[<0x1000000039e/comment-14.xml v1068>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008c1:[<0x1000000039e/comment-14.xml v1068>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.593+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000829 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml auth{0=1} v1108 ap=1 s=6810 n(v0 rc2024-05-20T17:35:09.315280+0000 b6810 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd86f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000829:[<0x1000000039e/comment-67.xml v1108>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000829:[<0x1000000039e/comment-67.xml v1108>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.593+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg auth v1048 ap=1 s=43617 n(v0 rc2024-05-20T17:35:06.274343+0000 b43617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd86f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bb:[<0x1000000039e/picture-54.jpg v1048>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004bb:[<0x1000000039e/picture-54.jpg v1048>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.861 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.594+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ed [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg auth{0=1} v1066 ap=1 s=58973 n(v0 rc2024-05-20T17:35:06.422340+0000 b58973 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd85e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ed:[<0x1000000039e/picture-29.jpg v1066>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ed:[<0x1000000039e/picture-29.jpg v1066>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.594+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml auth{0=1} v1070 ap=1 s=9543 n(v0 rc2024-05-20T17:35:09.764271+0000 b9543 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd85e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b7:[<0x1000000039e/comment-19.xml v1070>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008b7:[<0x1000000039e/comment-19.xml v1070>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.595+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml auth v1088 ap=1 s=25723 n(v0 rc2024-05-20T17:35:05.728354+0000 b25723 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd85eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e1:[<0x1000000039e/article-56.xml v1088>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003e1:[<0x1000000039e/article-56.xml v1088>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.595+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg auth v1046 ap=1 s=31319 n(v0 rc2024-05-20T17:35:06.218344+0000 b31319 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd545180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049e:[<0x1000000039e/picture-64.jpg v1046>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000049e:[<0x1000000039e/picture-64.jpg v1046>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.596+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml auth v1058 ap=1 s=10030 n(v0 rc2024-05-20T17:35:09.279281+0000 b10030 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081d:[<0x1000000039e/comment-71.xml v1058>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000081d:[<0x1000000039e/comment-71.xml v1058>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.597+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000514 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg auth v1094 ap=1 s=10752 n(v0 rc2024-05-20T17:35:06.531337+0000 b10752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@29},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000514:[<0x1000000039e/picture-10.jpg v1094>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000514:[<0x1000000039e/picture-10.jpg v1094>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.597+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml auth v1106 ap=1 s=3539 n(v0 rc2024-05-20T17:35:08.964287+0000 b3539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@14},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c0:[<0x1000000039e/comment-95.xml v1106>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007c0:[<0x1000000039e/comment-95.xml v1106>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.862 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.598+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000526 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg auth{0=1} v1054 ap=1 s=16696 n(v0 rc2024-05-20T17:35:06.583336+0000 b16696 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25025 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55f0cd5b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000526:[<0x1000000039e/picture-1.jpg v1054>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000526:[<0x1000000039e/picture-1.jpg v1054>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.598+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml auth v1098 ap=1 s=5616 n(v0 rc2024-05-20T17:35:09.781270+0000 b5616 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@18},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bd:[<0x1000000039e/comment-16.xml v1098>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008bd:[<0x1000000039e/comment-16.xml v1098>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.599+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046f [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml auth v1052 ap=1 s=7141 n(v0 rc2024-05-20T17:35:06.071347+0000 b7141 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046f:[<0x1000000039e/article-9.xml v1052>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000046f:[<0x1000000039e/article-9.xml v1052>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.600+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000406 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml auth v1096 ap=1 s=15560 n(v0 rc2024-05-20T17:35:05.786353+0000 b15560 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000406:[<0x1000000039e/article-44.xml v1096>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000406:[<0x1000000039e/article-44.xml v1096>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.600+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg auth v1048 ap=1 s=22750 n(v0 rc2024-05-20T17:35:06.553337+0000 b22750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@49},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051c:[<0x1000000039e/picture-6.jpg v1048>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000051c:[<0x1000000039e/picture-6.jpg v1048>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.601+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml auth v1090 ap=1 s=13358 n(v0 rc2024-05-20T17:35:05.683355+0000 b13358 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c6:[<0x1000000039e/article-65.xml v1090>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c6:[<0x1000000039e/article-65.xml v1090>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.602+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml auth v1092 ap=1 s=9884 n(v0 rc2024-05-20T17:35:05.698355+0000 b9884 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cf:[<0x1000000039e/article-62.xml v1092>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003cf:[<0x1000000039e/article-62.xml v1092>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.603+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000441 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml auth v1080 ap=1 s=6603 n(v0 rc2024-05-20T17:35:05.939350+0000 b6603 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000441:[<0x1000000039e/article-24.xml v1080>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000441:[<0x1000000039e/article-24.xml v1080>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.604+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ab [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml auth v1056 ap=1 s=4465 n(v0 rc2024-05-20T17:35:09.729271+0000 b4465 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ab:[<0x1000000039e/comment-25.xml v1056>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008ab:[<0x1000000039e/comment-25.xml v1056>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.605+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ef [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg auth v1082 ap=1 s=30770 n(v0 rc2024-05-20T17:35:06.428340+0000 b30770 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ef:[<0x1000000039e/picture-28.jpg v1082>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004ef:[<0x1000000039e/picture-28.jpg v1082>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.863 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.606+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml auth v1084 ap=1 s=8946 n(v0 rc2024-05-20T17:35:06.618336+0000 b8946 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25025 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052d:[<0x1000000039e/article-88.xml v1084>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000052d:[<0x1000000039e/article-88.xml v1084>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.606+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000879 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml auth v1102 ap=1 s=4762 n(v0 rc2024-05-20T17:35:09.568275+0000 b4762 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000879:[<0x1000000039e/comment-41.xml v1102>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000879:[<0x1000000039e/comment-41.xml v1102>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.607+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml auth v1074 ap=1 s=1649 n(v0 rc2024-05-20T17:35:05.672355+0000 b1649 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c0:[<0x1000000039e/article-67.xml v1074>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003c0:[<0x1000000039e/article-67.xml v1074>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.608+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000811 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml auth v1068 ap=1 s=3426 n(v0 rc2024-05-20T17:35:09.237281+0000 b3426 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000811:[<0x1000000039e/comment-75.xml v1068>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000811:[<0x1000000039e/comment-75.xml v1068>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.608+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dd [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg auth v1072 ap=1 s=22726 n(v0 rc2024-05-20T17:35:06.372341+0000 b22726 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5c5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004dd:[<0x1000000039e/picture-37.jpg v1072>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004dd:[<0x1000000039e/picture-37.jpg v1072>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.609+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000505 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg auth v1070 ap=1 s=29233 n(v0 rc2024-05-20T17:35:06.492338+0000 b29233 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000505:[<0x1000000039e/picture-17.jpg v1070>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000505:[<0x1000000039e/picture-17.jpg v1070>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.609+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000480 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml auth v1044 ap=1 s=28714 n(v0 rc2024-05-20T17:35:06.134346+0000 b28714 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@48},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000480:[<0x1000000039e/article-3.xml v1044>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000480:[<0x1000000039e/article-3.xml v1044>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.610+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg auth v1076 ap=1 s=56498 n(v0 rc2024-05-20T17:35:06.452339+0000 b56498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f7:[<0x1000000039e/picture-24.jpg v1076>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004f7:[<0x1000000039e/picture-24.jpg v1076>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.610+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg auth v1088 ap=1 s=59982 n(v0 rc2024-05-20T17:35:06.397340+0000 b59982 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e5:[<0x1000000039e/picture-33.jpg v1088>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e5:[<0x1000000039e/picture-33.jpg v1088>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.611+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg auth v1078 ap=1 s=43133 n(v0 rc2024-05-20T17:35:06.256343+0000 b43133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b3:[<0x1000000039e/picture-57.jpg v1078>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004b3:[<0x1000000039e/picture-57.jpg v1078>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.612+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000473 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml auth v1060 ap=1 s=24289 n(v0 rc2024-05-20T17:35:06.091347+0000 b24289 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@49},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000473:[<0x1000000039e/article-7.xml v1060>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000473:[<0x1000000039e/article-7.xml v1060>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.864 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.613+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg auth v1066 ap=1 s=25574 n(v0 rc2024-05-20T17:35:06.342341+0000 b25574 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d3:[<0x1000000039e/picture-42.jpg v1066>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d3:[<0x1000000039e/picture-42.jpg v1066>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.613+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000492 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg auth v1086 ap=1 s=53847 n(v0 rc2024-05-20T17:35:06.196344+0000 b53847 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000492:[<0x1000000039e/picture-68.jpg v1086>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000492:[<0x1000000039e/picture-68.jpg v1086>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.614+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d9 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg auth v1062 ap=1 s=64591 n(v0 rc2024-05-20T17:35:06.360341+0000 b64591 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d9:[<0x1000000039e/picture-39.jpg v1062>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004d9:[<0x1000000039e/picture-39.jpg v1062>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.615+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008af [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml auth v1050 ap=1 s=3714 n(v0 rc2024-05-20T17:35:09.741271+0000 b3714 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008af:[<0x1000000039e/comment-23.xml v1050>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008af:[<0x1000000039e/comment-23.xml v1050>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.615+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ad [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml auth v1108 ap=1 s=7968 n(v0 rc2024-05-20T17:35:09.735271+0000 b7968 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ad:[<0x1000000039e/comment-24.xml v1108>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008ad:[<0x1000000039e/comment-24.xml v1108>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.615+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml auth v1052 ap=1 s=25203 n(v0 rc2024-05-20T17:35:05.713354+0000 b25203 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d8:[<0x1000000039e/article-59.xml v1052>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d8:[<0x1000000039e/article-59.xml v1052>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.616+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg auth v1066 ap=1 s=47215 n(v0 rc2024-05-20T17:35:06.514338+0000 b47215 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@49},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050e:[<0x1000000039e/picture-13.jpg v1066>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000050e:[<0x1000000039e/picture-13.jpg v1066>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.617+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000503 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg auth v1056 ap=1 s=11110 n(v0 rc2024-05-20T17:35:06.487338+0000 b11110 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000503:[<0x1000000039e/picture-18.jpg v1056>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000503:[<0x1000000039e/picture-18.jpg v1056>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.618+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ab [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml auth v1084 ap=1 s=30217 n(v0 rc2024-05-20T17:35:05.635356+0000 b30217 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@6},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ab:[<0x1000000039e/article-74.xml v1084>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ab:[<0x1000000039e/article-74.xml v1084>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.618+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000453 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml auth v1048 ap=1 s=26276 n(v0 rc2024-05-20T17:35:05.993349+0000 b26276 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@13},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000453:[<0x1000000039e/article-18.xml v1048>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000453:[<0x1000000039e/article-18.xml v1048>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.865 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.619+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml auth{0=1} v1106 ap=1 s=8495 n(v0 rc2024-05-20T17:35:09.861269+0000 b8495 1=1+0) caps={25025=pAsLsXsFscr/pFscr@5} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd5e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d3:[<0x1000000039e/comment-5.xml v1094>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008d3:[<0x1000000039e/comment-5.xml v1106>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.619+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000501 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg auth v1096 ap=1 s=57581 n(v0 rc2024-05-20T17:35:06.481338+0000 b57581 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@20},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000501:[<0x1000000039e/picture-19.jpg v1096>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000501:[<0x1000000039e/picture-19.jpg v1096>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.620+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml auth v1064 ap=1 s=3671 n(v0 rc2024-05-20T17:35:05.752354+0000 b3671 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f0:[<0x1000000039e/article-51.xml v1064>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003f0:[<0x1000000039e/article-51.xml v1064>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.621+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml auth v1088 ap=1 s=6597 n(v0 rc2024-05-20T17:35:09.700272+0000 b6597 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a1:[<0x1000000039e/comment-29.xml v1088>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008a1:[<0x1000000039e/comment-29.xml v1088>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.621+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000438 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml auth v1090 ap=1 s=6910 n(v0 rc2024-05-20T17:35:05.911350+0000 b6910 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000438:[<0x1000000039e/article-27.xml v1090>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000438:[<0x1000000039e/article-27.xml v1090>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.622+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000520 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg auth v1062 ap=1 s=44015 n(v0 rc2024-05-20T17:35:06.564337+0000 b44015 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@48},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000520:[<0x1000000039e/picture-4.jpg v1062>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000520:[<0x1000000039e/picture-4.jpg v1062>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.623+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg auth v1100 ap=1 s=42800 n(v0 rc2024-05-20T17:35:06.383340+0000 b42800 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@7},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e1:[<0x1000000039e/picture-35.jpg v1100>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004e1:[<0x1000000039e/picture-35.jpg v1100>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.623+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000524 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg auth{0=1} v1104 ap=1 s=14063 n(v0 rc2024-05-20T17:35:06.575337+0000 b14063 1=1+0) caps={25025=pAsLsXsFscr/pFscr@5} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55f0cd5f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000524:[<0x1000000039e/picture-2.jpg v1054>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000524:[<0x1000000039e/picture-2.jpg v1104>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.624+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml auth v1046 ap=1 s=29489 n(v0 rc2024-05-20T17:35:05.657355+0000 b29489 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b7:[<0x1000000039e/article-70.xml v1046>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003b7:[<0x1000000039e/article-70.xml v1046>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.866 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.624+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044d [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml auth v1058 ap=1 s=17065 n(v0 rc2024-05-20T17:35:05.973349+0000 b17065 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044d:[<0x1000000039e/article-20.xml v1058>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000044d:[<0x1000000039e/article-20.xml v1058>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.625+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg auth v1082 ap=1 s=45075 n(v0 rc2024-05-20T17:35:06.509338+0000 b45075 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@49},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050c:[<0x1000000039e/picture-14.jpg v1082>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000050c:[<0x1000000039e/picture-14.jpg v1082>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.626+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml auth v1092 ap=1 s=8866 n(v0 rc2024-05-20T17:35:09.038286+0000 b8866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d7:[<0x1000000039e/comment-92.xml v1092>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007d7:[<0x1000000039e/comment-92.xml v1092>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.627+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml auth v1086 ap=1 s=19632 n(v0 rc2024-05-20T17:35:05.703355+0000 b19632 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@73},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d3:[<0x1000000039e/article-61.xml v1086>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003d3:[<0x1000000039e/article-61.xml v1086>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.627+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040e [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml auth v1074 ap=1 s=22497 n(v0 rc2024-05-20T17:35:05.802352+0000 b22497 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040e:[<0x1000000039e/article-41.xml v1074>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000040e:[<0x1000000039e/article-41.xml v1074>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.628+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000402 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml auth v1050 ap=1 s=21526 n(v0 rc2024-05-20T17:35:05.781353+0000 b21526 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000402:[<0x1000000039e/article-45.xml v1050>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000402:[<0x1000000039e/article-45.xml v1050>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.629+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ba [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml auth v1078 ap=1 s=2851 n(v0 rc2024-05-20T17:35:05.662355+0000 b2851 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@80},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd5f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ba:[<0x1000000039e/article-69.xml v1078>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000003ba:[<0x1000000039e/article-69.xml v1078>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.629+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml auth v1098 ap=1 s=3156 n(v0 rc2024-05-20T17:35:08.983287+0000 b3156 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@9},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd602000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c5:[<0x1000000039e/comment-94.xml v1098>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000007c5:[<0x1000000039e/comment-94.xml v1098>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.630+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg auth v1060 ap=1 s=30787 n(v0 rc2024-05-20T17:35:06.235344+0000 b30787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@68},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd602580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a7:[<0x1000000039e/picture-61.jpg v1060>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000004a7:[<0x1000000039e/picture-61.jpg v1060>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.630+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg auth v1068 ap=1 s=37246 n(v0 rc2024-05-20T17:35:06.548337+0000 b37246 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd602b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051a:[<0x1000000039e/picture-7.jpg v1068>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000051a:[<0x1000000039e/picture-7.jpg v1068>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.867 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.631+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml auth v1076 ap=1 s=9631 n(v0 rc2024-05-20T17:35:05.876351+0000 b9631 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd603080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042c:[<0x1000000039e/article-31.xml v1076>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x1000000042c:[<0x1000000039e/article-31.xml v1076>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.868 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.631+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000516 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg auth v1080 ap=1 s=10114 n(v0 rc2024-05-20T17:35:06.536337+0000 b10114 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd603600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000516:[<0x1000000039e/picture-9.jpg v1080>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000516:[<0x1000000039e/picture-9.jpg v1080>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.868 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.632+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c7 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml auth v1072 ap=1 s=3873 n(v0 rc2024-05-20T17:35:09.812270+0000 b3873 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd603b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c7:[<0x1000000039e/comment-11.xml v1072>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008c7:[<0x1000000039e/comment-11.xml v1072>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:35.868 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:35:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:35:35.632+0000 7fcde54a7700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml auth v1070 ap=1 s=2992 n(v0 rc2024-05-20T17:35:09.758271+0000 b2992 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@10},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f0cd604100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b5:[<0x1000000039e/comment-20.xml v1070>,<0x10000000399/blog-2 v12736>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x100000008b5:[<0x1000000039e/comment-20.xml v1070>,<0x10000000399/blog-2 v39644>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000430 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000042a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000433 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000045a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000040b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000403 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000149c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001489 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000041b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000144d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000148e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001454 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000469 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000424 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000442 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001807 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001801 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000661 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000065e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000671 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000658 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000065c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000068d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000687 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000930 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000066e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000773 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000066c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000078e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000947 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000668 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000674 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000669 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001714 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000005a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000605 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000045e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000005be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000005ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000634 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000005ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000571 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000908 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001440 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001443 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000142a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000143c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000141e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000141a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000665 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000657 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000906 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000693 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000691 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000666 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000090e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000068f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000066a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000065f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000068b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000006ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000076c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:36 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.517 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:36.517 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000430 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000042a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000433 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000045a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000040b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000403 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000149c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001489 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000041b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000144d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000148e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001454 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.526 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000469 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000424 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000442 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001807 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001801 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000661 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000065e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000671 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.534 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000658 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000065c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000068d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.535 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000687 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.536 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000930 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000066e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.537 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000773 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000066c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000078e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.538 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000947 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000668 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.539 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.540 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.540 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000674 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000669 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.541 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001714 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.542 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000005a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000605 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.543 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000045e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000005be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000005ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000634 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.544 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000005ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000571 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000908 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.545 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001440 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001443 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000142a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.547 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000143c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000141e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.548 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000141a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000665 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.549 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000657 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000906 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.550 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000693 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000691 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000666 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.551 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000090e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000068f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.552 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000066a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000065f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000068b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000006ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.553 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.554 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000076c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.554 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:36 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:36.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000430 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000042a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000433 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000045a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000045d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000040b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001472 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001467 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000403 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000149c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001489 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000147b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000041b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000144d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000148e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001454 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001476 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000469 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000044e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000463 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000424 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000442 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001807 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001801 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000670 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000661 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000663 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.598 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000065e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000671 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000658 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000065c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.599 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000068d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000687 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000930 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000066e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000773 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000066c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000078e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000947 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000668 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000674 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000669 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001714 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000005a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000605 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000045e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000005be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000005ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000634 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000005ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000571 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000908 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001417 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001440 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001443 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000142a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000143c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000141e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000141a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000665 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000657 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000906 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000792 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000693 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000691 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000666 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000090e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000068f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000764 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000066a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000065f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000068b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000006ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000076c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:36.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:36 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.171 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.171 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.171 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.171 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.171 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000171b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000169f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000169c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001698 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.175 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001690 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.176 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001711 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001717 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000168c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.177 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000171f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000178b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.178 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.179 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.187 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.187 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.187 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.187 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000171b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.188 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.189 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.190 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000169f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.191 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.191 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000169c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001698 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.192 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.193 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001690 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001711 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001717 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.195 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000168c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000171f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000178b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.196 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.197 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.198 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.199 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.200 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.201 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.202 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001848 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.203 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.204 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001806 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001843 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001803 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.206 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.207 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.207 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.213 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000141c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.214 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e5f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001488 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000126b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001556 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.215 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.216 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000147f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.217 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001580 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001589 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.218 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001250 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000154d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000157b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000149b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.219 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000123a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001491 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.220 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000149f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000158e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000eb8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f5c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.221 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000df5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.222 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001564 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e6e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001572 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000155b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000148d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.223 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001551 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001569 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.224 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000155f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000156d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.225 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.226 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000041a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000041e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000465 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ebd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.227 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000124c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.228 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000170f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.229 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000456 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.230 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001726 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e7d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e4f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.231 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000045f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001222 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.232 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000171a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000468 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.233 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000043c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000170c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.234 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000edb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000016d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.235 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000043e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000416 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.236 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000da9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001427 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.237 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000412 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.238 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000045c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000448 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000087c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000880 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dfa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.239 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.240 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.241 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000080e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000da2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.242 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000872 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001415 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.243 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.244 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.245 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.246 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.247 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000429 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000044b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.248 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001418 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.249 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000123f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001232 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.250 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.251 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e55 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.253 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000441 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.254 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.255 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000126f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000453 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000de9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000de1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000438 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000044d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ef4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.261 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.262 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.263 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000042c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000008b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000eb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.264 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ddc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.265 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e1b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.266 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.267 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.268 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.269 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001277 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.270 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e87 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.271 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000125d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.272 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d72 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.273 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.274 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ea9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.275 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.276 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.277 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000e73 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.278 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.279 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:37 smithi160 ceph-mon[36261]: pgmap v71: 97 pgs: 97 active+clean; 58 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 602 op/s 2024-05-20T17:35:37.454 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.360+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc4 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml auth{0=1} v1164 ap=1 s=6383 n(v0 rc2024-05-20T17:35:15.898144+0000 b6383 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a98f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc4:[<0x10000000a57/comment-71.xml v520>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dc4:[<0x10000000a57/comment-71.xml v1164>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.454 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.360+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad8 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg auth{0=1} v1162 ap=1 s=57829 n(v0 rc2024-05-20T17:35:12.452215+0000 b57829 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad8:[<0x10000000a57/picture-10.jpg v286>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000ad8:[<0x10000000a57/picture-10.jpg v1162>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.454 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.360+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d32 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml auth{0=1} v1166 ap=1 s=9678 n(v0 rc2024-05-20T17:35:15.412154+0000 b9678 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a991700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d32:[<0x10000000a57/comment-95.xml v376>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d32:[<0x10000000a57/comment-95.xml v1166>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.454 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.362+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aea [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg auth{0=1} v1152 ap=1 s=42404 n(v0 rc2024-05-20T17:35:12.491214+0000 b42404 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87aa4a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aea:[<0x10000000a57/picture-1.jpg v340>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000aea:[<0x10000000a57/picture-1.jpg v1152>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.362+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a6a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml auth{0=1} v1140 ap=1 s=28618 n(v0 rc2024-05-20T17:35:12.182221+0000 b28618 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87aa4ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a6a:[<0x10000000a57/article-9.xml v34>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a6a:[<0x10000000a57/article-9.xml v1140>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.363+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg auth{0=1} v1144 ap=1 s=17102 n(v0 rc2024-05-20T17:35:12.470215+0000 b17102 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87aa4b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae0:[<0x10000000a57/picture-6.jpg v310>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000ae0:[<0x10000000a57/picture-6.jpg v1144>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.364+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b1 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml auth{0=1} v923 ap=1 s=3238 n(v0 rc2024-05-20T17:35:23.579984+0000 b3238 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25025=0-4194304@3} caps={25025=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c87aa4b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b1:[<0x10000000a57/comment-58.xml v923>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x100000013b1:[<0x10000000a57/comment-58.xml v923>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.366+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab2 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg auth{0=1} v1156 ap=1 s=13272 n(v0 rc2024-05-20T17:35:12.362217+0000 b13272 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87aa4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab2:[<0x10000000a57/picture-28.jpg v178>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000ab2:[<0x10000000a57/picture-28.jpg v1156>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.368+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dab [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml auth{0=1} v1154 ap=1 s=3897 n(v0 rc2024-05-20T17:35:15.805146+0000 b3897 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87aa4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dab:[<0x10000000a57/comment-75.xml v496>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000dab:[<0x10000000a57/comment-75.xml v1154>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.368+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a97 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg auth{0=1} v1142 ap=1 s=62096 n(v0 rc2024-05-20T17:35:12.299218+0000 b62096 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d48000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a97:[<0x10000000a57/picture-37.jpg v124>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a97:[<0x10000000a57/picture-37.jpg v1142>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.369+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aca [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg auth{0=1} v1146 ap=1 s=17765 n(v0 rc2024-05-20T17:35:12.419216+0000 b17765 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aca:[<0x10000000a57/picture-17.jpg v244>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000aca:[<0x10000000a57/picture-17.jpg v1146>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.455 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.369+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a7c [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml auth{0=1} v1150 ap=1 s=28272 n(v0 rc2024-05-20T17:35:12.230220+0000 b28272 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a7c:[<0x10000000a57/article-3.xml v70>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a7c:[<0x10000000a57/article-3.xml v1150>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.370+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa3 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg auth{0=1} v1148 ap=1 s=52107 n(v0 rc2024-05-20T17:35:12.328218+0000 b52107 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa3:[<0x10000000a57/picture-33.jpg v148>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000aa3:[<0x10000000a57/picture-33.jpg v1148>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.370+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg auth{0=1} v1168 ap=1 s=17973 n(v0 rc2024-05-20T17:35:12.387216+0000 b17973 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abc:[<0x10000000a57/picture-24.jpg v202>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000abc:[<0x10000000a57/picture-24.jpg v1168>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.371+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a70 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml auth{0=1} v1138 ap=1 s=23230 n(v0 rc2024-05-20T17:35:12.197220+0000 b23230 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@3},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a70:[<0x10000000a57/article-7.xml v46>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a70:[<0x10000000a57/article-7.xml v1138>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.372+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a91 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg auth{0=1} v1158 ap=1 s=62199 n(v0 rc2024-05-20T17:35:12.284218+0000 b62199 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a91:[<0x10000000a57/picture-39.jpg v112>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a91:[<0x10000000a57/picture-39.jpg v1158>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.372+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a88 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg auth{0=1} v1160 ap=1 s=48630 n(v0 rc2024-05-20T17:35:12.261219+0000 b48630 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879d4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a88:[<0x10000000a57/picture-42.jpg v94>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a88:[<0x10000000a57/picture-42.jpg v1160>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.450+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg auth{0=1} v1153 ap=1 s=19011 n(v0 rc2024-05-20T17:35:12.369217+0000 b19011 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab5:[<0x10000000a57/picture-27.jpg v184>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000ab5:[<0x10000000a57/picture-27.jpg v1153>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.450+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a61 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml auth{0=1} v1155 ap=1 s=31562 n(v0 rc2024-05-20T17:35:12.161221+0000 b31562 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a61:[<0x10000000a57/article-12.xml v16>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a61:[<0x10000000a57/article-12.xml v1155>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.456 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.451+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a82 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml auth{0=1} v1149 ap=1 s=29962 n(v0 rc2024-05-20T17:35:12.245219+0000 b29962 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a82:[<0x10000000a57/article-1.xml v82>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000a82:[<0x10000000a57/article-1.xml v1149>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000171b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.463 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000169f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000169c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001698 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001695 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001690 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001711 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001717 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000168c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000171f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000178b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.472 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.473 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001848 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.476 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001806 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001843 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.477 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001803 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.479 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.480 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000141c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.481 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e5f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001488 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000126b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001556 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.482 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.483 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000147f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.484 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001580 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001589 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001250 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.485 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000154d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000157b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000149b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.486 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000123a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001491 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000149f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.487 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000158e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000eb8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f5c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000df5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001564 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e6e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001572 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000155b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000148d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001551 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001569 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000155f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000156d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000041a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000041e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000465 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ebd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.495 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000124c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000170f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000456 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001726 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e7d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e4f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000045f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001222 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.500 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000171a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000468 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000043c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000170c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000edb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000016d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000043e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000416 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000da9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001427 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000412 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000045c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000448 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000087c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000880 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dfa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.508 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.509 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000080e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000da2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000872 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001415 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.512 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.513 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.514 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.515 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.518 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000429 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000044b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.519 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001418 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000123f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001232 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.522 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.523 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e55 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.524 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000441 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.526 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.527 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000126f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.528 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.529 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000453 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000de9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.531 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000de1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000438 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.532 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000044d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ef4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.533 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.534 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000042c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000008b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000eb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ddc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.536 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.537 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e1b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.538 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.539 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.540 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001277 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.541 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.542 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e87 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.543 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000125d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.544 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d72 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.545 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ea9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.548 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.549 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.550 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000e73 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.551 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:37.552 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.552 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.552 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:37 smithi135 ceph-mon[32027]: pgmap v71: 97 pgs: 97 active+clean; 58 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 602 op/s 2024-05-20T17:35:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001848 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001806 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001843 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001803 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.587 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.588 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000141c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000145f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014b2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e5f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001488 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000126b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001556 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.591 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001496 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000147f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.593 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001580 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001589 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001457 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.594 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001250 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001466 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000154d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000157b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000149b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.595 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000123a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001577 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001491 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000149f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000158e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000eb8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f5c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000df5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.603 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000145b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001564 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e6e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001572 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000155b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000148d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.605 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001551 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001475 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001569 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000155f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000156d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000041a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000414 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000041e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000465 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ebd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000124c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001713 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.611 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000170f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001722 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000444 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.612 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000456 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001726 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e7d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e4f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000045f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001222 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.614 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003fc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ea4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000171a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000468 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012e4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000043c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001716 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000170c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016fb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.618 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000edb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000016d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000043e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000416 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.619 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.620 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000da9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001427 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000420 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000432 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.621 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000412 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000045c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000448 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000804 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000087c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000880 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.623 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dfa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000450 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007dc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e38 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000408 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000426 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000080e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.626 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000da2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000872 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001415 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.628 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.629 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.630 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000429 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000044b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007e2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001418 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000123f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001232 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.638 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e55 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000406 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000441 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012ca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000811 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.643 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000126f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.644 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.645 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000453 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000de9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000de1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000438 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.648 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000044d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.649 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ef4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e64 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.651 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000042c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000008b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.i log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000eb3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ddc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e69 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e1b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.654 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.656 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.657 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e0d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e9b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001277 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.659 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.660 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e87 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000125d (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.661 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.662 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d72 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.663 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.664 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e12 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ea9 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.665 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.666 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001422 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000e73 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:37.669 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:37 smithi172 ceph-mon[36511]: pgmap v71: 97 pgs: 97 active+clean; 58 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 602 op/s 2024-05-20T17:35:37.757 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.454+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa0 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg auth{0=1} v1151 ap=1 s=27248 n(v0 rc2024-05-20T17:35:12.321218+0000 b27248 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c87a8fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa0:[<0x10000000a57/picture-34.jpg v142>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000aa0:[<0x10000000a57/picture-34.jpg v1151>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.758 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.456+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000acc [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg auth{0=1} v1157 ap=1 s=24635 n(v0 rc2024-05-20T17:35:12.423216+0000 b24635 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879e82b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000acc:[<0x10000000a57/picture-16.jpg v250>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000acc:[<0x10000000a57/picture-16.jpg v1157>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.758 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.460+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5a [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml auth{0=1} v1161 ap=1 s=9594 n(v0 rc2024-05-20T17:35:15.573150+0000 b9594 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879e83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5a:[<0x10000000a57/comment-87.xml v424>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000d5a:[<0x10000000a57/comment-87.xml v1161>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.758 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.462+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000deb [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml auth{0=1} v1159 ap=1 s=2886 n(v0 rc2024-05-20T17:35:16.031141+0000 b2886 1=1+0) (ifile excl) cr={25025=0-4194304@3} caps={25025=pAsLsXsFsxcrwb/pFscr@2},l=25025 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879e84680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000deb:[<0x10000000a57/comment-65.xml v556>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000deb:[<0x10000000a57/comment-65.xml v1159>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.758 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.464+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd5 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml auth{0=1} v1163 ap=1 s=2090 n(v0 rc2024-05-20T17:35:15.111160+0000 b2090 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879e84c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd5:[<0x10000000a57/article-23.xml v346>,<0x10000000399/blog-10 v39202>,<0x10000000208/blogtest_in v423>,<0x10000000201/src v2127>,<0x10000000006/blogbench-1.0 v1839>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v54>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v73>,<0x10000000001/sv_1 v91>,<0x10000000000/qa v81>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000cd5:[<0x10000000a57/article-23.xml v1163>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:37.758 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:35:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:35:37.464+0000 7f51bbaa4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa6 [4,head] /volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg auth{0=1} v1147 ap=1 s=58244 n(v0 rc2024-05-20T17:35:12.335217+0000 b58244 1=1+0) caps={25025=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c879e85180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa6:[<0x10000000a57/picture-32.jpg v154>,<0x10000000399/blog-10 v14518>,<0x10000000208/blogtest_in v341>,<0x10000000201/src v2096>,<0x10000000006/blogbench-1.0 v1812>,<0x10000000005/tmp v40>,<0x100000001fb/client.0 v32>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v49>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v57>,<0x1/volumes v53>]//[]","memoryvalue":"(3)0x10000000aa6:[<0x10000000a57/picture-32.jpg v1147>,<0x10000000399/blog-10 v44246>,<0x10000000208/blogtest_in v472>,<0x10000000201/src v2136>,<0x10000000006/blogbench-1.0 v1844>,<0x10000000005/tmp v72>,<0x100000001fb/client.0 v58>,<0x100000001fa/5ebea960-e478-4ace-b870-4e650f43508a v26>,<0x10000000001/sv_1 v95>,<0x10000000000/qa v25>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-20T17:35:38.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:35:38.156+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ad8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000aea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ae0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ab2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000dab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a7c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000abc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a88 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:38.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:38 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ad8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000aea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ae0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ab2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000dab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a7c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000abc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a88 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:38.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:38 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ad8 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d32 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000aea (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a6a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ae0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ab2 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000dab (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a7c (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000abc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a70 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a88 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:38.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:38 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000acc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000deb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: active paths [/] 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000cd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: pgmap v72: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 1.01k op/s 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:35:39.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:39 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000acc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000deb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: active paths [/] 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000cd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: pgmap v72: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 1.01k op/s 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:35:39.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:39 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000acc (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000deb (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: active paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000cd5 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: pgmap v72: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 1.01k op/s 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] up:active 2024-05-20T17:35:39.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:39 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:40 smithi135 ceph-mon[32027]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:40.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:40 smithi160 ceph-mon[36261]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:40.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:40 smithi172 ceph-mon[36511]: scrub summary: idle+waiting paths [/] 2024-05-20T17:35:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:41 smithi135 ceph-mon[32027]: pgmap v73: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.1 MiB/s wr, 991 op/s 2024-05-20T17:35:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:41 smithi160 ceph-mon[36261]: pgmap v73: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.1 MiB/s wr, 991 op/s 2024-05-20T17:35:41.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:41 smithi172 ceph-mon[36511]: pgmap v73: 97 pgs: 97 active+clean; 90 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.1 MiB/s wr, 991 op/s 2024-05-20T17:35:42.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:42 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:35:42.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:42 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:42.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:42 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:35:42.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:42 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:42 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] up:active 2024-05-20T17:35:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:42 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:35:43.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:43 smithi160 ceph-mon[36261]: pgmap v74: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.4 MiB/s wr, 1.33k op/s 2024-05-20T17:35:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:43 smithi172 ceph-mon[36511]: pgmap v74: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.4 MiB/s wr, 1.33k op/s 2024-05-20T17:35:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:43 smithi135 ceph-mon[32027]: pgmap v74: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.4 MiB/s wr, 1.33k op/s 2024-05-20T17:35:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- 172.21.15.135:0/3945536787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107a10 msgr2=0x7f8a881015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 --2- 172.21.15.135:0/3945536787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107a10 0x7f8a881015c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009900 tx=0x7f8a8402a410 comp rx=0 tx=0).stop 2024-05-20T17:35:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- 172.21.15.135:0/3945536787 shutdown_connections 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 --2- 172.21.15.135:0/3945536787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a8810e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 --2- 172.21.15.135:0/3945536787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107eb0 0x7f8a88101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 --2- 172.21.15.135:0/3945536787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107a10 0x7f8a881015c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- 172.21.15.135:0/3945536787 >> 172.21.15.135:0/3945536787 conn(0x7f8a88077160 msgr2=0x7f8a880775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- 172.21.15.135:0/3945536787 shutdown_connections 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- 172.21.15.135:0/3945536787 wait complete. 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 Processor -- start 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.452+0000 7f8a90061640 1 -- start start 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107a10 0x7f8a880fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88111d60 con 0x7f8a88107eb0 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88111be0 con 0x7f8a88107a10 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a90061640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88111ee0 con 0x7f8a88102170 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8ddfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8ddfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:45194/0 (socket says 172.21.15.135:45194) 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8ddfd640 1 -- 172.21.15.135:0/3998255157 learned_addr learned my addr 172.21.15.135:0/3998255157 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40818/0 (socket says 172.21.15.135:40818) 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107a10 0x7f8a880fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 -- 172.21.15.135:0/3998255157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 msgr2=0x7f8a880fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 -- 172.21.15.135:0/3998255157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107a10 msgr2=0x7f8a880fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107a10 0x7f8a880fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 -- 172.21.15.135:0/3998255157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a881a7b70 con 0x7f8a88107eb0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009fd0 tx=0x7f8a8000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.453+0000 7f8a7effd640 1 -- 172.21.15.135:0/3998255157 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000ce20 con 0x7f8a88107eb0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.454+0000 7f8a7effd640 1 -- 172.21.15.135:0/3998255157 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a80005020 con 0x7f8a88107eb0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.454+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a881a7e60 con 0x7f8a88107eb0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.454+0000 7f8a7effd640 1 -- 172.21.15.135:0/3998255157 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80010720 con 0x7f8a88107eb0 2024-05-20T17:35:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.454+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a881a82c0 con 0x7f8a88107eb0 2024-05-20T17:35:44.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a96fe8740 1 Processor -- start 2024-05-20T17:35:44.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a7effd640 1 -- 172.21.15.135:0/3998255157 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8a80004b20 con 0x7f8a88107eb0 2024-05-20T17:35:44.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a96fe8740 1 -- start start 2024-05-20T17:35:44.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7712f0 0x562f0db395c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.457+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0db39b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562f0da9e340 con 0x562f0d7794d0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562f0da46290 con 0x562f0d79a1b0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f0da9a300 con 0x562f0d7712f0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a7effd640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 0x7f8a740a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:44864/0 (socket says 172.21.15.135:44864) 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/3817470272 learned_addr learned my addr 172.21.15.135:0/3817470272 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7712f0 0x562f0db395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0db39b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 0x7f8a740a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a7effd640 1 -- 172.21.15.135:0/3998255157 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8a800cfb00 con 0x7f8a88107eb0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/3817470272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7712f0 msgr2=0x562f0db395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7712f0 0x562f0db395c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/3817470272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 msgr2=0x562f0db39b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0db39b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/3817470272 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0da6a8e0 con 0x562f0d79a1b0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009730 tx=0x7f8a780096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=115a9b69e1b87e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.458+0000 7f8a73fff640 1 -- 172.21.15.135:0/3817470272 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78004050 con 0x562f0d79a1b0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a8e5fe640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 0x7f8a740a5200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a800cd850 tx=0x7f8a80066c50 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a73fff640 1 -- 172.21.15.135:0/3817470272 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a78005500 con 0x562f0d79a1b0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a73fff640 1 -- 172.21.15.135:0/3817470272 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78004c60 con 0x562f0d79a1b0 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 -- 172.21.15.135:0/3817470272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 msgr2=0x562f0db39080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009730 tx=0x7f8a780096c0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 -- 172.21.15.135:0/3817470272 shutdown_connections 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0db39b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7712f0 0x562f0db395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/3817470272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db39080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.459+0000 7f8a96fe8740 1 -- 172.21.15.135:0/3817470272 >> 172.21.15.135:0/3817470272 conn(0x562f0d78e300 msgr2=0x562f0db35830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 -- 172.21.15.135:0/3817470272 shutdown_connections 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 -- 172.21.15.135:0/3817470272 wait complete. 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 -- start start 2024-05-20T17:35:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 Processor -- start 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db45690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.460+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db435b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562f0db461b0 con 0x562f0d7712f0 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562f0da59790 con 0x562f0d79a1b0 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f0db46330 con 0x562f0d7794d0 2024-05-20T17:35:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a96fe8740 10 client.0 _ll_register_callbacks cb 0x562f0da94a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40842/0 (socket says 172.21.15.135:40842) 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1257251313 learned_addr learned my addr 172.21.15.135:0/1257251313 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db45690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1257251313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 msgr2=0x562f0db45690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db45690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 msgr2=0x562f0db435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1257251313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0d7b2210 con 0x562f0d7712f0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009c70 tx=0x7f8a78004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6209335f0bf778c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a717fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78004b40 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8a78004ce0 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.461+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a78005500 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a78034050 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 10 client.16182 fetch_fsmap learned FSMap version 26 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562f0d87e620 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a78005500 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8a7802c020 con 0x562f0d7712f0 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 10 client.16182 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 20 client.16182 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d758d80 0x562f0db55840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 4 client.16182 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f0daaba70 con 0x562f0d758d80 2024-05-20T17:35:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.462+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d758d80 0x562f0db55840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.463+0000 7f8a717fa640 10 client.16182 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.463+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d758d80 0x562f0db55840 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262df8608f63d7db server_cookie=33225ec65e6fb0a1 in_seq=0 out_seq=0 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a717fa640 1 -- 172.21.15.135:0/1257251313 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562f0daaba70 con 0x562f0d758d80 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a717fa640 10 client.16182 handle_command_reply: tid=0 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 client.16182 shutdown 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 msgr2=0x562f0db45130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009c70 tx=0x7f8a78004840 comp rx=0 tx=0).stop 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 shutdown_connections 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d758d80 0x562f0db55840 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d79a1b0 0x562f0db435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db45690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a717fa640 0 client.16182 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1257251313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db45130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 >> 172.21.15.135:0/1257251313 conn(0x562f0d78e300 msgr2=0x562f0db38eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 shutdown_connections 2024-05-20T17:35:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.467+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1257251313 wait complete. 2024-05-20T17:35:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.468+0000 7f8a96fe8740 20 client.16182 trim_cache size 0 max 16384 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 Processor -- start 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 -- start start 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d758d80 0x562f0db39520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db4bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881b3540 con 0x562f0d7712f0 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881b0e10 con 0x562f0d758d80 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881aec60 con 0x562f0d7794d0 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d758d80 0x562f0db39520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40848/0 (socket says 172.21.15.135:40848) 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 -- 172.21.15.135:0/4219649337 learned_addr learned my addr 172.21.15.135:0/4219649337 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db4bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 -- 172.21.15.135:0/4219649337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 msgr2=0x562f0db4bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db4bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 -- 172.21.15.135:0/4219649337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d758d80 msgr2=0x562f0db39520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d758d80 0x562f0db39520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.483+0000 7f8a8ddfd640 1 -- 172.21.15.135:0/4219649337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0db36420 con 0x562f0d7712f0 2024-05-20T17:35:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.484+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006010 tx=0x7f8a84009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e122ce93e3d3af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.484+0000 7f8a737fe640 1 -- 172.21.15.135:0/4219649337 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8404e030 con 0x562f0d7712f0 2024-05-20T17:35:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.484+0000 7f8a737fe640 1 -- 172.21.15.135:0/4219649337 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8404ae50 con 0x562f0d7712f0 2024-05-20T17:35:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.484+0000 7f8a737fe640 1 -- 172.21.15.135:0/4219649337 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84035040 con 0x562f0d7712f0 2024-05-20T17:35:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- 172.21.15.135:0/4219649337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 msgr2=0x562f0db4b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006010 tx=0x7f8a84009260 comp rx=0 tx=0).stop 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- 172.21.15.135:0/4219649337 shutdown_connections 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d7794d0 0x562f0db4bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7712f0 0x562f0db4b5c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/4219649337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d758d80 0x562f0db39520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- 172.21.15.135:0/4219649337 >> 172.21.15.135:0/4219649337 conn(0x562f0d78e300 msgr2=0x562f0db38e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- 172.21.15.135:0/4219649337 shutdown_connections 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- 172.21.15.135:0/4219649337 wait complete. 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 -- start start 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.485+0000 7f8a96fe8740 1 Processor -- start 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d758d80 0x562f0db4a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d7712f0 0x562f0db4ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881af2d0 con 0x562f0d7794d0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881b0740 con 0x562f0d7712f0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881af9a0 con 0x562f0d758d80 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 10 client.0 _ll_register_callbacks cb 0x7f8a78009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40864/0 (socket says 172.21.15.135:40864) 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1121598073 learned_addr learned my addr 172.21.15.135:0/1121598073 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d7712f0 0x562f0db4ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d758d80 0x562f0db4a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1121598073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d758d80 msgr2=0x562f0db4a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d758d80 0x562f0db4a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d7712f0 msgr2=0x562f0db4ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:44.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d7712f0 0x562f0db4ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 -- 172.21.15.135:0/1121598073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0dbbc040 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a8d5fc640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a780058c0 tx=0x7f8a78004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515ed6670d2208d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a717fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78005660 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8a78004b20 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.486+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8404ae50 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a78046050 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 10 client.16188 fetch_fsmap learned FSMap version 26 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562f0dbbd200 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8404ae50 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8a7801fce0 con 0x562f0d7794d0 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 10 client.16188 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 20 client.16188 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d79a1b0 0x562f0dbbf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 4 client.16188 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f0daa5dc0 con 0x562f0d79a1b0 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.487+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d79a1b0 0x562f0dbbf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.488+0000 7f8a717fa640 10 client.16188 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:44.488+0000 7f8a8ddfd640 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d79a1b0 0x562f0dbbf750 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398914f7c75bb601 server_cookie=a710085c7eec78cb in_seq=0 out_seq=0 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a717fa640 1 -- 172.21.15.135:0/1121598073 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f0daa5dc0 con 0x562f0d79a1b0 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a717fa640 10 client.16188 handle_command_reply: tid=0 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 client.16188 shutdown 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 msgr2=0x562f0dbbbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a780058c0 tx=0x7f8a78004840 comp rx=0 tx=0).stop 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 shutdown_connections 2024-05-20T17:35:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562f0d79a1b0 0x562f0dbbf750 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562f0d7794d0 0x562f0dbbbb00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f0d7712f0 0x562f0db4ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 --2- 172.21.15.135:0/1121598073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f0d758d80 0x562f0db4a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a717fa640 0 client.16188 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 >> 172.21.15.135:0/1121598073 conn(0x562f0d78e300 msgr2=0x562f0db3cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 shutdown_connections 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 1 -- 172.21.15.135:0/1121598073 wait complete. 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.391+0000 7f8a96fe8740 20 client.16188 trim_cache size 0 max 16384 2024-05-20T17:35:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:35:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:35:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:35:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 msgr2=0x7f8a740a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 0x7f8a740a5200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a800cd850 tx=0x7f8a80066c50 comp rx=0 tx=0).stop 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 msgr2=0x7f8a880fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009fd0 tx=0x7f8a8000ef10 comp rx=0 tx=0).stop 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 shutdown_connections 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8a740a2cf0 0x7f8a740a5200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a88107eb0 0x7f8a880fec80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a88107a10 0x7f8a880fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 --2- 172.21.15.135:0/3998255157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a88102170 0x7f8a880fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 >> 172.21.15.135:0/3998255157 conn(0x7f8a88077160 msgr2=0x7f8a88069370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 shutdown_connections 2024-05-20T17:35:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:45.392+0000 7f8a90061640 1 -- 172.21.15.135:0/3998255157 wait complete. 2024-05-20T17:35:45.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:45 smithi160 ceph-mon[36261]: pgmap v75: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.5 MiB/s wr, 827 op/s 2024-05-20T17:35:45.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:45 smithi172 ceph-mon[36511]: pgmap v75: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.5 MiB/s wr, 827 op/s 2024-05-20T17:35:45.607 INFO:tasks.workunit.client.0.smithi135.stdout: 56 496706 1003 318646 991 171013 455 2024-05-20T17:35:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:45 smithi135 ceph-mon[32027]: pgmap v75: 97 pgs: 97 active+clean; 128 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.5 MiB/s wr, 827 op/s 2024-05-20T17:35:47.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:47 smithi160 ceph-mon[36261]: pgmap v76: 97 pgs: 97 active+clean; 128 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-05-20T17:35:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:47 smithi172 ceph-mon[36511]: pgmap v76: 97 pgs: 97 active+clean; 128 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-05-20T17:35:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:47 smithi135 ceph-mon[32027]: pgmap v76: 97 pgs: 97 active+clean; 128 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-05-20T17:35:48.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:35:48.075+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:48.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:48 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:35:48.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:48 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:35:48.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:48 smithi135 ceph-mon[32027]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:48.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:48 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:35:48.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:48 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:35:48.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:48 smithi160 ceph-mon[36261]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:48.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:48 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:35:48.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:48 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:35:48.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:48 smithi172 ceph-mon[36511]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-20T17:35:49.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:49 smithi172 ceph-mon[36511]: scrub summary: idle 2024-05-20T17:35:49.481 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:49 smithi172 ceph-mon[36511]: pgmap v77: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.5 MiB/s wr, 1.17k op/s 2024-05-20T17:35:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:49 smithi160 ceph-mon[36261]: scrub summary: idle 2024-05-20T17:35:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:49 smithi160 ceph-mon[36261]: pgmap v77: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.5 MiB/s wr, 1.17k op/s 2024-05-20T17:35:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:49 smithi135 ceph-mon[32027]: scrub summary: idle 2024-05-20T17:35:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:49 smithi135 ceph-mon[32027]: pgmap v77: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.5 MiB/s wr, 1.17k op/s 2024-05-20T17:35:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:51 smithi160 ceph-mon[36261]: pgmap v78: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 759 op/s 2024-05-20T17:35:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:51 smithi172 ceph-mon[36511]: pgmap v78: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 759 op/s 2024-05-20T17:35:51.707 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:51 smithi135 ceph-mon[32027]: pgmap v78: 97 pgs: 97 active+clean; 113 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 759 op/s 2024-05-20T17:35:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:53 smithi160 ceph-mon[36261]: pgmap v79: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 794 op/s 2024-05-20T17:35:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:53 smithi172 ceph-mon[36511]: pgmap v79: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 794 op/s 2024-05-20T17:35:53.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:53 smithi135 ceph-mon[32027]: pgmap v79: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 794 op/s 2024-05-20T17:35:55.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:55 smithi160 ceph-mon[36261]: pgmap v80: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 456 op/s 2024-05-20T17:35:55.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:55 smithi172 ceph-mon[36511]: pgmap v80: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 456 op/s 2024-05-20T17:35:55.607 INFO:tasks.workunit.client.0.smithi135.stdout: 73 372504 963 246410 905 94075 71 2024-05-20T17:35:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:55 smithi135 ceph-mon[32027]: pgmap v80: 97 pgs: 97 active+clean; 120 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 456 op/s 2024-05-20T17:35:57.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:57 smithi160 ceph-mon[36261]: pgmap v81: 97 pgs: 97 active+clean; 133 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 516 op/s 2024-05-20T17:35:57.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:57 smithi172 ceph-mon[36511]: pgmap v81: 97 pgs: 97 active+clean; 133 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 516 op/s 2024-05-20T17:35:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:57 smithi135 ceph-mon[32027]: pgmap v81: 97 pgs: 97 active+clean; 133 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 516 op/s 2024-05-20T17:35:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.510+0000 7ffa95aca640 1 -- 172.21.15.135:0/614610526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa90108ff0 msgr2=0x7ffa90102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 --2- 172.21.15.135:0/614610526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa90108ff0 0x7ffa90102c30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009900 tx=0x7ffa8402a410 comp rx=0 tx=0).stop 2024-05-20T17:35:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 -- 172.21.15.135:0/614610526 shutdown_connections 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 --2- 172.21.15.135:0/614610526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa901032a0 0x7ffa9010f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 --2- 172.21.15.135:0/614610526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa90108ff0 0x7ffa90102c30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 --2- 172.21.15.135:0/614610526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa901026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 -- 172.21.15.135:0/614610526 >> 172.21.15.135:0/614610526 conn(0x7ffa90078250 msgr2=0x7ffa90078690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 -- 172.21.15.135:0/614610526 shutdown_connections 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 -- 172.21.15.135:0/614610526 wait complete. 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.511+0000 7ffa95aca640 1 Processor -- start 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 -- start start 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa9019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 0x7ffa90199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90112e90 con 0x7ffa901032a0 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90112d10 con 0x7ffa90108b50 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa95aca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90113010 con 0x7ffa90108ff0 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 0x7ffa90199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55240/0 (socket says 172.21.15.135:55240) 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 -- 172.21.15.135:0/1551000623 learned_addr learned my addr 172.21.15.135:0/1551000623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8effd640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa9019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 -- 172.21.15.135:0/1551000623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 msgr2=0x7ffa90199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 0x7ffa90199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 -- 172.21.15.135:0/1551000623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 msgr2=0x7ffa9019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa9019fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8f7fe640 1 -- 172.21.15.135:0/1551000623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa90199dc0 con 0x7ffa901032a0 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8effd640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa9019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.512+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 0x7ffa90199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa8f7fe640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000e9c0 tx=0x7ffa8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa8cff9640 1 -- 172.21.15.135:0/1551000623 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000cd80 con 0x7ffa901032a0 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9019a050 con 0x7ffa901032a0 2024-05-20T17:35:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa8cff9640 1 -- 172.21.15.135:0/1551000623 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa80005500 con 0x7ffa901032a0 2024-05-20T17:35:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa8cff9640 1 -- 172.21.15.135:0/1551000623 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80010690 con 0x7ffa901032a0 2024-05-20T17:35:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.513+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa901a62b0 con 0x7ffa901032a0 2024-05-20T17:35:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.515+0000 7ffa9c96c740 1 Processor -- start 2024-05-20T17:35:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.515+0000 7ffa9c96c740 1 -- start start 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8cff9640 1 -- 172.21.15.135:0/1551000623 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ffa80010830 con 0x7ffa901032a0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bc72f0 0x564c30f8f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bcf4d0 0x564c30f8f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564c30ef4340 con 0x564c30bf01b0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564c30e9c290 con 0x564c30bc72f0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c30ef0300 con 0x564c30bcf4d0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55250/0 (socket says 172.21.15.135:55250) 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bc72f0 0x564c30f8f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 -- 172.21.15.135:0/2300022401 learned_addr learned my addr 172.21.15.135:0/2300022401 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8effd640 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bcf4d0 0x564c30f8f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 -- 172.21.15.135:0/2300022401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bcf4d0 msgr2=0x564c30f8f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bcf4d0 0x564c30f8f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 -- 172.21.15.135:0/2300022401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bc72f0 msgr2=0x564c30f8f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bc72f0 0x564c30f8f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 -- 172.21.15.135:0/2300022401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c30ec08e0 con 0x564c30bf01b0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.516+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffa880117e0 tx=0x7ffa88011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c57fe4438aaab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa8cff9640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 0x7ffa780a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa75ffb640 1 -- 172.21.15.135:0/2300022401 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011310 con 0x564c30bf01b0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa8f7fe640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 0x7ffa780a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa75ffb640 1 -- 172.21.15.135:0/2300022401 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa88003e50 con 0x564c30bf01b0 2024-05-20T17:35:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa75ffb640 1 -- 172.21.15.135:0/2300022401 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004560 con 0x564c30bf01b0 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.517+0000 7ffa8cff9640 1 -- 172.21.15.135:0/1551000623 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ffa800cf750 con 0x7ffa901032a0 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 -- 172.21.15.135:0/2300022401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 msgr2=0x564c30f8ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa8f7fe640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 0x7ffa780a5200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa800ccf50 tx=0x7ffa800d5550 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffa880117e0 tx=0x7ffa88011ca0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 -- 172.21.15.135:0/2300022401 shutdown_connections 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bcf4d0 0x564c30f8f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bc72f0 0x564c30f8f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/2300022401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f8ef70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.518+0000 7ffa9c96c740 1 -- 172.21.15.135:0/2300022401 >> 172.21.15.135:0/2300022401 conn(0x564c30be4300 msgr2=0x564c30f8b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.521+0000 7ffa9c96c740 1 -- 172.21.15.135:0/2300022401 shutdown_connections 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.521+0000 7ffa9c96c740 1 -- 172.21.15.135:0/2300022401 wait complete. 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.521+0000 7ffa9c96c740 1 -- start start 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.521+0000 7ffa9c96c740 1 Processor -- start 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f9fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f9da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564c30fa05c0 con 0x564c30bf01b0 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564c30eaf790 con 0x564c30bcf4d0 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c30fa0740 con 0x564c30bc72f0 2024-05-20T17:35:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa9c96c740 10 client.0 _ll_register_callbacks cb 0x564c30eeaa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa8effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f9fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:45050/0 (socket says 172.21.15.135:45050) 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa8ffff640 1 -- 172.21.15.135:0/4227477832 learned_addr learned my addr 172.21.15.135:0/4227477832 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.522+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f9da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 -- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 msgr2=0x564c30f9fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f9fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 -- 172.21.15.135:0/4227477832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 msgr2=0x564c30f9da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f9da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 -- 172.21.15.135:0/4227477832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c30c08210 con 0x564c30bc72f0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa88004240 tx=0x7ffa88004140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b628ee4699c5bbeb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa6effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8801e070 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa88003e50 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ffa880042e0 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa88025040 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa9c96c740 10 client.25726 fetch_fsmap learned FSMap version 26 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.523+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c30cd4620 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa88003e50 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffa88018020 con 0x564c30bc72f0 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 10 client.25726 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 20 client.25726 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30baed80 0x564c30fafc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 4 client.25726 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c30f01a70 con 0x564c30baed80 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.524+0000 7ffa8effd640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30baed80 0x564c30fafc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.525+0000 7ffa6effd640 10 client.25726 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.525+0000 7ffa8effd640 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30baed80 0x564c30fafc30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55bbf49e76832fdb server_cookie=d6f309a480329f2 in_seq=0 out_seq=0 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa6effd640 1 -- 172.21.15.135:0/4227477832 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564c30f01a70 con 0x564c30baed80 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa6effd640 10 client.25726 handle_command_reply: tid=0 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa9c96c740 1 client.25726 shutdown 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 msgr2=0x564c30f9f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa88004240 tx=0x7ffa88004140 comp rx=0 tx=0).stop 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 shutdown_connections 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.528+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30baed80 0x564c30fafc30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bf01b0 0x564c30f9da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f9fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa6effd640 0 client.25726 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4227477832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30f9f5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 >> 172.21.15.135:0/4227477832 conn(0x564c30be4300 msgr2=0x564c30f8ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 shutdown_connections 2024-05-20T17:35:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4227477832 wait complete. 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.529+0000 7ffa9c96c740 20 client.25726 trim_cache size 0 max 16384 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.545+0000 7ffa9c96c740 1 Processor -- start 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.545+0000 7ffa9c96c740 1 -- start start 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f8ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901af280 con 0x564c30baed80 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901acb50 con 0x564c30bcf4d0 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901aa9a0 con 0x564c30bc72f0 2024-05-20T17:35:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55258/0 (socket says 172.21.15.135:55258) 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:45054/0 (socket says 172.21.15.135:45054) 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 -- 172.21.15.135:0/19460507 learned_addr learned my addr 172.21.15.135:0/19460507 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f8ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 -- 172.21.15.135:0/19460507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 msgr2=0x564c30fb5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 -- 172.21.15.135:0/19460507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 msgr2=0x564c30f8ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f8ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8ffff640 1 -- 172.21.15.135:0/19460507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c30f9bf60 con 0x564c30baed80 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.546+0000 7ffa8effd640 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.547+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffa88004210 tx=0x7ffa88011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409267349522fb82 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.547+0000 7ffa757fa640 1 -- 172.21.15.135:0/19460507 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8801e070 con 0x564c30baed80 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.547+0000 7ffa757fa640 1 -- 172.21.15.135:0/19460507 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa8803c030 con 0x564c30baed80 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.547+0000 7ffa757fa640 1 -- 172.21.15.135:0/19460507 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880052f0 con 0x564c30baed80 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- 172.21.15.135:0/19460507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 msgr2=0x564c30fb52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffa88004210 tx=0x7ffa88011ca0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- 172.21.15.135:0/19460507 shutdown_connections 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30f8ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30bc72f0 0x564c30fb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/19460507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30baed80 0x564c30fb52c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- 172.21.15.135:0/19460507 >> 172.21.15.135:0/19460507 conn(0x564c30be4300 msgr2=0x564c30f9c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- 172.21.15.135:0/19460507 shutdown_connections 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- 172.21.15.135:0/19460507 wait complete. 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 -- start start 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.548+0000 7ffa9c96c740 1 Processor -- start 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 0x564c30fa5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30fa2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901ab010 con 0x564c30bc72f0 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901ac480 con 0x564c30bcf4d0 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901ab6e0 con 0x564c30baed80 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa9c96c740 10 client.0 _ll_register_callbacks cb 0x7ffa800d5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 0x564c30fa5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:45066/0 (socket says 172.21.15.135:45066) 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8ffff640 1 -- 172.21.15.135:0/4093551326 learned_addr learned my addr 172.21.15.135:0/4093551326 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30fa2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 -- 172.21.15.135:0/4093551326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 msgr2=0x564c30fa5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 -- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 msgr2=0x564c30fa2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30fa2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 -- 172.21.15.135:0/4093551326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c30fa3430 con 0x564c30bc72f0 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa8effd640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 0x564c30fa5e80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffa8402a930 tx=0x7ffa84004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb1285388dabd78 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa6effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.549+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84035040 con 0x564c30bc72f0 2024-05-20T17:35:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ffa84005450 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa8803c030 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa84053050 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 10 client.16206 fetch_fsmap learned FSMap version 26 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c31017850 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa8803c030 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffa84004750 con 0x564c30bc72f0 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 10 client.16206 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 10 client.16206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 20 client.16206 populate_metadata read hostname 'smithi135' 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30bf01b0 0x564c3101a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:35:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 4 client.16206 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:35:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564c30efbdc0 con 0x564c30bf01b0 2024-05-20T17:35:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.550+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30bf01b0 0x564c3101a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:35:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.551+0000 7ffa6effd640 10 client.16206 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:58.551+0000 7ffa8ffff640 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30bf01b0 0x564c3101a070 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3adc8fe261633ea6 server_cookie=90802c815bd581b3 in_seq=0 out_seq=0 2024-05-20T17:35:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.228+0000 7ffa6effd640 1 -- 172.21.15.135:0/4093551326 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564c30efbdc0 con 0x564c30bf01b0 2024-05-20T17:35:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.228+0000 7ffa6effd640 10 client.16206 handle_command_reply: tid=0 2024-05-20T17:35:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.228+0000 7ffa9c96c740 1 client.16206 shutdown 2024-05-20T17:35:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 msgr2=0x564c30fa5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 0x564c30fa5e80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffa8402a930 tx=0x7ffa84004350 comp rx=0 tx=0).stop 2024-05-20T17:35:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 shutdown_connections 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564c30bf01b0 0x564c3101a070 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564c30bcf4d0 0x564c30fa2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c30bc72f0 0x564c30fa5e80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 --2- 172.21.15.135:0/4093551326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c30baed80 0x564c30fa5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 >> 172.21.15.135:0/4093551326 conn(0x564c30be4300 msgr2=0x564c30f9c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa6effd640 0 client.16206 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 shutdown_connections 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 1 -- 172.21.15.135:0/4093551326 wait complete. 2024-05-20T17:35:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.229+0000 7ffa9c96c740 20 client.16206 trim_cache size 0 max 16384 2024-05-20T17:35:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:35:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:35:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:35:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.230+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 msgr2=0x7ffa780a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.230+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 0x7ffa780a5200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa800ccf50 tx=0x7ffa800d5550 comp rx=0 tx=0).stop 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.230+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 msgr2=0x7ffa9019f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.230+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000e9c0 tx=0x7ffa8000ee80 comp rx=0 tx=0).stop 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 shutdown_connections 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffa780a2cf0 0x7ffa780a5200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa90108ff0 0x7ffa90199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa90108b50 0x7ffa9019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 --2- 172.21.15.135:0/1551000623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa901032a0 0x7ffa9019f510 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:35:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 >> 172.21.15.135:0/1551000623 conn(0x7ffa90078250 msgr2=0x7ffa90101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:35:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 shutdown_connections 2024-05-20T17:35:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:35:59.231+0000 7ffa95aca640 1 -- 172.21.15.135:0/1551000623 wait complete. 2024-05-20T17:35:59.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:35:59 smithi135 ceph-mon[32027]: pgmap v82: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 748 op/s 2024-05-20T17:35:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:35:59 smithi160 ceph-mon[36261]: pgmap v82: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 748 op/s 2024-05-20T17:35:59.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:35:59 smithi172 ceph-mon[36511]: pgmap v82: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 748 op/s 2024-05-20T17:36:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:01 smithi160 ceph-mon[36261]: pgmap v83: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 409 op/s 2024-05-20T17:36:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:01 smithi172 ceph-mon[36511]: pgmap v83: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 409 op/s 2024-05-20T17:36:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:01 smithi135 ceph-mon[32027]: pgmap v83: 97 pgs: 97 active+clean; 212 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 409 op/s 2024-05-20T17:36:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:03 smithi160 ceph-mon[36261]: pgmap v84: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-20T17:36:03.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:03 smithi172 ceph-mon[36511]: pgmap v84: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-20T17:36:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:03 smithi135 ceph-mon[32027]: pgmap v84: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-20T17:36:04.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-05-20T17:36:04.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-20T17:36:04.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 -- 172.21.15.135:0/4190771005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810a6f0 msgr2=0x7fd6c810cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/4190771005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810a6f0 0x7fd6c810cb10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009900 tx=0x7fd6b802a480 comp rx=0 tx=0).stop 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 -- 172.21.15.135:0/4190771005 shutdown_connections 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/4190771005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810d050 0x7fd6c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/4190771005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810a6f0 0x7fd6c810cb10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/4190771005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 0x7fd6c81040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 -- 172.21.15.135:0/4190771005 >> 172.21.15.135:0/4190771005 conn(0x7fd6c8077130 msgr2=0x7fd6c8077570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 -- 172.21.15.135:0/4190771005 shutdown_connections 2024-05-20T17:36:04.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.757+0000 7fd6cfcca640 1 -- 172.21.15.135:0/4190771005 wait complete. 2024-05-20T17:36:04.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 Processor -- start 2024-05-20T17:36:04.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 -- start start 2024-05-20T17:36:04.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 0x7fd6c819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810a6f0 0x7fd6c819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c8112e30 con 0x7fd6c810d050 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c8112cb0 con 0x7fd6c810a6f0 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cfcca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c8112fb0 con 0x7fd6c8103c90 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810a6f0 0x7fd6c819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49254/0 (socket says 172.21.15.135:49254) 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 -- 172.21.15.135:0/497141062 learned_addr learned my addr 172.21.15.135:0/497141062 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6cda66640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 0x7fd6c819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 -- 172.21.15.135:0/497141062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 msgr2=0x7fd6c819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 0x7fd6c819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 -- 172.21.15.135:0/497141062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810a6f0 msgr2=0x7fd6c819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810a6f0 0x7fd6c819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.758+0000 7fd6ce267640 1 -- 172.21.15.135:0/497141062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8199d80 con 0x7fd6c810d050 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6ce267640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000eb10 tx=0x7fd6c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6beffd640 1 -- 172.21.15.135:0/497141062 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0004b20 con 0x7fd6c810d050 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6beffd640 1 -- 172.21.15.135:0/497141062 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c0004cc0 con 0x7fd6c810d050 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c819a010 con 0x7fd6c810d050 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6beffd640 1 -- 172.21.15.135:0/497141062 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0010760 con 0x7fd6c810d050 2024-05-20T17:36:04.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.759+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c81a6270 con 0x7fd6c810d050 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.761+0000 7fd6beffd640 1 -- 172.21.15.135:0/497141062 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd6c0005020 con 0x7fd6c810d050 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.762+0000 7fd6d6b6c740 1 Processor -- start 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.762+0000 7fd6d6b6c740 1 -- start start 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.762+0000 7fd6beffd640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 0x7fd6b40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 0x56342d559d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cd265640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 0x7fd6b40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d55a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d55a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56342d4bfd00 con 0x56342d19a6b0 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56342d4674c0 con 0x56342d1924d0 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56342d4bbcc0 con 0x56342d1bb390 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6beffd640 1 -- 172.21.15.135:0/497141062 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6c00cf940 con 0x7fd6c810d050 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d55a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d55a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d55a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57580/0 (socket says 172.21.15.135:57580) 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cd265640 1 -- 172.21.15.135:0/1926586416 learned_addr learned my addr 172.21.15.135:0/1926586416 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d55a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49262/0 (socket says 172.21.15.135:49262) 2024-05-20T17:36:04.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 0x56342d559d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 -- 172.21.15.135:0/1926586416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 msgr2=0x56342d55a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d55a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 -- 172.21.15.135:0/1926586416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 msgr2=0x56342d55a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d55a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cd265640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 0x7fd6b40a5210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8031550 tx=0x7fd6b8004380 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 -- 172.21.15.135:0/1926586416 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56342d29d7d0 con 0x56342d1bb390 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.763+0000 7fd6cda66640 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 0x56342d559d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009c00 tx=0x7fd6c4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234c37853471c2f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.764+0000 7fd6b3fff640 1 -- 172.21.15.135:0/1926586416 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4004050 con 0x56342d1bb390 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.764+0000 7fd6b3fff640 1 -- 172.21.15.135:0/1926586416 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c4005500 con 0x56342d1bb390 2024-05-20T17:36:04.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.764+0000 7fd6b3fff640 1 -- 172.21.15.135:0/1926586416 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4004dd0 con 0x56342d1bb390 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.764+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/1926586416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 msgr2=0x56342d559d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.764+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 0x56342d559d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009c00 tx=0x7fd6c4011810 comp rx=0 tx=0).stop 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/1926586416 shutdown_connections 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d55a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d55a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/1926586416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1bb390 0x56342d559d30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/1926586416 >> 172.21.15.135:0/1926586416 conn(0x56342d1af4e0 msgr2=0x56342d5564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/1926586416 shutdown_connections 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/1926586416 wait complete. 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 -- start start 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.765+0000 7fd6d6b6c740 1 Processor -- start 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d19a6b0 0x56342d5662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56342d567020 con 0x56342d1bb390 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56342d47ab90 con 0x56342d1924d0 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56342d5671a0 con 0x56342d19a6b0 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 10 client.0 _ll_register_callbacks cb 0x56342d4b6da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6cda66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6cda66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57586/0 (socket says 172.21.15.135:57586) 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49266/0 (socket says 172.21.15.135:49266) 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6cda66640 1 -- 172.21.15.135:0/567310392 learned_addr learned my addr 172.21.15.135:0/567310392 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6cd265640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d19a6b0 0x56342d5662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 -- 172.21.15.135:0/567310392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d19a6b0 msgr2=0x56342d5662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d19a6b0 0x56342d5662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 -- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 msgr2=0x56342d565d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 -- 172.21.15.135:0/567310392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56342d1d33f0 con 0x56342d1bb390 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6cda66640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6ce267640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00cd090 tx=0x7fd6c009b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f06c9fc5154f6be server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:04.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00cd520 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6c009c2c0 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.766+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c4005500 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd6c00a0210 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 10 client.16218 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56342d1930f0 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c4005500 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd6c009b2b0 con 0x56342d1bb390 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 10 client.16218 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 20 client.16218 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d179f60 0x56342d576b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 4 client.16218 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:04.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56342d4cd430 con 0x56342d179f60 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.767+0000 7fd6cda66640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d179f60 0x56342d576b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.768+0000 7fd6cda66640 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d179f60 0x56342d576b20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a672b5d2d0420bc server_cookie=fad1947abf93aff8 in_seq=0 out_seq=0 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.768+0000 7fd6b17fa640 10 client.16218 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6b17fa640 1 -- 172.21.15.135:0/567310392 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56342d4cd430 con 0x56342d179f60 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6b17fa640 10 client.16218 handle_command_reply: tid=0 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 client.16218 shutdown 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 msgr2=0x56342d564290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00cd090 tx=0x7fd6c009b880 comp rx=0 tx=0).stop 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 shutdown_connections 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d179f60 0x56342d576b20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1bb390 0x56342d564290 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6b17fa640 0 client.16218 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d19a6b0 0x56342d5662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/567310392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1924d0 0x56342d565d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 >> 172.21.15.135:0/567310392 conn(0x56342d1af4e0 msgr2=0x56342d55ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 shutdown_connections 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/567310392 wait complete. 2024-05-20T17:36:04.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.770+0000 7fd6d6b6c740 20 client.16218 trim_cache size 0 max 16384 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 Processor -- start 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 -- start start 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 0x56342d564190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 0x56342d563270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81b1340 con 0x56342d1924d0 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81aec10 con 0x56342d19a6b0 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.790+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81aca60 con 0x56342d1af4e0 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49282/0 (socket says 172.21.15.135:49282) 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cd265640 1 -- 172.21.15.135:0/3766093600 learned_addr learned my addr 172.21.15.135:0/3766093600 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 0x56342d564190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6ce267640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 0x56342d563270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 -- 172.21.15.135:0/3766093600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 msgr2=0x56342d563270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 0x56342d563270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 -- 172.21.15.135:0/3766093600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 msgr2=0x56342d55f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 -- 172.21.15.135:0/3766093600 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56342d5570b0 con 0x56342d1af4e0 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6ce267640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 0x56342d563270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cd265640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 0x56342d564190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56342d563af0 tx=0x7fd6c4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2890cf29d41901a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6b37fe640 1 -- 172.21.15.135:0/3766093600 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4033070 con 0x56342d1af4e0 2024-05-20T17:36:04.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6b37fe640 1 -- 172.21.15.135:0/3766093600 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c4004360 con 0x56342d1af4e0 2024-05-20T17:36:04.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.791+0000 7fd6b37fe640 1 -- 172.21.15.135:0/3766093600 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4003870 con 0x56342d1af4e0 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3766093600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 msgr2=0x56342d564190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 0x56342d564190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56342d563af0 tx=0x7fd6c4005f90 comp rx=0 tx=0).stop 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3766093600 shutdown_connections 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d19a6b0 0x56342d563270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d1924d0 0x56342d55f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3766093600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1af4e0 0x56342d564190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3766093600 >> 172.21.15.135:0/3766093600 conn(0x56342d55fc10 msgr2=0x56342d562b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3766093600 shutdown_connections 2024-05-20T17:36:04.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.792+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3766093600 wait complete. 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 -- start start 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 Processor -- start 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1924d0 0x56342d569870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 0x56342d5d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81ad0d0 con 0x56342d19a6b0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81ae540 con 0x56342d1af4e0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c81ad7a0 con 0x56342d1924d0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.793+0000 7fd6d6b6c740 10 client.0 _ll_register_callbacks cb 0x7fd6c00bc050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 0x56342d5d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6cd265640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49294/0 (socket says 172.21.15.135:49294) 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6cd265640 1 -- 172.21.15.135:0/3721576387 learned_addr learned my addr 172.21.15.135:0/3721576387 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1924d0 0x56342d569870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 -- 172.21.15.135:0/3721576387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1924d0 msgr2=0x56342d569870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1924d0 0x56342d569870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 -- 172.21.15.135:0/3721576387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 msgr2=0x56342d569db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 -- 172.21.15.135:0/3721576387 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56342d5d73d0 con 0x56342d1af4e0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6cd265640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6ce267640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 0x56342d5d6e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6c009bb60 tx=0x7fd6c000efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a2f4f1d2761add server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00a8070 con 0x56342d1af4e0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6c009c2d0 con 0x56342d1af4e0 2024-05-20T17:36:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c4004360 con 0x56342d1af4e0 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.794+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd6c00cd520 con 0x56342d1af4e0 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 10 client.25862 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56342d5de6b0 con 0x56342d1af4e0 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c4004360 con 0x56342d1af4e0 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd6c00baaa0 con 0x56342d1af4e0 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 10 client.25862 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 20 client.25862 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d1bb390 0x56342d5e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 4 client.25862 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56342d4c7780 con 0x56342d1bb390 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.795+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d1bb390 0x56342d5e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.796+0000 7fd6b17fa640 10 client.25862 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.796+0000 7fd6cda66640 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d1bb390 0x56342d5e0d30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f876e33ca8bcf35 server_cookie=c0cdd09d0d41faa4 in_seq=0 out_seq=0 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6b17fa640 1 -- 172.21.15.135:0/3721576387 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56342d4c7780 con 0x56342d1bb390 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6b17fa640 10 client.25862 handle_command_reply: tid=0 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 client.25862 shutdown 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 msgr2=0x56342d5d6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 0x56342d5d6e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6c009bb60 tx=0x7fd6c000efd0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 shutdown_connections 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56342d1bb390 0x56342d5e0d30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56342d1af4e0 0x56342d5d6e60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56342d19a6b0 0x56342d569db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6b17fa640 0 client.25862 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 --2- 172.21.15.135:0/3721576387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56342d1924d0 0x56342d569870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 >> 172.21.15.135:0/3721576387 conn(0x56342d55fc10 msgr2=0x56342d55df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 shutdown_connections 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 1 -- 172.21.15.135:0/3721576387 wait complete. 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.797+0000 7fd6d6b6c740 20 client.25862 trim_cache size 0 max 16384 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:36:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-05-20T17:36:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-05-20T17:36:04.805 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:36:04.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 msgr2=0x7fd6b40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 0x7fd6b40a5210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8031550 tx=0x7fd6b8004380 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 msgr2=0x7fd6c8199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000eb10 tx=0x7fd6c000c2d0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 shutdown_connections 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6b40a2d00 0x7fd6b40a5210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6c810d050 0x7fd6c8199650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6c810a6f0 0x7fd6c819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 --2- 172.21.15.135:0/497141062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8103c90 0x7fd6c819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 >> 172.21.15.135:0/497141062 conn(0x7fd6c8077130 msgr2=0x7fd6c8100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 shutdown_connections 2024-05-20T17:36:04.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.798+0000 7fd6cfcca640 1 -- 172.21.15.135:0/497141062 wait complete. 2024-05-20T17:36:04.811 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-20T17:36:04.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:36:04.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.928+0000 7fde2d196640 1 -- 172.21.15.135:0/2567063727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 msgr2=0x7fde28105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.928+0000 7fde2d196640 1 --2- 172.21.15.135:0/2567063727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28105d40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009900 tx=0x7fde1c02a410 comp rx=0 tx=0).stop 2024-05-20T17:36:04.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 -- 172.21.15.135:0/2567063727 shutdown_connections 2024-05-20T17:36:04.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 --2- 172.21.15.135:0/2567063727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 0x7fde2810db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 --2- 172.21.15.135:0/2567063727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28105d40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 --2- 172.21.15.135:0/2567063727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde28101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 -- 172.21.15.135:0/2567063727 >> 172.21.15.135:0/2567063727 conn(0x7fde280fc7c0 msgr2=0x7fde280fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:04.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 -- 172.21.15.135:0/2567063727 shutdown_connections 2024-05-20T17:36:04.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.929+0000 7fde2d196640 1 -- 172.21.15.135:0/2567063727 wait complete. 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 Processor -- start 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 -- start start 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 0x7fde2819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110c00 con 0x7fde28105910 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110a80 con 0x7fde281063d0 2024-05-20T17:36:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2d196640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde28110d80 con 0x7fde28101380 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49318/0 (socket says 172.21.15.135:49318) 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2659c640 1 -- 172.21.15.135:0/527809747 learned_addr learned my addr 172.21.15.135:0/527809747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde26d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.930+0000 7fde2759e640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 0x7fde2819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 -- 172.21.15.135:0/527809747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 msgr2=0x7fde2819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 0x7fde2819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 -- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 msgr2=0x7fde28199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 -- 172.21.15.135:0/527809747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2819e630 con 0x7fde28101380 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde26d9d640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde281997d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde1800aed0 tx=0x7fde1800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18013450 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde18013ad0 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2819e920 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1801bb30 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.931+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde281972f0 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.932+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde28102400 con 0x7fde28101380 2024-05-20T17:36:04.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.934+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fde1801bcd0 con 0x7fde28101380 2024-05-20T17:36:04.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.935+0000 7fde0ffff640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 0x7fde100a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:04.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.935+0000 7fde2659c640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 0x7fde100a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:04.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.935+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fde180d3790 con 0x7fde28101380 2024-05-20T17:36:04.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.936+0000 7fde2659c640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 0x7fde100a5290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde1c031550 tx=0x7fde1c009560 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:04.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:04.938+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fde1809fe70 con 0x7fde28101380 2024-05-20T17:36:05.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.175+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde280682c0 con 0x7fde28101380 2024-05-20T17:36:05.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.176+0000 7fde0ffff640 1 -- 172.21.15.135:0/527809747 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11889 (secure 0 0 0) 0x7fde180a4170 con 0x7fde28101380 2024-05-20T17:36:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:36:05.178 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:35:40.835736+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":72,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":72,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24523,24560,24521]},"id":1}]} 2024-05-20T17:36:05.178 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 26 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 msgr2=0x7fde100a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 0x7fde100a5290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde1c031550 tx=0x7fde1c009560 comp rx=0 tx=0).stop 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 msgr2=0x7fde281997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde281997d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde1800aed0 tx=0x7fde1800ee60 comp rx=0 tx=0).stop 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 shutdown_connections 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fde100a2d80 0x7fde100a5290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde281063d0 0x7fde2819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde28105910 0x7fde28199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 --2- 172.21.15.135:0/527809747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde28101380 0x7fde281997d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.178+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 >> 172.21.15.135:0/527809747 conn(0x7fde280fc7c0 msgr2=0x7fde2810cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.179+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 shutdown_connections 2024-05-20T17:36:05.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.179+0000 7fde2d196640 1 -- 172.21.15.135:0/527809747 wait complete. 2024-05-20T17:36:05.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-20T17:36:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 -- 172.21.15.135:0/4233406430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c01079d0 msgr2=0x7f54c0101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 --2- 172.21.15.135:0/4233406430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c01079d0 0x7f54c0101560 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009900 tx=0x7f54b002a410 comp rx=0 tx=0).stop 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 -- 172.21.15.135:0/4233406430 shutdown_connections 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 --2- 172.21.15.135:0/4233406430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c010c330 0x7f54c010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 --2- 172.21.15.135:0/4233406430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c0101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 --2- 172.21.15.135:0/4233406430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c01079d0 0x7f54c0101560 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 -- 172.21.15.135:0/4233406430 >> 172.21.15.135:0/4233406430 conn(0x7f54c00770b0 msgr2=0x7f54c00774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 -- 172.21.15.135:0/4233406430 shutdown_connections 2024-05-20T17:36:05.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.312+0000 7f54c4d21640 1 -- 172.21.15.135:0/4233406430 wait complete. 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 Processor -- start 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 -- start start 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c01079d0 0x7f54c0198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0111ce0 con 0x7f54c010c330 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0111b60 con 0x7f54c0101aa0 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54c4d21640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0111e60 con 0x7f54c01079d0 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54be59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49344/0 (socket says 172.21.15.135:49344) 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54be59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57646/0 (socket says 172.21.15.135:57646) 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54bed9d640 1 -- 172.21.15.135:0/405005863 learned_addr learned my addr 172.21.15.135:0/405005863 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.313+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c01079d0 0x7f54c0198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 -- 172.21.15.135:0/405005863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c01079d0 msgr2=0x7f54c0198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c01079d0 0x7f54c0198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 -- 172.21.15.135:0/405005863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 msgr2=0x7f54c01986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 -- 172.21.15.135:0/405005863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c019d500 con 0x7f54c010c330 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54be59c640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54bed9d640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fd0 tx=0x7f54b800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54af7fe640 1 -- 172.21.15.135:0/405005863 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8017070 con 0x7f54c010c330 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54af7fe640 1 -- 172.21.15.135:0/405005863 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b8003e50 con 0x7f54c010c330 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c019d7f0 con 0x7f54c010c330 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54af7fe640 1 -- 172.21.15.135:0/405005863 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b80106c0 con 0x7f54c010c330 2024-05-20T17:36:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.314+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01a5170 con 0x7f54c010c330 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.316+0000 7f54cbbc6740 1 Processor -- start 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54af7fe640 1 -- 172.21.15.135:0/405005863 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f54b8003970 con 0x7f54c010c330 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 -- start start 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 0x5563eeddbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eeddc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563eed41c40 con 0x5563eea1c6b0 2024-05-20T17:36:05.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5563eece9580 con 0x5563eea3d390 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563eed3dc00 con 0x5563eea144d0 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 0x5563eeddbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54be59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 0x5563eeddbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57662/0 (socket says 172.21.15.135:57662) 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54be59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:37718/0 (socket says 172.21.15.135:37718) 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54bdd9b640 1 -- 172.21.15.135:0/2951623918 learned_addr learned my addr 172.21.15.135:0/2951623918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.317+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eeddc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54af7fe640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 0x7f54a80a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 -- 172.21.15.135:0/2951623918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 msgr2=0x5563eeddbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 0x5563eeddbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 -- 172.21.15.135:0/2951623918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 msgr2=0x5563eeddc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eeddc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 -- 172.21.15.135:0/2951623918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563eea553f0 con 0x5563eea144d0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54bed9d640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 0x7f54a80a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54af7fe640 1 -- 172.21.15.135:0/405005863 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f54b80cf0d0 con 0x7f54c010c330 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54be59c640 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006010 tx=0x7f54b0005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac4ddf9ba7fd7d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54bed9d640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 0x7f54a80a5290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54b809b630 tx=0x7f54b80044b0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54acff9640 1 -- 172.21.15.135:0/2951623918 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0035040 con 0x5563eea144d0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54acff9640 1 -- 172.21.15.135:0/2951623918 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00317b0 con 0x5563eea144d0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.318+0000 7f54acff9640 1 -- 172.21.15.135:0/2951623918 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b00047a0 con 0x5563eea144d0 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2951623918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 msgr2=0x5563eeddc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006010 tx=0x7f54b0005d50 comp rx=0 tx=0).stop 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2951623918 shutdown_connections 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eeddc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea144d0 0x5563eeddc0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2951623918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea3d390 0x5563eeddbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2951623918 >> 172.21.15.135:0/2951623918 conn(0x5563eea314e0 msgr2=0x5563eedd84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2951623918 shutdown_connections 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.319+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2951623918 wait complete. 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 -- start start 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 Processor -- start 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eede8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eede8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563eedeb220 con 0x5563eea3d390 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5563eecfcc40 con 0x5563eea144d0 2024-05-20T17:36:05.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563eedeb3a0 con 0x5563eea1c6b0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54cbbc6740 10 client.0 _ll_register_callbacks cb 0x5563eea54be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49370/0 (socket says 172.21.15.135:49370) 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54bdd9b640 1 -- 172.21.15.135:0/2606619463 learned_addr learned my addr 172.21.15.135:0/2606619463 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eede8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.320+0000 7f54be59c640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eede8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 -- 172.21.15.135:0/2606619463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 msgr2=0x5563eede8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eede8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 -- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 msgr2=0x5563eede8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eede8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 -- 172.21.15.135:0/2606619463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563eeb1f7d0 con 0x5563eea3d390 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f54b4005bc0 tx=0x7f54b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94738fca8bfe93da server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4004030 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b00317b0 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f54b40041d0 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54b40043d0 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54cbbc6740 10 client.16242 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5563eedf79e0 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.321+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00317b0 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f54b401d070 con 0x5563eea3d390 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 10 client.16242 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 10 client.16242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 20 client.16242 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563ee9fbf60 0x5563eedfaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 4 client.16242 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:05.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563eed4f370 con 0x5563ee9fbf60 2024-05-20T17:36:05.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54be59c640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563ee9fbf60 0x5563eedfaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54a5ffb640 10 client.16242 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:36:05.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.322+0000 7f54be59c640 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563ee9fbf60 0x5563eedfaf90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68e7ffa50ae34a4 server_cookie=50a6a252153c3b07 in_seq=0 out_seq=0 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54a5ffb640 1 -- 172.21.15.135:0/2606619463 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5563eed4f370 con 0x5563ee9fbf60 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54a5ffb640 10 client.16242 handle_command_reply: tid=0 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 client.16242 shutdown 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 msgr2=0x5563eedee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f54b4005bc0 tx=0x7f54b4004730 comp rx=0 tx=0).stop 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 shutdown_connections 2024-05-20T17:36:05.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563ee9fbf60 0x5563eedfaf90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea3d390 0x5563eedee6a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54a5ffb640 0 client.16242 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eede8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/2606619463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eede8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 >> 172.21.15.135:0/2606619463 conn(0x5563eea314e0 msgr2=0x5563eeddda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 shutdown_connections 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 1 -- 172.21.15.135:0/2606619463 wait complete. 2024-05-20T17:36:05.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.324+0000 7f54cbbc6740 20 client.16242 trim_cache size 0 max 16384 2024-05-20T17:36:05.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 Processor -- start 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 -- start start 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eedddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01aeee0 con 0x5563ee9fbf60 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01ac7b0 con 0x5563eea144d0 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01aa600 con 0x5563eea1c6b0 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49382/0 (socket says 172.21.15.135:49382) 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4060295096 learned_addr learned my addr 172.21.15.135:0/4060295096 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54be59c640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.339+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eedddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4060295096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 msgr2=0x5563eedddf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eedddf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4060295096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 msgr2=0x5563eedf5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4060295096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563eedd2870 con 0x5563ee9fbf60 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54be59c640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f54b400ffb0 tx=0x7f54b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12ff8b6242ef48 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54a7fff640 1 -- 172.21.15.135:0/4060295096 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b402f040 con 0x5563ee9fbf60 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54a7fff640 1 -- 172.21.15.135:0/4060295096 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b4004570 con 0x5563ee9fbf60 2024-05-20T17:36:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.340+0000 7f54a7fff640 1 -- 172.21.15.135:0/4060295096 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003ab0 con 0x5563ee9fbf60 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4060295096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 msgr2=0x5563eedee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f54b400ffb0 tx=0x7f54b4001e70 comp rx=0 tx=0).stop 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4060295096 shutdown_connections 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563eea1c6b0 0x5563eedddf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4060295096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563ee9fbf60 0x5563eedee610 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4060295096 >> 172.21.15.135:0/4060295096 conn(0x5563eea314e0 msgr2=0x5563eeddd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4060295096 shutdown_connections 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4060295096 wait complete. 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 -- start start 2024-05-20T17:36:05.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.341+0000 7f54cbbc6740 1 Processor -- start 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ee9fbf60 0x5563eedf0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01aac70 con 0x5563eea1c6b0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01ac0e0 con 0x5563eea144d0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c01ab340 con 0x5563ee9fbf60 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54cbbc6740 10 client.0 _ll_register_callbacks cb 0x7f54b4011500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49388/0 (socket says 172.21.15.135:49388) 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4253932260 learned_addr learned my addr 172.21.15.135:0/4253932260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54be59c640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ee9fbf60 0x5563eedf0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4253932260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ee9fbf60 msgr2=0x5563eedf0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ee9fbf60 0x5563eedf0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 msgr2=0x5563eedf07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 -- 172.21.15.135:0/4253932260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563eee61830 con 0x5563eea1c6b0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54be59c640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54bdd9b640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f54b4003750 tx=0x7f54b403a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f6b3776526bc91 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.342+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b402f040 con 0x5563eea1c6b0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5563eed496c0 con 0x5563eea1c6b0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f54b4004de0 con 0x5563eea1c6b0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54b4004fe0 con 0x5563eea1c6b0 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 10 client.16248 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5563eee629e0 con 0x5563eea1c6b0 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5563eed496c0 con 0x5563eea1c6b0 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f54b4042020 con 0x5563eea1c6b0 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 10 client.16248 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 10 client.16248 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 20 client.16248 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563eea3d390 0x5563eee65170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 4 client.16248 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 --> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563eecc6820 con 0x5563eea3d390 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.343+0000 7f54be59c640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563eea3d390 0x5563eee65170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.344+0000 7f54a5ffb640 10 client.16248 ms_handle_connect on v2:172.21.15.160:6836/320557399 2024-05-20T17:36:05.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.344+0000 7f54be59c640 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563eea3d390 0x5563eee65170 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5236e017d8c5e85 server_cookie=d94cbe11957554f1 in_seq=0 out_seq=0 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54a5ffb640 1 -- 172.21.15.135:0/4253932260 <== mds.2 v2:172.21.15.160:6836/320557399 1 ==== command_reply(tid 0: 0 ) ==== 8+0+136382 (crc 0 0 0) 0x5563eecc6820 con 0x5563eea3d390 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54a5ffb640 10 client.16248 handle_command_reply: tid=0 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 client.16248 shutdown 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 msgr2=0x5563eee612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f54b4003750 tx=0x7f54b403a040 comp rx=0 tx=0).stop 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 shutdown_connections 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:6836/320557399,v1:172.21.15.160:6837/320557399] conn(0x5563eea3d390 0x5563eee65170 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563eea1c6b0 0x5563eee612f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563eea144d0 0x5563eedf07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 --2- 172.21.15.135:0/4253932260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ee9fbf60 0x5563eedf0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54a5ffb640 0 client.16248 ms_handle_reset on v2:172.21.15.160:6836/320557399 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 >> 172.21.15.135:0/4253932260 conn(0x5563eea314e0 msgr2=0x5563eede8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 shutdown_connections 2024-05-20T17:36:05.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 1 -- 172.21.15.135:0/4253932260 wait complete. 2024-05-20T17:36:05.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.348+0000 7f54cbbc6740 20 client.16248 trim_cache size 0 max 16384 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3609530, 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628811, 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml" 2024-05-20T17:36:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 5592355, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629803, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml" 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 7422945, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632525, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg" 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.359 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 8251832, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631766, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg" 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 12308606, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631964, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg" 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.360 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 25159854, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631874, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg" 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 51340617, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631857, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg" 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 61751491, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630043, 2024-05-20T17:36:05.361 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml" 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 66859432, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629629, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg" 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 74075095, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633714, 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg" 2024-05-20T17:36:05.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 75331065, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631949, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg" 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 78245176, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632664, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml" 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 83167862, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630560, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg" 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 87659792, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628866, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml" 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.364 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 97515914, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629053, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg" 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 112550457, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628804, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml" 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 112865633, 2024-05-20T17:36:05.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630499, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg" 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 120741756, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632414, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg" 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 128292439, 2024-05-20T17:36:05.366 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632866, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml" 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 140951634, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631604, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg" 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 150441900, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632593, 2024-05-20T17:36:05.367 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml" 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 155493082, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630094, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg" 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 157141701, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629439, 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml" 2024-05-20T17:36:05.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 160649331, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632820, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml" 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 178796290, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632755, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml" 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.369 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 186827635, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632442, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg" 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 198862266, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632871, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml" 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.370 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 206506664, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628905, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml" 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 211168612, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632684, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml" 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 216771997, 2024-05-20T17:36:05.371 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629668, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg" 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 224807818, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628722, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml" 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 234541805, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628986, 2024-05-20T17:36:05.372 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg" 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 244620087, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629788, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml" 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 247849469, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631410, 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml" 2024-05-20T17:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 254718809, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632438, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml" 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 284365753, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632434, 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg" 2024-05-20T17:36:05.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 285134852, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628818, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml" 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 295998235, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631387, 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml" 2024-05-20T17:36:05.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 304182077, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631574, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml" 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 307075630, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629044, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg" 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.376 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 308012683, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630517, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg" 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 312075646, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628807, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml" 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.377 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 320960084, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632509, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml" 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 323109923, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631882, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg" 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.378 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 326551379, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633706, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg" 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 338707414, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628939, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml" 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 343104805, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631475, 2024-05-20T17:36:05.379 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml" 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 345835536, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633690, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg" 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 359340132, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632846, 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml" 2024-05-20T17:36:05.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 362890243, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632418, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml" 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 364001575, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631982, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg" 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.381 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 366099861, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632567, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml" 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 370584476, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629009, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg" 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.382 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 371629340, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632513, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg" 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 382585745, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629169, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml" 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.383 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 416463720, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632942, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg" 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 426200894, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632677, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml" 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 433693510, 2024-05-20T17:36:05.384 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633628, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg" 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 433964550, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631480, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml" 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 436903273, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631943, 2024-05-20T17:36:05.385 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg" 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 438909666, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631851, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg" 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 450011943, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628737, 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml" 2024-05-20T17:36:05.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 451684347, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632786, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml" 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 469722136, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631266, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml" 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 492969010, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632939, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml" 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 505921546, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632878, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml" 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 516131416, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628861, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml" 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 516266548, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628887, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml" 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.389 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 516559567, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631300, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml" 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 521845369, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632781, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml" 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.390 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 534370099, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632898, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml" 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 538381788, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628712, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml" 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.391 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 552940403, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628764, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml" 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 553807923, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631554, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml" 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.392 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 554747713, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632882, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml" 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 555997167, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633669, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg" 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.393 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 567821919, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629293, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml" 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 568723372, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629055, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg" 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.394 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 575333588, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629459, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml" 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 576332368, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632739, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml" 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.395 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 577368132, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631465, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml" 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 586670307, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632763, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml" 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 595954439, 2024-05-20T17:36:05.396 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632658, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml" 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 598155311, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631924, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg" 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 601956431, 2024-05-20T17:36:05.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629048, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg" 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 606728884, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632774, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml" 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 608306034, 2024-05-20T17:36:05.398 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632842, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml" 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 613946634, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632831, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml" 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 632234415, 2024-05-20T17:36:05.399 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628944, 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml" 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 635602300, 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628726, 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml" 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 650822612, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631510, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml" 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 668326934, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631287, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml" 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 676916916, 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632859, 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml" 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 708807447, 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631373, 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml" 2024-05-20T17:36:05.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 720246251, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629593, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg" 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 743987476, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632922, 2024-05-20T17:36:05.403 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg" 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 760409236, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632788, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml" 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 762294865, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633659, 2024-05-20T17:36:05.404 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg" 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 777106497, 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633617, 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml" 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 784080946, 2024-05-20T17:36:05.405 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632867, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml" 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 784273344, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629539, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml" 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 788052722, 2024-05-20T17:36:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632832, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml" 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 792089923, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631775, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg" 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 799710452, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631246, 2024-05-20T17:36:05.407 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml" 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 809545859, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628823, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml" 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 814151232, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631915, 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg" 2024-05-20T17:36:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 824827448, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632769, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml" 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 825587235, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632836, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml" 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 826875798, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630448, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml" 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 849946383, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631763, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg" 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 850060921, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632910, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml" 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 855463004, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629647, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg" 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.411 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 879919909, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629218, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml" 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 887651663, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631280, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml" 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.412 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 901119298, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632451, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg" 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 903746769, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632737, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml" 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 906607851, 2024-05-20T17:36:05.413 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631665, 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg" 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 912191058, 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628880, 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml" 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.414 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 922620917, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629532, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml" 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 932952554, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629563, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg" 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 939938710, 2024-05-20T17:36:05.415 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632733, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml" 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 947188341, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628855, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml" 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 950412510, 2024-05-20T17:36:05.416 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629038, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg" 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 951714858, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628962, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg" 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 958763067, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628885, 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml" 2024-05-20T17:36:05.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 963882981, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631393, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml" 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 971229965, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633642, 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg" 2024-05-20T17:36:05.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 971487086, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629064, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg" 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 976189003, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631450, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml" 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 991434984, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632919, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg" 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1000885667, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629726, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg" 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.420 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1006361295, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632491, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg" 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1014540951, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632912, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg" 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1015173878, 2024-05-20T17:36:05.421 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629671, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg" 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1021008627, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632886, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml" 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1021218274, 2024-05-20T17:36:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628728, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml" 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1028459417, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630442, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml" 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1035545849, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628701, 2024-05-20T17:36:05.423 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml" 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1035748134, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628767, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml" 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1038472517, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631736, 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg" 2024-05-20T17:36:05.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1042235732, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632963, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg" 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1045463968, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632645, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml" 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.425 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1052255697, 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628770, 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml" 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1057317373, 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633672, 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg" 2024-05-20T17:36:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1060313956, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632956, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg" 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1067664229, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629620, 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg" 2024-05-20T17:36:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1068268286, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628758, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml" 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1070747144, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628810, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml" 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1080683611, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632486, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml" 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1082860904, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631865, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg" 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.429 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1086632206, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633621, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg" 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1090033783, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633717, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg" 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.430 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1108115227, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629714, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg" 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1117835365, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628711, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml" 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1125627143, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631967, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg" 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1128913898, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631802, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg" 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.432 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1132521125, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629521, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml" 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1145732820, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632424, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml" 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1170489290, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633638, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg" 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1180559618, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629818, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml" 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.434 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1181186095, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628894, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml" 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1185343909, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630538, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg" 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1193314673, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629340, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg" 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1196955865, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628909, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml" 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1204769042, 2024-05-20T17:36:05.436 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629581, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg" 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1222017038, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629828, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml" 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1222990419, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629698, 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg" 2024-05-20T17:36:05.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1225742265, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631902, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg" 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1241203837, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632928, 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg" 2024-05-20T17:36:05.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1251439753, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632852, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml" 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1259566373, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631579, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml" 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1259737801, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631564, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml" 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1276608206, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630540, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg" 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.440 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1283725439, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632927, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml" 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1288185486, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629676, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg" 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.441 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1297684100, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631599, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg" 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1306704182, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631529, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml" 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.442 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1315983260, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632835, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml" 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1317370943, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631854, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg" 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.443 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1339669568, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628792, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml" 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1340842148, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629399, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml" 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1341974240, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632808, 2024-05-20T17:36:05.444 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml" 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1360705148, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628932, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml" 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1369148358, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631259, 2024-05-20T17:36:05.445 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml" 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1373090917, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632431, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml" 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1379058314, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628761, 2024-05-20T17:36:05.446 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml" 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1388008662, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632879, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml" 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1425441587, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632799, 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml" 2024-05-20T17:36:05.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1435864331, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628857, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml" 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1443333791, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630487, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg" 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1443582369, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629756, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml" 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1455508167, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632719, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml" 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.449 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1463244536, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631211, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml" 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1464305862, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631629, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg" 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.450 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1474306825, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631894, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg" 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1485661602, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629040, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg" 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.451 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1494986199, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630460, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml" 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1501670581, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630552, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg" 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1513233593, 2024-05-20T17:36:05.452 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631728, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg" 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1539427912, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631958, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg" 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1544936272, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629023, 2024-05-20T17:36:05.453 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg" 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1545271991, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631886, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg" 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1551669034, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632821, 2024-05-20T17:36:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml" 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1554722735, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628831, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml" 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1570672355, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632930, 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml" 2024-05-20T17:36:05.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1587929631, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633614, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml" 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1588992620, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629058, 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg" 2024-05-20T17:36:05.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1590135398, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631955, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg" 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1593760250, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628996, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg" 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.457 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1604890077, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632546, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml" 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1607489728, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632875, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml" 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.458 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1613424968, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629012, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg" 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1617964945, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631500, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml" 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.459 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1623570408, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629519, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml" 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1626110183, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628734, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml" 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1631039531, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632853, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml" 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1634263062, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628749, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml" 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1635817576, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632949, 2024-05-20T17:36:05.461 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg" 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1636784515, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629032, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg" 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1639709949, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632838, 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml" 2024-05-20T17:36:05.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1644769637, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628718, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml" 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1648960365, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631677, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg" 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1649349344, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630514, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg" 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1666745129, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633655, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg" 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.464 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1667991471, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631647, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg" 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1668043941, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628768, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml" 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.465 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1675946201, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632481, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg" 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1699687453, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632460, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg" 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1700449800, 2024-05-20T17:36:05.466 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631337, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml" 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1703147518, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632946, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg" 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1704373212, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631399, 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml" 2024-05-20T17:36:05.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1713599988, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632848, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml" 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1718250198, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632864, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml" 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.468 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1725652625, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629957, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg" 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1726454899, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629693, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg" 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.469 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1731975401, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628704, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml" 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1732465663, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632863, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml" 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1740377174, 2024-05-20T17:36:05.470 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631299, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml" 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1741759060, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631311, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml" 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1795277904, 2024-05-20T17:36:05.471 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632704, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml" 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1816756846, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629513, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml" 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1823378485, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628956, 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml" 2024-05-20T17:36:05.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1831252617, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632477, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml" 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1831948923, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631961, 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg" 2024-05-20T17:36:05.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1833384400, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630524, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg" 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1850847756, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631232, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml" 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.474 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1865184051, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631238, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml" 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1871959943, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631594, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg" 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.475 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1876669653, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630304, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg" 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1877315849, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631194, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml" 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.476 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1877806747, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628981, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml" 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1895404762, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631524, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml" 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.477 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1895405662, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633702, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg" 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1897715051, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629413, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml" 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.478 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1929183694, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632883, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml" 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1929930752, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631329, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml" 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1936220425, 2024-05-20T17:36:05.479 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628950, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml" 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1939397935, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632824, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml" 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1945071537, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631998, 2024-05-20T17:36:05.480 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg" 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1949056706, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632625, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml" 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1951006164, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632560, 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml" 2024-05-20T17:36:05.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1954875809, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631750, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg" 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1970985791, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632599, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml" 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1971117298, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631878, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg" 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1981343545, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631317, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml" 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.483 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1982520459, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632818, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml" 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1991103796, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632810, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml" 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.484 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1998054222, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632924, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml" 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2003592977, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631898, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg" 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2004302789, 2024-05-20T17:36:05.485 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629455, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml" 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2006398770, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629551, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml" 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2009862609, 2024-05-20T17:36:05.486 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632849, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml" 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2018427380, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633683, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg" 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2024779242, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632690, 2024-05-20T17:36:05.487 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml" 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2032084694, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631584, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml" 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2037287311, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633725, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg" 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2037382617, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631936, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg" 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2040242411, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631428, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml" 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.489 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2042089021, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629028, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg" 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2044983872, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629035, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg" 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.490 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2045317657, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629262, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml" 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2046370289, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629481, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml" 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.491 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2078040547, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633631, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg" 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2093717077, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632726, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml" 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.492 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2120875050, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629543, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml" 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2129372919, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629832, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml" 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.493 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2134912697, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632823, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml" 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2140670349, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631061, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml" 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.494 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2142860173, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629904, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml" 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2151417962, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628924, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml" 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2178951155, 2024-05-20T17:36:05.495 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632901, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg" 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2209306414, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629000, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg" 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2210476669, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632935, 2024-05-20T17:36:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml" 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2218217119, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631361, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml" 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2220298729, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631614, 2024-05-20T17:36:05.497 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg" 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2239894202, 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631569, 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml" 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2248951822, 2024-05-20T17:36:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630119, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg" 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2250643332, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629501, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml" 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2254743909, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632960, 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg" 2024-05-20T17:36:05.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2258576703, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629475, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml" 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2262419849, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629584, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg" 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.500 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2262526731, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631845, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg" 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2264304729, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629877, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml" 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.501 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2287466061, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631519, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml" 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2301984981, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631354, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml" 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2303210789, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631439, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml" 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2304321990, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632411, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml" 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.503 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2305547148, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632454, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml" 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2310614058, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629002, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg" 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.504 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2326868621, 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631986, 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg" 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2348024294, 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633728, 2024-05-20T17:36:05.505 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg" 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2349592864, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631992, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg" 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2357436075, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629054, 2024-05-20T17:36:05.506 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg" 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2359827595, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629626, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg" 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2372711049, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628890, 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml" 2024-05-20T17:36:05.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2376218902, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633676, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg" 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2389412681, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632813, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml" 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2397736982, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631273, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml" 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2407338671, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631624, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg" 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.509 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2412954008, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631940, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg" 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2419481415, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633694, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg" 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.510 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2421031142, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629441, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml" 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2428323313, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632773, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml" 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.511 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2431197136, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631485, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml" 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2436575361, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631349, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml" 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.512 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2439851925, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630205, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml" 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2452384455, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631795, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg" 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2459986398, 2024-05-20T17:36:05.513 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632671, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml" 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2463200874, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631946, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg" 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2465944424, 2024-05-20T17:36:05.514 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629418, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml" 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2469719735, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629948, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml" 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2470205832, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629034, 2024-05-20T17:36:05.515 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg" 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2471100191, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630466, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml" 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2495720968, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631544, 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml" 2024-05-20T17:36:05.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2514880005, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632796, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml" 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2519857332, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630433, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml" 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2520457429, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632779, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml" 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2537260238, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631218, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml" 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.518 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2550257587, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629046, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg" 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2550890065, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629030, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg" 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2553350490, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629952, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml" 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2560298635, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630088, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg" 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2563363375, 2024-05-20T17:36:05.520 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629018, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg" 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2576556026, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632464, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg" 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2582521654, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632806, 2024-05-20T17:36:05.521 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml" 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2586639590, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628780, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml" 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2594442096, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632421, 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg" 2024-05-20T17:36:05.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2600187361, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631534, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml" 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2612021623, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631708, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg" 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.523 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2621096758, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632651, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml" 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2622670834, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632897, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml" 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.524 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2638658509, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632632, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml" 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2649445059, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632916, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg" 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.525 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2649671875, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631654, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg" 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2665521680, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632539, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml" 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2677992538, 2024-05-20T17:36:05.526 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629062, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg" 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2680774029, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629632, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg" 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2684890296, 2024-05-20T17:36:05.527 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630299, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml" 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2689680509, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631921, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg" 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2700930818, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632829, 2024-05-20T17:36:05.528 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml" 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2719463601, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632894, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml" 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2724188795, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628785, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml" 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.529 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2729268901, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632889, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml" 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2729479072, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631445, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml" 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2730396055, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632938, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg" 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2736893923, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632753, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml" 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.531 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2742417742, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632746, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml" 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2747460226, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628832, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml" 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2749953154, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632887, 2024-05-20T17:36:05.532 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml" 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2755325539, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632839, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml" 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2765776192, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631995, 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg" 2024-05-20T17:36:05.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2779848241, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631862, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg" 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2782403369, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630472, 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg" 2024-05-20T17:36:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2787288041, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631930, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg" 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2793434761, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629407, 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml" 2024-05-20T17:36:05.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2802087617, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631788, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg" 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2802347867, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628716, 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml" 2024-05-20T17:36:05.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2815150662, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629019, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg" 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2830546846, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628957, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml" 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.537 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2846517401, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629414, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml" 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2850594480, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631589, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg" 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2857757774, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632467, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml" 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2877042968, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628878, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml" 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.539 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2894465383, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629599, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg" 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2903492257, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629770, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg" 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2905492447, 2024-05-20T17:36:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631252, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml" 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2911414618, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632580, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml" 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2918073932, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631890, 2024-05-20T17:36:05.541 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg" 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2924060321, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632905, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml" 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2925427136, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633686, 2024-05-20T17:36:05.542 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg" 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2926077666, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629281, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml" 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2944739979, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628803, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml" 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.543 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2957650057, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632890, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml" 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2959341035, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631848, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg" 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.544 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2961235498, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631641, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg" 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2962618110, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631906, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg" 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2971760729, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628828, 2024-05-20T17:36:05.545 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml" 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2974641104, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628988, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg" 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2975061665, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632953, 2024-05-20T17:36:05.546 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg" 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2981445169, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628893, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml" 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2996210615, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628876, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml" 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.547 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3011319815, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633710, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg" 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3011715290, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632748, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml" 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.548 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3024396265, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629719, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg" 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3035821167, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628740, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml" 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3058932368, 2024-05-20T17:36:05.549 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632860, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml" 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3066576276, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631722, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg" 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3074369714, 2024-05-20T17:36:05.550 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628836, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml" 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3075446459, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630502, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg" 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3081518518, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632503, 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml" 2024-05-20T17:36:05.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3100065463, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632902, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml" 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3120941467, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629246, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml" 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3122899398, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631378, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml" 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3131074311, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632843, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml" 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.553 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3133425677, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633698, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg" 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3149439001, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631976, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg" 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.554 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3165637106, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629509, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml" 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3178296594, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629614, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg" 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3180653426, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633624, 2024-05-20T17:36:05.555 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg" 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3193484720, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628752, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml" 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3207436817, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631838, 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg" 2024-05-20T17:36:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3209534066, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629443, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml" 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3211455440, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629638, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg" 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.557 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3212303387, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629060, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg" 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3214539957, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628787, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml" 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.558 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3222676540, 2024-05-20T17:36:05.559 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631515, 2024-05-20T17:36:05.559 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml" 2024-05-20T17:36:05.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.559 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.559 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3245521444, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631342, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml" 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3250630319, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629524, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml" 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3254405259, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631989, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg" 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3254535076, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630496, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg" 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3262232308, 2024-05-20T17:36:05.563 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631634, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg" 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3264270010, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632917, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml" 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3268099759, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633662, 2024-05-20T17:36:05.564 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg" 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3268831305, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632815, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml" 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3273285807, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631743, 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg" 2024-05-20T17:36:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3277844611, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631779, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg" 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3279670635, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629457, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml" 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.566 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3280252256, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628951, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml" 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3280274117, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632872, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml" 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.567 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3287327597, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632814, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml" 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3297395585, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631756, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg" 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.568 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3309888036, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631835, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg" 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3313045622, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629467, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml" 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3330953176, 2024-05-20T17:36:05.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628899, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml" 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3332565402, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628776, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml" 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3339569117, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631339, 2024-05-20T17:36:05.570 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml" 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3344136377, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630086, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml" 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3361471216, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631698, 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg" 2024-05-20T17:36:05.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3361591782, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631918, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg" 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3363497197, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632586, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml" 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.572 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3369287365, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629175, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml" 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3378422315, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628980, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg" 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.573 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3379177695, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633666, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg" 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3398294110, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629364, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg" 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3406723706, 2024-05-20T17:36:05.574 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629703, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg" 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3432289031, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633648, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg" 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3442377022, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628783, 2024-05-20T17:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml" 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3448549040, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632876, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml" 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3459866932, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632817, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml" 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.576 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3467063931, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628827, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml" 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3469193499, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628992, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg" 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.577 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3486391162, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628738, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml" 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3497320423, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632447, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml" 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.578 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3500044025, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628933, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml" 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3505392904, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631416, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml" 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.579 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3524253194, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632926, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg" 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3540060380, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632856, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml" 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.580 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3549823186, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632847, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml" 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3560205834, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628851, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml" 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3583054268, 2024-05-20T17:36:05.581 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629471, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml" 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3583233767, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632495, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml" 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3583864433, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632612, 2024-05-20T17:36:05.582 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml" 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3585381385, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630481, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg" 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3590651059, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631832, 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg" 2024-05-20T17:36:05.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3598456427, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631405, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml" 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3598582619, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631868, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg" 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3607747545, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631367, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml" 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3608870752, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632920, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml" 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3615482179, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632606, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml" 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3634797338, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633645, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg" 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.586 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3652880108, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629499, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml" 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3654202903, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628834, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml" 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.587 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3655473922, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632934, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg" 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3660458689, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629317, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml" 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.588 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3662996915, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631455, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml" 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3664821511, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632857, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml" 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.589 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3683536665, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629826, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg" 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3686542242, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631275, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml" 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.590 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3687548862, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628773, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml" 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3688608443, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631927, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg" 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3706551042, 2024-05-20T17:36:05.591 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631324, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml" 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3717134456, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632638, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml" 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3718058371, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631224, 2024-05-20T17:36:05.592 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml" 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3721400328, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631970, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg" 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3722854250, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631539, 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml" 2024-05-20T17:36:05.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3750184534, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632761, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml" 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3772149587, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629816, 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg" 2024-05-20T17:36:05.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3774179713, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628968, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg" 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3776510647, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632913, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml" 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.595 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3781059762, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628892, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml" 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3791977270, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629547, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml" 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.596 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3794779487, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629487, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml" 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3795784453, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630570, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg" 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3797741679, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628842, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml" 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3798923031, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631841, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg" 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3822978408, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632803, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml" 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3828331374, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631292, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml" 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.599 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3829996167, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629813, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg" 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3832953760, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633652, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg" 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3836268298, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631460, 2024-05-20T17:36:05.600 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml" 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3856170413, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631549, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml" 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3862451366, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631559, 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml" 2024-05-20T17:36:05.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3865700072, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632573, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml" 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3866311063, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632909, 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg" 2024-05-20T17:36:05.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3867347771, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629052, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg" 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3886696320, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631912, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg" 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.603 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3890325790, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631909, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg" 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3891770754, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628873, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml" 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.604 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3897521445, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631807, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg" 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3931745951, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632619, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml" 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.605 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3933513861, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631495, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml" 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3935514231, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633679, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg" 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.606 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3955177202, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628799, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml" 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3996352793, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632711, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml" 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3999398674, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633635, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg" 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4003786567, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631973, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg" 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.608 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4006902579, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631933, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg" 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4028552941, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631154, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml" 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4038207869, 2024-05-20T17:36:05.609 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628848, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml" 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4040778722, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632553, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml" 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4042019662, 2024-05-20T17:36:05.610 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632828, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml" 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4046489543, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632793, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml" 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4050469513, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631609, 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg" 2024-05-20T17:36:05.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4053292982, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632427, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg" 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4058510203, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631470, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml" 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.612 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4065513781, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632473, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg" 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4070318020, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629797, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml" 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4071787335, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632500, 2024-05-20T17:36:05.613 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg" 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4083640276, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631871, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg" 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4096292379, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631303, 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml" 2024-05-20T17:36:05.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4099782633, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631979, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg" 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4108563852, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632895, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml" 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4125427038, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629451, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml" 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4143188136, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631952, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg" 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.616 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4158412793, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632698, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml" 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4164932652, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629534, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml" 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.617 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4164933038, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629653, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg" 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4171852463, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631716, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg" 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.618 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4175617280, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631619, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg" 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4182794673, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629010, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg" 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4200201726, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631490, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml" 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4202509095, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632904, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg" 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.620 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4203259654, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631689, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg" 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4239705012, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629527, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml" 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4241509829, 2024-05-20T17:36:05.621 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629732, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg" 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4259272230, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629056, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg" 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4268286680, 2024-05-20T17:36:05.622 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632520, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml" 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4270080687, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632531, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml" 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4274583970, 2024-05-20T17:36:05.623 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631771, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg" 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4277077876, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629847, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml" 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4280257523, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511631422, 2024-05-20T17:36:05.624 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml" 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4286968375, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628998, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg" 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4289243854, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633721, 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg" 2024-05-20T17:36:05.625 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:36:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-20T17:36:05.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:05 smithi172 ceph-mon[36511]: pgmap v85: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 827 op/s 2024-05-20T17:36:05.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:05 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/527809747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:36:05.627 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:05 smithi160 ceph-mon[36261]: pgmap v85: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 827 op/s 2024-05-20T17:36:05.628 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:05 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/527809747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 msgr2=0x7f54a80a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 0x7f54a80a5290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54b809b630 tx=0x7f54b80044b0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 msgr2=0x7f54c019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fd0 tx=0x7f54b800b260 comp rx=0 tx=0).stop 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 shutdown_connections 2024-05-20T17:36:05.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f54a80a2d80 0x7f54a80a5290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c010c330 0x7f54c019cec0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c01079d0 0x7f54c0198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 --2- 172.21.15.135:0/405005863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0101aa0 0x7f54c01986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 >> 172.21.15.135:0/405005863 conn(0x7f54c00770b0 msgr2=0x7f54c0103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 shutdown_connections 2024-05-20T17:36:05.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.349+0000 7f54c4d21640 1 -- 172.21.15.135:0/405005863 wait complete. 2024-05-20T17:36:05.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-20T17:36:05.631 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:05 smithi135 ceph-mon[32027]: pgmap v85: 97 pgs: 97 active+clean; 217 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 827 op/s 2024-05-20T17:36:05.631 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:05 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/527809747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:36:05.631 INFO:tasks.workunit.client.0.smithi135.stdout: 93 732793 1152 723062 719 169950 1172 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 -- 172.21.15.135:0/3460647735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca41079d0 msgr2=0x7f0ca4101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/3460647735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca41079d0 0x7f0ca4101560 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009900 tx=0x7f0c9402a410 comp rx=0 tx=0).stop 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 -- 172.21.15.135:0/3460647735 shutdown_connections 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/3460647735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca410c330 0x7f0ca410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/3460647735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca4101aa0 0x7f0ca4101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/3460647735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca41079d0 0x7f0ca4101560 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 -- 172.21.15.135:0/3460647735 >> 172.21.15.135:0/3460647735 conn(0x7f0ca40770b0 msgr2=0x7f0ca40774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 -- 172.21.15.135:0/3460647735 shutdown_connections 2024-05-20T17:36:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.748+0000 7f0caa0e9640 1 -- 172.21.15.135:0/3460647735 wait complete. 2024-05-20T17:36:05.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 Processor -- start 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 -- start start 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca4101aa0 0x7f0ca40fe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 0x7f0ca40fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4111ce0 con 0x7f0ca410c330 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4111b60 con 0x7f0ca41079d0 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0caa0e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4111e60 con 0x7f0ca4101aa0 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0ca3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0ca3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49408/0 (socket says 172.21.15.135:49408) 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0ca3fff640 1 -- 172.21.15.135:0/1542970896 learned_addr learned my addr 172.21.15.135:0/1542970896 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.749+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 0x7f0ca40fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca4101aa0 0x7f0ca40fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 -- 172.21.15.135:0/1542970896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca4101aa0 msgr2=0x7f0ca40fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca4101aa0 0x7f0ca40fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 -- 172.21.15.135:0/1542970896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 msgr2=0x7f0ca40fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 0x7f0ca40fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 -- 172.21.15.135:0/1542970896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca41a7ab0 con 0x7f0ca410c330 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 0x7f0ca40fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca3fff640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00eb10 tx=0x7f0c9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca0ff9640 1 -- 172.21.15.135:0/1542970896 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c004b20 con 0x7f0ca410c330 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca0ff9640 1 -- 172.21.15.135:0/1542970896 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c9c004cc0 con 0x7f0ca410c330 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca41a7da0 con 0x7f0ca410c330 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0ca0ff9640 1 -- 172.21.15.135:0/1542970896 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c010760 con 0x7f0ca410c330 2024-05-20T17:36:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.750+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca41a8260 con 0x7f0ca410c330 2024-05-20T17:36:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.753+0000 7f0cb0f94740 1 Processor -- start 2024-05-20T17:36:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca0ff9640 1 -- 172.21.15.135:0/1542970896 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0c9c010900 con 0x7f0ca410c330 2024-05-20T17:36:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 -- start start 2024-05-20T17:36:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77b44d0 0x5586d7b7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b7c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5586d7ae1c40 con 0x5586d77dd390 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5586d7a89580 con 0x5586d77b44d0 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5586d7addc00 con 0x5586d77bc6b0 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca37fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77b44d0 0x5586d7b7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49410/0 (socket says 172.21.15.135:49410) 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/94568261 learned_addr learned my addr 172.21.15.135:0/94568261 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b7c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca0ff9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 0x7f0c8c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/94568261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 msgr2=0x5586d7b7c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b7c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/94568261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77b44d0 msgr2=0x5586d7b7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77b44d0 0x5586d7b7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.754+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/94568261 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d77f53f0 con 0x5586d77dd390 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0ca3fff640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 0x7f0c8c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0c98013910 tx=0x7f0c98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7f667c2447c089 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0ca0ff9640 1 -- 172.21.15.135:0/1542970896 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0c9c0cfb50 con 0x7f0ca410c330 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0c89ffb640 1 -- 172.21.15.135:0/94568261 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98004050 con 0x5586d77dd390 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0c89ffb640 1 -- 172.21.15.135:0/94568261 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c9800fe20 con 0x5586d77dd390 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.755+0000 7f0c89ffb640 1 -- 172.21.15.135:0/94568261 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98003c20 con 0x5586d77dd390 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- 172.21.15.135:0/94568261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 msgr2=0x5586d7b7bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0ca3fff640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 0x7f0c8c0a5210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c09c000 tx=0x7f0c9c06afa0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0c98013910 tx=0x7f0c98009f90 comp rx=0 tx=0).stop 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- 172.21.15.135:0/94568261 shutdown_connections 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b7c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77b44d0 0x5586d7b7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/94568261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77dd390 0x5586d7b7bd20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- 172.21.15.135:0/94568261 >> 172.21.15.135:0/94568261 conn(0x5586d77d14e0 msgr2=0x5586d7b784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- 172.21.15.135:0/94568261 shutdown_connections 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- 172.21.15.135:0/94568261 wait complete. 2024-05-20T17:36:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.756+0000 7f0cb0f94740 1 -- start start 2024-05-20T17:36:05.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 Processor -- start 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 0x5586d7b86920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77dd390 0x5586d7b8c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5586d7b88fb0 con 0x5586d77b44d0 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5586d7a9cc40 con 0x5586d77bc6b0 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5586d7b89130 con 0x5586d77dd390 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0cb0f94740 10 client.0 _ll_register_callbacks cb 0x5586d77f4be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca37fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 0x5586d7b86920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49420/0 (socket says 172.21.15.135:49420) 2024-05-20T17:36:05.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/3316364122 learned_addr learned my addr 172.21.15.135:0/3316364122 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77dd390 0x5586d7b8c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77dd390 msgr2=0x5586d7b8c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77dd390 0x5586d7b8c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/3316364122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 msgr2=0x5586d7b86920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 0x5586d7b86920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/3316364122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d78bf7d0 con 0x5586d77b44d0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.757+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 0x5586d7b86920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0c980058c0 tx=0x7f0c98005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1209eaa24c8b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98010840 con 0x5586d77b44d0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c9800fe20 con 0x5586d77b44d0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0c980109e0 con 0x5586d77b44d0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c98037050 con 0x5586d77b44d0 2024-05-20T17:36:05.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 10 client.16260 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586d7b957b0 con 0x5586d77b44d0 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c9800fe20 con 0x5586d77b44d0 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0c9801e070 con 0x5586d77b44d0 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 10 client.16260 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 10 client.16260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 20 client.16260 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d779bf60 0x5586d7b98b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 4 client.16260 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.758+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d7aef370 con 0x5586d779bf60 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.759+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d779bf60 0x5586d7b98b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.759+0000 7f0c82ffd640 10 client.16260 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:36:05.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.759+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d779bf60 0x5586d7b98b70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6fefd7eb96d3a7a3 server_cookie=fa0ece2bdbcbef5a in_seq=0 out_seq=0 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0c82ffd640 1 -- 172.21.15.135:0/3316364122 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5586d7aef370 con 0x5586d779bf60 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0c82ffd640 10 client.16260 handle_command_reply: tid=0 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 client.16260 shutdown 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 msgr2=0x5586d7b863e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0c980058c0 tx=0x7f0c98005850 comp rx=0 tx=0).stop 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 shutdown_connections 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d779bf60 0x5586d7b98b70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77dd390 0x5586d7b8c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77bc6b0 0x5586d7b86920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0c82ffd640 0 client.16260 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/3316364122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b863e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 >> 172.21.15.135:0/3316364122 conn(0x5586d77d14e0 msgr2=0x5586d7b7da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 shutdown_connections 2024-05-20T17:36:05.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 1 -- 172.21.15.135:0/3316364122 wait complete. 2024-05-20T17:36:05.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.760+0000 7f0cb0f94740 20 client.16260 trim_cache size 0 max 16384 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 Processor -- start 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 -- start start 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41b3540 con 0x5586d77b44d0 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41b0e10 con 0x5586d77dd390 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41aec60 con 0x5586d77bc6b0 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49428/0 (socket says 172.21.15.135:49428) 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/829415201 learned_addr learned my addr 172.21.15.135:0/829415201 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/829415201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 msgr2=0x5586d7b85080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b85080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/829415201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 msgr2=0x5586d7b7f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.775+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.776+0000 7f0ca2ffd640 1 -- 172.21.15.135:0/829415201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d7b870e0 con 0x5586d77b44d0 2024-05-20T17:36:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.776+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c980092e0 tx=0x7f0c9801fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aec0589cf3461c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.776+0000 7f0c897fa640 1 -- 172.21.15.135:0/829415201 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98005d30 con 0x5586d77b44d0 2024-05-20T17:36:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.776+0000 7f0c897fa640 1 -- 172.21.15.135:0/829415201 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c9802b040 con 0x5586d77b44d0 2024-05-20T17:36:05.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.776+0000 7f0c897fa640 1 -- 172.21.15.135:0/829415201 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c980053b0 con 0x5586d77b44d0 2024-05-20T17:36:05.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- 172.21.15.135:0/829415201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 msgr2=0x5586d7b8c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c980092e0 tx=0x7f0c9801fd20 comp rx=0 tx=0).stop 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- 172.21.15.135:0/829415201 shutdown_connections 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77bc6b0 0x5586d7b85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/829415201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77b44d0 0x5586d7b8c360 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- 172.21.15.135:0/829415201 >> 172.21.15.135:0/829415201 conn(0x5586d77d14e0 msgr2=0x5586d7b84970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- 172.21.15.135:0/829415201 shutdown_connections 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- 172.21.15.135:0/829415201 wait complete. 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 -- start start 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.777+0000 7f0cb0f94740 1 Processor -- start 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 0x5586d7b800f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41af2d0 con 0x5586d77bc6b0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41b0740 con 0x5586d77dd390 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca41af9a0 con 0x5586d77b44d0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0cb0f94740 10 client.0 _ll_register_callbacks cb 0x7f0c98013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49430/0 (socket says 172.21.15.135:49430) 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 -- 172.21.15.135:0/874104518 learned_addr learned my addr 172.21.15.135:0/874104518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 0x5586d7b800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 -- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 msgr2=0x5586d7b800f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 0x5586d7b800f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 -- 172.21.15.135:0/874104518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 msgr2=0x5586d7b7ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 -- 172.21.15.135:0/874104518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d7b7f5f0 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 0x5586d7b800f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0ca37fe640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0c94005f70 tx=0x7f0c940041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6157d3ba94bd4f81 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.778+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94035040 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0c94005040 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c9802b040 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c94052050 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 10 client.16266 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586d7bffc30 con 0x5586d77bc6b0 2024-05-20T17:36:05.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c9802b040 con 0x5586d77bc6b0 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0c9404d030 con 0x5586d77bc6b0 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 10 client.16266 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 10 client.16266 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 20 client.16266 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d77713a0 0x5586d7c02410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 4 client.16266 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 --> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586d7ae96c0 con 0x5586d77713a0 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.779+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d77713a0 0x5586d7c02410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.780+0000 7f0ca2ffd640 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d77713a0 0x5586d7c02410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af8aff59dedb9f45 server_cookie=5b6a776fe7e63abe in_seq=0 out_seq=0 2024-05-20T17:36:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.780+0000 7f0c82ffd640 10 client.16266 ms_handle_connect on v2:172.21.15.172:6838/380136788 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.783+0000 7f0c82ffd640 1 -- 172.21.15.135:0/874104518 <== mds.1 v2:172.21.15.172:6838/380136788 1 ==== command_reply(tid 0: 0 ) ==== 8+0+178667 (crc 0 0 0) 0x5586d7ae96c0 con 0x5586d77713a0 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.783+0000 7f0c82ffd640 10 client.16266 handle_command_reply: tid=0 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 client.16266 shutdown 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 msgr2=0x5586d7b7e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0c94005f70 tx=0x7f0c940041a0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 shutdown_connections 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:6838/380136788,v1:172.21.15.172:6839/380136788] conn(0x5586d77713a0 0x5586d7c02410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586d77dd390 0x5586d7b7ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586d77bc6b0 0x5586d7b7e9c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0c82ffd640 0 client.16266 ms_handle_reset on v2:172.21.15.172:6838/380136788 2024-05-20T17:36:05.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 --2- 172.21.15.135:0/874104518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586d77b44d0 0x5586d7b800f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:05.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 >> 172.21.15.135:0/874104518 conn(0x5586d77d14e0 msgr2=0x5586d7b76b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:05.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 shutdown_connections 2024-05-20T17:36:05.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 1 -- 172.21.15.135:0/874104518 wait complete. 2024-05-20T17:36:05.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.784+0000 7f0cb0f94740 20 client.16266 trim_cache size 0 max 16384 2024-05-20T17:36:05.791 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-20T17:36:05.791 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.791 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.791 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 950160, 2024-05-20T17:36:05.791 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628293, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8" 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 5653058, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629835, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml" 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 11593670, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633737, 2024-05-20T17:36:05.792 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml" 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 46473536, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629920, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml" 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 49453095, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630023, 2024-05-20T17:36:05.793 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml" 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 55481540, 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633438, 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg" 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 59857984, 2024-05-20T17:36:05.794 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630025, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml" 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 70407735, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633767, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg" 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 78476848, 2024-05-20T17:36:05.795 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628904, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml" 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 81234267, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629935, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml" 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 83850095, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629428, 2024-05-20T17:36:05.796 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml" 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 84333359, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633656, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg" 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 89154152, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628868, 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml" 2024-05-20T17:36:05.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 95993687, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633013, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml" 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 102284849, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629814, 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml" 2024-05-20T17:36:05.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 104297277, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633901, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml" 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 107943420, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628949, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg" 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 133942723, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629489, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml" 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 139863696, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633957, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml" 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.800 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 142411997, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633411, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml" 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 145690291, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633943, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml" 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 147080302, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633881, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml" 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 154281507, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628713, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml" 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.802 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 158030280, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633041, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml" 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 164796436, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633429, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg" 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 173134514, 2024-05-20T17:36:05.803 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633842, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml" 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 181261142, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628938, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg" 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 183638093, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633703, 2024-05-20T17:36:05.804 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg" 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 198044694, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628955, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg" 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 201795198, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629865, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml" 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.805 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 205597838, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628806, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml" 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 207455220, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633687, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg" 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.806 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 207548274, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633483, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg" 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 211766405, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629602, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg" 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.807 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 219070248, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633846, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml" 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 226134439, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628925, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml" 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 241343746, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629072, 2024-05-20T17:36:05.808 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg" 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 263216234, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629473, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml" 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 267198204, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628739, 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml" 2024-05-20T17:36:05.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 273637050, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633906, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml" 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 288557532, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628987, 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg" 2024-05-20T17:36:05.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 296149263, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628889, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml" 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 301842099, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628993, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg" 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.811 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 305223955, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633511, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg" 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 312838954, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629080, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg" 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.812 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 316164786, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633977, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml" 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 325981044, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633936, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml" 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.813 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 331442277, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633956, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml" 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 338775278, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629426, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml" 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.814 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 340496538, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629094, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg" 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 350967871, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629469, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml" 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 353623395, 2024-05-20T17:36:05.815 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629465, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml" 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 355002524, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628769, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml" 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 359407421, 2024-05-20T17:36:05.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633931, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml" 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 365893271, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633089, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml" 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 371820804, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630035, 2024-05-20T17:36:05.817 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml" 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 376663342, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633836, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml" 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 380057404, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633536, 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg" 2024-05-20T17:36:05.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 381790301, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633922, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml" 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 387763091, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629001, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg" 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.819 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 399248115, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633406, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml" 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 404476607, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630019, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml" 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.820 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 409137882, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633827, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml" 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 427293553, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629404, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml" 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.821 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 429695435, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629665, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg" 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 434840525, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629932, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml" 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.822 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 442270366, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633103, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg" 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 443569840, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629774, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml" 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 445115968, 2024-05-20T17:36:05.823 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633473, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml" 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 454517261, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633913, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml" 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 457953582, 2024-05-20T17:36:05.824 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633831, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml" 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 486658768, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630133, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg" 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 491258945, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633247, 2024-05-20T17:36:05.825 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml" 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 492925576, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633989, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml" 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 494699437, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628970, 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg" 2024-05-20T17:36:05.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 495002073, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629938, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml" 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 496510613, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633233, 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml" 2024-05-20T17:36:05.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 502295159, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633144, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml" 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 507782447, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633867, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml" 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 509754787, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633982, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml" 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 511592408, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633816, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml" 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.829 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 511638843, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628898, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml" 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 529220039, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628717, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml" 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.830 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 534902768, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633317, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml" 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 538503506, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629447, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml" 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.831 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 539902040, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629406, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml" 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 544208676, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633149, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml" 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 552918870, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633834, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml" 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 554857678, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633756, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg" 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 564980973, 2024-05-20T17:36:05.833 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633764, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg" 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 569369022, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628784, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml" 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 569399231, 2024-05-20T17:36:05.834 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629635, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg" 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 580464800, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633983, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml" 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 584635102, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629575, 2024-05-20T17:36:05.835 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg" 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 585724634, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629017, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg" 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 587969904, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630015, 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml" 2024-05-20T17:36:05.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 591227002, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629057, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg" 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 632510770, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629092, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg" 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.837 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 632556428, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628295, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in" 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 634578417, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633383, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml" 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.838 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 642326203, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629736, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml" 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 646058864, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628908, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml" 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 646943344, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633189, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml" 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 647145972, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633145, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg" 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 649451407, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633998, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml" 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 657839105, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628991, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg" 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 662898915, 2024-05-20T17:36:05.841 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628883, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml" 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 663482814, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633904, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml" 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 664606247, 2024-05-20T17:36:05.842 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633066, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml" 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 679395072, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633809, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml" 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 689059846, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633815, 2024-05-20T17:36:05.843 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml" 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 689194497, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633806, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml" 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 692238462, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633190, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg" 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 696901191, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628796, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml" 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 704824406, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633975, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml" 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.845 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 706232472, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633771, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg" 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 720035414, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633018, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml" 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 720905970, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633775, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg" 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 730378088, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633266, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml" 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.847 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 732737315, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633980, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml" 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 732938952, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629926, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml" 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.848 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 733189121, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633327, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml" 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 735429459, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633663, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg" 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 736970603, 2024-05-20T17:36:05.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633632, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg" 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 739068842, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633529, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg" 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 740522413, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628985, 2024-05-20T17:36:05.850 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg" 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 741097613, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633670, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg" 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 744230966, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633447, 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg" 2024-05-20T17:36:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 745014468, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633860, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml" 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 751653680, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628725, 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml" 2024-05-20T17:36:05.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 752164775, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633793, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml" 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 759307928, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633855, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml" 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.853 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 762940507, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629479, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml" 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 774240787, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633160, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg" 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 782734412, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629650, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg" 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 801260173, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629765, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml" 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.855 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 801638215, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628790, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml" 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 814741431, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633907, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml" 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.856 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 816168119, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633840, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml" 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 825832826, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629027, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg" 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 838758959, 2024-05-20T17:36:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633872, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml" 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 840685407, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633261, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml" 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 842401965, 2024-05-20T17:36:05.858 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629051, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg" 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 845579643, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629483, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml" 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 845849757, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633608, 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg" 2024-05-20T17:36:05.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 848739652, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633069, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml" 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 855793852, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633199, 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml" 2024-05-20T17:36:05.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 867011657, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633899, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml" 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 869368788, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633745, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg" 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.861 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 877388853, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633280, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml" 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 887551497, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633653, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg" 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.862 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 893412638, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633719, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg" 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 897215952, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633508, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg" 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.863 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 907312782, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633164, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml" 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 912109331, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633605, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg" 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.864 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 920561032, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629611, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg" 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 924445382, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633929, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml" 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 930309376, 2024-05-20T17:36:05.865 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633462, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml" 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 937377492, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628703, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml" 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 937906099, 2024-05-20T17:36:05.866 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633858, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml" 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 939610564, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633289, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml" 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 944029641, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628989, 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg" 2024-05-20T17:36:05.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 951423453, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629045, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg" 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 958062377, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629923, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml" 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.868 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 960776786, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630143, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg" 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 964717320, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629945, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml" 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 972292362, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633942, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml" 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 974163901, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633822, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml" 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 987952234, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628979, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg" 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 999437882, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633185, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg" 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1000968445, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633965, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml" 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1026080791, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633457, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml" 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1030487909, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633574, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg" 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1031668718, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629545, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml" 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.873 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1035617928, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633920, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml" 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1049670406, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633914, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml" 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1054956814, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628872, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml" 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1055990807, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630107, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg" 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.875 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1060956733, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633024, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml" 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1076224789, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628798, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml" 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1080626612, 2024-05-20T17:36:05.876 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633629, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg" 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1089019015, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633845, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml" 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1090553584, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632998, 2024-05-20T17:36:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml" 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1099673614, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628856, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml" 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1122691648, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629515, 2024-05-20T17:36:05.878 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml" 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1129788521, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633833, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml" 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1137540455, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633875, 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml" 2024-05-20T17:36:05.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1140469445, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629656, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg" 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1142091707, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630013, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml" 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.880 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1146474583, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629941, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml" 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1146941017, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628865, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml" 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.881 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1150330347, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629824, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml" 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1158084963, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629049, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg" 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.882 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1160271714, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633900, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml" 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1162351329, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633948, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml" 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.883 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1163858757, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633918, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml" 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1170191243, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633051, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml" 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1171423495, 2024-05-20T17:36:05.884 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629841, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml" 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1175592563, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633996, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml" 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1176171562, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629557, 2024-05-20T17:36:05.885 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg" 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1188381810, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633987, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml" 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1190683702, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629029, 2024-05-20T17:36:05.886 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg" 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1193716912, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629641, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg" 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1195537070, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633200, 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg" 2024-05-20T17:36:05.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1198536913, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633997, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml" 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1204049995, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633401, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml" 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.888 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1217249563, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633947, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml" 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1219917426, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633009, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml" 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1220744774, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629659, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg" 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1240659212, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633364, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml" 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.890 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1242783605, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633322, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml" 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1254488229, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633184, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml" 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.891 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1255374013, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630017, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml" 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1257916451, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633519, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg" 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1262163974, 2024-05-20T17:36:05.892 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628736, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml" 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1264220254, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633884, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml" 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1268502466, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632985, 2024-05-20T17:36:05.893 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml" 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1272354813, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629025, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg" 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1278949621, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628973, 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg" 2024-05-20T17:36:05.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1297837935, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633880, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml" 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1304227364, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633903, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml" 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1308609213, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633959, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml" 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1311011639, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633971, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml" 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.896 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1315205267, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633646, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg" 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1316971082, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628901, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml" 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.897 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1323101361, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633990, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml" 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1324800572, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633741, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml" 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1337551511, 2024-05-20T17:36:05.898 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633497, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg" 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1346964665, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629409, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml" 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1350104709, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633819, 2024-05-20T17:36:05.899 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml" 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1356416170, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630009, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml" 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1362569433, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633179, 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml" 2024-05-20T17:36:05.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1365580429, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633897, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml" 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1376711758, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633742, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg" 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.901 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1386771598, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633925, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml" 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1388757715, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633824, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml" 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.902 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1390916448, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633093, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml" 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1397480292, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628941, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg" 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1401003664, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630139, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg" 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1401236973, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633976, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml" 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.904 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1401943012, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630115, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg" 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1407119992, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633303, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml" 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.905 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1408695850, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633893, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml" 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1414069153, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633801, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg" 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.906 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1415105021, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633299, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml" 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1419269337, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632991, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml" 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.907 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1419583027, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633984, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml" 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1421354375, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629578, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg" 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1426648188, 2024-05-20T17:36:05.908 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629549, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml" 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1427884649, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628931, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml" 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1434932291, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629910, 2024-05-20T17:36:05.909 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml" 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1437472912, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629401, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml" 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1443299872, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633539, 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg" 2024-05-20T17:36:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1448725700, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633615, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg" 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1448774272, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633210, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml" 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.911 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1450617167, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633921, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml" 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1463288051, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633964, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml" 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1466909899, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633169, 2024-05-20T17:36:05.912 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml" 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1467977570, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632973, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml" 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1471317879, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633070, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml" 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1471611993, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628755, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml" 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1483565534, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630033, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml" 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.914 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1491408461, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633084, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml" 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1495498359, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628794, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml" 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1496989857, 2024-05-20T17:36:05.915 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633133, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml" 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1498004158, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633958, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml" 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1505819764, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629880, 2024-05-20T17:36:05.916 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml" 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1510305532, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633004, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml" 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1510941249, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633681, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg" 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1520913037, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629750, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg" 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1522645737, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633707, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg" 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.918 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1523069128, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633753, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg" 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1535201454, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628923, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml" 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.919 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1539577945, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629907, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml" 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1548816300, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633954, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml" 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.920 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1549598600, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629929, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml" 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1558727643, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633926, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml" 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.921 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1560558053, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629751, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml" 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1578196114, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628808, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml" 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.922 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1578452655, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633587, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg" 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1580648247, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633993, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml" 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1588127371, 2024-05-20T17:36:05.923 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633594, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg" 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1593575843, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633935, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml" 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1595493324, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633294, 2024-05-20T17:36:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml" 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1599597353, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628835, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml" 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1603036672, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628710, 2024-05-20T17:36:05.925 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml" 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1609782354, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633905, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml" 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1636195890, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628877, 2024-05-20T17:36:05.926 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml" 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1639452599, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629608, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg" 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1639844341, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633870, 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml" 2024-05-20T17:36:05.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1650804131, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633974, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml" 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1667311516, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633937, 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml" 2024-05-20T17:36:05.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1668685963, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629033, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg" 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1669712842, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628820, 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml" 2024-05-20T17:36:05.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1672543457, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633960, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml" 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1673097017, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633711, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg" 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1681474517, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628915, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml" 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1682496826, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629758, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg" 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1682951800, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633973, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml" 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1685877838, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630021, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml" 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.932 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1689318553, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630124, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg" 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1704441155, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629461, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml" 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.933 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1705249629, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628727, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml" 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1715062729, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633684, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg" 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.934 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1723354260, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633790, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg" 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1737550544, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633896, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml" 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.935 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1742605669, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633331, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml" 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1744971273, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633916, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml" 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1757422746, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633951, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml" 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1759897500, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633639, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg" 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.937 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1760672477, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628715, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml" 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1761490861, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629844, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml" 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.938 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1764972320, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629791, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml" 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1769272566, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633532, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg" 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.939 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1771424814, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629868, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml" 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1771780917, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629435, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml" 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1772244694, 2024-05-20T17:36:05.940 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633079, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml" 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1779297469, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633285, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml" 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1792656804, 2024-05-20T17:36:05.941 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633028, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml" 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1800463633, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633748, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml" 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1802718650, 2024-05-20T17:36:05.942 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633940, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml" 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1812905739, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633127, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml" 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1816549409, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633891, 2024-05-20T17:36:05.943 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml" 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1824053433, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633598, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg" 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1833404711, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629821, 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml" 2024-05-20T17:36:05.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1838137182, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633949, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml" 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1842824817, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633165, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg" 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.945 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1845958600, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633759, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml" 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1850289044, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633749, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg" 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.946 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1850500617, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633889, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml" 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1851188767, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633080, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml" 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.947 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1852340200, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630151, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg" 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1854187336, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633857, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml" 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1856868253, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630005, 2024-05-20T17:36:05.948 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml" 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1857189586, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629988, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml" 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1859178228, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630001, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml" 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1861910274, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633490, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg" 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1863772028, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629874, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml" 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.950 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1875550217, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629074, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg" 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1876571679, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633243, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml" 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1876708951, 2024-05-20T17:36:05.951 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629644, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg" 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1883563960, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628775, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml" 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1887391646, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633967, 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml" 2024-05-20T17:36:05.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1893059024, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629063, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg" 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1899538506, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633564, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg" 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.953 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1902485658, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633715, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg" 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1907969123, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629463, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml" 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.954 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1919311346, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633650, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg" 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1939358042, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633691, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg" 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.955 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1947682154, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633804, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg" 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1947935031, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629572, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg" 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1948076109, 2024-05-20T17:36:05.956 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629529, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml" 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1953595054, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633763, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml" 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1954368681, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633470, 2024-05-20T17:36:05.957 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml" 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1960194092, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628952, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg" 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1963970567, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629856, 2024-05-20T17:36:05.958 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml" 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1979067651, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633874, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml" 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1981387699, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629985, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml" 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.959 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1982567257, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629449, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml" 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1982979476, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633032, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml" 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.960 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1985150211, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629853, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml" 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1993311444, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629416, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml" 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1993387955, 2024-05-20T17:36:05.961 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633525, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg" 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 1997501925, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629422, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml" 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2007540868, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633065, 2024-05-20T17:36:05.962 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml" 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2016448866, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633999, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml" 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2019149806, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630011, 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml" 2024-05-20T17:36:05.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2019195835, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633194, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml" 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2026661905, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633722, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg" 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.964 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2032099826, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628875, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml" 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2037668580, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629999, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml" 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2038786678, 2024-05-20T17:36:05.965 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629764, 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg" 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2041176915, 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633494, 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg" 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.966 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2057281089, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633797, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml" 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2066699624, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629497, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml" 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2084979005, 2024-05-20T17:36:05.967 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628786, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml" 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2089216502, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633933, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml" 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2092696741, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633116, 2024-05-20T17:36:05.968 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml" 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2096858779, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629993, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml" 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2097282669, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629410, 2024-05-20T17:36:05.969 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml" 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2100653306, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633061, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml" 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2101587987, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629021, 2024-05-20T17:36:05.970 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg" 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2106665489, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629493, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml" 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2106928157, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633894, 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml" 2024-05-20T17:36:05.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2115380853, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628964, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg" 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2124021962, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629084, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg" 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.972 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2124184810, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633355, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml" 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2150560294, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633961, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml" 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.973 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2157142246, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633636, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg" 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2161633442, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630041, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml" 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2170987719, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633014, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml" 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2173462557, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633786, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg" 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.975 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2180603524, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629424, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml" 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2187035037, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629076, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg" 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2189883719, 2024-05-20T17:36:05.976 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633359, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml" 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2202393172, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633928, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml" 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2204240793, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633677, 2024-05-20T17:36:05.977 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg" 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2206651584, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629566, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg" 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2207588706, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629445, 2024-05-20T17:36:05.978 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml" 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2210753136, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633726, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg" 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2215471738, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629862, 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml" 2024-05-20T17:36:05.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2222588411, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628886, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml" 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2223620576, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629617, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg" 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.980 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2225804264, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633810, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg" 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2252398363, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629421, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml" 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.981 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2274069352, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633667, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg" 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2286817688, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633107, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml" 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2292635557, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629101, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml" 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2299079120, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628748, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml" 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.983 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2310737245, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633581, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg" 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2311379380, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633112, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg" 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2318749032, 2024-05-20T17:36:05.984 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633994, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml" 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2329842354, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628779, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml" 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2335676998, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628982, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg" 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2339946885, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629537, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml" 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2344125744, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632976, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml" 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.986 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2344327875, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633917, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml" 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2344866221, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629991, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml" 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.987 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2346244584, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633373, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml" 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2347629147, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629662, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg" 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2357088455, 2024-05-20T17:36:05.988 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633175, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg" 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2360012071, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633271, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml" 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2361386655, 2024-05-20T17:36:05.989 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633800, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml" 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2369145283, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633886, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml" 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2374934357, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633023, 2024-05-20T17:36:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml" 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2375025817, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633005, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml" 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2380714406, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633074, 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml" 2024-05-20T17:36:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2388104011, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633818, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml" 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2391360868, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629997, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml" 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2393667802, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633544, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg" 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2400949770, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629569, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg" 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2420151538, 2024-05-20T17:36:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628911, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml" 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2430110248, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629587, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg" 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2458335683, 2024-05-20T17:36:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633882, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml" 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2461819856, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633577, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg" 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2468629530, 2024-05-20T17:36:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628757, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml" 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2473149588, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628745, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml" 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2479943752, 2024-05-20T17:36:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633102, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml" 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2483667060, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633695, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg" 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2487835010, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633584, 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg" 2024-05-20T17:36:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2490054881, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628919, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml" 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2491875550, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629082, 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg" 2024-05-20T17:36:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2523736095, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632983, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml" 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2542266172, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630155, 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg" 2024-05-20T17:36:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2546313272, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629043, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg" 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2558648118, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633979, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml" 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2568532674, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633224, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml" 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2573719724, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629871, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml" 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2574628210, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629065, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg" 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2577551392, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632969, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml" 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2581500680, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633919, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml" 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2584233620, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633397, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml" 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2596935204, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633219, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml" 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2606554076, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629775, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg" 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.004 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2607292586, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629039, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg" 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2615888568, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629555, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg" 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2623347100, 2024-05-20T17:36:06.005 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633643, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg" 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2624158474, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633313, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml" 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2626883658, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628838, 2024-05-20T17:36:06.006 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml" 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2629343207, 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633966, 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml" 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2633471291, 2024-05-20T17:36:06.007 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633037, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml" 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2638290520, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633055, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml" 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2640278405, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633760, 2024-05-20T17:36:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg" 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2644622262, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629031, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg" 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2649279833, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628766, 2024-05-20T17:36:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml" 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2655741933, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633515, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg" 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2661835597, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629710, 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg" 2024-05-20T17:36:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2690800363, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633978, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml" 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2697499395, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628860, 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml" 2024-05-20T17:36:06.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2701032522, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633955, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml" 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2705304656, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629783, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml" 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2720418276, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633908, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml" 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2720496163, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633387, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml" 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.013 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2721415297, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633744, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml" 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2727583391, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629015, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg" 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.014 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2732422292, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629400, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml" 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2735034924, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633848, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml" 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2740755974, 2024-05-20T17:36:06.015 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629740, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg" 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2752898855, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630039, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml" 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2760201078, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633425, 2024-05-20T17:36:06.016 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml" 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2764071414, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629505, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml" 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2765160418, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633420, 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml" 2024-05-20T17:36:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2772891829, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633052, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml" 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2774459902, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633885, 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml" 2024-05-20T17:36:06.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2778401152, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633873, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml" 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2781285187, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633195, 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg" 2024-05-20T17:36:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2786920716, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629850, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml" 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2804507335, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633369, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml" 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.020 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2810094089, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629047, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg" 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2810859858, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633991, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml" 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.021 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2817572075, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629070, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg" 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2821175481, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628826, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml" 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.022 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2821700449, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633755, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml" 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2824093246, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633934, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml" 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2833544916, 2024-05-20T17:36:06.023 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629623, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg" 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2856989749, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629517, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml" 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2873059520, 2024-05-20T17:36:06.024 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633139, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml" 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2885615824, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630083, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg" 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2888163631, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633985, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml" 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2889471416, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629485, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml" 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2903333984, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633781, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml" 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.026 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2907171376, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628782, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml" 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2911010568, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633869, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml" 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.027 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2917693763, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633734, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg" 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2920093085, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633992, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml" 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2927699704, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632994, 2024-05-20T17:36:06.028 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml" 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2938595697, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633042, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml" 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2946284211, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630003, 2024-05-20T17:36:06.029 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml" 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2971392479, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633854, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml" 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2972503117, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628961, 2024-05-20T17:36:06.030 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg" 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2981381880, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633094, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg" 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2983163361, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633088, 2024-05-20T17:36:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml" 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2992539151, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629689, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg" 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 2997505677, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633552, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg" 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.032 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3017447328, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629507, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml" 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3018258308, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633501, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg" 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.033 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3023652771, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629807, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml" 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3024309937, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629425, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml" 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.034 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3041726935, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630128, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg" 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3042379285, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629432, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml" 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.035 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3051856720, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633567, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg" 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3058915535, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628822, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml" 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3068512408, 2024-05-20T17:36:06.036 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633345, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml" 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3069298511, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633453, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml" 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3079876961, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633981, 2024-05-20T17:36:06.037 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml" 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3084728791, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633927, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml" 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3087892060, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629683, 2024-05-20T17:36:06.038 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg" 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3088320787, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628844, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml" 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3089690662, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633378, 2024-05-20T17:36:06.039 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml" 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3097871380, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633915, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml" 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3108439811, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628928, 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml" 2024-05-20T17:36:06.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3124799315, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633909, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml" 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3138070517, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629596, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg" 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.041 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3139894256, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633752, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml" 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3153563619, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629007, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg" 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.042 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3156225752, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633986, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml" 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3157374514, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633010, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml" 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.043 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3158988416, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633851, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml" 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3159114068, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629068, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg" 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3164575704, 2024-05-20T17:36:06.044 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633963, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml" 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3165418069, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628999, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg" 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3170431992, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633733, 2024-05-20T17:36:06.045 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml" 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3172364202, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633060, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml" 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3177074675, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633140, 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg" 2024-05-20T17:36:06.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3183990884, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633591, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg" 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3184332461, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633480, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml" 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.047 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3195512129, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629917, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml" 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3196506380, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630031, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml" 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.048 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3201193565, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633477, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml" 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3207227130, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633019, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml" 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.049 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3210601627, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632995, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml" 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3211063457, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628763, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml" 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.050 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3221715771, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633785, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml" 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3221875757, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632980, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml" 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.051 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3225680339, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628760, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml" 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3228932395, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633864, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml" 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.052 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3231624586, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628830, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml" 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3236493200, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633204, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml" 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.053 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3244993516, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633812, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml" 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3258082770, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629005, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg" 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.054 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3262149817, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633969, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml" 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3262828129, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629003, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg" 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3271215742, 2024-05-20T17:36:06.055 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630029, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml" 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3273703468, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630100, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg" 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3280084018, 2024-05-20T17:36:06.056 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628733, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml" 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3288329105, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633434, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg" 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3293518384, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633341, 2024-05-20T17:36:06.057 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml" 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3312067274, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633229, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml" 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3312452735, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630027, 2024-05-20T17:36:06.058 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml" 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3320868235, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628294, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am" 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3322861075, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629013, 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg" 2024-05-20T17:36:06.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3331024543, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633699, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg" 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3335744964, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633932, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml" 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3339608258, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628706, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml" 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3340966084, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629511, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml" 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.061 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3347828251, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633625, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg" 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3350285646, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633972, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml" 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.062 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3362660643, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629810, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml" 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3370906152, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628976, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg" 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.063 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3373652671, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629838, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml" 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3399534368, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628997, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg" 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3400246315, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629011, 2024-05-20T17:36:06.064 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg" 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3435575781, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633098, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg" 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3439564094, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629420, 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml" 2024-05-20T17:36:06.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3443463991, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633150, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg" 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3447831030, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633988, 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml" 2024-05-20T17:36:06.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3449433414, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633770, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml" 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3449670053, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633504, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg" 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.067 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3457182344, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628658, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile" 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3460574919, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628841, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml" 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3462801931, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633122, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml" 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3468008551, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633571, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg" 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.069 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3482495459, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629760, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml" 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3485247177, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633902, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml" 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.070 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3489964490, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633938, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml" 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3492052366, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633878, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml" 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3493317306, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629453, 2024-05-20T17:36:06.071 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml" 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3518418779, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629995, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml" 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3520107098, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633941, 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml" 2024-05-20T17:36:06.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3521623331, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629590, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg" 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3522357866, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633849, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml" 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3523673875, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633879, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml" 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3528033669, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629037, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg" 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.074 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3530341601, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629605, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg" 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3535294147, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633174, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml" 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.075 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3535656383, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628895, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml" 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3535950012, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633557, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg" 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3536545404, 2024-05-20T17:36:06.076 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628730, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml" 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3539168959, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633117, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg" 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3539627991, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629560, 2024-05-20T17:36:06.077 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg" 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3546168044, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633392, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml" 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3548784784, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633046, 2024-05-20T17:36:06.078 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml" 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3550022650, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633953, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml" 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3559198404, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633825, 2024-05-20T17:36:06.079 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml" 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3561403105, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633056, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml" 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3563538790, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633888, 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml" 2024-05-20T17:36:06.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3565570951, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633863, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml" 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3568297511, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629078, 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg" 2024-05-20T17:36:06.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3569226383, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633939, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml" 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3573313303, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633866, 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml" 2024-05-20T17:36:06.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3575599850, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633257, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml" 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3578570428, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633275, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml" 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3586688522, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633252, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml" 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3594518657, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633350, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml" 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3605712705, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633782, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg" 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3607505144, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633968, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml" 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3608045865, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628946, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg" 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3608677396, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629417, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml" 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3618906218, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633612, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg" 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3619792164, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633730, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg" 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3624761713, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633830, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml" 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3628276143, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633674, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg" 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3633894053, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628913, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml" 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3640727596, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633123, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg" 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3641519009, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628814, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml" 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3651515708, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633821, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml" 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3658350717, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633466, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml" 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3660417920, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629794, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml" 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3681845182, 2024-05-20T17:36:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633027, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml" 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3709869205, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633238, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml" 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3722165085, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633443, 2024-05-20T17:36:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg" 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3722935777, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633803, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml" 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3726245920, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628847, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml" 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3726722629, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633828, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml" 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3728341048, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628967, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg" 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3733261435, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628862, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml" 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3744657617, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633155, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg" 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3760300403, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629437, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml" 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3760896569, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629983, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml" 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3762333820, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633910, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml" 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3769453138, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633159, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml" 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3773396786, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629477, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml" 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3778116049, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633895, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml" 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3782734941, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628751, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml" 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3801398815, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633946, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml" 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3802625056, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633837, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml" 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3805675889, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629086, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg" 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3813540729, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633911, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml" 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3822843192, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629495, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml" 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3834792536, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633930, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml" 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3838969122, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633887, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml" 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3841695624, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633215, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml" 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3848767200, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633777, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml" 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3854598262, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633308, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml" 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3858810305, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628802, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml" 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3864762950, 2024-05-20T17:36:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633839, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml" 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3879152320, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633852, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml" 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3898199643, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628943, 2024-05-20T17:36:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg" 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3902079134, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633618, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg" 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3904388460, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633798, 2024-05-20T17:36:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg" 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3922073310, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633601, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg" 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3922426469, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628850, 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml" 2024-05-20T17:36:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3923556518, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632987, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml" 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3924181373, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633083, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml" 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3925363776, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633912, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml" 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3926342323, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633336, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml" 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3928224109, 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633560, 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg" 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3928316275, 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633416, 2024-05-20T17:36:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml" 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3929703819, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633548, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg" 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3942496994, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633660, 2024-05-20T17:36:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg" 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3943738573, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633038, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml" 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3956494839, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633794, 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg" 2024-05-20T17:36:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3968654152, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633180, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg" 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3971488616, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629061, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg" 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3976249761, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633134, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg" 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3984253524, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633952, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml" 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3987920858, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629913, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml" 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3988977690, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633945, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml" 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3990915044, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633522, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg" 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 3999545072, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633807, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg" 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4013590247, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633890, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml" 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4024117818, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633774, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml" 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4031350866, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629503, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml" 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4037233374, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633898, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml" 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4041510889, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633487, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg" 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4044019230, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629800, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml" 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4052823207, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633108, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg" 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4053389174, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633033, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml" 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4053947102, 2024-05-20T17:36:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633843, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml" 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4054283744, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633861, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml" 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4056365664, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633876, 2024-05-20T17:36:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml" 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4059128384, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633075, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml" 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4066429197, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633111, 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml" 2024-05-20T17:36:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4072026241, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629541, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml" 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4072985584, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633995, 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml" 2024-05-20T17:36:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4075001855, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633128, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg" 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4082722164, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633923, 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml" 2024-05-20T17:36:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4099743274, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633622, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg" 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4106288309, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629429, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml" 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4114924291, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633789, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml" 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4119808269, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633924, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml" 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4122078451, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633877, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml" 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4131198208, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628958, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg" 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4143688961, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629859, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml" 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4144233226, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633170, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg" 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4155153846, 2024-05-20T17:36:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633944, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml" 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4166676952, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633154, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml" 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4166688650, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630007, 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml" 2024-05-20T17:36:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4171544712, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629059, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg" 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4179121046, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633778, 2024-05-20T17:36:06.130 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg" 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4184066475, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633097, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml" 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4185606728, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633047, 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml" 2024-05-20T17:36:06.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4186748768, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629090, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg" 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4189292692, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629553, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml" 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.132 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4200696113, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633892, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml" 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4201354359, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511632999, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml" 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4202775578, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633883, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml" 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4203308139, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628934, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml" 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.134 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4204080262, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633950, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml" 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4211334198, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633962, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml" 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.135 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4213877614, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633738, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg" 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4216806299, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511633766, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml" 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.136 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4243609685, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511630037, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml" 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4253147382, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511628742, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml" 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.137 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4255333366, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629744, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml" 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4286018022, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629411, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml" 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4287450582, 2024-05-20T17:36:06.138 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629088, 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg" 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: "damage_type": "backtrace", 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4289703158, 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1099511629041, 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg" 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:36:06.139 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 msgr2=0x7f0c8c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 0x7f0c8c0a5210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c09c000 tx=0x7f0c9c06afa0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 msgr2=0x7f0ca40fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00eb10 tx=0x7f0c9c00c2d0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 shutdown_connections 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0c8c0a2d00 0x7f0c8c0a5210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca410c330 0x7f0ca40fec80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca41079d0 0x7f0ca40fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 --2- 172.21.15.135:0/1542970896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca4101aa0 0x7f0ca40fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 >> 172.21.15.135:0/1542970896 conn(0x7f0ca40770b0 msgr2=0x7f0ca4068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 shutdown_connections 2024-05-20T17:36:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:05.785+0000 7f0caa0e9640 1 -- 172.21.15.135:0/1542970896 wait complete. 2024-05-20T17:36:06.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-20T17:36:06.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 -- 172.21.15.135:0/3531001989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 msgr2=0x7f9de8101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 --2- 172.21.15.135:0/3531001989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8101560 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd802a410 comp rx=0 tx=0).stop 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 -- 172.21.15.135:0/3531001989 shutdown_connections 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 --2- 172.21.15.135:0/3531001989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de810c330 0x7f9de810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 --2- 172.21.15.135:0/3531001989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de8101aa0 0x7f9de8101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 --2- 172.21.15.135:0/3531001989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8101560 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 -- 172.21.15.135:0/3531001989 >> 172.21.15.135:0/3531001989 conn(0x7f9de80770b0 msgr2=0x7f9de80774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 -- 172.21.15.135:0/3531001989 shutdown_connections 2024-05-20T17:36:06.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.264+0000 7f9dece37640 1 -- 172.21.15.135:0/3531001989 wait complete. 2024-05-20T17:36:06.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 Processor -- start 2024-05-20T17:36:06.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 -- start start 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de8101aa0 0x7f9de8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de810c330 0x7f9de819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8111d30 con 0x7f9de81079d0 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8111bb0 con 0x7f9de8101aa0 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9dece37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8111eb0 con 0x7f9de810c330 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49452/0 (socket says 172.21.15.135:49452) 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9ddffff640 1 -- 172.21.15.135:0/3226345736 learned_addr learned my addr 172.21.15.135:0/3226345736 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9de659c640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de8101aa0 0x7f9de8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.265+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de810c330 0x7f9de819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 -- 172.21.15.135:0/3226345736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de810c330 msgr2=0x7f9de819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de810c330 0x7f9de819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 -- 172.21.15.135:0/3226345736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de8101aa0 msgr2=0x7f9de8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de8101aa0 0x7f9de8198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 -- 172.21.15.135:0/3226345736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de819d4f0 con 0x7f9de81079d0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000eb00 tx=0x7f9dd0009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/3226345736 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001c070 con 0x7f9de81079d0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de819d7e0 con 0x7f9de81079d0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/3226345736 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd000bba0 con 0x7f9de81079d0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/3226345736 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0003de0 con 0x7f9de81079d0 2024-05-20T17:36:06.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.266+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de819dce0 con 0x7f9de81079d0 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 Processor -- start 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 -- start start 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/3226345736 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9dd001f070 con 0x7f9de81079d0 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591a1189c40 con 0x5591a0e85390 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5591a1131580 con 0x5591a0e5c4d0 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9df3db3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591a1185c00 con 0x5591a0e646b0 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9de6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9de659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9de659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57790/0 (socket says 172.21.15.135:57790) 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9de6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49460/0 (socket says 172.21.15.135:49460) 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.269+0000 7f9de659c640 1 -- 172.21.15.135:0/715092767 learned_addr learned my addr 172.21.15.135:0/715092767 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 -- 172.21.15.135:0/715092767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 msgr2=0x5591a12247a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12247a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 -- 172.21.15.135:0/715092767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 msgr2=0x5591a1223d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 -- 172.21.15.135:0/715092767 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a0e9d3f0 con 0x5591a0e5c4d0 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9ddf7fe640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 0x7f9dd40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de659c640 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd8009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941410b6925c9bb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 0x7f9dd40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/3226345736 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9dd00d0b20 con 0x7f9de81079d0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9ddcff9640 1 -- 172.21.15.135:0/715092767 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8035040 con 0x5591a0e5c4d0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9ddcff9640 1 -- 172.21.15.135:0/715092767 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd8005520 con 0x5591a0e5c4d0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.270+0000 7f9ddcff9640 1 -- 172.21.15.135:0/715092767 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8004e20 con 0x5591a0e5c4d0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 -- 172.21.15.135:0/715092767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 msgr2=0x5591a1224260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd8009650 comp rx=0 tx=0).stop 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 0x7f9dd40a5210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5591a1220e90 tx=0x7f9de0009500 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 -- 172.21.15.135:0/715092767 shutdown_connections 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12247a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e5c4d0 0x5591a1224260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 --2- 172.21.15.135:0/715092767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1223d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 -- 172.21.15.135:0/715092767 >> 172.21.15.135:0/715092767 conn(0x5591a0e794e0 msgr2=0x5591a12204d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 -- 172.21.15.135:0/715092767 shutdown_connections 2024-05-20T17:36:06.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.271+0000 7f9df3db3740 1 -- 172.21.15.135:0/715092767 wait complete. 2024-05-20T17:36:06.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 -- start start 2024-05-20T17:36:06.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 Processor -- start 2024-05-20T17:36:06.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a122e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591a1230fb0 con 0x5591a0e646b0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5591a1144c40 con 0x5591a0e85390 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591a1231130 con 0x5591a0e5c4d0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9df3db3740 10 client.0 _ll_register_callbacks cb 0x5591a0e9cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49476/0 (socket says 172.21.15.135:49476) 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 -- 172.21.15.135:0/2713945118 learned_addr learned my addr 172.21.15.135:0/2713945118 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a122e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9de659c640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 -- 172.21.15.135:0/2713945118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 msgr2=0x5591a122fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 -- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 msgr2=0x5591a122e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.272+0000 7f9ddffff640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a122e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9ddffff640 1 -- 172.21.15.135:0/2713945118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a0f677d0 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9ddffff640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009fd0 tx=0x7f9dd0098c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb74875830f4eb17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd009cc30 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9dd0099760 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd8005520 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9dd009ca50 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 10 client.16278 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5591a123d750 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd8005520 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9dd009c540 con 0x5591a0e646b0 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 10 client.16278 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:06.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 20 client.16278 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e43f60 0x5591a1240c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 4 client.16278 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.273+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a1197370 con 0x5591a0e43f60 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.274+0000 7f9de659c640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e43f60 0x5591a1240c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.274+0000 7f9de659c640 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e43f60 0x5591a1240c60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a518aed75a9d45af server_cookie=2c1fb866fc88b355 in_seq=0 out_seq=0 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.274+0000 7f9dcdffb640 10 client.16278 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9dcdffb640 1 -- 172.21.15.135:0/2713945118 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5591a1197370 con 0x5591a0e43f60 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9dcdffb640 10 client.16278 handle_command_reply: tid=0 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 client.16278 shutdown 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 msgr2=0x5591a1230360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009fd0 tx=0x7f9dd0098c70 comp rx=0 tx=0).stop 2024-05-20T17:36:06.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 shutdown_connections 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e43f60 0x5591a1240c60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a122e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e646b0 0x5591a1230360 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9dcdffb640 0 client.16278 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 --2- 172.21.15.135:0/2713945118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 >> 172.21.15.135:0/2713945118 conn(0x5591a0e794e0 msgr2=0x5591a1225a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 shutdown_connections 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 1 -- 172.21.15.135:0/2713945118 wait complete. 2024-05-20T17:36:06.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.276+0000 7f9df3db3740 20 client.16278 trim_cache size 0 max 16384 2024-05-20T17:36:06.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 Processor -- start 2024-05-20T17:36:06.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 -- start start 2024-05-20T17:36:06.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e646b0 0x5591a12243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81aef70 con 0x5591a0e85390 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81ac840 con 0x5591a0e646b0 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9df3db3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81aa690 con 0x5591a0e5c4d0 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49482/0 (socket says 172.21.15.135:49482) 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 -- 172.21.15.135:0/3860786956 learned_addr learned my addr 172.21.15.135:0/3860786956 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e646b0 0x5591a12243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de659c640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 -- 172.21.15.135:0/3860786956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 msgr2=0x5591a122e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 -- 172.21.15.135:0/3860786956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e646b0 msgr2=0x5591a12243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e646b0 0x5591a12243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 -- 172.21.15.135:0/3860786956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a122fc20 con 0x5591a0e85390 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de659c640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.291+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9de0003c90 tx=0x7f9de001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60494d3157b20e2c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.292+0000 7f9dcffff640 1 -- 172.21.15.135:0/3860786956 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de000fe60 con 0x5591a0e85390 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.292+0000 7f9dcffff640 1 -- 172.21.15.135:0/3860786956 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9de0003cc0 con 0x5591a0e85390 2024-05-20T17:36:06.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.292+0000 7f9dcffff640 1 -- 172.21.15.135:0/3860786956 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de001e430 con 0x5591a0e85390 2024-05-20T17:36:06.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- 172.21.15.135:0/3860786956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 msgr2=0x5591a1227aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9de0003c90 tx=0x7f9de001a000 comp rx=0 tx=0).stop 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- 172.21.15.135:0/3860786956 shutdown_connections 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e85390 0x5591a1227aa0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e646b0 0x5591a12243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3860786956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e5c4d0 0x5591a122e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- 172.21.15.135:0/3860786956 >> 172.21.15.135:0/3860786956 conn(0x5591a0e794e0 msgr2=0x5591a1223ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- 172.21.15.135:0/3860786956 shutdown_connections 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- 172.21.15.135:0/3860786956 wait complete. 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 -- start start 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 Processor -- start 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.293+0000 7f9df3db3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a12a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81aad00 con 0x5591a0e5c4d0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81ac170 con 0x5591a0e85390 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81ab3d0 con 0x5591a0e646b0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 10 client.0 _ll_register_callbacks cb 0x7f9dd00037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49496/0 (socket says 172.21.15.135:49496) 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 -- 172.21.15.135:0/3752722748 learned_addr learned my addr 172.21.15.135:0/3752722748 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de6d9d640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a12a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 -- 172.21.15.135:0/3752722748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 msgr2=0x5591a12327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 -- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 msgr2=0x5591a12a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a12a7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 -- 172.21.15.135:0/3752722748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a1232fc0 con 0x5591a0e5c4d0 2024-05-20T17:36:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9de659c640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8004a10 tx=0x7f9dd802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589e30cf90b5abfa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8035040 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9dd8031a80 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9de0003cc0 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9dd8065050 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 10 client.16284 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.294+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5591a12a9490 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9de0003cc0 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9dd804d070 con 0x5591a0e5c4d0 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 10 client.16284 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 20 client.16284 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e193a0 0x5591a12ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 4 client.16284 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591a11916c0 con 0x5591a0e193a0 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.295+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e193a0 0x5591a12ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.296+0000 7f9dcdffb640 10 client.16284 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.296+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e193a0 0x5591a12ab8a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0bb91331198c11 server_cookie=aa784b60555aa5cc in_seq=0 out_seq=0 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.297+0000 7f9dcdffb640 1 -- 172.21.15.135:0/3752722748 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591a11916c0 con 0x5591a0e193a0 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.297+0000 7f9dcdffb640 10 client.16284 handle_command_reply: tid=0 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.297+0000 7f9df3db3740 1 client.16284 shutdown 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.297+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 msgr2=0x5591a1232290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.297+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8004a10 tx=0x7f9dd802a410 comp rx=0 tx=0).stop 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 shutdown_connections 2024-05-20T17:36:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5591a0e193a0 0x5591a12ab8a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591a0e85390 0x5591a12a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a0e646b0 0x5591a12327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dcdffb640 0 client.16284 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 --2- 172.21.15.135:0/3752722748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591a0e5c4d0 0x5591a1232290 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 >> 172.21.15.135:0/3752722748 conn(0x5591a0e794e0 msgr2=0x5591a122df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 shutdown_connections 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 1 -- 172.21.15.135:0/3752722748 wait complete. 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9df3db3740 20 client.16284 trim_cache size 0 max 16384 2024-05-20T17:36:06.304 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 msgr2=0x7f9dd40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 0x7f9dd40a5210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5591a1220e90 tx=0x7f9de0009500 comp rx=0 tx=0).stop 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 msgr2=0x7f9de8198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000eb00 tx=0x7f9dd0009ea0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 shutdown_connections 2024-05-20T17:36:06.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9dd40a2d00 0x7f9dd40a5210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9de810c330 0x7f9de819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de81079d0 0x7f9de8198bf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 --2- 172.21.15.135:0/3226345736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de8101aa0 0x7f9de8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 >> 172.21.15.135:0/3226345736 conn(0x7f9de80770b0 msgr2=0x7f9de8103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 shutdown_connections 2024-05-20T17:36:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:36:06.298+0000 7f9dece37640 1 -- 172.21.15.135:0/3226345736 wait complete. 2024-05-20T17:36:06.313 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 3609530, 'ino': 1099511628811, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-49.xml'}, {'damage_type': 'backtrace', 'id': 5592355, 'ino': 1099511629803, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 7422945, 'ino': 1099511632525, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 8251832, 'ino': 1099511631766, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 12308606, 'ino': 1099511631964, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 25159854, 'ino': 1099511631874, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 51340617, 'ino': 1099511631857, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 61751491, 'ino': 1099511630043, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 66859432, 'ino': 1099511629629, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 74075095, 'ino': 1099511633714, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 75331065, 'ino': 1099511631949, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 78245176, 'ino': 1099511632664, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 83167862, 'ino': 1099511630560, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 87659792, 'ino': 1099511628866, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-31.xml'}, {'damage_type': 'backtrace', 'id': 97515914, 'ino': 1099511629053, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 112550457, 'ino': 1099511628804, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-36.xml'}, {'damage_type': 'backtrace', 'id': 112865633, 'ino': 1099511630499, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 120741756, 'ino': 1099511632414, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 128292439, 'ino': 1099511632866, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml'}, {'damage_type': 'backtrace', 'id': 140951634, 'ino': 1099511631604, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-97.jpg'}, {'damage_type': 'backtrace', 'id': 150441900, 'ino': 1099511632593, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 155493082, 'ino': 1099511630094, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 157141701, 'ino': 1099511629439, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-56.xml'}, {'damage_type': 'backtrace', 'id': 160649331, 'ino': 1099511632820, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml'}, {'damage_type': 'backtrace', 'id': 178796290, 'ino': 1099511632755, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 186827635, 'ino': 1099511632442, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 198862266, 'ino': 1099511632871, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml'}, {'damage_type': 'backtrace', 'id': 206506664, 'ino': 1099511628905, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-18.xml'}, {'damage_type': 'backtrace', 'id': 211168612, 'ino': 1099511632684, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 216771997, 'ino': 1099511629668, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 224807818, 'ino': 1099511628722, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-79.xml'}, {'damage_type': 'backtrace', 'id': 234541805, 'ino': 1099511628986, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 244620087, 'ino': 1099511629788, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 247849469, 'ino': 1099511631410, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml'}, {'damage_type': 'backtrace', 'id': 254718809, 'ino': 1099511632438, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 284365753, 'ino': 1099511632434, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 285134852, 'ino': 1099511628818, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml'}, {'damage_type': 'backtrace', 'id': 295998235, 'ino': 1099511631387, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml'}, {'damage_type': 'backtrace', 'id': 304182077, 'ino': 1099511631574, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml'}, {'damage_type': 'backtrace', 'id': 307075630, 'ino': 1099511629044, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 308012683, 'ino': 1099511630517, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 312075646, 'ino': 1099511628807, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-51.xml'}, {'damage_type': 'backtrace', 'id': 320960084, 'ino': 1099511632509, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 323109923, 'ino': 1099511631882, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 326551379, 'ino': 1099511633706, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 338707414, 'ino': 1099511628939, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-7.xml'}, {'damage_type': 'backtrace', 'id': 343104805, 'ino': 1099511631475, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml'}, {'damage_type': 'backtrace', 'id': 345835536, 'ino': 1099511633690, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 359340132, 'ino': 1099511632846, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml'}, {'damage_type': 'backtrace', 'id': 362890243, 'ino': 1099511632418, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 364001575, 'ino': 1099511631982, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 366099861, 'ino': 1099511632567, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 370584476, 'ino': 1099511629009, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 371629340, 'ino': 1099511632513, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 382585745, 'ino': 1099511629169, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-18.xml'}, {'damage_type': 'backtrace', 'id': 416463720, 'ino': 1099511632942, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 426200894, 'ino': 1099511632677, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 433693510, 'ino': 1099511633628, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 433964550, 'ino': 1099511631480, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml'}, {'damage_type': 'backtrace', 'id': 436903273, 'ino': 1099511631943, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 438909666, 'ino': 1099511631851, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 450011943, 'ino': 1099511628737, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-74.xml'}, {'damage_type': 'backtrace', 'id': 451684347, 'ino': 1099511632786, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml'}, {'damage_type': 'backtrace', 'id': 469722136, 'ino': 1099511631266, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml'}, {'damage_type': 'backtrace', 'id': 492969010, 'ino': 1099511632939, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 505921546, 'ino': 1099511632878, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml'}, {'damage_type': 'backtrace', 'id': 516131416, 'ino': 1099511628861, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-33.xml'}, {'damage_type': 'backtrace', 'id': 516266548, 'ino': 1099511628887, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-24.xml'}, {'damage_type': 'backtrace', 'id': 516559567, 'ino': 1099511631300, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 521845369, 'ino': 1099511632781, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 534370099, 'ino': 1099511632898, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 538381788, 'ino': 1099511628712, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-43.xml'}, {'damage_type': 'backtrace', 'id': 552940403, 'ino': 1099511628764, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-65.xml'}, {'damage_type': 'backtrace', 'id': 553807923, 'ino': 1099511631554, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml'}, {'damage_type': 'backtrace', 'id': 554747713, 'ino': 1099511632882, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml'}, {'damage_type': 'backtrace', 'id': 555997167, 'ino': 1099511633669, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 567821919, 'ino': 1099511629293, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-3.xml'}, {'damage_type': 'backtrace', 'id': 568723372, 'ino': 1099511629055, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 575333588, 'ino': 1099511629459, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-46.xml'}, {'damage_type': 'backtrace', 'id': 576332368, 'ino': 1099511632739, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 577368132, 'ino': 1099511631465, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml'}, {'damage_type': 'backtrace', 'id': 586670307, 'ino': 1099511632763, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 595954439, 'ino': 1099511632658, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 598155311, 'ino': 1099511631924, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 601956431, 'ino': 1099511629048, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 606728884, 'ino': 1099511632774, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml'}, {'damage_type': 'backtrace', 'id': 608306034, 'ino': 1099511632842, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml'}, {'damage_type': 'backtrace', 'id': 613946634, 'ino': 1099511632831, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml'}, {'damage_type': 'backtrace', 'id': 632234415, 'ino': 1099511628944, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-5.xml'}, {'damage_type': 'backtrace', 'id': 635602300, 'ino': 1099511628726, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-78.xml'}, {'damage_type': 'backtrace', 'id': 650822612, 'ino': 1099511631510, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml'}, {'damage_type': 'backtrace', 'id': 668326934, 'ino': 1099511631287, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml'}, {'damage_type': 'backtrace', 'id': 676916916, 'ino': 1099511632859, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml'}, {'damage_type': 'backtrace', 'id': 708807447, 'ino': 1099511631373, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml'}, {'damage_type': 'backtrace', 'id': 720246251, 'ino': 1099511629593, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 743987476, 'ino': 1099511632922, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 760409236, 'ino': 1099511632788, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 762294865, 'ino': 1099511633659, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 777106497, 'ino': 1099511633617, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml'}, {'damage_type': 'backtrace', 'id': 784080946, 'ino': 1099511632867, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 784273344, 'ino': 1099511629539, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-8.xml'}, {'damage_type': 'backtrace', 'id': 788052722, 'ino': 1099511632832, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 792089923, 'ino': 1099511631775, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 799710452, 'ino': 1099511631246, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml'}, {'damage_type': 'backtrace', 'id': 809545859, 'ino': 1099511628823, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-45.xml'}, {'damage_type': 'backtrace', 'id': 814151232, 'ino': 1099511631915, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 824827448, 'ino': 1099511632769, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 825587235, 'ino': 1099511632836, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 826875798, 'ino': 1099511630448, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml'}, {'damage_type': 'backtrace', 'id': 849946383, 'ino': 1099511631763, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 850060921, 'ino': 1099511632910, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 855463004, 'ino': 1099511629647, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 879919909, 'ino': 1099511629218, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-12.xml'}, {'damage_type': 'backtrace', 'id': 887651663, 'ino': 1099511631280, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml'}, {'damage_type': 'backtrace', 'id': 901119298, 'ino': 1099511632451, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 903746769, 'ino': 1099511632737, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml'}, {'damage_type': 'backtrace', 'id': 906607851, 'ino': 1099511631665, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 912191058, 'ino': 1099511628880, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml'}, {'damage_type': 'backtrace', 'id': 922620917, 'ino': 1099511629532, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-11.xml'}, {'damage_type': 'backtrace', 'id': 932952554, 'ino': 1099511629563, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 939938710, 'ino': 1099511632733, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 947188341, 'ino': 1099511628855, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-31.xml'}, {'damage_type': 'backtrace', 'id': 950412510, 'ino': 1099511629038, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 951714858, 'ino': 1099511628962, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 958763067, 'ino': 1099511628885, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-29.xml'}, {'damage_type': 'backtrace', 'id': 963882981, 'ino': 1099511631393, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml'}, {'damage_type': 'backtrace', 'id': 971229965, 'ino': 1099511633642, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 971487086, 'ino': 1099511629064, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 976189003, 'ino': 1099511631450, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-28.xml'}, {'damage_type': 'backtrace', 'id': 991434984, 'ino': 1099511632919, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1000885667, 'ino': 1099511629726, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1006361295, 'ino': 1099511632491, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1014540951, 'ino': 1099511632912, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1015173878, 'ino': 1099511629671, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1021008627, 'ino': 1099511632886, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1021218274, 'ino': 1099511628728, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-77.xml'}, {'damage_type': 'backtrace', 'id': 1028459417, 'ino': 1099511630442, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1035545849, 'ino': 1099511628701, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1035748134, 'ino': 1099511628767, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-64.xml'}, {'damage_type': 'backtrace', 'id': 1038472517, 'ino': 1099511631736, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 1042235732, 'ino': 1099511632963, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1045463968, 'ino': 1099511632645, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 1052255697, 'ino': 1099511628770, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1057317373, 'ino': 1099511633672, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1060313956, 'ino': 1099511632956, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1067664229, 'ino': 1099511629620, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1068268286, 'ino': 1099511628758, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1070747144, 'ino': 1099511628810, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1080683611, 'ino': 1099511632486, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1082860904, 'ino': 1099511631865, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1086632206, 'ino': 1099511633621, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1090033783, 'ino': 1099511633717, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1108115227, 'ino': 1099511629714, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1117835365, 'ino': 1099511628711, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-83.xml'}, {'damage_type': 'backtrace', 'id': 1125627143, 'ino': 1099511631967, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1128913898, 'ino': 1099511631802, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1132521125, 'ino': 1099511629521, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1145732820, 'ino': 1099511632424, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 1170489290, 'ino': 1099511633638, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1180559618, 'ino': 1099511629818, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 1181186095, 'ino': 1099511628894, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1185343909, 'ino': 1099511630538, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1193314673, 'ino': 1099511629340, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1196955865, 'ino': 1099511628909, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1204769042, 'ino': 1099511629581, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 1222017038, 'ino': 1099511629828, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 1222990419, 'ino': 1099511629698, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1225742265, 'ino': 1099511631902, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1241203837, 'ino': 1099511632928, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1251439753, 'ino': 1099511632852, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1259566373, 'ino': 1099511631579, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1259737801, 'ino': 1099511631564, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1276608206, 'ino': 1099511630540, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1283725439, 'ino': 1099511632927, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1288185486, 'ino': 1099511629676, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1297684100, 'ino': 1099511631599, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-98.jpg'}, {'damage_type': 'backtrace', 'id': 1306704182, 'ino': 1099511631529, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1315983260, 'ino': 1099511632835, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1317370943, 'ino': 1099511631854, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1339669568, 'ino': 1099511628792, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1340842148, 'ino': 1099511629399, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-82.xml'}, {'damage_type': 'backtrace', 'id': 1341974240, 'ino': 1099511632808, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 1360705148, 'ino': 1099511628932, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1369148358, 'ino': 1099511631259, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1373090917, 'ino': 1099511632431, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 1379058314, 'ino': 1099511628761, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1388008662, 'ino': 1099511632879, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 1425441587, 'ino': 1099511632799, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1435864331, 'ino': 1099511628857, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1443333791, 'ino': 1099511630487, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1443582369, 'ino': 1099511629756, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-96.xml'}, {'damage_type': 'backtrace', 'id': 1455508167, 'ino': 1099511632719, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 1463244536, 'ino': 1099511631211, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml'}, {'damage_type': 'backtrace', 'id': 1464305862, 'ino': 1099511631629, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg'}, {'damage_type': 'backtrace', 'id': 1474306825, 'ino': 1099511631894, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1485661602, 'ino': 1099511629040, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1494986199, 'ino': 1099511630460, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1501670581, 'ino': 1099511630552, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1513233593, 'ino': 1099511631728, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 1539427912, 'ino': 1099511631958, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1544936272, 'ino': 1099511629023, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1545271991, 'ino': 1099511631886, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1551669034, 'ino': 1099511632821, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1554722735, 'ino': 1099511628831, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1570672355, 'ino': 1099511632930, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1587929631, 'ino': 1099511633614, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1588992620, 'ino': 1099511629058, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1590135398, 'ino': 1099511631955, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1593760250, 'ino': 1099511628996, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1604890077, 'ino': 1099511632546, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 1607489728, 'ino': 1099511632875, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1613424968, 'ino': 1099511629012, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1617964945, 'ino': 1099511631500, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1623570408, 'ino': 1099511629519, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1626110183, 'ino': 1099511628734, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1631039531, 'ino': 1099511632853, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1634263062, 'ino': 1099511628749, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1635817576, 'ino': 1099511632949, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1636784515, 'ino': 1099511629032, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1639709949, 'ino': 1099511632838, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1644769637, 'ino': 1099511628718, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1648960365, 'ino': 1099511631677, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 1649349344, 'ino': 1099511630514, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1666745129, 'ino': 1099511633655, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1667991471, 'ino': 1099511631647, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 1668043941, 'ino': 1099511628768, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1675946201, 'ino': 1099511632481, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1699687453, 'ino': 1099511632460, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1700449800, 'ino': 1099511631337, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1703147518, 'ino': 1099511632946, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1704373212, 'ino': 1099511631399, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1713599988, 'ino': 1099511632848, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1718250198, 'ino': 1099511632864, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1725652625, 'ino': 1099511629957, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1726454899, 'ino': 1099511629693, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1731975401, 'ino': 1099511628704, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-85.xml'}, {'damage_type': 'backtrace', 'id': 1732465663, 'ino': 1099511632863, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1740377174, 'ino': 1099511631299, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1741759060, 'ino': 1099511631311, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml'}, {'damage_type': 'backtrace', 'id': 1795277904, 'ino': 1099511632704, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1816756846, 'ino': 1099511629513, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1823378485, 'ino': 1099511628956, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1831252617, 'ino': 1099511632477, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 1831948923, 'ino': 1099511631961, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1833384400, 'ino': 1099511630524, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1850847756, 'ino': 1099511631232, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1865184051, 'ino': 1099511631238, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1871959943, 'ino': 1099511631594, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg'}, {'damage_type': 'backtrace', 'id': 1876669653, 'ino': 1099511630304, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1877315849, 'ino': 1099511631194, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 1877806747, 'ino': 1099511628981, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1895404762, 'ino': 1099511631524, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1895405662, 'ino': 1099511633702, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1897715051, 'ino': 1099511629413, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-72.xml'}, {'damage_type': 'backtrace', 'id': 1929183694, 'ino': 1099511632883, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1929930752, 'ino': 1099511631329, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1936220425, 'ino': 1099511628950, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1939397935, 'ino': 1099511632824, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 1945071537, 'ino': 1099511631998, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1949056706, 'ino': 1099511632625, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1951006164, 'ino': 1099511632560, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 1954875809, 'ino': 1099511631750, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 1970985791, 'ino': 1099511632599, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 1971117298, 'ino': 1099511631878, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1981343545, 'ino': 1099511631317, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1982520459, 'ino': 1099511632818, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1991103796, 'ino': 1099511632810, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1998054222, 'ino': 1099511632924, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 2003592977, 'ino': 1099511631898, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2004302789, 'ino': 1099511629455, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2006398770, 'ino': 1099511629551, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2009862609, 'ino': 1099511632849, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 2018427380, 'ino': 1099511633683, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2024779242, 'ino': 1099511632690, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 2032084694, 'ino': 1099511631584, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2037287311, 'ino': 1099511633725, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2037382617, 'ino': 1099511631936, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2040242411, 'ino': 1099511631428, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2042089021, 'ino': 1099511629028, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2044983872, 'ino': 1099511629035, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2045317657, 'ino': 1099511629262, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2046370289, 'ino': 1099511629481, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2078040547, 'ino': 1099511633631, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2093717077, 'ino': 1099511632726, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 2120875050, 'ino': 1099511629543, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2129372919, 'ino': 1099511629832, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2134912697, 'ino': 1099511632823, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2140670349, 'ino': 1099511631061, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2142860173, 'ino': 1099511629904, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2151417962, 'ino': 1099511628924, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2178951155, 'ino': 1099511632901, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2209306414, 'ino': 1099511629000, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2210476669, 'ino': 1099511632935, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2218217119, 'ino': 1099511631361, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2220298729, 'ino': 1099511631614, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-95.jpg'}, {'damage_type': 'backtrace', 'id': 2239894202, 'ino': 1099511631569, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2248951822, 'ino': 1099511630119, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2250643332, 'ino': 1099511629501, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2254743909, 'ino': 1099511632960, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2258576703, 'ino': 1099511629475, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2262419849, 'ino': 1099511629584, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 2262526731, 'ino': 1099511631845, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 2264304729, 'ino': 1099511629877, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2287466061, 'ino': 1099511631519, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2301984981, 'ino': 1099511631354, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2303210789, 'ino': 1099511631439, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2304321990, 'ino': 1099511632411, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 2305547148, 'ino': 1099511632454, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 2310614058, 'ino': 1099511629002, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2326868621, 'ino': 1099511631986, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2348024294, 'ino': 1099511633728, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2349592864, 'ino': 1099511631992, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2357436075, 'ino': 1099511629054, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2359827595, 'ino': 1099511629626, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2372711049, 'ino': 1099511628890, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2376218902, 'ino': 1099511633676, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2389412681, 'ino': 1099511632813, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2397736982, 'ino': 1099511631273, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2407338671, 'ino': 1099511631624, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 2412954008, 'ino': 1099511631940, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2419481415, 'ino': 1099511633694, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2421031142, 'ino': 1099511629441, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-55.xml'}, {'damage_type': 'backtrace', 'id': 2428323313, 'ino': 1099511632773, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2431197136, 'ino': 1099511631485, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2436575361, 'ino': 1099511631349, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2439851925, 'ino': 1099511630205, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2452384455, 'ino': 1099511631795, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2459986398, 'ino': 1099511632671, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 2463200874, 'ino': 1099511631946, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2465944424, 'ino': 1099511629418, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2469719735, 'ino': 1099511629948, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2470205832, 'ino': 1099511629034, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2471100191, 'ino': 1099511630466, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2495720968, 'ino': 1099511631544, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2514880005, 'ino': 1099511632796, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2519857332, 'ino': 1099511630433, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2520457429, 'ino': 1099511632779, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2537260238, 'ino': 1099511631218, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2550257587, 'ino': 1099511629046, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2550890065, 'ino': 1099511629030, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2553350490, 'ino': 1099511629952, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 2560298635, 'ino': 1099511630088, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2563363375, 'ino': 1099511629018, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2576556026, 'ino': 1099511632464, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2582521654, 'ino': 1099511632806, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2586639590, 'ino': 1099511628780, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2594442096, 'ino': 1099511632421, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2600187361, 'ino': 1099511631534, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2612021623, 'ino': 1099511631708, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 2621096758, 'ino': 1099511632651, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 2622670834, 'ino': 1099511632897, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2638658509, 'ino': 1099511632632, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2649445059, 'ino': 1099511632916, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2649671875, 'ino': 1099511631654, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 2665521680, 'ino': 1099511632539, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 2677992538, 'ino': 1099511629062, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2680774029, 'ino': 1099511629632, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2684890296, 'ino': 1099511630299, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2689680509, 'ino': 1099511631921, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2700930818, 'ino': 1099511632829, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2719463601, 'ino': 1099511632894, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2724188795, 'ino': 1099511628785, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2729268901, 'ino': 1099511632889, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2729479072, 'ino': 1099511631445, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2730396055, 'ino': 1099511632938, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2736893923, 'ino': 1099511632753, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2742417742, 'ino': 1099511632746, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2747460226, 'ino': 1099511628832, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2749953154, 'ino': 1099511632887, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2755325539, 'ino': 1099511632839, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2765776192, 'ino': 1099511631995, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2779848241, 'ino': 1099511631862, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2782403369, 'ino': 1099511630472, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2787288041, 'ino': 1099511631930, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2793434761, 'ino': 1099511629407, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-76.xml'}, {'damage_type': 'backtrace', 'id': 2802087617, 'ino': 1099511631788, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2802347867, 'ino': 1099511628716, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-81.xml'}, {'damage_type': 'backtrace', 'id': 2815150662, 'ino': 1099511629019, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2830546846, 'ino': 1099511628957, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2846517401, 'ino': 1099511629414, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-71.xml'}, {'damage_type': 'backtrace', 'id': 2850594480, 'ino': 1099511631589, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-100.jpg'}, {'damage_type': 'backtrace', 'id': 2857757774, 'ino': 1099511632467, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 2877042968, 'ino': 1099511628878, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2894465383, 'ino': 1099511629599, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2903492257, 'ino': 1099511629770, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2905492447, 'ino': 1099511631252, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml'}, {'damage_type': 'backtrace', 'id': 2911414618, 'ino': 1099511632580, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 2918073932, 'ino': 1099511631890, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2924060321, 'ino': 1099511632905, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 2925427136, 'ino': 1099511633686, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2926077666, 'ino': 1099511629281, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2944739979, 'ino': 1099511628803, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2957650057, 'ino': 1099511632890, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 2959341035, 'ino': 1099511631848, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 2961235498, 'ino': 1099511631641, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 2962618110, 'ino': 1099511631906, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2971760729, 'ino': 1099511628828, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2974641104, 'ino': 1099511628988, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2975061665, 'ino': 1099511632953, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2981445169, 'ino': 1099511628893, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2996210615, 'ino': 1099511628876, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3011319815, 'ino': 1099511633710, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3011715290, 'ino': 1099511632748, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 3024396265, 'ino': 1099511629719, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3035821167, 'ino': 1099511628740, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-73.xml'}, {'damage_type': 'backtrace', 'id': 3058932368, 'ino': 1099511632860, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 3066576276, 'ino': 1099511631722, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3074369714, 'ino': 1099511628836, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3075446459, 'ino': 1099511630502, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3081518518, 'ino': 1099511632503, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3100065463, 'ino': 1099511632902, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3120941467, 'ino': 1099511629246, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3122899398, 'ino': 1099511631378, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3131074311, 'ino': 1099511632843, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3133425677, 'ino': 1099511633698, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3149439001, 'ino': 1099511631976, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3165637106, 'ino': 1099511629509, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3178296594, 'ino': 1099511629614, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3180653426, 'ino': 1099511633624, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 3193484720, 'ino': 1099511628752, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3207436817, 'ino': 1099511631838, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 3209534066, 'ino': 1099511629443, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3211455440, 'ino': 1099511629638, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3212303387, 'ino': 1099511629060, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3214539957, 'ino': 1099511628787, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3222676540, 'ino': 1099511631515, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3245521444, 'ino': 1099511631342, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3250630319, 'ino': 1099511629524, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3254405259, 'ino': 1099511631989, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3254535076, 'ino': 1099511630496, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3262232308, 'ino': 1099511631634, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-91.jpg'}, {'damage_type': 'backtrace', 'id': 3264270010, 'ino': 1099511632917, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3268099759, 'ino': 1099511633662, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3268831305, 'ino': 1099511632815, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 3273285807, 'ino': 1099511631743, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 3277844611, 'ino': 1099511631779, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3279670635, 'ino': 1099511629457, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3280252256, 'ino': 1099511628951, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3280274117, 'ino': 1099511632872, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3287327597, 'ino': 1099511632814, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3297395585, 'ino': 1099511631756, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3309888036, 'ino': 1099511631835, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3313045622, 'ino': 1099511629467, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3330953176, 'ino': 1099511628899, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3332565402, 'ino': 1099511628776, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3339569117, 'ino': 1099511631339, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3344136377, 'ino': 1099511630086, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-89.xml'}, {'damage_type': 'backtrace', 'id': 3361471216, 'ino': 1099511631698, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 3361591782, 'ino': 1099511631918, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3363497197, 'ino': 1099511632586, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3369287365, 'ino': 1099511629175, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3378422315, 'ino': 1099511628980, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3379177695, 'ino': 1099511633666, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3398294110, 'ino': 1099511629364, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3406723706, 'ino': 1099511629703, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3432289031, 'ino': 1099511633648, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3442377022, 'ino': 1099511628783, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3448549040, 'ino': 1099511632876, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3459866932, 'ino': 1099511632817, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3467063931, 'ino': 1099511628827, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3469193499, 'ino': 1099511628992, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3486391162, 'ino': 1099511628738, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3497320423, 'ino': 1099511632447, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 3500044025, 'ino': 1099511628933, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3505392904, 'ino': 1099511631416, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3524253194, 'ino': 1099511632926, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3540060380, 'ino': 1099511632856, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3549823186, 'ino': 1099511632847, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3560205834, 'ino': 1099511628851, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3583054268, 'ino': 1099511629471, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3583233767, 'ino': 1099511632495, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 3583864433, 'ino': 1099511632612, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 3585381385, 'ino': 1099511630481, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3590651059, 'ino': 1099511631832, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 3598456427, 'ino': 1099511631405, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml'}, {'damage_type': 'backtrace', 'id': 3598582619, 'ino': 1099511631868, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3607747545, 'ino': 1099511631367, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3608870752, 'ino': 1099511632920, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 3615482179, 'ino': 1099511632606, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3634797338, 'ino': 1099511633645, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3652880108, 'ino': 1099511629499, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3654202903, 'ino': 1099511628834, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3655473922, 'ino': 1099511632934, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3660458689, 'ino': 1099511629317, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3662996915, 'ino': 1099511631455, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3664821511, 'ino': 1099511632857, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3683536665, 'ino': 1099511629826, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3686542242, 'ino': 1099511631275, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3687548862, 'ino': 1099511628773, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3688608443, 'ino': 1099511631927, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3706551042, 'ino': 1099511631324, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3717134456, 'ino': 1099511632638, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 3718058371, 'ino': 1099511631224, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3721400328, 'ino': 1099511631970, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3722854250, 'ino': 1099511631539, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3750184534, 'ino': 1099511632761, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3772149587, 'ino': 1099511629816, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 3774179713, 'ino': 1099511628968, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3776510647, 'ino': 1099511632913, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 3781059762, 'ino': 1099511628892, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3791977270, 'ino': 1099511629547, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3794779487, 'ino': 1099511629487, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3795784453, 'ino': 1099511630570, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3797741679, 'ino': 1099511628842, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3798923031, 'ino': 1099511631841, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3822978408, 'ino': 1099511632803, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3828331374, 'ino': 1099511631292, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3829996167, 'ino': 1099511629813, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3832953760, 'ino': 1099511633652, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3836268298, 'ino': 1099511631460, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3856170413, 'ino': 1099511631549, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3862451366, 'ino': 1099511631559, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3865700072, 'ino': 1099511632573, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 3866311063, 'ino': 1099511632909, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3867347771, 'ino': 1099511629052, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3886696320, 'ino': 1099511631912, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3890325790, 'ino': 1099511631909, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3891770754, 'ino': 1099511628873, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3897521445, 'ino': 1099511631807, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3931745951, 'ino': 1099511632619, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 3933513861, 'ino': 1099511631495, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3935514231, 'ino': 1099511633679, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3955177202, 'ino': 1099511628799, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3996352793, 'ino': 1099511632711, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3999398674, 'ino': 1099511633635, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 4003786567, 'ino': 1099511631973, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4006902579, 'ino': 1099511631933, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 4028552941, 'ino': 1099511631154, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 4038207869, 'ino': 1099511628848, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/article-37.xml'}, {'damage_type': 'backtrace', 'id': 4040778722, 'ino': 1099511632553, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 4042019662, 'ino': 1099511632828, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4046489543, 'ino': 1099511632793, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml'}, {'damage_type': 'backtrace', 'id': 4050469513, 'ino': 1099511631609, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-96.jpg'}, {'damage_type': 'backtrace', 'id': 4053292982, 'ino': 1099511632427, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 4058510203, 'ino': 1099511631470, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml'}, {'damage_type': 'backtrace', 'id': 4065513781, 'ino': 1099511632473, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 4070318020, 'ino': 1099511629797, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 4071787335, 'ino': 1099511632500, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 4083640276, 'ino': 1099511631871, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 4096292379, 'ino': 1099511631303, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml'}, {'damage_type': 'backtrace', 'id': 4099782633, 'ino': 1099511631979, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 4108563852, 'ino': 1099511632895, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 4125427038, 'ino': 1099511629451, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-50.xml'}, {'damage_type': 'backtrace', 'id': 4143188136, 'ino': 1099511631952, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4158412793, 'ino': 1099511632698, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 4164932652, 'ino': 1099511629534, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-10.xml'}, {'damage_type': 'backtrace', 'id': 4164933038, 'ino': 1099511629653, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 4171852463, 'ino': 1099511631716, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 4175617280, 'ino': 1099511631619, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-94.jpg'}, {'damage_type': 'backtrace', 'id': 4182794673, 'ino': 1099511629010, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 4200201726, 'ino': 1099511631490, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4202509095, 'ino': 1099511632904, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 4203259654, 'ino': 1099511631689, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 4239705012, 'ino': 1099511629527, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-13.xml'}, {'damage_type': 'backtrace', 'id': 4241509829, 'ino': 1099511629732, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 4259272230, 'ino': 1099511629056, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4268286680, 'ino': 1099511632520, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 4270080687, 'ino': 1099511632531, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 4274583970, 'ino': 1099511631771, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 4277077876, 'ino': 1099511629847, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 4280257523, 'ino': 1099511631422, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml'}, {'damage_type': 'backtrace', 'id': 4286968375, 'ino': 1099511628998, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 4289243854, 'ino': 1099511633721, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-3.jpg'}] 2024-05-20T17:36:06.314 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 950160, 'ino': 1099511628293, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/blogbench.8'}, {'damage_type': 'backtrace', 'id': 5653058, 'ino': 1099511629835, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 11593670, 'ino': 1099511633737, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-92.xml'}, {'damage_type': 'backtrace', 'id': 46473536, 'ino': 1099511629920, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 49453095, 'ino': 1099511630023, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 55481540, 'ino': 1099511633438, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 59857984, 'ino': 1099511630025, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 70407735, 'ino': 1099511633767, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 78476848, 'ino': 1099511628904, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-11.xml'}, {'damage_type': 'backtrace', 'id': 81234267, 'ino': 1099511629935, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 83850095, 'ino': 1099511629428, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-61.xml'}, {'damage_type': 'backtrace', 'id': 84333359, 'ino': 1099511633656, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 89154152, 'ino': 1099511628868, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml'}, {'damage_type': 'backtrace', 'id': 95993687, 'ino': 1099511633013, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-87.xml'}, {'damage_type': 'backtrace', 'id': 102284849, 'ino': 1099511629814, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 104297277, 'ino': 1099511633901, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-42.xml'}, {'damage_type': 'backtrace', 'id': 107943420, 'ino': 1099511628949, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 133942723, 'ino': 1099511629489, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-31.xml'}, {'damage_type': 'backtrace', 'id': 139863696, 'ino': 1099511633957, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-48.xml'}, {'damage_type': 'backtrace', 'id': 142411997, 'ino': 1099511633411, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-4.xml'}, {'damage_type': 'backtrace', 'id': 145690291, 'ino': 1099511633943, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-28.xml'}, {'damage_type': 'backtrace', 'id': 147080302, 'ino': 1099511633881, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-47.xml'}, {'damage_type': 'backtrace', 'id': 154281507, 'ino': 1099511628713, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml'}, {'damage_type': 'backtrace', 'id': 158030280, 'ino': 1099511633041, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-81.xml'}, {'damage_type': 'backtrace', 'id': 164796436, 'ino': 1099511633429, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 173134514, 'ino': 1099511633842, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-60.xml'}, {'damage_type': 'backtrace', 'id': 181261142, 'ino': 1099511628938, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 183638093, 'ino': 1099511633703, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 198044694, 'ino': 1099511628955, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 201795198, 'ino': 1099511629865, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 205597838, 'ino': 1099511628806, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml'}, {'damage_type': 'backtrace', 'id': 207455220, 'ino': 1099511633687, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 207548274, 'ino': 1099511633483, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-92.jpg'}, {'damage_type': 'backtrace', 'id': 211766405, 'ino': 1099511629602, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 219070248, 'ino': 1099511633846, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-60.xml'}, {'damage_type': 'backtrace', 'id': 226134439, 'ino': 1099511628925, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-4.xml'}, {'damage_type': 'backtrace', 'id': 241343746, 'ino': 1099511629072, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 263216234, 'ino': 1099511629473, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-39.xml'}, {'damage_type': 'backtrace', 'id': 267198204, 'ino': 1099511628739, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml'}, {'damage_type': 'backtrace', 'id': 273637050, 'ino': 1099511633906, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-65.xml'}, {'damage_type': 'backtrace', 'id': 288557532, 'ino': 1099511628987, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 296149263, 'ino': 1099511628889, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-16.xml'}, {'damage_type': 'backtrace', 'id': 301842099, 'ino': 1099511628993, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 305223955, 'ino': 1099511633511, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 312838954, 'ino': 1099511629080, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 316164786, 'ino': 1099511633977, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-17.xml'}, {'damage_type': 'backtrace', 'id': 325981044, 'ino': 1099511633936, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-55.xml'}, {'damage_type': 'backtrace', 'id': 331442277, 'ino': 1099511633956, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-22.xml'}, {'damage_type': 'backtrace', 'id': 338775278, 'ino': 1099511629426, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-62.xml'}, {'damage_type': 'backtrace', 'id': 340496538, 'ino': 1099511629094, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 350967871, 'ino': 1099511629469, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-41.xml'}, {'damage_type': 'backtrace', 'id': 353623395, 'ino': 1099511629465, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-43.xml'}, {'damage_type': 'backtrace', 'id': 355002524, 'ino': 1099511628769, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml'}, {'damage_type': 'backtrace', 'id': 359407421, 'ino': 1099511633931, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-32.xml'}, {'damage_type': 'backtrace', 'id': 365893271, 'ino': 1099511633089, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-1.xml'}, {'damage_type': 'backtrace', 'id': 371820804, 'ino': 1099511630035, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 376663342, 'ino': 1099511633836, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-62.xml'}, {'damage_type': 'backtrace', 'id': 380057404, 'ino': 1099511633536, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 381790301, 'ino': 1099511633922, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-35.xml'}, {'damage_type': 'backtrace', 'id': 387763091, 'ino': 1099511629001, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 399248115, 'ino': 1099511633406, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-5.xml'}, {'damage_type': 'backtrace', 'id': 404476607, 'ino': 1099511630019, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 409137882, 'ino': 1099511633827, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-65.xml'}, {'damage_type': 'backtrace', 'id': 427293553, 'ino': 1099511629404, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-78.xml'}, {'damage_type': 'backtrace', 'id': 429695435, 'ino': 1099511629665, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 434840525, 'ino': 1099511629932, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 442270366, 'ino': 1099511633103, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 443569840, 'ino': 1099511629774, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 445115968, 'ino': 1099511633473, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-3.xml'}, {'damage_type': 'backtrace', 'id': 454517261, 'ino': 1099511633913, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-38.xml'}, {'damage_type': 'backtrace', 'id': 457953582, 'ino': 1099511633831, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-65.xml'}, {'damage_type': 'backtrace', 'id': 486658768, 'ino': 1099511630133, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 491258945, 'ino': 1099511633247, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-39.xml'}, {'damage_type': 'backtrace', 'id': 492925576, 'ino': 1099511633989, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-13.xml'}, {'damage_type': 'backtrace', 'id': 494699437, 'ino': 1099511628970, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 495002073, 'ino': 1099511629938, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 496510613, 'ino': 1099511633233, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-42.xml'}, {'damage_type': 'backtrace', 'id': 502295159, 'ino': 1099511633144, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-60.xml'}, {'damage_type': 'backtrace', 'id': 507782447, 'ino': 1099511633867, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-53.xml'}, {'damage_type': 'backtrace', 'id': 509754787, 'ino': 1099511633982, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-39.xml'}, {'damage_type': 'backtrace', 'id': 511592408, 'ino': 1099511633816, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-70.xml'}, {'damage_type': 'backtrace', 'id': 511638843, 'ino': 1099511628898, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml'}, {'damage_type': 'backtrace', 'id': 529220039, 'ino': 1099511628717, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml'}, {'damage_type': 'backtrace', 'id': 534902768, 'ino': 1099511633317, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-24.xml'}, {'damage_type': 'backtrace', 'id': 538503506, 'ino': 1099511629447, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-52.xml'}, {'damage_type': 'backtrace', 'id': 539902040, 'ino': 1099511629406, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-77.xml'}, {'damage_type': 'backtrace', 'id': 544208676, 'ino': 1099511633149, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-59.xml'}, {'damage_type': 'backtrace', 'id': 552918870, 'ino': 1099511633834, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-64.xml'}, {'damage_type': 'backtrace', 'id': 554857678, 'ino': 1099511633756, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 564980973, 'ino': 1099511633764, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 569369022, 'ino': 1099511628784, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml'}, {'damage_type': 'backtrace', 'id': 569399231, 'ino': 1099511629635, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 580464800, 'ino': 1099511633983, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-15.xml'}, {'damage_type': 'backtrace', 'id': 584635102, 'ino': 1099511629575, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 585724634, 'ino': 1099511629017, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 587969904, 'ino': 1099511630015, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 591227002, 'ino': 1099511629057, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 632510770, 'ino': 1099511629092, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 632556428, 'ino': 1099511628295, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.in'}, {'damage_type': 'backtrace', 'id': 634578417, 'ino': 1099511633383, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-10.xml'}, {'damage_type': 'backtrace', 'id': 642326203, 'ino': 1099511629736, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-99.xml'}, {'damage_type': 'backtrace', 'id': 646058864, 'ino': 1099511628908, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-10.xml'}, {'damage_type': 'backtrace', 'id': 646943344, 'ino': 1099511633189, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-51.xml'}, {'damage_type': 'backtrace', 'id': 647145972, 'ino': 1099511633145, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 649451407, 'ino': 1099511633998, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-10.xml'}, {'damage_type': 'backtrace', 'id': 657839105, 'ino': 1099511628991, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 662898915, 'ino': 1099511628883, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml'}, {'damage_type': 'backtrace', 'id': 663482814, 'ino': 1099511633904, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-41.xml'}, {'damage_type': 'backtrace', 'id': 664606247, 'ino': 1099511633066, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-6.xml'}, {'damage_type': 'backtrace', 'id': 679395072, 'ino': 1099511633809, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-72.xml'}, {'damage_type': 'backtrace', 'id': 689059846, 'ino': 1099511633815, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-69.xml'}, {'damage_type': 'backtrace', 'id': 689194497, 'ino': 1099511633806, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-73.xml'}, {'damage_type': 'backtrace', 'id': 692238462, 'ino': 1099511633190, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 696901191, 'ino': 1099511628796, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-47.xml'}, {'damage_type': 'backtrace', 'id': 704824406, 'ino': 1099511633975, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-17.xml'}, {'damage_type': 'backtrace', 'id': 706232472, 'ino': 1099511633771, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 720035414, 'ino': 1099511633018, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-86.xml'}, {'damage_type': 'backtrace', 'id': 720905970, 'ino': 1099511633775, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 730378088, 'ino': 1099511633266, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-35.xml'}, {'damage_type': 'backtrace', 'id': 732737315, 'ino': 1099511633980, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-16.xml'}, {'damage_type': 'backtrace', 'id': 732938952, 'ino': 1099511629926, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 733189121, 'ino': 1099511633327, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-22.xml'}, {'damage_type': 'backtrace', 'id': 735429459, 'ino': 1099511633663, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 736970603, 'ino': 1099511633632, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 739068842, 'ino': 1099511633529, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 740522413, 'ino': 1099511628985, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 741097613, 'ino': 1099511633670, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 744230966, 'ino': 1099511633447, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 745014468, 'ino': 1099511633860, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-54.xml'}, {'damage_type': 'backtrace', 'id': 751653680, 'ino': 1099511628725, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-71.xml'}, {'damage_type': 'backtrace', 'id': 752164775, 'ino': 1099511633793, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-77.xml'}, {'damage_type': 'backtrace', 'id': 759307928, 'ino': 1099511633855, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-57.xml'}, {'damage_type': 'backtrace', 'id': 762940507, 'ino': 1099511629479, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-36.xml'}, {'damage_type': 'backtrace', 'id': 774240787, 'ino': 1099511633160, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 782734412, 'ino': 1099511629650, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 801260173, 'ino': 1099511629765, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 801638215, 'ino': 1099511628790, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-49.xml'}, {'damage_type': 'backtrace', 'id': 814741431, 'ino': 1099511633907, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-40.xml'}, {'damage_type': 'backtrace', 'id': 816168119, 'ino': 1099511633840, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-62.xml'}, {'damage_type': 'backtrace', 'id': 825832826, 'ino': 1099511629027, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 838758959, 'ino': 1099511633872, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-50.xml'}, {'damage_type': 'backtrace', 'id': 840685407, 'ino': 1099511633261, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-36.xml'}, {'damage_type': 'backtrace', 'id': 842401965, 'ino': 1099511629051, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 845579643, 'ino': 1099511629483, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-34.xml'}, {'damage_type': 'backtrace', 'id': 845849757, 'ino': 1099511633608, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 848739652, 'ino': 1099511633069, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-75.xml'}, {'damage_type': 'backtrace', 'id': 855793852, 'ino': 1099511633199, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-49.xml'}, {'damage_type': 'backtrace', 'id': 867011657, 'ino': 1099511633899, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-41.xml'}, {'damage_type': 'backtrace', 'id': 869368788, 'ino': 1099511633745, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 877388853, 'ino': 1099511633280, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-32.xml'}, {'damage_type': 'backtrace', 'id': 887551497, 'ino': 1099511633653, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 893412638, 'ino': 1099511633719, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 897215952, 'ino': 1099511633508, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 907312782, 'ino': 1099511633164, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-56.xml'}, {'damage_type': 'backtrace', 'id': 912109331, 'ino': 1099511633605, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 920561032, 'ino': 1099511629611, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 924445382, 'ino': 1099511633929, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-31.xml'}, {'damage_type': 'backtrace', 'id': 930309376, 'ino': 1099511633462, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-6.xml'}, {'damage_type': 'backtrace', 'id': 937377492, 'ino': 1099511628703, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml'}, {'damage_type': 'backtrace', 'id': 937906099, 'ino': 1099511633858, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-56.xml'}, {'damage_type': 'backtrace', 'id': 939610564, 'ino': 1099511633289, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-30.xml'}, {'damage_type': 'backtrace', 'id': 944029641, 'ino': 1099511628989, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 951423453, 'ino': 1099511629045, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 958062377, 'ino': 1099511629923, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 960776786, 'ino': 1099511630143, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 964717320, 'ino': 1099511629945, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 972292362, 'ino': 1099511633942, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-53.xml'}, {'damage_type': 'backtrace', 'id': 974163901, 'ino': 1099511633822, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-68.xml'}, {'damage_type': 'backtrace', 'id': 987952234, 'ino': 1099511628979, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 999437882, 'ino': 1099511633185, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1000968445, 'ino': 1099511633965, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1026080791, 'ino': 1099511633457, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1030487909, 'ino': 1099511633574, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1031668718, 'ino': 1099511629545, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1035617928, 'ino': 1099511633920, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1049670406, 'ino': 1099511633914, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1054956814, 'ino': 1099511628872, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1055990807, 'ino': 1099511630107, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1060956733, 'ino': 1099511633024, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1076224789, 'ino': 1099511628798, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1080626612, 'ino': 1099511633629, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1089019015, 'ino': 1099511633845, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1090553584, 'ino': 1099511632998, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-90.xml'}, {'damage_type': 'backtrace', 'id': 1099673614, 'ino': 1099511628856, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1122691648, 'ino': 1099511629515, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1129788521, 'ino': 1099511633833, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1137540455, 'ino': 1099511633875, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1140469445, 'ino': 1099511629656, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1142091707, 'ino': 1099511630013, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1146474583, 'ino': 1099511629941, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1146941017, 'ino': 1099511628865, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1150330347, 'ino': 1099511629824, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 1158084963, 'ino': 1099511629049, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1160271714, 'ino': 1099511633900, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1162351329, 'ino': 1099511633948, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1163858757, 'ino': 1099511633918, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1170191243, 'ino': 1099511633051, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-79.xml'}, {'damage_type': 'backtrace', 'id': 1171423495, 'ino': 1099511629841, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 1175592563, 'ino': 1099511633996, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1176171562, 'ino': 1099511629557, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1188381810, 'ino': 1099511633987, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1190683702, 'ino': 1099511629029, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1193716912, 'ino': 1099511629641, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1195537070, 'ino': 1099511633200, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1198536913, 'ino': 1099511633997, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1204049995, 'ino': 1099511633401, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1217249563, 'ino': 1099511633947, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1219917426, 'ino': 1099511633009, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-88.xml'}, {'damage_type': 'backtrace', 'id': 1220744774, 'ino': 1099511629659, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1240659212, 'ino': 1099511633364, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1242783605, 'ino': 1099511633322, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1254488229, 'ino': 1099511633184, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1255374013, 'ino': 1099511630017, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 1257916451, 'ino': 1099511633519, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 1262163974, 'ino': 1099511628736, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1264220254, 'ino': 1099511633884, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1268502466, 'ino': 1099511632985, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1272354813, 'ino': 1099511629025, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1278949621, 'ino': 1099511628973, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1297837935, 'ino': 1099511633880, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1304227364, 'ino': 1099511633903, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1308609213, 'ino': 1099511633959, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1311011639, 'ino': 1099511633971, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1315205267, 'ino': 1099511633646, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1316971082, 'ino': 1099511628901, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1323101361, 'ino': 1099511633990, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1324800572, 'ino': 1099511633741, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-91.xml'}, {'damage_type': 'backtrace', 'id': 1337551511, 'ino': 1099511633497, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 1346964665, 'ino': 1099511629409, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1350104709, 'ino': 1099511633819, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1356416170, 'ino': 1099511630009, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 1362569433, 'ino': 1099511633179, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1365580429, 'ino': 1099511633897, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-68.xml'}, {'damage_type': 'backtrace', 'id': 1376711758, 'ino': 1099511633742, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1386771598, 'ino': 1099511633925, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1388757715, 'ino': 1099511633824, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1390916448, 'ino': 1099511633093, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1397480292, 'ino': 1099511628941, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 1401003664, 'ino': 1099511630139, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1401236973, 'ino': 1099511633976, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1401943012, 'ino': 1099511630115, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1407119992, 'ino': 1099511633303, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1408695850, 'ino': 1099511633893, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1414069153, 'ino': 1099511633801, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1415105021, 'ino': 1099511633299, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1419269337, 'ino': 1099511632991, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-92.xml'}, {'damage_type': 'backtrace', 'id': 1419583027, 'ino': 1099511633984, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1421354375, 'ino': 1099511629578, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1426648188, 'ino': 1099511629549, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1427884649, 'ino': 1099511628931, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1434932291, 'ino': 1099511629910, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 1437472912, 'ino': 1099511629401, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1443299872, 'ino': 1099511633539, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 1448725700, 'ino': 1099511633615, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1448774272, 'ino': 1099511633210, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1450617167, 'ino': 1099511633921, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1463288051, 'ino': 1099511633964, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1466909899, 'ino': 1099511633169, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1467977570, 'ino': 1099511632973, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1471317879, 'ino': 1099511633070, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1471611993, 'ino': 1099511628755, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1483565534, 'ino': 1099511630033, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1491408461, 'ino': 1099511633084, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1495498359, 'ino': 1099511628794, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1496989857, 'ino': 1099511633133, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1498004158, 'ino': 1099511633958, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1505819764, 'ino': 1099511629880, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1510305532, 'ino': 1099511633004, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-89.xml'}, {'damage_type': 'backtrace', 'id': 1510941249, 'ino': 1099511633681, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1520913037, 'ino': 1099511629750, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1522645737, 'ino': 1099511633707, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1523069128, 'ino': 1099511633753, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1535201454, 'ino': 1099511628923, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1539577945, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1548816300, 'ino': 1099511633954, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1549598600, 'ino': 1099511629929, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1558727643, 'ino': 1099511633926, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1560558053, 'ino': 1099511629751, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-97.xml'}, {'damage_type': 'backtrace', 'id': 1578196114, 'ino': 1099511628808, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1578452655, 'ino': 1099511633587, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1580648247, 'ino': 1099511633993, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1588127371, 'ino': 1099511633594, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1593575843, 'ino': 1099511633935, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1595493324, 'ino': 1099511633294, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1599597353, 'ino': 1099511628835, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1603036672, 'ino': 1099511628710, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1609782354, 'ino': 1099511633905, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1636195890, 'ino': 1099511628877, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1639452599, 'ino': 1099511629608, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1639844341, 'ino': 1099511633870, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1650804131, 'ino': 1099511633974, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1667311516, 'ino': 1099511633937, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1668685963, 'ino': 1099511629033, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1669712842, 'ino': 1099511628820, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1672543457, 'ino': 1099511633960, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1673097017, 'ino': 1099511633711, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1681474517, 'ino': 1099511628915, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1682496826, 'ino': 1099511629758, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1682951800, 'ino': 1099511633973, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1685877838, 'ino': 1099511630021, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1689318553, 'ino': 1099511630124, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1704441155, 'ino': 1099511629461, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1705249629, 'ino': 1099511628727, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1715062729, 'ino': 1099511633684, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1723354260, 'ino': 1099511633790, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1737550544, 'ino': 1099511633896, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1742605669, 'ino': 1099511633331, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1744971273, 'ino': 1099511633916, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1757422746, 'ino': 1099511633951, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-50.xml'}, {'damage_type': 'backtrace', 'id': 1759897500, 'ino': 1099511633639, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1760672477, 'ino': 1099511628715, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml'}, {'damage_type': 'backtrace', 'id': 1761490861, 'ino': 1099511629844, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 1764972320, 'ino': 1099511629791, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 1769272566, 'ino': 1099511633532, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 1771424814, 'ino': 1099511629868, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 1771780917, 'ino': 1099511629435, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1772244694, 'ino': 1099511633079, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1779297469, 'ino': 1099511633285, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1792656804, 'ino': 1099511633028, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1800463633, 'ino': 1099511633748, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-89.xml'}, {'damage_type': 'backtrace', 'id': 1802718650, 'ino': 1099511633940, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1812905739, 'ino': 1099511633127, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1816549409, 'ino': 1099511633891, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1824053433, 'ino': 1099511633598, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 1833404711, 'ino': 1099511629821, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1838137182, 'ino': 1099511633949, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1842824817, 'ino': 1099511633165, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1845958600, 'ino': 1099511633759, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-86.xml'}, {'damage_type': 'backtrace', 'id': 1850289044, 'ino': 1099511633749, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1850500617, 'ino': 1099511633889, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1851188767, 'ino': 1099511633080, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1852340200, 'ino': 1099511630151, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1854187336, 'ino': 1099511633857, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1856868253, 'ino': 1099511630005, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1857189586, 'ino': 1099511629988, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 1859178228, 'ino': 1099511630001, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1861910274, 'ino': 1099511633490, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 1863772028, 'ino': 1099511629874, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1875550217, 'ino': 1099511629074, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1876571679, 'ino': 1099511633243, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1876708951, 'ino': 1099511629644, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1883563960, 'ino': 1099511628775, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-54.xml'}, {'damage_type': 'backtrace', 'id': 1887391646, 'ino': 1099511633967, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1893059024, 'ino': 1099511629063, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1899538506, 'ino': 1099511633564, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 1902485658, 'ino': 1099511633715, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1907969123, 'ino': 1099511629463, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1919311346, 'ino': 1099511633650, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1939358042, 'ino': 1099511633691, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1947682154, 'ino': 1099511633804, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1947935031, 'ino': 1099511629572, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1948076109, 'ino': 1099511629529, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1953595054, 'ino': 1099511633763, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-85.xml'}, {'damage_type': 'backtrace', 'id': 1954368681, 'ino': 1099511633470, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1960194092, 'ino': 1099511628952, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 1963970567, 'ino': 1099511629856, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1979067651, 'ino': 1099511633874, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1981387699, 'ino': 1099511629985, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1982567257, 'ino': 1099511629449, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1982979476, 'ino': 1099511633032, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-83.xml'}, {'damage_type': 'backtrace', 'id': 1985150211, 'ino': 1099511629853, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1993311444, 'ino': 1099511629416, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1993387955, 'ino': 1099511633525, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 1997501925, 'ino': 1099511629422, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2007540868, 'ino': 1099511633065, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-76.xml'}, {'damage_type': 'backtrace', 'id': 2016448866, 'ino': 1099511633999, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2019149806, 'ino': 1099511630011, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 2019195835, 'ino': 1099511633194, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2026661905, 'ino': 1099511633722, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2032099826, 'ino': 1099511628875, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2037668580, 'ino': 1099511629999, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2038786678, 'ino': 1099511629764, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2041176915, 'ino': 1099511633494, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 2057281089, 'ino': 1099511633797, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-76.xml'}, {'damage_type': 'backtrace', 'id': 2066699624, 'ino': 1099511629497, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2084979005, 'ino': 1099511628786, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2089216502, 'ino': 1099511633933, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2092696741, 'ino': 1099511633116, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2096858779, 'ino': 1099511629993, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 2097282669, 'ino': 1099511629410, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2100653306, 'ino': 1099511633061, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2101587987, 'ino': 1099511629021, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2106665489, 'ino': 1099511629493, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2106928157, 'ino': 1099511633894, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2115380853, 'ino': 1099511628964, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 2124021962, 'ino': 1099511629084, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2124184810, 'ino': 1099511633355, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2150560294, 'ino': 1099511633961, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2157142246, 'ino': 1099511633636, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2161633442, 'ino': 1099511630041, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2170987719, 'ino': 1099511633014, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2173462557, 'ino': 1099511633786, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2180603524, 'ino': 1099511629424, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2187035037, 'ino': 1099511629076, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2189883719, 'ino': 1099511633359, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2202393172, 'ino': 1099511633928, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2204240793, 'ino': 1099511633677, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2206651584, 'ino': 1099511629566, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2207588706, 'ino': 1099511629445, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2210753136, 'ino': 1099511633726, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2215471738, 'ino': 1099511629862, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 2222588411, 'ino': 1099511628886, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2223620576, 'ino': 1099511629617, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2225804264, 'ino': 1099511633810, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2252398363, 'ino': 1099511629421, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-66.xml'}, {'damage_type': 'backtrace', 'id': 2274069352, 'ino': 1099511633667, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2286817688, 'ino': 1099511633107, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2292635557, 'ino': 1099511629101, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-88.xml'}, {'damage_type': 'backtrace', 'id': 2299079120, 'ino': 1099511628748, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2310737245, 'ino': 1099511633581, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2311379380, 'ino': 1099511633112, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2318749032, 'ino': 1099511633994, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2329842354, 'ino': 1099511628779, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2335676998, 'ino': 1099511628982, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2339946885, 'ino': 1099511629537, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2344125744, 'ino': 1099511632976, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2344327875, 'ino': 1099511633917, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2344866221, 'ino': 1099511629991, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 2346244584, 'ino': 1099511633373, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2347629147, 'ino': 1099511629662, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2357088455, 'ino': 1099511633175, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2360012071, 'ino': 1099511633271, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2361386655, 'ino': 1099511633800, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2369145283, 'ino': 1099511633886, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2374934357, 'ino': 1099511633023, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-85.xml'}, {'damage_type': 'backtrace', 'id': 2375025817, 'ino': 1099511633005, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2380714406, 'ino': 1099511633074, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2388104011, 'ino': 1099511633818, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2391360868, 'ino': 1099511629997, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2393667802, 'ino': 1099511633544, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2400949770, 'ino': 1099511629569, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2420151538, 'ino': 1099511628911, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2430110248, 'ino': 1099511629587, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2458335683, 'ino': 1099511633882, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-73.xml'}, {'damage_type': 'backtrace', 'id': 2461819856, 'ino': 1099511633577, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 2468629530, 'ino': 1099511628757, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2473149588, 'ino': 1099511628745, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2479943752, 'ino': 1099511633102, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2483667060, 'ino': 1099511633695, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2487835010, 'ino': 1099511633584, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2490054881, 'ino': 1099511628919, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2491875550, 'ino': 1099511629082, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2523736095, 'ino': 1099511632983, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-94.xml'}, {'damage_type': 'backtrace', 'id': 2542266172, 'ino': 1099511630155, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2546313272, 'ino': 1099511629043, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2558648118, 'ino': 1099511633979, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2568532674, 'ino': 1099511633224, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2573719724, 'ino': 1099511629871, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2574628210, 'ino': 1099511629065, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2577551392, 'ino': 1099511632969, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2581500680, 'ino': 1099511633919, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2584233620, 'ino': 1099511633397, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2596935204, 'ino': 1099511633219, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2606554076, 'ino': 1099511629775, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2607292586, 'ino': 1099511629039, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2615888568, 'ino': 1099511629555, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2623347100, 'ino': 1099511633643, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2624158474, 'ino': 1099511633313, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2626883658, 'ino': 1099511628838, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2629343207, 'ino': 1099511633966, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2633471291, 'ino': 1099511633037, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-82.xml'}, {'damage_type': 'backtrace', 'id': 2638290520, 'ino': 1099511633055, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-78.xml'}, {'damage_type': 'backtrace', 'id': 2640278405, 'ino': 1099511633760, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2644622262, 'ino': 1099511629031, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2649279833, 'ino': 1099511628766, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2655741933, 'ino': 1099511633515, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 2661835597, 'ino': 1099511629710, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2690800363, 'ino': 1099511633978, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2697499395, 'ino': 1099511628860, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2701032522, 'ino': 1099511633955, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2705304656, 'ino': 1099511629783, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 2720418276, 'ino': 1099511633908, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2720496163, 'ino': 1099511633387, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2721415297, 'ino': 1099511633744, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-90.xml'}, {'damage_type': 'backtrace', 'id': 2727583391, 'ino': 1099511629015, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2732422292, 'ino': 1099511629400, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-81.xml'}, {'damage_type': 'backtrace', 'id': 2735034924, 'ino': 1099511633848, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2740755974, 'ino': 1099511629740, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2752898855, 'ino': 1099511630039, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 2760201078, 'ino': 1099511633425, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2764071414, 'ino': 1099511629505, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2765160418, 'ino': 1099511633420, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2772891829, 'ino': 1099511633052, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2774459902, 'ino': 1099511633885, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-72.xml'}, {'damage_type': 'backtrace', 'id': 2778401152, 'ino': 1099511633873, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-76.xml'}, {'damage_type': 'backtrace', 'id': 2781285187, 'ino': 1099511633195, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2786920716, 'ino': 1099511629850, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 2804507335, 'ino': 1099511633369, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2810094089, 'ino': 1099511629047, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2810859858, 'ino': 1099511633991, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2817572075, 'ino': 1099511629070, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2821175481, 'ino': 1099511628826, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2821700449, 'ino': 1099511633755, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-87.xml'}, {'damage_type': 'backtrace', 'id': 2824093246, 'ino': 1099511633934, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2833544916, 'ino': 1099511629623, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2856989749, 'ino': 1099511629517, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2873059520, 'ino': 1099511633139, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2885615824, 'ino': 1099511630083, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2888163631, 'ino': 1099511633985, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2889471416, 'ino': 1099511629485, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2903333984, 'ino': 1099511633781, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-80.xml'}, {'damage_type': 'backtrace', 'id': 2907171376, 'ino': 1099511628782, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2911010568, 'ino': 1099511633869, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2917693763, 'ino': 1099511633734, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2920093085, 'ino': 1099511633992, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2927699704, 'ino': 1099511632994, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-91.xml'}, {'damage_type': 'backtrace', 'id': 2938595697, 'ino': 1099511633042, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2946284211, 'ino': 1099511630003, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2971392479, 'ino': 1099511633854, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2972503117, 'ino': 1099511628961, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2981381880, 'ino': 1099511633094, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2983163361, 'ino': 1099511633088, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-71.xml'}, {'damage_type': 'backtrace', 'id': 2992539151, 'ino': 1099511629689, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2997505677, 'ino': 1099511633552, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 3017447328, 'ino': 1099511629507, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3018258308, 'ino': 1099511633501, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 3023652771, 'ino': 1099511629807, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 3024309937, 'ino': 1099511629425, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3041726935, 'ino': 1099511630128, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3042379285, 'ino': 1099511629432, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3051856720, 'ino': 1099511633567, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 3058915535, 'ino': 1099511628822, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3068512408, 'ino': 1099511633345, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3069298511, 'ino': 1099511633453, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3079876961, 'ino': 1099511633981, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3084728791, 'ino': 1099511633927, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3087892060, 'ino': 1099511629683, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3088320787, 'ino': 1099511628844, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3089690662, 'ino': 1099511633378, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3097871380, 'ino': 1099511633915, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3108439811, 'ino': 1099511628928, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3124799315, 'ino': 1099511633909, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3138070517, 'ino': 1099511629596, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3139894256, 'ino': 1099511633752, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-88.xml'}, {'damage_type': 'backtrace', 'id': 3153563619, 'ino': 1099511629007, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3156225752, 'ino': 1099511633986, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3157374514, 'ino': 1099511633010, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3158988416, 'ino': 1099511633851, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3159114068, 'ino': 1099511629068, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3164575704, 'ino': 1099511633963, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3165418069, 'ino': 1099511628999, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3170431992, 'ino': 1099511633733, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-93.xml'}, {'damage_type': 'backtrace', 'id': 3172364202, 'ino': 1099511633060, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3177074675, 'ino': 1099511633140, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3183990884, 'ino': 1099511633591, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 3184332461, 'ino': 1099511633480, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3195512129, 'ino': 1099511629917, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 3196506380, 'ino': 1099511630031, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3201193565, 'ino': 1099511633477, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3207227130, 'ino': 1099511633019, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3210601627, 'ino': 1099511632995, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3211063457, 'ino': 1099511628763, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3221715771, 'ino': 1099511633785, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-79.xml'}, {'damage_type': 'backtrace', 'id': 3221875757, 'ino': 1099511632980, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3225680339, 'ino': 1099511628760, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3228932395, 'ino': 1099511633864, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3231624586, 'ino': 1099511628830, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3236493200, 'ino': 1099511633204, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3244993516, 'ino': 1099511633812, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-71.xml'}, {'damage_type': 'backtrace', 'id': 3258082770, 'ino': 1099511629005, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3262149817, 'ino': 1099511633969, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3262828129, 'ino': 1099511629003, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3271215742, 'ino': 1099511630029, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 3273703468, 'ino': 1099511630100, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3280084018, 'ino': 1099511628733, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3288329105, 'ino': 1099511633434, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3293518384, 'ino': 1099511633341, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3312067274, 'ino': 1099511633229, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3312452735, 'ino': 1099511630027, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 3320868235, 'ino': 1099511628294, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile.am'}, {'damage_type': 'backtrace', 'id': 3322861075, 'ino': 1099511629013, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3331024543, 'ino': 1099511633699, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3335744964, 'ino': 1099511633932, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3339608258, 'ino': 1099511628706, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3340966084, 'ino': 1099511629511, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3347828251, 'ino': 1099511633625, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3350285646, 'ino': 1099511633972, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3362660643, 'ino': 1099511629810, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 3370906152, 'ino': 1099511628976, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 3373652671, 'ino': 1099511629838, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 3399534368, 'ino': 1099511628997, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3400246315, 'ino': 1099511629011, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3435575781, 'ino': 1099511633098, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3439564094, 'ino': 1099511629420, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3443463991, 'ino': 1099511633150, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3447831030, 'ino': 1099511633988, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3449433414, 'ino': 1099511633770, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-83.xml'}, {'damage_type': 'backtrace', 'id': 3449670053, 'ino': 1099511633504, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 3457182344, 'ino': 1099511628658, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/man/Makefile'}, {'damage_type': 'backtrace', 'id': 3460574919, 'ino': 1099511628841, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3462801931, 'ino': 1099511633122, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3468008551, 'ino': 1099511633571, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3482495459, 'ino': 1099511629760, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 3485247177, 'ino': 1099511633902, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3489964490, 'ino': 1099511633938, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3492052366, 'ino': 1099511633878, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3493317306, 'ino': 1099511629453, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3518418779, 'ino': 1099511629995, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3520107098, 'ino': 1099511633941, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3521623331, 'ino': 1099511629590, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 3522357866, 'ino': 1099511633849, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3523673875, 'ino': 1099511633879, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3528033669, 'ino': 1099511629037, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3530341601, 'ino': 1099511629605, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3535294147, 'ino': 1099511633174, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3535656383, 'ino': 1099511628895, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3535950012, 'ino': 1099511633557, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3536545404, 'ino': 1099511628730, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3539168959, 'ino': 1099511633117, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3539627991, 'ino': 1099511629560, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3546168044, 'ino': 1099511633392, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3548784784, 'ino': 1099511633046, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-80.xml'}, {'damage_type': 'backtrace', 'id': 3550022650, 'ino': 1099511633953, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3559198404, 'ino': 1099511633825, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3561403105, 'ino': 1099511633056, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3563538790, 'ino': 1099511633888, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-71.xml'}, {'damage_type': 'backtrace', 'id': 3565570951, 'ino': 1099511633863, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3568297511, 'ino': 1099511629078, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3569226383, 'ino': 1099511633939, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3573313303, 'ino': 1099511633866, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3575599850, 'ino': 1099511633257, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3578570428, 'ino': 1099511633275, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3586688522, 'ino': 1099511633252, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3594518657, 'ino': 1099511633350, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3605712705, 'ino': 1099511633782, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3607505144, 'ino': 1099511633968, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3608045865, 'ino': 1099511628946, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3608677396, 'ino': 1099511629417, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3618906218, 'ino': 1099511633612, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 3619792164, 'ino': 1099511633730, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3624761713, 'ino': 1099511633830, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3628276143, 'ino': 1099511633674, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3633894053, 'ino': 1099511628913, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3640727596, 'ino': 1099511633123, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3641519009, 'ino': 1099511628814, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3651515708, 'ino': 1099511633821, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3658350717, 'ino': 1099511633466, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3660417920, 'ino': 1099511629794, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 3681845182, 'ino': 1099511633027, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-84.xml'}, {'damage_type': 'backtrace', 'id': 3709869205, 'ino': 1099511633238, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3722165085, 'ino': 1099511633443, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3722935777, 'ino': 1099511633803, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3726245920, 'ino': 1099511628847, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3726722629, 'ino': 1099511633828, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-66.xml'}, {'damage_type': 'backtrace', 'id': 3728341048, 'ino': 1099511628967, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3733261435, 'ino': 1099511628862, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3744657617, 'ino': 1099511633155, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3760300403, 'ino': 1099511629437, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3760896569, 'ino': 1099511629983, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 3762333820, 'ino': 1099511633910, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3769453138, 'ino': 1099511633159, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3773396786, 'ino': 1099511629477, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3778116049, 'ino': 1099511633895, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3782734941, 'ino': 1099511628751, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3801398815, 'ino': 1099511633946, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3802625056, 'ino': 1099511633837, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3805675889, 'ino': 1099511629086, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3813540729, 'ino': 1099511633911, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3822843192, 'ino': 1099511629495, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3834792536, 'ino': 1099511633930, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3838969122, 'ino': 1099511633887, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3841695624, 'ino': 1099511633215, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3848767200, 'ino': 1099511633777, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-81.xml'}, {'damage_type': 'backtrace', 'id': 3854598262, 'ino': 1099511633308, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3858810305, 'ino': 1099511628802, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3864762950, 'ino': 1099511633839, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3879152320, 'ino': 1099511633852, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3898199643, 'ino': 1099511628943, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 3902079134, 'ino': 1099511633618, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3904388460, 'ino': 1099511633798, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3922073310, 'ino': 1099511633601, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3922426469, 'ino': 1099511628850, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3923556518, 'ino': 1099511632987, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-93.xml'}, {'damage_type': 'backtrace', 'id': 3924181373, 'ino': 1099511633083, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-72.xml'}, {'damage_type': 'backtrace', 'id': 3925363776, 'ino': 1099511633912, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3926342323, 'ino': 1099511633336, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3928224109, 'ino': 1099511633560, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3928316275, 'ino': 1099511633416, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3929703819, 'ino': 1099511633548, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 3942496994, 'ino': 1099511633660, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3943738573, 'ino': 1099511633038, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3956494839, 'ino': 1099511633794, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3968654152, 'ino': 1099511633180, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3971488616, 'ino': 1099511629061, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3976249761, 'ino': 1099511633134, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3984253524, 'ino': 1099511633952, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3987920858, 'ino': 1099511629913, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 3988977690, 'ino': 1099511633945, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3990915044, 'ino': 1099511633522, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3999545072, 'ino': 1099511633807, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 4013590247, 'ino': 1099511633890, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-44.xml'}, {'damage_type': 'backtrace', 'id': 4024117818, 'ino': 1099511633774, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-82.xml'}, {'damage_type': 'backtrace', 'id': 4031350866, 'ino': 1099511629503, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-24.xml'}, {'damage_type': 'backtrace', 'id': 4037233374, 'ino': 1099511633898, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-43.xml'}, {'damage_type': 'backtrace', 'id': 4041510889, 'ino': 1099511633487, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-91.jpg'}, {'damage_type': 'backtrace', 'id': 4044019230, 'ino': 1099511629800, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 4052823207, 'ino': 1099511633108, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 4053389174, 'ino': 1099511633033, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-13.xml'}, {'damage_type': 'backtrace', 'id': 4053947102, 'ino': 1099511633843, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-61.xml'}, {'damage_type': 'backtrace', 'id': 4054283744, 'ino': 1099511633861, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-55.xml'}, {'damage_type': 'backtrace', 'id': 4056365664, 'ino': 1099511633876, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-75.xml'}, {'damage_type': 'backtrace', 'id': 4059128384, 'ino': 1099511633075, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-4.xml'}, {'damage_type': 'backtrace', 'id': 4066429197, 'ino': 1099511633111, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-66.xml'}, {'damage_type': 'backtrace', 'id': 4072026241, 'ino': 1099511629541, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-7.xml'}, {'damage_type': 'backtrace', 'id': 4072985584, 'ino': 1099511633995, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-11.xml'}, {'damage_type': 'backtrace', 'id': 4075001855, 'ino': 1099511633128, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4082722164, 'ino': 1099511633923, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-33.xml'}, {'damage_type': 'backtrace', 'id': 4099743274, 'ino': 1099511633622, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 4106288309, 'ino': 1099511629429, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-60.xml'}, {'damage_type': 'backtrace', 'id': 4114924291, 'ino': 1099511633789, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-78.xml'}, {'damage_type': 'backtrace', 'id': 4119808269, 'ino': 1099511633924, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/article-59.xml'}, {'damage_type': 'backtrace', 'id': 4122078451, 'ino': 1099511633877, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-50.xml'}, {'damage_type': 'backtrace', 'id': 4131198208, 'ino': 1099511628958, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 4143688961, 'ino': 1099511629859, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 4144233226, 'ino': 1099511633170, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 4155153846, 'ino': 1099511633944, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-26.xml'}, {'damage_type': 'backtrace', 'id': 4166676952, 'ino': 1099511633154, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-58.xml'}, {'damage_type': 'backtrace', 'id': 4166688650, 'ino': 1099511630007, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 4171544712, 'ino': 1099511629059, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4179121046, 'ino': 1099511633778, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 4184066475, 'ino': 1099511633097, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-27/article-69.xml'}, {'damage_type': 'backtrace', 'id': 4185606728, 'ino': 1099511633047, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-10.xml'}, {'damage_type': 'backtrace', 'id': 4186748768, 'ino': 1099511629090, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 4189292692, 'ino': 1099511629553, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-1.xml'}, {'damage_type': 'backtrace', 'id': 4200696113, 'ino': 1099511633892, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-45.xml'}, {'damage_type': 'backtrace', 'id': 4201354359, 'ino': 1099511632999, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-26/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4202775578, 'ino': 1099511633883, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-48.xml'}, {'damage_type': 'backtrace', 'id': 4203308139, 'ino': 1099511628934, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml'}, {'damage_type': 'backtrace', 'id': 4204080262, 'ino': 1099511633950, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-24.xml'}, {'damage_type': 'backtrace', 'id': 4211334198, 'ino': 1099511633962, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-32/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4213877614, 'ino': 1099511633738, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-29/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 4216806299, 'ino': 1099511633766, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-31/article-84.xml'}, {'damage_type': 'backtrace', 'id': 4243609685, 'ino': 1099511630037, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 4253147382, 'ino': 1099511628742, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml'}, {'damage_type': 'backtrace', 'id': 4255333366, 'ino': 1099511629744, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-98.xml'}, {'damage_type': 'backtrace', 'id': 4286018022, 'ino': 1099511629411, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-5/article-73.xml'}, {'damage_type': 'backtrace', 'id': 4287450582, 'ino': 1099511629088, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4289703158, 'ino': 1099511629041, 'path': '/volumes/qa/sv_1/5ebea960-e478-4ace-b870-4e650f43508a/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg'}] 2024-05-20T17:36:06.314 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-05-20T17:36:07.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:07 smithi160 ceph-mon[36261]: pgmap v86: 97 pgs: 97 active+clean; 221 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 864 op/s 2024-05-20T17:36:07.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:07 smithi172 ceph-mon[36511]: pgmap v86: 97 pgs: 97 active+clean; 221 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 864 op/s 2024-05-20T17:36:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:07 smithi135 ceph-mon[32027]: pgmap v86: 97 pgs: 97 active+clean; 221 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 864 op/s 2024-05-20T17:36:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:09 smithi160 ceph-mon[36261]: pgmap v87: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-20T17:36:09.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:09 smithi172 ceph-mon[36511]: pgmap v87: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-20T17:36:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:09 smithi135 ceph-mon[32027]: pgmap v87: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-20T17:36:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:11 smithi160 ceph-mon[36261]: pgmap v88: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 525 op/s 2024-05-20T17:36:11.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:11 smithi172 ceph-mon[36511]: pgmap v88: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 525 op/s 2024-05-20T17:36:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:11 smithi135 ceph-mon[32027]: pgmap v88: 97 pgs: 97 active+clean; 226 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 525 op/s 2024-05-20T17:36:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.400+0000 7f01d4779640 1 -- 172.21.15.135:0/2733490611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc119770 msgr2=0x7f01cc11bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.401+0000 7f01d4779640 1 --2- 172.21.15.135:0/2733490611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc119770 0x7f01cc11bb90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009900 tx=0x7f01c802a4d0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.405+0000 7f01d4779640 1 -- 172.21.15.135:0/2733490611 shutdown_connections 2024-05-20T17:36:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.405+0000 7f01d4779640 1 --2- 172.21.15.135:0/2733490611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc11c0d0 0x7f01cc11e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.405+0000 7f01d4779640 1 --2- 172.21.15.135:0/2733490611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc119770 0x7f01cc11bb90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.405+0000 7f01d4779640 1 --2- 172.21.15.135:0/2733490611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc109080 0x7f01cc109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.405+0000 7f01d4779640 1 -- 172.21.15.135:0/2733490611 >> 172.21.15.135:0/2733490611 conn(0x7f01cc06d780 msgr2=0x7f01cc06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.406+0000 7f01d4779640 1 -- 172.21.15.135:0/2733490611 shutdown_connections 2024-05-20T17:36:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.406+0000 7f01d4779640 1 -- 172.21.15.135:0/2733490611 wait complete. 2024-05-20T17:36:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.407+0000 7f01d4779640 1 Processor -- start 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.407+0000 7f01d4779640 1 -- start start 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.407+0000 7f01d4779640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc109080 0x7f01cc1a8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.408+0000 7f01d4779640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc119770 0x7f01cc1a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.408+0000 7f01d4779640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.408+0000 7f01d4779640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc121d30 con 0x7f01cc109080 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.408+0000 7f01d4779640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc121bb0 con 0x7f01cc119770 2024-05-20T17:36:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.408+0000 7f01d4779640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc121eb0 con 0x7f01cc11c0d0 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.409+0000 7f01d2d16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.409+0000 7f01d2d16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:54282/0 (socket says 172.21.15.135:54282) 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.409+0000 7f01d2d16640 1 -- 172.21.15.135:0/1138369695 learned_addr learned my addr 172.21.15.135:0/1138369695 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.409+0000 7f01d2515640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc109080 0x7f01cc1a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.409+0000 7f01d1d14640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc119770 0x7f01cc1a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 -- 172.21.15.135:0/1138369695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc119770 msgr2=0x7f01cc1a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc119770 0x7f01cc1a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 -- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc109080 msgr2=0x7f01cc1a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc109080 0x7f01cc1a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 -- 172.21.15.135:0/1138369695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1ad5f0 con 0x7f01cc11c0d0 2024-05-20T17:36:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.410+0000 7f01d2d16640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b990 tx=0x7f01c400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.412+0000 7f01c37fe640 1 -- 172.21.15.135:0/1138369695 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4019070 con 0x7f01cc11c0d0 2024-05-20T17:36:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.412+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1ad8e0 con 0x7f01cc11c0d0 2024-05-20T17:36:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.412+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc110f60 con 0x7f01cc11c0d0 2024-05-20T17:36:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.412+0000 7f01c37fe640 1 -- 172.21.15.135:0/1138369695 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c400cba0 con 0x7f01cc11c0d0 2024-05-20T17:36:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.413+0000 7f01c37fe640 1 -- 172.21.15.135:0/1138369695 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4007650 con 0x7f01cc11c0d0 2024-05-20T17:36:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.418+0000 7f01db619740 1 Processor -- start 2024-05-20T17:36:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.420+0000 7f01db619740 1 -- start start 2024-05-20T17:36:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b4a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 0x556a17b4a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 0x556a17b4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a17aaf340 con 0x556a177822f0 2024-05-20T17:36:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556a17a57290 con 0x556a177ab1b0 2024-05-20T17:36:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01db619740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556a17aab300 con 0x556a1778a4d0 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01c37fe640 1 -- 172.21.15.135:0/1138369695 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f01c40077f0 con 0x7f01cc11c0d0 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 0x556a17b4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 0x556a17b4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:54294/0 (socket says 172.21.15.135:54294) 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.421+0000 7f01d1d14640 1 -- 172.21.15.135:0/4208575670 learned_addr learned my addr 172.21.15.135:0/4208575670 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.422+0000 7f01d2515640 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 0x556a17b4a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.423+0000 7f01c37fe640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 0x7f01b80a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.423+0000 7f01c37fe640 1 -- 172.21.15.135:0/1138369695 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f01c40ce780 con 0x7f01cc11c0d0 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.424+0000 7f01d2d16640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 0x7f01b80a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.424+0000 7f01d1d14640 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b4a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.424+0000 7f01d2515640 1 -- 172.21.15.135:0/4208575670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 msgr2=0x556a17b4ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.424+0000 7f01d2515640 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 0x556a17b4ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.425+0000 7f01d2515640 1 -- 172.21.15.135:0/4208575670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 msgr2=0x556a17b4a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.425+0000 7f01d2515640 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b4a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.425+0000 7f01d2515640 1 -- 172.21.15.135:0/4208575670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a17a7b8e0 con 0x556a177822f0 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.426+0000 7f01d2515640 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 0x556a17b4a5c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009980 tx=0x7f01bc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53144a73e5f83d59 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.427+0000 7f01d2d16640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 0x7f01b80a52f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01c40cbfe0 tx=0x7f01c4004ad0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.427+0000 7f01c0ff9640 1 -- 172.21.15.135:0/4208575670 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc017070 con 0x556a177822f0 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.427+0000 7f01c0ff9640 1 -- 172.21.15.135:0/4208575670 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01bc013470 con 0x556a177822f0 2024-05-20T17:36:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.427+0000 7f01c0ff9640 1 -- 172.21.15.135:0/4208575670 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012630 con 0x556a177822f0 2024-05-20T17:36:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.428+0000 7f01db619740 1 -- 172.21.15.135:0/4208575670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 msgr2=0x556a17b4a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 0x556a17b4a5c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009980 tx=0x7f01bc009e40 comp rx=0 tx=0).stop 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 -- 172.21.15.135:0/4208575670 shutdown_connections 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1778a4d0 0x556a17b4ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177822f0 0x556a17b4a5c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 --2- 172.21.15.135:0/4208575670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b4a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.429+0000 7f01db619740 1 -- 172.21.15.135:0/4208575670 >> 172.21.15.135:0/4208575670 conn(0x556a1779f300 msgr2=0x556a17b46830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.431+0000 7f01db619740 1 -- 172.21.15.135:0/4208575670 shutdown_connections 2024-05-20T17:36:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.433+0000 7f01db619740 1 -- 172.21.15.135:0/4208575670 wait complete. 2024-05-20T17:36:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.434+0000 7f01db619740 1 -- start start 2024-05-20T17:36:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.435+0000 7f01db619740 1 Processor -- start 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b54740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b5a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a17b571b0 con 0x556a1778a4d0 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556a17a6a790 con 0x556a177ab1b0 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556a17b57330 con 0x556a177822f0 2024-05-20T17:36:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.436+0000 7f01db619740 10 client.0 _ll_register_callbacks cb 0x556a17aa5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.437+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b54740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.437+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b5a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.438+0000 7f01d2515640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.438+0000 7f01d2515640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40098/0 (socket says 172.21.15.135:40098) 2024-05-20T17:36:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.438+0000 7f01d2515640 1 -- 172.21.15.135:0/3963636070 learned_addr learned my addr 172.21.15.135:0/3963636070 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.440+0000 7f01d2515640 1 -- 172.21.15.135:0/3963636070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 msgr2=0x556a17b54740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.440+0000 7f01d2515640 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b54740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.440+0000 7f01d2515640 1 -- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 msgr2=0x556a17b5a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.440+0000 7f01d2515640 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b5a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.440+0000 7f01d2515640 1 -- 172.21.15.135:0/3963636070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a177c3210 con 0x556a1778a4d0 2024-05-20T17:36:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.441+0000 7f01d2515640 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000c00 tx=0x7f01bc013850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb451e21207f8aa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.442+0000 7f01b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.442+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc017050 con 0x556a1778a4d0 2024-05-20T17:36:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.442+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f01bc01c650 con 0x556a1778a4d0 2024-05-20T17:36:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.444+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01bc013470 con 0x556a1778a4d0 2024-05-20T17:36:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.447+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01bc0095a0 con 0x556a1778a4d0 2024-05-20T17:36:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.447+0000 7f01db619740 10 client.16296 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.447+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556a1788f620 con 0x556a1778a4d0 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01bc013470 con 0x556a1778a4d0 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f01bc030870 con 0x556a1778a4d0 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 10 client.16296 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 20 client.16296 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a17769d80 0x556a17b66da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 4 client.16296 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.448+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a17abca70 con 0x556a17769d80 2024-05-20T17:36:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.458+0000 7f01d1d14640 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a17769d80 0x556a17b66da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.466+0000 7f01d1d14640 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a17769d80 0x556a17b66da0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57d1013f564afba server_cookie=77e9ee7adea9a3cd in_seq=0 out_seq=0 2024-05-20T17:36:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.466+0000 7f01b5ffb640 10 client.16296 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.473+0000 7f01b5ffb640 1 -- 172.21.15.135:0/3963636070 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556a17abca70 con 0x556a17769d80 2024-05-20T17:36:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.473+0000 7f01b5ffb640 10 client.16296 handle_command_reply: tid=0 2024-05-20T17:36:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.473+0000 7f01db619740 1 client.16296 shutdown 2024-05-20T17:36:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 msgr2=0x556a17b54ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000c00 tx=0x7f01bc013850 comp rx=0 tx=0).stop 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 shutdown_connections 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a17769d80 0x556a17b66da0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177ab1b0 0x556a17b5a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b54ca0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 --2- 172.21.15.135:0/3963636070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b54740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 >> 172.21.15.135:0/3963636070 conn(0x556a1779f300 msgr2=0x556a17b4bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.475+0000 7f01b5ffb640 0 client.16296 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.476+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 shutdown_connections 2024-05-20T17:36:12.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.478+0000 7f01db619740 1 -- 172.21.15.135:0/3963636070 wait complete. 2024-05-20T17:36:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.480+0000 7f01db619740 20 client.16296 trim_cache size 0 max 16384 2024-05-20T17:36:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.514+0000 7f01db619740 1 Processor -- start 2024-05-20T17:36:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.514+0000 7f01db619740 1 -- start start 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 0x556a17b469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b5a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 0x556a17b4de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01b0011190 con 0x556a1778a4d0 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000ea60 con 0x556a177822f0 2024-05-20T17:36:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.515+0000 7f01db619740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000c8b0 con 0x556a177ab1b0 2024-05-20T17:36:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.517+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 0x556a17b469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.517+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 0x556a17b4de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.517+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 0x556a17b469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:55422/0 (socket says 172.21.15.135:55422) 2024-05-20T17:36:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.517+0000 7f01d1d14640 1 -- 172.21.15.135:0/3535875036 learned_addr learned my addr 172.21.15.135:0/3535875036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d2515640 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b5a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 -- 172.21.15.135:0/3535875036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 msgr2=0x556a17b469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 0x556a17b469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 -- 172.21.15.135:0/3535875036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 msgr2=0x556a17b5a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b5a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 -- 172.21.15.135:0/3535875036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a17b52aa0 con 0x556a177ab1b0 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.518+0000 7f01d1d14640 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 0x556a17b4de00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006010 tx=0x7f01c802a9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a6d20c5fb6de0a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.519+0000 7f01b7fff640 1 -- 172.21.15.135:0/3535875036 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8035040 con 0x556a177ab1b0 2024-05-20T17:36:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.519+0000 7f01b7fff640 1 -- 172.21.15.135:0/3535875036 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c804ce50 con 0x556a177ab1b0 2024-05-20T17:36:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.520+0000 7f01db619740 1 -- 172.21.15.135:0/3535875036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 msgr2=0x556a17b4de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.520+0000 7f01db619740 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 0x556a17b4de00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006010 tx=0x7f01c802a9d0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.522+0000 7f01db619740 1 -- 172.21.15.135:0/3535875036 shutdown_connections 2024-05-20T17:36:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.522+0000 7f01db619740 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177ab1b0 0x556a17b4de00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.522+0000 7f01db619740 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a1778a4d0 0x556a17b5a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.522+0000 7f01db619740 1 --2- 172.21.15.135:0/3535875036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a177822f0 0x556a17b469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.522+0000 7f01db619740 1 -- 172.21.15.135:0/3535875036 >> 172.21.15.135:0/3535875036 conn(0x556a1779f300 msgr2=0x556a17b462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.523+0000 7f01db619740 1 -- 172.21.15.135:0/3535875036 shutdown_connections 2024-05-20T17:36:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.523+0000 7f01db619740 1 -- 172.21.15.135:0/3535875036 wait complete. 2024-05-20T17:36:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.523+0000 7f01db619740 1 -- start start 2024-05-20T17:36:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 Processor -- start 2024-05-20T17:36:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b61270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a1778a4d0 0x556a17b45670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000cf20 con 0x556a177ab1b0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000e390 con 0x556a1778a4d0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000d5f0 con 0x556a177822f0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.524+0000 7f01db619740 10 client.0 _ll_register_callbacks cb 0x7f01c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.525+0000 7f01d2515640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a1778a4d0 0x556a17b45670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.525+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.525+0000 7f01d1d14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40120/0 (socket says 172.21.15.135:40120) 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.525+0000 7f01d1d14640 1 -- 172.21.15.135:0/2934371591 learned_addr learned my addr 172.21.15.135:0/2934371591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.525+0000 7f01d1d14640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b61270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.527+0000 7f01d1d14640 1 -- 172.21.15.135:0/2934371591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 msgr2=0x556a17b61270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.527+0000 7f01d1d14640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b61270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.527+0000 7f01d1d14640 1 -- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a1778a4d0 msgr2=0x556a17b45670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.527+0000 7f01d1d14640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a1778a4d0 0x556a17b45670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.527+0000 7f01d1d14640 1 -- 172.21.15.135:0/2934371591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a17bcd120 con 0x556a177ab1b0 2024-05-20T17:36:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.528+0000 7f01d1d14640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f01c80096c0 tx=0x7f01c8004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a962562e48892e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.529+0000 7f01b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.529+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8035040 con 0x556a177ab1b0 2024-05-20T17:36:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.529+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f01c80051e0 con 0x556a177ab1b0 2024-05-20T17:36:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.530+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c804ce50 con 0x556a177ab1b0 2024-05-20T17:36:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.531+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01c804baa0 con 0x556a177ab1b0 2024-05-20T17:36:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.531+0000 7f01db619740 10 client.16302 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.531+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556a17bce300 con 0x556a177ab1b0 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.531+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c804ce50 con 0x556a177ab1b0 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f01c8082020 con 0x556a177ab1b0 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 10 client.16302 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 20 client.16302 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a1773f1c0 0x556a17bd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 4 client.16302 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:36:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.532+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a17ab6dc0 con 0x556a1773f1c0 2024-05-20T17:36:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.533+0000 7f01d2515640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a1773f1c0 0x556a17bd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.538+0000 7f01d2515640 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a1773f1c0 0x556a17bd0930 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc42b5118df42073 server_cookie=f7d97f99712e3f3d in_seq=0 out_seq=0 2024-05-20T17:36:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:12.539+0000 7f01b5ffb640 10 client.16302 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:13 smithi160 ceph-mon[36261]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 563 op/s 2024-05-20T17:36:13.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:13 smithi172 ceph-mon[36511]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 563 op/s 2024-05-20T17:36:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:13 smithi135 ceph-mon[32027]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 563 op/s 2024-05-20T17:36:15.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:15 smithi160 ceph-mon[36261]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-05-20T17:36:15.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:15 smithi172 ceph-mon[36511]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-05-20T17:36:15.607 INFO:tasks.workunit.client.0.smithi135.stdout: 113 141349 780 87892 969 34614 403 2024-05-20T17:36:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:15 smithi135 ceph-mon[32027]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 108 op/s 2024-05-20T17:36:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01b5ffb640 1 -- 172.21.15.135:0/2934371591 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556a17ab6dc0 con 0x556a1773f1c0 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01b5ffb640 10 client.16302 handle_command_reply: tid=0 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 client.16302 shutdown 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 msgr2=0x556a17b45c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f01c80096c0 tx=0x7f01c8004840 comp rx=0 tx=0).stop 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 shutdown_connections 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556a1773f1c0 0x556a17bd0930 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a177ab1b0 0x556a17b45c70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556a1778a4d0 0x556a17b45670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 --2- 172.21.15.135:0/2934371591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a177822f0 0x556a17b61270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01b5ffb640 0 client.16302 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 >> 172.21.15.135:0/2934371591 conn(0x556a1779f300 msgr2=0x556a17b4bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.284+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 shutdown_connections 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01db619740 1 -- 172.21.15.135:0/2934371591 wait complete. 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01db619740 20 client.16302 trim_cache size 0 max 16384 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:36:16.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:36:16.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 msgr2=0x7f01b80a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 0x7f01b80a52f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01c40cbfe0 tx=0x7f01c4004ad0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 msgr2=0x7f01cc1acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b990 tx=0x7f01c400be50 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 shutdown_connections 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f01b80a2de0 0x7f01b80a52f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc11c0d0 0x7f01cc1acfb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc119770 0x7f01cc1a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 --2- 172.21.15.135:0/1138369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01cc109080 0x7f01cc1a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:16.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 >> 172.21.15.135:0/1138369695 conn(0x7f01cc06d780 msgr2=0x7f01cc119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 shutdown_connections 2024-05-20T17:36:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:16.285+0000 7f01d4779640 1 -- 172.21.15.135:0/1138369695 wait complete. 2024-05-20T17:36:17.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:17 smithi172 ceph-mon[36511]: pgmap v91: 97 pgs: 97 active+clean; 264 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-05-20T17:36:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:17 smithi135 ceph-mon[32027]: pgmap v91: 97 pgs: 97 active+clean; 264 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-05-20T17:36:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:17 smithi160 ceph-mon[36261]: pgmap v91: 97 pgs: 97 active+clean; 264 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-05-20T17:36:19.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:19 smithi160 ceph-mon[36261]: pgmap v92: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.9 MiB/s wr, 944 op/s 2024-05-20T17:36:19.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:19 smithi172 ceph-mon[36511]: pgmap v92: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.9 MiB/s wr, 944 op/s 2024-05-20T17:36:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:19 smithi135 ceph-mon[32027]: pgmap v92: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.9 MiB/s wr, 944 op/s 2024-05-20T17:36:21.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:21 smithi172 ceph-mon[36511]: pgmap v93: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.5 MiB/s wr, 910 op/s 2024-05-20T17:36:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:21 smithi135 ceph-mon[32027]: pgmap v93: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.5 MiB/s wr, 910 op/s 2024-05-20T17:36:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:21 smithi160 ceph-mon[36261]: pgmap v93: 97 pgs: 97 active+clean; 297 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.5 MiB/s wr, 910 op/s 2024-05-20T17:36:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:23 smithi172 ceph-mon[36511]: pgmap v94: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-05-20T17:36:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:23 smithi135 ceph-mon[32027]: pgmap v94: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-05-20T17:36:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:23 smithi160 ceph-mon[36261]: pgmap v94: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-05-20T17:36:25.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:25 smithi172 ceph-mon[36511]: pgmap v95: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-05-20T17:36:25.608 INFO:tasks.workunit.client.0.smithi135.stdout: 121 788944 559 508114 555 229905 1064 2024-05-20T17:36:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:25 smithi135 ceph-mon[32027]: pgmap v95: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-05-20T17:36:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:25 smithi160 ceph-mon[36261]: pgmap v95: 97 pgs: 97 active+clean; 335 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-05-20T17:36:27.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:27 smithi172 ceph-mon[36511]: pgmap v96: 97 pgs: 97 active+clean; 346 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2024-05-20T17:36:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:27 smithi135 ceph-mon[32027]: pgmap v96: 97 pgs: 97 active+clean; 346 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2024-05-20T17:36:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:27 smithi160 ceph-mon[36261]: pgmap v96: 97 pgs: 97 active+clean; 346 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 -- 172.21.15.135:0/3435406210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638107ed0 msgr2=0x7fd638101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/3435406210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638107ed0 0x7fd638101b20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd628009900 tx=0x7fd62802a3f0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 -- 172.21.15.135:0/3435406210 shutdown_connections 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/3435406210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638102190 0x7fd63810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/3435406210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638107ed0 0x7fd638101b20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/3435406210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd6381015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 -- 172.21.15.135:0/3435406210 >> 172.21.15.135:0/3435406210 conn(0x7fd638077030 msgr2=0x7fd638077490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 -- 172.21.15.135:0/3435406210 shutdown_connections 2024-05-20T17:36:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.440+0000 7fd63f9ea640 1 -- 172.21.15.135:0/3435406210 wait complete. 2024-05-20T17:36:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.441+0000 7fd63f9ea640 1 Processor -- start 2024-05-20T17:36:29.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 -- start start 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 0x7fd63819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638107ed0 0x7fd6381996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd638111df0 con 0x7fd638102190 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd638111c70 con 0x7fd638107ed0 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63f9ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd638111f70 con 0x7fd638107a30 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63d786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 0x7fd63819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63cf85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63cf85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:44900/0 (socket says 172.21.15.135:44900) 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63cf85640 1 -- 172.21.15.135:0/333819233 learned_addr learned my addr 172.21.15.135:0/333819233 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63d786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 0x7fd63819f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39576/0 (socket says 172.21.15.135:39576) 2024-05-20T17:36:29.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.442+0000 7fd63df87640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638107ed0 0x7fd6381996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 -- 172.21.15.135:0/333819233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638107ed0 msgr2=0x7fd6381996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638107ed0 0x7fd6381996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 -- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 msgr2=0x7fd63819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 0x7fd63819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 -- 172.21.15.135:0/333819233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd638199df0 con 0x7fd638107a30 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63cf85640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd62802a910 tx=0x7fd628003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd62e7fc640 1 -- 172.21.15.135:0/333819233 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62803f070 con 0x7fd638107a30 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd62e7fc640 1 -- 172.21.15.135:0/333819233 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd628031c90 con 0x7fd638107a30 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd62e7fc640 1 -- 172.21.15.135:0/333819233 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628035030 con 0x7fd638107a30 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63819a020 con 0x7fd638107a30 2024-05-20T17:36:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.443+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63819a4c0 con 0x7fd638107a30 2024-05-20T17:36:29.447 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.446+0000 7fd62e7fc640 1 -- 172.21.15.135:0/333819233 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd628042070 con 0x7fd638107a30 2024-05-20T17:36:29.449 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.448+0000 7fd62e7fc640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 0x7fd6240a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.448+0000 7fd62e7fc640 1 -- 172.21.15.135:0/333819233 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6280efdb0 con 0x7fd638107a30 2024-05-20T17:36:29.451 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.449+0000 7fd63d786640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 0x7fd6240a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.451+0000 7fd64696e740 1 Processor -- start 2024-05-20T17:36:29.452 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.451+0000 7fd63d786640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 0x7fd6240a5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd638069310 tx=0x7fd634005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 -- start start 2024-05-20T17:36:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d76b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d76bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d6d0340 con 0x55ff0d3a32f0 2024-05-20T17:36:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d678290 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd64696e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d6cc300 con 0x55ff0d3ab4d0 2024-05-20T17:36:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd63d786640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.452+0000 7fd63d786640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:52712/0 (socket says 172.21.15.135:52712) 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 -- 172.21.15.135:0/3516189534 learned_addr learned my addr 172.21.15.135:0/3516189534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63cf85640 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d76b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 -- 172.21.15.135:0/3516189534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 msgr2=0x55ff0d76bb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d76bb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 -- 172.21.15.135:0/3516189534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 msgr2=0x55ff0d76b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d76b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.453+0000 7fd63d786640 1 -- 172.21.15.135:0/3516189534 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0d69c8e0 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.455+0000 7fd63d786640 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6340058c0 tx=0x7fd634014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86bd8ae4f0dfaaf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.455+0000 7fd6237fe640 1 -- 172.21.15.135:0/3516189534 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634005020 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.455+0000 7fd6237fe640 1 -- 172.21.15.135:0/3516189534 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6340047a0 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.455+0000 7fd6237fe640 1 -- 172.21.15.135:0/3516189534 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63401e730 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 -- 172.21.15.135:0/3516189534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 msgr2=0x55ff0d76b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6340058c0 tx=0x7fd634014000 comp rx=0 tx=0).stop 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 -- 172.21.15.135:0/3516189534 shutdown_connections 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d76bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d76b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 --2- 172.21.15.135:0/3516189534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d76b080 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.456+0000 7fd64696e740 1 -- 172.21.15.135:0/3516189534 >> 172.21.15.135:0/3516189534 conn(0x55ff0d3c0300 msgr2=0x55ff0d767830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.457+0000 7fd64696e740 1 -- 172.21.15.135:0/3516189534 shutdown_connections 2024-05-20T17:36:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.457+0000 7fd64696e740 1 -- 172.21.15.135:0/3516189534 wait complete. 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.457+0000 7fd64696e740 1 -- start start 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.457+0000 7fd64696e740 1 Processor -- start 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d775ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d78c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d7891c0 con 0x55ff0d3ab4d0 2024-05-20T17:36:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d68b790 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff0d789340 con 0x55ff0d3a32f0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd64696e740 10 client.0 _ll_register_callbacks cb 0x55ff0d6c6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53790/0 (socket says 172.21.15.135:53790) 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 -- 172.21.15.135:0/1793386149 learned_addr learned my addr 172.21.15.135:0/1793386149 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63cf85640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d775ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63df87640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d78c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 -- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 msgr2=0x55ff0d78c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d78c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 -- 172.21.15.135:0/1793386149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3ab4d0 msgr2=0x55ff0d775ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d775ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.458+0000 7fd63d786640 1 -- 172.21.15.135:0/1793386149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0d3e4210 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd63d786640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd634000c00 tx=0x7fd63401fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39523035206e0e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634036060 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd6340043a0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6340047a0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd63403a410 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd64696e740 10 client.25825 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.459+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff0d4b0620 con 0x55ff0d3a32f0 2024-05-20T17:36:29.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.460+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6340047a0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd63400e4d0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 10 client.25825 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 10 client.25825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 20 client.25825 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d38ad80 0x55ff0d798810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 4 client.25825 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff0d6dda70 con 0x55ff0d38ad80 2024-05-20T17:36:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd63cf85640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d38ad80 0x55ff0d798810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd620ff9640 10 client.25825 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.461+0000 7fd63cf85640 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d38ad80 0x55ff0d798810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f93b2aef5595c3 server_cookie=8f0bc91fe155e186 in_seq=0 out_seq=0 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd620ff9640 1 -- 172.21.15.135:0/1793386149 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ff0d6dda70 con 0x55ff0d38ad80 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd620ff9640 10 client.25825 handle_command_reply: tid=0 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 client.25825 shutdown 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 msgr2=0x55ff0d775780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd634000c00 tx=0x7fd63401fc20 comp rx=0 tx=0).stop 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 shutdown_connections 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d38ad80 0x55ff0d798810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3cc1b0 0x55ff0d78c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd620ff9640 0 client.25825 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d775ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 --2- 172.21.15.135:0/1793386149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3a32f0 0x55ff0d775780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 >> 172.21.15.135:0/1793386149 conn(0x55ff0d3c0300 msgr2=0x55ff0d76aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 shutdown_connections 2024-05-20T17:36:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 1 -- 172.21.15.135:0/1793386149 wait complete. 2024-05-20T17:36:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.464+0000 7fd64696e740 20 client.25825 trim_cache size 0 max 16384 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 Processor -- start 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 -- start start 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d78caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381a8c10 con 0x55ff0d38ad80 2024-05-20T17:36:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381a64e0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.481+0000 7fd64696e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd63819abd0 con 0x55ff0d3ab4d0 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63df87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d78caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63cf85640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63df87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d78caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53804/0 (socket says 172.21.15.135:53804) 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59316/0 (socket says 172.21.15.135:59316) 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63df87640 1 -- 172.21.15.135:0/2067911617 learned_addr learned my addr 172.21.15.135:0/2067911617 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 -- 172.21.15.135:0/2067911617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 msgr2=0x55ff0d78caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d78caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 -- 172.21.15.135:0/2067911617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3a32f0 msgr2=0x55ff0d78c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 -- 172.21.15.135:0/2067911617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0d768400 con 0x55ff0d38ad80 2024-05-20T17:36:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd63d786640 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e940 tx=0x7fd634004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9181fecb9530118 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.482+0000 7fd622ffd640 1 -- 172.21.15.135:0/2067911617 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634036040 con 0x55ff0d38ad80 2024-05-20T17:36:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.483+0000 7fd622ffd640 1 -- 172.21.15.135:0/2067911617 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd634005620 con 0x55ff0d38ad80 2024-05-20T17:36:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.483+0000 7fd622ffd640 1 -- 172.21.15.135:0/2067911617 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63400e610 con 0x55ff0d38ad80 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- 172.21.15.135:0/2067911617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 msgr2=0x55ff0d76f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e940 tx=0x7fd634004270 comp rx=0 tx=0).stop 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- 172.21.15.135:0/2067911617 shutdown_connections 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d78caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 --2- 172.21.15.135:0/2067911617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d38ad80 0x55ff0d76f450 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- 172.21.15.135:0/2067911617 >> 172.21.15.135:0/2067911617 conn(0x55ff0d3c0300 msgr2=0x55ff0d76ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- 172.21.15.135:0/2067911617 shutdown_connections 2024-05-20T17:36:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- 172.21.15.135:0/2067911617 wait complete. 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 -- start start 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.484+0000 7fd64696e740 1 Processor -- start 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d38ad80 0x55ff0d78fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d791fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd638072470 con 0x55ff0d3a32f0 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6380738c0 con 0x55ff0d3ab4d0 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd638072b20 con 0x55ff0d38ad80 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd64696e740 10 client.0 _ll_register_callbacks cb 0x7fd628005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59328/0 (socket says 172.21.15.135:59328) 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 -- 172.21.15.135:0/3591131873 learned_addr learned my addr 172.21.15.135:0/3591131873 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63d786640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d38ad80 0x55ff0d78fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63df87640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d791fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 -- 172.21.15.135:0/3591131873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d38ad80 msgr2=0x55ff0d78fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d38ad80 0x55ff0d78fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 -- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3ab4d0 msgr2=0x55ff0d791fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d791fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.485+0000 7fd63cf85640 1 -- 172.21.15.135:0/3591131873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0d792540 con 0x55ff0d3a32f0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd63cf85640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd6280ed5b0 tx=0x7fd6280dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad4bc467de2da2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280d4020 con 0x55ff0d3a32f0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd62803b460 con 0x55ff0d3a32f0 2024-05-20T17:36:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd634005620 con 0x55ff0d3a32f0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd628049040 con 0x55ff0d3a32f0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd64696e740 10 client.16320 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff0d8004e0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.486+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd634005620 con 0x55ff0d3a32f0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd6280bc5e0 con 0x55ff0d3a32f0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 10 client.16320 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 10 client.16320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 20 client.16320 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d3cc1b0 0x55ff0d802cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 4 client.16320 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff0d6d7dc0 con 0x55ff0d3cc1b0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd63d786640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d3cc1b0 0x55ff0d802cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd620ff9640 10 client.16320 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:29.487+0000 7fd63d786640 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d3cc1b0 0x55ff0d802cb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc680ea655bafa4 server_cookie=3097f3f54dc3da9c in_seq=0 out_seq=0 2024-05-20T17:36:29.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:29 smithi172 ceph-mon[36511]: pgmap v97: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 805 op/s 2024-05-20T17:36:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:29 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:36:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:29 smithi135 ceph-mon[32027]: pgmap v97: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 805 op/s 2024-05-20T17:36:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:29 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:36:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:29 smithi160 ceph-mon[36261]: pgmap v97: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 805 op/s 2024-05-20T17:36:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:29 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:36:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.462+0000 7fd620ff9640 1 -- 172.21.15.135:0/3591131873 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff0d6d7dc0 con 0x55ff0d3cc1b0 2024-05-20T17:36:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.462+0000 7fd620ff9640 10 client.16320 handle_command_reply: tid=0 2024-05-20T17:36:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.462+0000 7fd64696e740 1 client.16320 shutdown 2024-05-20T17:36:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 msgr2=0x55ff0d78ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd6280ed5b0 tx=0x7fd6280dc040 comp rx=0 tx=0).stop 2024-05-20T17:36:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 shutdown_connections 2024-05-20T17:36:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ff0d3cc1b0 0x55ff0d802cb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff0d3ab4d0 0x55ff0d791fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff0d3a32f0 0x55ff0d78ff80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 --2- 172.21.15.135:0/3591131873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff0d38ad80 0x55ff0d78fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 >> 172.21.15.135:0/3591131873 conn(0x55ff0d3c0300 msgr2=0x55ff0d773a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd620ff9640 0 client.16320 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 shutdown_connections 2024-05-20T17:36:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 1 -- 172.21.15.135:0/3591131873 wait complete. 2024-05-20T17:36:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.463+0000 7fd64696e740 20 client.16320 trim_cache size 0 max 16384 2024-05-20T17:36:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:36:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:36:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:36:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:36:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 msgr2=0x7fd6240a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 0x7fd6240a5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd638069310 tx=0x7fd634005f90 comp rx=0 tx=0).stop 2024-05-20T17:36:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 msgr2=0x7fd63819fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd62802a910 tx=0x7fd628003b20 comp rx=0 tx=0).stop 2024-05-20T17:36:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 shutdown_connections 2024-05-20T17:36:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd6240a2cf0 0x7fd6240a5200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd638107ed0 0x7fd6381996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd638107a30 0x7fd63819fa80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 --2- 172.21.15.135:0/333819233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd638102190 0x7fd63819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 >> 172.21.15.135:0/333819233 conn(0x7fd638077030 msgr2=0x7fd63806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 shutdown_connections 2024-05-20T17:36:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:30.464+0000 7fd63f9ea640 1 -- 172.21.15.135:0/333819233 wait complete. 2024-05-20T17:36:30.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:30 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:36:30.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:30 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:36:30.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:30 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:36:30.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:30 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:36:30.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:30 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:36:30.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:30 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:36:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:30 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:36:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:30 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:36:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:30 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:36:31.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:31 smithi172 ceph-mon[36511]: pgmap v98: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 310 op/s 2024-05-20T17:36:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:31 smithi135 ceph-mon[32027]: pgmap v98: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 310 op/s 2024-05-20T17:36:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:31 smithi160 ceph-mon[36261]: pgmap v98: 97 pgs: 97 active+clean; 346 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 310 op/s 2024-05-20T17:36:33.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:33 smithi172 ceph-mon[36511]: pgmap v99: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.5 MiB/s wr, 796 op/s 2024-05-20T17:36:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:33 smithi135 ceph-mon[32027]: pgmap v99: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.5 MiB/s wr, 796 op/s 2024-05-20T17:36:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:33 smithi160 ceph-mon[36261]: pgmap v99: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.5 MiB/s wr, 796 op/s 2024-05-20T17:36:35.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:35 smithi172 ceph-mon[36511]: pgmap v100: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-05-20T17:36:35.608 INFO:tasks.workunit.client.0.smithi135.stdout: 142 1187003 1057 786830 1113 358218 1074 2024-05-20T17:36:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:35 smithi135 ceph-mon[32027]: pgmap v100: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-05-20T17:36:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:35 smithi160 ceph-mon[36261]: pgmap v100: 97 pgs: 97 active+clean; 334 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-05-20T17:36:37.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:37 smithi172 ceph-mon[36511]: pgmap v101: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 795 op/s 2024-05-20T17:36:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:37 smithi135 ceph-mon[32027]: pgmap v101: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 795 op/s 2024-05-20T17:36:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:37 smithi160 ceph-mon[36261]: pgmap v101: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 795 op/s 2024-05-20T17:36:39.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:39 smithi172 ceph-mon[36511]: pgmap v102: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 961 op/s 2024-05-20T17:36:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:39 smithi135 ceph-mon[32027]: pgmap v102: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 961 op/s 2024-05-20T17:36:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:39 smithi160 ceph-mon[36261]: pgmap v102: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 961 op/s 2024-05-20T17:36:41.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:41 smithi172 ceph-mon[36511]: pgmap v103: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 947 op/s 2024-05-20T17:36:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:41 smithi135 ceph-mon[32027]: pgmap v103: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 947 op/s 2024-05-20T17:36:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:41 smithi160 ceph-mon[36261]: pgmap v103: 97 pgs: 97 active+clean; 439 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 947 op/s 2024-05-20T17:36:43.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:43 smithi172 ceph-mon[36511]: pgmap v104: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2024-05-20T17:36:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:43 smithi135 ceph-mon[32027]: pgmap v104: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2024-05-20T17:36:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:43 smithi160 ceph-mon[36261]: pgmap v104: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 -- 172.21.15.135:0/460689369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c109080 msgr2=0x7fdf5c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/460689369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c109080 0x7fdf5c109490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009ca0 tx=0x7fdf5402a980 comp rx=0 tx=0).stop 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 -- 172.21.15.135:0/460689369 shutdown_connections 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/460689369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c11e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/460689369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c11bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/460689369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c109080 0x7fdf5c109490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 -- 172.21.15.135:0/460689369 >> 172.21.15.135:0/460689369 conn(0x7fdf5c06d780 msgr2=0x7fdf5c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 -- 172.21.15.135:0/460689369 shutdown_connections 2024-05-20T17:36:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.814+0000 7fdf62b8f640 1 -- 172.21.15.135:0/460689369 wait complete. 2024-05-20T17:36:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.816+0000 7fdf62b8f640 1 Processor -- start 2024-05-20T17:36:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.816+0000 7fdf62b8f640 1 -- start start 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf62b8f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 0x7fdf5c1a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf62b8f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c1a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf62b8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf62b8f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c121c50 con 0x7fdf5c109080 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf6112c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf6092b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 0x7fdf5c1a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf6112c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:59306/0 (socket says 172.21.15.135:59306) 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.817+0000 7fdf6112c640 1 -- 172.21.15.135:0/3256867348 learned_addr learned my addr 172.21.15.135:0/3256867348 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c121ad0 con 0x7fdf5c119770 2024-05-20T17:36:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c121dd0 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c1a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 -- 172.21.15.135:0/3256867348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 msgr2=0x7fdf5c1a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c1a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 -- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 msgr2=0x7fdf5c1a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c1a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 0x7fdf5c1a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 -- 172.21.15.135:0/3256867348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c1ad3d0 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6092b640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 0x7fdf5c1a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:36:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.818+0000 7fdf6112c640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00e9e0 tx=0x7fdf4c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.828+0000 7fdf59ffb640 1 -- 172.21.15.135:0/3256867348 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00cdb0 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.828+0000 7fdf59ffb640 1 -- 172.21.15.135:0/3256867348 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c0035f0 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.830+0000 7fdf59ffb640 1 -- 172.21.15.135:0/3256867348 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c010690 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.831+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c1ad6c0 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.831+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c1adb90 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.836+0000 7fdf69a3b740 1 Processor -- start 2024-05-20T17:36:43.846 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.844+0000 7fdf59ffb640 1 -- 172.21.15.135:0/3256867348 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdf4c004000 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.845+0000 7fdf59ffb640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 0x7fdf440a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.845+0000 7fdf59ffb640 1 -- 172.21.15.135:0/3256867348 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdf4c0cf610 con 0x7fdf5c11c0d0 2024-05-20T17:36:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.846+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 0x7fdf440a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.848 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.847+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 0x7fdf440a5170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c11b540 tx=0x7fdf50005e70 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.847+0000 7fdf69a3b740 1 -- start start 2024-05-20T17:36:43.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539c1c1b0 0x561539fbb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 0x561539fbbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561539f20340 con 0x561539bfb4d0 2024-05-20T17:36:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561539ec8290 con 0x561539c1c1b0 2024-05-20T17:36:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561539f1c300 con 0x561539bf32f0 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf6092b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539c1c1b0 0x561539fbb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:59316/0 (socket says 172.21.15.135:59316) 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.848+0000 7fdf5bfff640 1 -- 172.21.15.135:0/561593584 learned_addr learned my addr 172.21.15.135:0/561593584 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf5bfff640 1 -- 172.21.15.135:0/561593584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539c1c1b0 msgr2=0x561539fbb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539c1c1b0 0x561539fbb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf5bfff640 1 -- 172.21.15.135:0/561593584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 msgr2=0x561539fbbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf6112c640 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 0x561539fbbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 0x561539fbbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf5bfff640 1 -- 172.21.15.135:0/561593584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561539eec8e0 con 0x561539bf32f0 2024-05-20T17:36:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.849+0000 7fdf6112c640 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 0x561539fbbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.850+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000de70 tx=0x7fdf50008f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f22bd26c6d8110d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.856+0000 7fdf42ffd640 1 -- 172.21.15.135:0/561593584 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50020070 con 0x561539bf32f0 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.856+0000 7fdf42ffd640 1 -- 172.21.15.135:0/561593584 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5000fe30 con 0x561539bf32f0 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 -- 172.21.15.135:0/561593584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 msgr2=0x561539fbb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000de70 tx=0x7fdf50008f90 comp rx=0 tx=0).stop 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 -- 172.21.15.135:0/561593584 shutdown_connections 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bfb4d0 0x561539fbbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fbb5c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/561593584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539c1c1b0 0x561539fbb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.858+0000 7fdf69a3b740 1 -- 172.21.15.135:0/561593584 >> 172.21.15.135:0/561593584 conn(0x561539c10300 msgr2=0x561539fb7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.860+0000 7fdf69a3b740 1 -- 172.21.15.135:0/561593584 shutdown_connections 2024-05-20T17:36:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.861+0000 7fdf69a3b740 1 -- 172.21.15.135:0/561593584 wait complete. 2024-05-20T17:36:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.861+0000 7fdf69a3b740 1 -- start start 2024-05-20T17:36:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.861+0000 7fdf69a3b740 1 Processor -- start 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 0x561539fc7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fc55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561539fd9210 con 0x561539c1c1b0 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561539edb790 con 0x561539bf32f0 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561539fd9390 con 0x561539bfb4d0 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf69a3b740 10 client.0 _ll_register_callbacks cb 0x561539f16a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:59326/0 (socket says 172.21.15.135:59326) 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf5bfff640 1 -- 172.21.15.135:0/3011865042 learned_addr learned my addr 172.21.15.135:0/3011865042 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.863+0000 7fdf6092b640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 0x561539fc7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf5bfff640 1 -- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 msgr2=0x561539fc7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 0x561539fc7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf5bfff640 1 -- 172.21.15.135:0/3011865042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 msgr2=0x561539fc55f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:36:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf6112c640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fc55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fc55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf5bfff640 1 -- 172.21.15.135:0/3011865042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561539c34210 con 0x561539bfb4d0 2024-05-20T17:36:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.864+0000 7fdf6092b640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 0x561539fc7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:36:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.865+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf50008250 tx=0x7fdf5001ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ac65675dbe182 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.865+0000 7fdf6112c640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fc55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.867+0000 7fdf3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:36:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.867+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50020040 con 0x561539bfb4d0 2024-05-20T17:36:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.867+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdf50025860 con 0x561539bfb4d0 2024-05-20T17:36:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.867+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf5000fe30 con 0x561539bfb4d0 2024-05-20T17:36:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.868+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf500083a0 con 0x561539bfb4d0 2024-05-20T17:36:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.868+0000 7fdf69a3b740 10 client.25843 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.868+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561539d00620 con 0x561539bfb4d0 2024-05-20T17:36:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.868+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5000fe30 con 0x561539bfb4d0 2024-05-20T17:36:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf5003a640 con 0x561539bfb4d0 2024-05-20T17:36:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 10 client.25843 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 10 client.25843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 20 client.25843 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bdad80 0x561539fe8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 4 client.25843 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:36:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561539f2da70 con 0x561539bdad80 2024-05-20T17:36:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.870+0000 7fdf6092b640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bdad80 0x561539fe8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.871+0000 7fdf6092b640 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bdad80 0x561539fe8950 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b7c5fcd16fb3e58 server_cookie=2a49bc87f4ce5d2 in_seq=0 out_seq=0 2024-05-20T17:36:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.871+0000 7fdf3bfff640 10 client.25843 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.872+0000 7fdf3bfff640 1 -- 172.21.15.135:0/3011865042 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561539f2da70 con 0x561539bdad80 2024-05-20T17:36:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.872+0000 7fdf3bfff640 10 client.25843 handle_command_reply: tid=0 2024-05-20T17:36:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.872+0000 7fdf69a3b740 1 client.25843 shutdown 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 msgr2=0x561539fc76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf50008250 tx=0x7fdf5001ce20 comp rx=0 tx=0).stop 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 shutdown_connections 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bdad80 0x561539fe8950 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fc55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bfb4d0 0x561539fc76b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/3011865042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bf32f0 0x561539fc7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 >> 172.21.15.135:0/3011865042 conn(0x561539c10300 msgr2=0x561539fbcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf3bfff640 0 client.25843 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 shutdown_connections 2024-05-20T17:36:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 1 -- 172.21.15.135:0/3011865042 wait complete. 2024-05-20T17:36:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.873+0000 7fdf69a3b740 20 client.25843 trim_cache size 0 max 16384 2024-05-20T17:36:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.922+0000 7fdf69a3b740 1 Processor -- start 2024-05-20T17:36:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 -- start start 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 0x561539fb7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fbed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 0x561539fbf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b77a0 con 0x561539bf32f0 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b5180 con 0x561539bfb4d0 2024-05-20T17:36:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.923+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c10a3a0 con 0x561539c1c1b0 2024-05-20T17:36:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.924+0000 7fdf6112c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 0x561539fbf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.924+0000 7fdf6112c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 0x561539fbf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:59332/0 (socket says 172.21.15.135:59332) 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.924+0000 7fdf6112c640 1 -- 172.21.15.135:0/2435863761 learned_addr learned my addr 172.21.15.135:0/2435863761 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.924+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fbed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.924+0000 7fdf6092b640 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 0x561539fb7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.925+0000 7fdf6092b640 1 -- 172.21.15.135:0/2435863761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 msgr2=0x561539fbf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.925+0000 7fdf6092b640 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 0x561539fbf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.925+0000 7fdf6092b640 1 -- 172.21.15.135:0/2435863761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 msgr2=0x561539fbed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.925+0000 7fdf6092b640 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fbed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.925+0000 7fdf6092b640 1 -- 172.21.15.135:0/2435863761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561539fbae10 con 0x561539bf32f0 2024-05-20T17:36:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.926+0000 7fdf6092b640 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 0x561539fb7900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdf5402af70 tx=0x7fdf5403c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a6a843be47d9fb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.941+0000 7fdf427fc640 1 -- 172.21.15.135:0/2435863761 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54034040 con 0x561539bf32f0 2024-05-20T17:36:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.941+0000 7fdf427fc640 1 -- 172.21.15.135:0/2435863761 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5402f8b0 con 0x561539bf32f0 2024-05-20T17:36:43.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.941+0000 7fdf427fc640 1 -- 172.21.15.135:0/2435863761 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf540042a0 con 0x561539bf32f0 2024-05-20T17:36:43.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.943+0000 7fdf69a3b740 1 -- 172.21.15.135:0/2435863761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 msgr2=0x561539fb7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:43.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.943+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 0x561539fb7900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdf5402af70 tx=0x7fdf5403c040 comp rx=0 tx=0).stop 2024-05-20T17:36:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 -- 172.21.15.135:0/2435863761 shutdown_connections 2024-05-20T17:36:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539c1c1b0 0x561539fbf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/2435863761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539bf32f0 0x561539fb7900 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 -- 172.21.15.135:0/2435863761 >> 172.21.15.135:0/2435863761 conn(0x561539c10300 msgr2=0x561539fb71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 -- 172.21.15.135:0/2435863761 shutdown_connections 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.954+0000 7fdf69a3b740 1 -- 172.21.15.135:0/2435863761 wait complete. 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.955+0000 7fdf69a3b740 1 -- start start 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.955+0000 7fdf69a3b740 1 Processor -- start 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fe8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fe9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c117c60 con 0x561539c1c1b0 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1190d0 con 0x561539bfb4d0 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c118330 con 0x561539bf32f0 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf69a3b740 10 client.0 _ll_register_callbacks cb 0x7fdf5000ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf6092b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf6092b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:59346/0 (socket says 172.21.15.135:59346) 2024-05-20T17:36:43.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.956+0000 7fdf6092b640 1 -- 172.21.15.135:0/1378581145 learned_addr learned my addr 172.21.15.135:0/1378581145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:36:43.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fe8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 -- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 msgr2=0x561539fe8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fe8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 -- 172.21.15.135:0/1378581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 msgr2=0x561539fe9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6112c640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fe9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fe9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 -- 172.21.15.135:0/1378581145 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153a04ea70 con 0x561539bf32f0 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fe8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6112c640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fe9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:36:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.957+0000 7fdf6092b640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009ca0 tx=0x7fdf54003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc75ee7a1328743 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:36:43.965 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.964+0000 7fdf3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:36:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.964+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54034040 con 0x561539bf32f0 2024-05-20T17:36:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.964+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf5402f8b0 con 0x561539bf32f0 2024-05-20T17:36:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.964+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdf5402f5d0 con 0x561539bf32f0 2024-05-20T17:36:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.965+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf54030680 con 0x561539bf32f0 2024-05-20T17:36:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.967+0000 7fdf69a3b740 10 client.25849 fetch_fsmap learned FSMap version 26 2024-05-20T17:36:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.967+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56153a04fce0 con 0x561539bf32f0 2024-05-20T17:36:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.968+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5402f8b0 con 0x561539bf32f0 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.968+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf54043070 con 0x561539bf32f0 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 10 client.25849 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 10 client.25849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 20 client.25849 populate_metadata read hostname 'smithi135' 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bb01c0 0x56153a052460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:36:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 4 client.25849 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:36:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561539f27dc0 con 0x561539bb01c0 2024-05-20T17:36:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bb01c0 0x56153a052460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:36:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.969+0000 7fdf3bfff640 10 client.25849 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:43.970+0000 7fdf5bfff640 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bb01c0 0x56153a052460 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe1ff14dcdba815a server_cookie=54e1591d59bf38b1 in_seq=0 out_seq=0 2024-05-20T17:36:45.608 INFO:tasks.workunit.client.0.smithi135.stdout: 161 2339671 1077 1594561 1122 729551 1940 2024-05-20T17:36:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:45 smithi135 ceph-mon[32027]: pgmap v105: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 616 op/s 2024-05-20T17:36:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:45 smithi160 ceph-mon[36261]: pgmap v105: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 616 op/s 2024-05-20T17:36:45.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:45 smithi172 ceph-mon[36511]: pgmap v105: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 616 op/s 2024-05-20T17:36:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.074+0000 7fdf3bfff640 1 -- 172.21.15.135:0/1378581145 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561539f27dc0 con 0x561539bb01c0 2024-05-20T17:36:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.074+0000 7fdf3bfff640 10 client.25849 handle_command_reply: tid=0 2024-05-20T17:36:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.075+0000 7fdf69a3b740 1 client.25849 shutdown 2024-05-20T17:36:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.075+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 msgr2=0x561539fe85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.075+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009ca0 tx=0x7fdf54003a00 comp rx=0 tx=0).stop 2024-05-20T17:36:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 shutdown_connections 2024-05-20T17:36:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x561539bb01c0 0x56153a052460 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561539c1c1b0 0x561539fe9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561539bfb4d0 0x561539fe8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 --2- 172.21.15.135:0/1378581145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561539bf32f0 0x561539fe85e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.078+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 >> 172.21.15.135:0/1378581145 conn(0x561539c10300 msgr2=0x561539fbafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.079+0000 7fdf3bfff640 0 client.25849 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.079+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 shutdown_connections 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.079+0000 7fdf69a3b740 1 -- 172.21.15.135:0/1378581145 wait complete. 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.079+0000 7fdf69a3b740 20 client.25849 trim_cache size 0 max 16384 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:36:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:36:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:36:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.090+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 msgr2=0x7fdf440a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.090+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 0x7fdf440a5170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c11b540 tx=0x7fdf50005e70 comp rx=0 tx=0).stop 2024-05-20T17:36:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.091+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 msgr2=0x7fdf5c1ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:36:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.091+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00e9e0 tx=0x7fdf4c00eea0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.094+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 shutdown_connections 2024-05-20T17:36:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.094+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdf440a2c60 0x7fdf440a5170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.094+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf5c11c0d0 0x7fdf5c1ace10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.095+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf5c119770 0x7fdf5c1a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.095+0000 7fdf62b8f640 1 --2- 172.21.15.135:0/3256867348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c109080 0x7fdf5c1a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:36:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.095+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 >> 172.21.15.135:0/3256867348 conn(0x7fdf5c06d780 msgr2=0x7fdf5c119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:36:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.095+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 shutdown_connections 2024-05-20T17:36:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:36:46.095+0000 7fdf62b8f640 1 -- 172.21.15.135:0/3256867348 wait complete. 2024-05-20T17:36:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:47 smithi135 ceph-mon[32027]: pgmap v106: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 883 op/s 2024-05-20T17:36:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:47 smithi160 ceph-mon[36261]: pgmap v106: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 883 op/s 2024-05-20T17:36:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:47 smithi172 ceph-mon[36511]: pgmap v106: 97 pgs: 97 active+clean; 458 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 883 op/s 2024-05-20T17:36:49.632 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:49 smithi172 ceph-mon[36511]: pgmap v107: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 879 op/s 2024-05-20T17:36:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:49 smithi135 ceph-mon[32027]: pgmap v107: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 879 op/s 2024-05-20T17:36:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:49 smithi160 ceph-mon[36261]: pgmap v107: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 879 op/s 2024-05-20T17:36:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:51 smithi135 ceph-mon[32027]: pgmap v108: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 665 op/s 2024-05-20T17:36:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:51 smithi160 ceph-mon[36261]: pgmap v108: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 665 op/s 2024-05-20T17:36:51.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:51 smithi172 ceph-mon[36511]: pgmap v108: 97 pgs: 97 active+clean; 469 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 665 op/s 2024-05-20T17:36:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:53 smithi135 ceph-mon[32027]: pgmap v109: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 749 op/s 2024-05-20T17:36:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:53 smithi160 ceph-mon[36261]: pgmap v109: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 749 op/s 2024-05-20T17:36:53.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:53 smithi172 ceph-mon[36511]: pgmap v109: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 749 op/s 2024-05-20T17:36:55.609 INFO:tasks.workunit.client.0.smithi135.stdout: 180 1851241 1191 1284133 1357 623535 1545 2024-05-20T17:36:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:55 smithi135 ceph-mon[32027]: pgmap v110: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 594 op/s 2024-05-20T17:36:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:55 smithi160 ceph-mon[36261]: pgmap v110: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 594 op/s 2024-05-20T17:36:55.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:55 smithi172 ceph-mon[36511]: pgmap v110: 97 pgs: 97 active+clean; 456 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 594 op/s 2024-05-20T17:36:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:57 smithi135 ceph-mon[32027]: pgmap v111: 97 pgs: 97 active+clean; 467 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 651 op/s 2024-05-20T17:36:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:57 smithi160 ceph-mon[36261]: pgmap v111: 97 pgs: 97 active+clean; 467 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 651 op/s 2024-05-20T17:36:57.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:57 smithi172 ceph-mon[36511]: pgmap v111: 97 pgs: 97 active+clean; 467 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 651 op/s 2024-05-20T17:36:59.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:36:59 smithi135 ceph-mon[32027]: pgmap v112: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 402 op/s 2024-05-20T17:36:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:36:59 smithi160 ceph-mon[36261]: pgmap v112: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 402 op/s 2024-05-20T17:36:59.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:36:59 smithi172 ceph-mon[36511]: pgmap v112: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 402 op/s 2024-05-20T17:37:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.734+0000 7f0670d16640 1 -- 172.21.15.135:0/3035648845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 msgr2=0x7f066c10dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.734+0000 7f0670d16640 1 --2- 172.21.15.135:0/3035648845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c10dce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0664009ca0 tx=0x7f066402a8d0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.740+0000 7f0670d16640 1 -- 172.21.15.135:0/3035648845 shutdown_connections 2024-05-20T17:37:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.740+0000 7f0670d16640 1 --2- 172.21.15.135:0/3035648845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c079e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.740+0000 7f0670d16640 1 --2- 172.21.15.135:0/3035648845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c10dce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.740+0000 7f0670d16640 1 --2- 172.21.15.135:0/3035648845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.740+0000 7f0670d16640 1 -- 172.21.15.135:0/3035648845 >> 172.21.15.135:0/3035648845 conn(0x7f066c06d780 msgr2=0x7f066c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.752+0000 7f0670d16640 1 -- 172.21.15.135:0/3035648845 shutdown_connections 2024-05-20T17:37:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.752+0000 7f0670d16640 1 -- 172.21.15.135:0/3035648845 wait complete. 2024-05-20T17:37:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 Processor -- start 2024-05-20T17:37:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 -- start start 2024-05-20T17:37:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c084210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c07f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f066c07d460 con 0x7f066c10e370 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f066c07d2e0 con 0x7f066c109320 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.754+0000 7f0670d16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f066c07d5e0 con 0x7f066c10d8b0 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f066a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c084210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46814/0 (socket says 172.21.15.135:46814) 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 -- 172.21.15.135:0/709506088 learned_addr learned my addr 172.21.15.135:0/709506088 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f066a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c084210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:48434/0 (socket says 172.21.15.135:48434) 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f066ad9d640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c07f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 -- 172.21.15.135:0/709506088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 msgr2=0x7f066c084210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c084210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 -- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 msgr2=0x7f066c07f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c07f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f0669d9b640 1 -- 172.21.15.135:0/709506088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c07fb90 con 0x7f066c10d8b0 2024-05-20T17:37:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.755+0000 7f066ad9d640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c07f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:37:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.756+0000 7f0669d9b640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f066402aec0 tx=0x7f0664031690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.761+0000 7f065b7fe640 1 -- 172.21.15.135:0/709506088 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664031980 con 0x7f066c10d8b0 2024-05-20T17:37:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.761+0000 7f065b7fe640 1 -- 172.21.15.135:0/709506088 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0664004520 con 0x7f066c10d8b0 2024-05-20T17:37:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.761+0000 7f065b7fe640 1 -- 172.21.15.135:0/709506088 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066402fda0 con 0x7f066c10d8b0 2024-05-20T17:37:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.761+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c07fe20 con 0x7f066c10d8b0 2024-05-20T17:37:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.761+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c138cb0 con 0x7f066c10d8b0 2024-05-20T17:37:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.771+0000 7f0677bb6740 1 Processor -- start 2024-05-20T17:37:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.772+0000 7f0677bb6740 1 -- start start 2024-05-20T17:37:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.772+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e48080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.772+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e48b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f066ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e48080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f066ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e48080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46826/0 (socket says 172.21.15.135:46826) 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f066ad9d640 1 -- 172.21.15.135:0/2151694983 learned_addr learned my addr 172.21.15.135:0/2151694983 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f066a59c640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f0669d9b640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.773+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc63dad340 con 0x55fc63a884d0 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fc63d55290 con 0x55fc63a802f0 2024-05-20T17:37:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc63da9300 con 0x55fc63aa91b0 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f065b7fe640 1 -- 172.21.15.135:0/709506088 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f06640305d0 con 0x7f066c10d8b0 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f066a59c640 1 -- 172.21.15.135:0/2151694983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 msgr2=0x55fc63e48080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f066a59c640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e48080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f066a59c640 1 -- 172.21.15.135:0/2151694983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 msgr2=0x55fc63e48b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f066a59c640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e48b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f066a59c640 1 -- 172.21.15.135:0/2151694983 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc63d798e0 con 0x55fc63a802f0 2024-05-20T17:37:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.774+0000 7f0669d9b640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e48b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.775+0000 7f066a59c640 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e485c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0660009980 tx=0x7f0660009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb80ca7dbadc2202 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.776+0000 7f065b7fe640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 0x7f06540a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.777+0000 7f066ad9d640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 0x7f06540a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.777+0000 7f0658ff9640 1 -- 172.21.15.135:0/2151694983 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660017070 con 0x55fc63a802f0 2024-05-20T17:37:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.778+0000 7f0658ff9640 1 -- 172.21.15.135:0/2151694983 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0660013470 con 0x55fc63a802f0 2024-05-20T17:37:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.778+0000 7f0658ff9640 1 -- 172.21.15.135:0/2151694983 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660012630 con 0x55fc63a802f0 2024-05-20T17:37:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.778+0000 7f066ad9d640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 0x7f06540a5420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f065c006fd0 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.780+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 msgr2=0x55fc63e485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.780+0000 7f0677bb6740 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e485c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0660009980 tx=0x7f0660009e40 comp rx=0 tx=0).stop 2024-05-20T17:37:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.780+0000 7f065b7fe640 1 -- 172.21.15.135:0/709506088 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06640f1630 con 0x7f066c10d8b0 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 shutdown_connections 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e48b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e485c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 --2- 172.21.15.135:0/2151694983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e48080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 >> 172.21.15.135:0/2151694983 conn(0x55fc63a9d300 msgr2=0x55fc63e44830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 shutdown_connections 2024-05-20T17:37:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.787+0000 7f0677bb6740 1 -- 172.21.15.135:0/2151694983 wait complete. 2024-05-20T17:37:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.788+0000 7f0677bb6740 1 -- start start 2024-05-20T17:37:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.788+0000 7f0677bb6740 1 Processor -- start 2024-05-20T17:37:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.788+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a884d0 0x55fc63e54720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 0x55fc63e52660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc63e551b0 con 0x55fc63aa91b0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fc63d68790 con 0x55fc63a884d0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc63e55330 con 0x55fc63a802f0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0677bb6740 10 client.0 _ll_register_callbacks cb 0x55fc63da3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46840/0 (socket says 172.21.15.135:46840) 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 -- 172.21.15.135:0/728208100 learned_addr learned my addr 172.21.15.135:0/728208100 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f0669d9b640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a884d0 0x55fc63e54720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066ad9d640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 0x55fc63e52660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 -- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a884d0 msgr2=0x55fc63e54720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a884d0 0x55fc63e54720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 -- 172.21.15.135:0/728208100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 msgr2=0x55fc63e52660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 0x55fc63e52660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.789+0000 7f066a59c640 1 -- 172.21.15.135:0/728208100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc63ac1210 con 0x55fc63a802f0 2024-05-20T17:37:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.790+0000 7f066ad9d640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 0x55fc63e52660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:37:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.790+0000 7f066a59c640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0660019000 tx=0x7f0660013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aaf691ef97f9cfc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.790+0000 7f0651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:37:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.793+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660017050 con 0x55fc63a802f0 2024-05-20T17:37:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.793+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f066001c650 con 0x55fc63a802f0 2024-05-20T17:37:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.793+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0660013470 con 0x55fc63a802f0 2024-05-20T17:37:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.797+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06600095a0 con 0x55fc63a802f0 2024-05-20T17:37:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.797+0000 7f0677bb6740 10 client.25861 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.797+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fc63b8d620 con 0x55fc63a802f0 2024-05-20T17:37:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.798+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0660013470 con 0x55fc63a802f0 2024-05-20T17:37:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.799+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f066002f940 con 0x55fc63a802f0 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.799+0000 7f0677bb6740 10 client.25861 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.799+0000 7f0677bb6740 10 client.25861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.799+0000 7f0677bb6740 20 client.25861 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.799+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a67d80 0x55fc63e647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.800+0000 7f0677bb6740 4 client.25861 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.800+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc63dbaa70 con 0x55fc63a67d80 2024-05-20T17:37:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.800+0000 7f0669d9b640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a67d80 0x55fc63e647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.800+0000 7f0651ffb640 10 client.25861 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.800+0000 7f0669d9b640 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a67d80 0x55fc63e647a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef809cd80b9be91 server_cookie=b64f5cbf4f6be4f in_seq=0 out_seq=0 2024-05-20T17:37:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.801+0000 7f0651ffb640 1 -- 172.21.15.135:0/728208100 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc63dbaa70 con 0x55fc63a67d80 2024-05-20T17:37:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.801+0000 7f0651ffb640 10 client.25861 handle_command_reply: tid=0 2024-05-20T17:37:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.801+0000 7f0677bb6740 1 client.25861 shutdown 2024-05-20T17:37:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.804+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 msgr2=0x55fc63e541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.804+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0660019000 tx=0x7f0660013830 comp rx=0 tx=0).stop 2024-05-20T17:37:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 shutdown_connections 2024-05-20T17:37:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a67d80 0x55fc63e647a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63aa91b0 0x55fc63e52660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a884d0 0x55fc63e54720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 --2- 172.21.15.135:0/728208100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a802f0 0x55fc63e541e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0651ffb640 0 client.25861 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 >> 172.21.15.135:0/728208100 conn(0x55fc63a9d300 msgr2=0x55fc63e49da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 shutdown_connections 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 1 -- 172.21.15.135:0/728208100 wait complete. 2024-05-20T17:37:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.805+0000 7f0677bb6740 20 client.25861 trim_cache size 0 max 16384 2024-05-20T17:37:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 Processor -- start 2024-05-20T17:37:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 -- start start 2024-05-20T17:37:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e4a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e4bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d9940 con 0x55fc63a884d0 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d7210 con 0x55fc63a802f0 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0669d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e4bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0677bb6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d5110 con 0x55fc63aa91b0 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46852/0 (socket says 172.21.15.135:46852) 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 -- 172.21.15.135:0/3251982450 learned_addr learned my addr 172.21.15.135:0/3251982450 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.826+0000 7f0669d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e4bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37932/0 (socket says 172.21.15.135:37932) 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 -- 172.21.15.135:0/3251982450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 msgr2=0x55fc63e4a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e4a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 -- 172.21.15.135:0/3251982450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 msgr2=0x55fc63e4bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e4bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 -- 172.21.15.135:0/3251982450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc63e4def0 con 0x55fc63aa91b0 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.827+0000 7f066ad9d640 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f065c010a80 tx=0x7f065c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df4cb724ce0c3c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.828+0000 7f0653fff640 1 -- 172.21.15.135:0/3251982450 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c01c040 con 0x55fc63aa91b0 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.828+0000 7f0653fff640 1 -- 172.21.15.135:0/3251982450 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f065c026070 con 0x55fc63aa91b0 2024-05-20T17:37:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.828+0000 7f0653fff640 1 -- 172.21.15.135:0/3251982450 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c021410 con 0x55fc63aa91b0 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- 172.21.15.135:0/3251982450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 msgr2=0x55fc63e4c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f065c010a80 tx=0x7f065c013000 comp rx=0 tx=0).stop 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- 172.21.15.135:0/3251982450 shutdown_connections 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63aa91b0 0x55fc63e4c270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a884d0 0x55fc63e4bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3251982450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63a802f0 0x55fc63e4a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- 172.21.15.135:0/3251982450 >> 172.21.15.135:0/3251982450 conn(0x55fc63a9d300 msgr2=0x55fc63e49d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- 172.21.15.135:0/3251982450 shutdown_connections 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- 172.21.15.135:0/3251982450 wait complete. 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 -- start start 2024-05-20T17:37:00.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.829+0000 7f0677bb6740 1 Processor -- start 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 0x55fc63e5ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f066a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 0x55fc63e5ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 0x55fc63e5f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f066a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 0x55fc63e5ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37944/0 (socket says 172.21.15.135:37944) 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f066a59c640 1 -- 172.21.15.135:0/3469488066 learned_addr learned my addr 172.21.15.135:0/3469488066 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63aa91b0 0x55fc63e5c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d56d0 con 0x55fc63a802f0 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d6b40 con 0x55fc63aa91b0 2024-05-20T17:37:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1d5da0 con 0x55fc63a884d0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0677bb6740 10 client.0 _ll_register_callbacks cb 0x7f0664003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f066ad9d640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63aa91b0 0x55fc63e5c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.830+0000 7f0669d9b640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 0x55fc63e5f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 -- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63aa91b0 msgr2=0x55fc63e5c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63aa91b0 0x55fc63e5c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 -- 172.21.15.135:0/3469488066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 msgr2=0x55fc63e5ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 0x55fc63e5ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc63e5c900 con 0x55fc63a884d0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0669d9b640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 0x55fc63e5f200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06640eee30 tx=0x7f066402a8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6f9a63a847a408 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:37:00.837 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.831+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640098b0 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06640046d0 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f065c026070 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06640bdc00 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 10 client.25867 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fc63ecc460 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f065c026070 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f06640ef030 con 0x55fc63a884d0 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 10 client.25867 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 10 client.25867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 20 client.25867 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a3d1c0 0x55fc63ecec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:00.838 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 4 client.25867 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:37:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.832+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc63db4dc0 con 0x55fc63a3d1c0 2024-05-20T17:37:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.833+0000 7f066a59c640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a3d1c0 0x55fc63ecec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.833+0000 7f0651ffb640 10 client.25867 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:00.833+0000 7f066a59c640 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a3d1c0 0x55fc63ecec80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95078344ec5aa55b server_cookie=ab8552674db743e6 in_seq=0 out_seq=0 2024-05-20T17:37:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:01 smithi135 ceph-mon[32027]: pgmap v113: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 159 op/s 2024-05-20T17:37:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:01 smithi160 ceph-mon[36261]: pgmap v113: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 159 op/s 2024-05-20T17:37:01.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:01 smithi172 ceph-mon[36511]: pgmap v113: 97 pgs: 97 active+clean; 469 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 159 op/s 2024-05-20T17:37:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.281+0000 7f0651ffb640 1 -- 172.21.15.135:0/3469488066 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc63db4dc0 con 0x55fc63a3d1c0 2024-05-20T17:37:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.281+0000 7f0651ffb640 10 client.25867 handle_command_reply: tid=0 2024-05-20T17:37:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.281+0000 7f0677bb6740 1 client.25867 shutdown 2024-05-20T17:37:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.282+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 msgr2=0x55fc63e5f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.282+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 0x55fc63e5f200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06640eee30 tx=0x7f066402a8d0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 shutdown_connections 2024-05-20T17:37:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55fc63a3d1c0 0x55fc63ecec80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fc63aa91b0 0x55fc63e5c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc63a884d0 0x55fc63e5f200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 --2- 172.21.15.135:0/3469488066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc63a802f0 0x55fc63e5ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 >> 172.21.15.135:0/3469488066 conn(0x55fc63a9d300 msgr2=0x55fc63e47e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0651ffb640 0 client.25867 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 shutdown_connections 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.284+0000 7f0677bb6740 1 -- 172.21.15.135:0/3469488066 wait complete. 2024-05-20T17:37:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.285+0000 7f0677bb6740 20 client.25867 trim_cache size 0 max 16384 2024-05-20T17:37:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:37:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:37:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:37:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:37:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.322+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 msgr2=0x7f06540a5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.322+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 0x7f06540a5420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f065c006fd0 tx=0x7f065c008040 comp rx=0 tx=0).stop 2024-05-20T17:37:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.322+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 msgr2=0x7f066c084750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.322+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f066402aec0 tx=0x7f0664031690 comp rx=0 tx=0).stop 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 shutdown_connections 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06540a2f10 0x7f06540a5420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f066c10e370 0x7f066c07f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f066c10d8b0 0x7f066c084750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 --2- 172.21.15.135:0/709506088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f066c109320 0x7f066c084210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.323+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 >> 172.21.15.135:0/709506088 conn(0x7f066c06d780 msgr2=0x7f066c10b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.339+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 shutdown_connections 2024-05-20T17:37:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:02.339+0000 7f0670d16640 1 -- 172.21.15.135:0/709506088 wait complete. 2024-05-20T17:37:03.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:03 smithi135 ceph-mon[32027]: pgmap v114: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-05-20T17:37:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:03 smithi160 ceph-mon[36261]: pgmap v114: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-05-20T17:37:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:03 smithi172 ceph-mon[36511]: pgmap v114: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-05-20T17:37:05.612 INFO:tasks.workunit.client.0.smithi135.stdout: 196 2116817 833 1471271 890 775628 1928 2024-05-20T17:37:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:05 smithi135 ceph-mon[32027]: pgmap v115: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 146 op/s 2024-05-20T17:37:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:05 smithi160 ceph-mon[36261]: pgmap v115: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 146 op/s 2024-05-20T17:37:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:05 smithi172 ceph-mon[36511]: pgmap v115: 97 pgs: 97 active+clean; 485 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 146 op/s 2024-05-20T17:37:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:07 smithi135 ceph-mon[32027]: pgmap v116: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-05-20T17:37:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:07 smithi160 ceph-mon[36261]: pgmap v116: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-05-20T17:37:07.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:07 smithi172 ceph-mon[36511]: pgmap v116: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-05-20T17:37:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:09 smithi135 ceph-mon[32027]: pgmap v117: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-05-20T17:37:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:09 smithi160 ceph-mon[36261]: pgmap v117: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-05-20T17:37:09.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:09 smithi172 ceph-mon[36511]: pgmap v117: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.37k op/s 2024-05-20T17:37:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:11 smithi135 ceph-mon[32027]: pgmap v118: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.35k op/s 2024-05-20T17:37:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:11 smithi160 ceph-mon[36261]: pgmap v118: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.35k op/s 2024-05-20T17:37:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:11 smithi172 ceph-mon[36511]: pgmap v118: 97 pgs: 97 active+clean; 611 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.35k op/s 2024-05-20T17:37:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:13 smithi135 ceph-mon[32027]: pgmap v119: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-20T17:37:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:13 smithi160 ceph-mon[36261]: pgmap v119: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-20T17:37:13.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:13 smithi172 ceph-mon[36511]: pgmap v119: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- 172.21.15.135:0/4013217625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc106ce0 msgr2=0x7f46dc10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/4013217625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc106ce0 0x7f46dc10e510 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009ca0 tx=0x7f46d402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- 172.21.15.135:0/4013217625 shutdown_connections 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/4013217625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc106ce0 0x7f46dc10e510 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/4013217625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/4013217625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1023a0 0x7f46dc1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- 172.21.15.135:0/4013217625 >> 172.21.15.135:0/4013217625 conn(0x7f46dc076860 msgr2=0x7f46dc076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- 172.21.15.135:0/4013217625 shutdown_connections 2024-05-20T17:37:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- 172.21.15.135:0/4013217625 wait complete. 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 Processor -- start 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.601+0000 7f46e3cc3640 1 -- start start 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc106ce0 0x7f46dc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111d50 con 0x7f46dc1023a0 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111bd0 con 0x7f46dc106260 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111ed0 con 0x7f46dc106ce0 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48762/0 (socket says 172.21.15.135:48762) 2024-05-20T17:37:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 -- 172.21.15.135:0/617774739 learned_addr learned my addr 172.21.15.135:0/617774739 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e125e640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e2260640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc106ce0 0x7f46dc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 -- 172.21.15.135:0/617774739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc106ce0 msgr2=0x7f46dc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc106ce0 0x7f46dc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 -- 172.21.15.135:0/617774739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 msgr2=0x7f46dc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 -- 172.21.15.135:0/617774739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc19d490 con 0x7f46dc1023a0 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e125e640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009830 tx=0x7f46d8009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46d2ffd640 1 -- 172.21.15.135:0/617774739 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8005020 con 0x7f46dc1023a0 2024-05-20T17:37:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc19d780 con 0x7f46dc1023a0 2024-05-20T17:37:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46d2ffd640 1 -- 172.21.15.135:0/617774739 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46d80047a0 con 0x7f46dc1023a0 2024-05-20T17:37:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.602+0000 7f46d2ffd640 1 -- 172.21.15.135:0/617774739 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007bc0 con 0x7f46dc1023a0 2024-05-20T17:37:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.603+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc100bd0 con 0x7f46dc1023a0 2024-05-20T17:37:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.605+0000 7f46d2ffd640 1 -- 172.21.15.135:0/617774739 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f46d8018420 con 0x7f46dc1023a0 2024-05-20T17:37:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 Processor -- start 2024-05-20T17:37:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 -- start start 2024-05-20T17:37:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea46e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea46eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562aea3d3340 con 0x562aea0a62f0 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562aea37b290 con 0x562aea0cf1b0 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46eab66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562aea3cf300 con 0x562aea0ae4d0 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46d2ffd640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 0x7f46c80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e2260640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e2260640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:38722/0 (socket says 172.21.15.135:38722) 2024-05-20T17:37:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e2260640 1 -- 172.21.15.135:0/4229519518 learned_addr learned my addr 172.21.15.135:0/4229519518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea46e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e2260640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 0x7f46c80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.606+0000 7f46e125e640 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea46eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46d2ffd640 1 -- 172.21.15.135:0/617774739 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f46d80d0890 con 0x7f46dc1023a0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 -- 172.21.15.135:0/4229519518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 msgr2=0x562aea46eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea46eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 -- 172.21.15.135:0/4229519518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 msgr2=0x562aea46e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea46e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 -- 172.21.15.135:0/4229519518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aea39f8e0 con 0x562aea0cf1b0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e125e640 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea46eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 0x7f46c80a5280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009ca0 tx=0x7f46d4036000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46e2260640 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46d4004af0 tx=0x7f46d4031f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f595f307b8b9265c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46c7fff640 1 -- 172.21.15.135:0/4229519518 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4055070 con 0x562aea0cf1b0 2024-05-20T17:37:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46c7fff640 1 -- 172.21.15.135:0/4229519518 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46d4036070 con 0x562aea0cf1b0 2024-05-20T17:37:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.607+0000 7f46c7fff640 1 -- 172.21.15.135:0/4229519518 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4049400 con 0x562aea0cf1b0 2024-05-20T17:37:15.614 INFO:tasks.workunit.client.0.smithi135.stdout: 198 198669 22 136078 27 75048 238 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 -- 172.21.15.135:0/4229519518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 msgr2=0x562aea46e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46d4004af0 tx=0x7f46d4031f40 comp rx=0 tx=0).stop 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 -- 172.21.15.135:0/4229519518 shutdown_connections 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea46eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea46e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 --2- 172.21.15.135:0/4229519518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0cf1b0 0x562aea46e080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 -- 172.21.15.135:0/4229519518 >> 172.21.15.135:0/4229519518 conn(0x562aea0c3300 msgr2=0x562aea46a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 -- 172.21.15.135:0/4229519518 shutdown_connections 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.608+0000 7f46eab66740 1 -- 172.21.15.135:0/4229519518 wait complete. 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 -- start start 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 Processor -- start 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 0x562aea47a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea47a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562aea47afd0 con 0x562aea0cf1b0 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562aea38e790 con 0x562aea0a62f0 2024-05-20T17:37:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562aea47b150 con 0x562aea0ae4d0 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46eab66740 10 client.0 _ll_register_callbacks cb 0x562aea3c9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46e2260640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.609+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 0x562aea47a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48772/0 (socket says 172.21.15.135:48772) 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 -- 172.21.15.135:0/1706158167 learned_addr learned my addr 172.21.15.135:0/1706158167 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e125e640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea47a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 -- 172.21.15.135:0/1706158167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 msgr2=0x562aea47a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea47a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 -- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 msgr2=0x562aea47a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 0x562aea47a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 -- 172.21.15.135:0/1706158167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aea0e7210 con 0x562aea0cf1b0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 0x562aea47a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46e2260640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d4053040 tx=0x7f46d4004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30365580bd762d65 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4060060 con 0x562aea0cf1b0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f46d4030d80 con 0x562aea0cf1b0 2024-05-20T17:37:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46d4036070 con 0x562aea0cf1b0 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46d4055070 con 0x562aea0cf1b0 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46eab66740 10 client.16353 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562aea1b3620 con 0x562aea0cf1b0 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.610+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46d4036070 con 0x562aea0cf1b0 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f46d4005500 con 0x562aea0cf1b0 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 10 client.16353 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 20 client.16353 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea08dd80 0x562aea48a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 4 client.16353 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:37:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aea3e0a70 con 0x562aea08dd80 2024-05-20T17:37:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea08dd80 0x562aea48a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46c57fa640 10 client.16353 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.611+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea08dd80 0x562aea48a6f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b78143ba339d3 server_cookie=4379debbde35a082 in_seq=0 out_seq=0 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46c57fa640 1 -- 172.21.15.135:0/1706158167 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562aea3e0a70 con 0x562aea08dd80 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46c57fa640 10 client.16353 handle_command_reply: tid=0 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 client.16353 shutdown 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 msgr2=0x562aea4786a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d4053040 tx=0x7f46d4004a80 comp rx=0 tx=0).stop 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 shutdown_connections 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea08dd80 0x562aea48a6f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0cf1b0 0x562aea4786a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0ae4d0 0x562aea47a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46c57fa640 0 client.16353 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 --2- 172.21.15.135:0/1706158167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0a62f0 0x562aea47a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.623+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 >> 172.21.15.135:0/1706158167 conn(0x562aea0c3300 msgr2=0x562aea46de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.624+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 shutdown_connections 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.624+0000 7f46eab66740 1 -- 172.21.15.135:0/1706158167 wait complete. 2024-05-20T17:37:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.624+0000 7f46eab66740 20 client.16353 trim_cache size 0 max 16384 2024-05-20T17:37:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 Processor -- start 2024-05-20T17:37:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 -- start start 2024-05-20T17:37:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea08dd80 0x562aea48fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4803e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1af140 con 0x562aea0a62f0 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1aca10 con 0x562aea0ae4d0 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46eab66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1aa860 con 0x562aea08dd80 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48784/0 (socket says 172.21.15.135:48784) 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 -- 172.21.15.135:0/4156817710 learned_addr learned my addr 172.21.15.135:0/4156817710 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea08dd80 0x562aea48fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 -- 172.21.15.135:0/4156817710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea08dd80 msgr2=0x562aea48fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea08dd80 0x562aea48fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 -- 172.21.15.135:0/4156817710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 msgr2=0x562aea4803e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4803e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 -- 172.21.15.135:0/4156817710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aea46f430 con 0x562aea0a62f0 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.640+0000 7f46e125e640 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0058b0 tx=0x7f46cc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9056c1541e765c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.641+0000 7f46c77fe640 1 -- 172.21.15.135:0/4156817710 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc021070 con 0x562aea0a62f0 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.641+0000 7f46c77fe640 1 -- 172.21.15.135:0/4156817710 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46cc004310 con 0x562aea0a62f0 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.641+0000 7f46c77fe640 1 -- 172.21.15.135:0/4156817710 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc01c9a0 con 0x562aea0a62f0 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.641+0000 7f46eab66740 1 -- 172.21.15.135:0/4156817710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 msgr2=0x562aea490350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.641+0000 7f46eab66740 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0058b0 tx=0x7f46cc010800 comp rx=0 tx=0).stop 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 -- 172.21.15.135:0/4156817710 shutdown_connections 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4803e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea0a62f0 0x562aea490350 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 --2- 172.21.15.135:0/4156817710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea08dd80 0x562aea48fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 -- 172.21.15.135:0/4156817710 >> 172.21.15.135:0/4156817710 conn(0x562aea0c3300 msgr2=0x562aea476f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 -- 172.21.15.135:0/4156817710 shutdown_connections 2024-05-20T17:37:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 -- 172.21.15.135:0/4156817710 wait complete. 2024-05-20T17:37:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 -- start start 2024-05-20T17:37:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.642+0000 7f46eab66740 1 Processor -- start 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0a62f0 0x562aea47fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1aaed0 con 0x562aea08dd80 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1ac340 con 0x562aea0ae4d0 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1ab5a0 con 0x562aea0a62f0 2024-05-20T17:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 10 client.0 _ll_register_callbacks cb 0x7f46d4053070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48798/0 (socket says 172.21.15.135:48798) 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 -- 172.21.15.135:0/3873532719 learned_addr learned my addr 172.21.15.135:0/3873532719 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e125e640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0a62f0 0x562aea47fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e2260640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 -- 172.21.15.135:0/3873532719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0a62f0 msgr2=0x562aea47fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0a62f0 0x562aea47fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 -- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 msgr2=0x562aea4f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 -- 172.21.15.135:0/3873532719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aea4f5320 con 0x562aea08dd80 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46e1a5f640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007590 tx=0x7f46d80990a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4d7cbad33b7978 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8099470 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f46d8004950 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46cc004310 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46d8099610 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 10 client.16359 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.643+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562aea4f64f0 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46cc004310 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f46d809bd50 con 0x562aea08dd80 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 10 client.16359 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 20 client.16359 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea0cf1b0 0x562aea4f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 4 client.16359 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aea3dadc0 con 0x562aea0cf1b0 2024-05-20T17:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46e125e640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea0cf1b0 0x562aea4f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.644+0000 7f46c57fa640 10 client.16359 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:15.645+0000 7f46e125e640 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea0cf1b0 0x562aea4f8cc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93a0865bd156aac server_cookie=7e55067006e137da in_seq=0 out_seq=0 2024-05-20T17:37:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:15 smithi135 ceph-mon[32027]: pgmap v120: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 22 MiB/s wr, 1.80k op/s 2024-05-20T17:37:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:15 smithi160 ceph-mon[36261]: pgmap v120: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 22 MiB/s wr, 1.80k op/s 2024-05-20T17:37:15.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:15 smithi172 ceph-mon[36511]: pgmap v120: 97 pgs: 97 active+clean; 719 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 22 MiB/s wr, 1.80k op/s 2024-05-20T17:37:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.998+0000 7f46c57fa640 1 -- 172.21.15.135:0/3873532719 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aea3dadc0 con 0x562aea0cf1b0 2024-05-20T17:37:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.998+0000 7f46c57fa640 10 client.16359 handle_command_reply: tid=0 2024-05-20T17:37:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.998+0000 7f46eab66740 1 client.16359 shutdown 2024-05-20T17:37:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 msgr2=0x562aea47f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007590 tx=0x7f46d80990a0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 shutdown_connections 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x562aea0cf1b0 0x562aea4f8cc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aea0ae4d0 0x562aea4f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aea0a62f0 0x562aea47fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 --2- 172.21.15.135:0/3873532719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aea08dd80 0x562aea47f700 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 >> 172.21.15.135:0/3873532719 conn(0x562aea0c3300 msgr2=0x562aea46de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46c57fa640 0 client.16359 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 shutdown_connections 2024-05-20T17:37:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 1 -- 172.21.15.135:0/3873532719 wait complete. 2024-05-20T17:37:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:16.999+0000 7f46eab66740 20 client.16359 trim_cache size 0 max 16384 2024-05-20T17:37:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:37:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:37:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:37:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.000+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 msgr2=0x7f46c80a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.000+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 0x7f46c80a5280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009ca0 tx=0x7f46d4036000 comp rx=0 tx=0).stop 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.000+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 msgr2=0x7f46dc198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.000+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009830 tx=0x7f46d8009cf0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.000+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 shutdown_connections 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46c80a2d70 0x7f46c80a5280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc106ce0 0x7f46dc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106260 0x7f46dc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 --2- 172.21.15.135:0/617774739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46dc1023a0 0x7f46dc198630 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 >> 172.21.15.135:0/617774739 conn(0x7f46dc076860 msgr2=0x7f46dc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 shutdown_connections 2024-05-20T17:37:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:17.001+0000 7f46e3cc3640 1 -- 172.21.15.135:0/617774739 wait complete. 2024-05-20T17:37:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:17 smithi135 ceph-mon[32027]: pgmap v121: 97 pgs: 97 active+clean; 736 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 24 MiB/s wr, 1.85k op/s 2024-05-20T17:37:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:17 smithi160 ceph-mon[36261]: pgmap v121: 97 pgs: 97 active+clean; 736 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 24 MiB/s wr, 1.85k op/s 2024-05-20T17:37:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:17 smithi172 ceph-mon[36511]: pgmap v121: 97 pgs: 97 active+clean; 736 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 24 MiB/s wr, 1.85k op/s 2024-05-20T17:37:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:19 smithi135 ceph-mon[32027]: pgmap v122: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-05-20T17:37:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:19 smithi160 ceph-mon[36261]: pgmap v122: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-05-20T17:37:19.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:19 smithi172 ceph-mon[36511]: pgmap v122: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-05-20T17:37:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:21 smithi135 ceph-mon[32027]: pgmap v123: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 595 op/s 2024-05-20T17:37:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:21 smithi160 ceph-mon[36261]: pgmap v123: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 595 op/s 2024-05-20T17:37:21.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:21 smithi172 ceph-mon[36511]: pgmap v123: 97 pgs: 97 active+clean; 740 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 595 op/s 2024-05-20T17:37:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:23 smithi135 ceph-mon[32027]: pgmap v124: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 14 MiB/s wr, 869 op/s 2024-05-20T17:37:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:23 smithi160 ceph-mon[36261]: pgmap v124: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 14 MiB/s wr, 869 op/s 2024-05-20T17:37:23.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:23 smithi172 ceph-mon[36511]: pgmap v124: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 14 MiB/s wr, 869 op/s 2024-05-20T17:37:25.609 INFO:tasks.workunit.client.0.smithi135.stdout: 215 2045947 920 1431901 958 811913 2408 2024-05-20T17:37:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:25 smithi135 ceph-mon[32027]: pgmap v125: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:37:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:25 smithi160 ceph-mon[36261]: pgmap v125: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:37:25.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:25 smithi172 ceph-mon[36511]: pgmap v125: 97 pgs: 97 active+clean; 724 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:37:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:27 smithi135 ceph-mon[32027]: pgmap v126: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 407 op/s 2024-05-20T17:37:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:27 smithi160 ceph-mon[36261]: pgmap v126: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 407 op/s 2024-05-20T17:37:27.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:27 smithi172 ceph-mon[36511]: pgmap v126: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 407 op/s 2024-05-20T17:37:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:29 smithi135 ceph-mon[32027]: pgmap v127: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-20T17:37:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:29 smithi160 ceph-mon[36261]: pgmap v127: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-20T17:37:29.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:29 smithi172 ceph-mon[36511]: pgmap v127: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-20T17:37:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 -- 172.21.15.135:0/4268400316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107a20 msgr2=0x7fac541015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 --2- 172.21.15.135:0/4268400316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107a20 0x7fac541015d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fac50009900 tx=0x7fac5002a410 comp rx=0 tx=0).stop 2024-05-20T17:37:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 -- 172.21.15.135:0/4268400316 shutdown_connections 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 --2- 172.21.15.135:0/4268400316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 0x7fac5410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 --2- 172.21.15.135:0/4268400316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107ec0 0x7fac54101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 --2- 172.21.15.135:0/4268400316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107a20 0x7fac541015d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 -- 172.21.15.135:0/4268400316 >> 172.21.15.135:0/4268400316 conn(0x7fac54077100 msgr2=0x7fac54077540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 -- 172.21.15.135:0/4268400316 shutdown_connections 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.279+0000 7fac5c673640 1 -- 172.21.15.135:0/4268400316 wait complete. 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 Processor -- start 2024-05-20T17:37:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 -- start start 2024-05-20T17:37:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 0x7fac54198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107a20 0x7fac54198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac54111d70 con 0x7fac54107ec0 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac54111bf0 con 0x7fac54102180 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.280+0000 7fac5c673640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac54111ef0 con 0x7fac54107a20 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107a20 0x7fac54198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55780/0 (socket says 172.21.15.135:55780) 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 -- 172.21.15.135:0/1491388335 learned_addr learned my addr 172.21.15.135:0/1491388335 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5a40f640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 0x7fac54198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 -- 172.21.15.135:0/1491388335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107a20 msgr2=0x7fac54198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107a20 0x7fac54198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 -- 172.21.15.135:0/1491388335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 msgr2=0x7fac54198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 0x7fac54198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 -- 172.21.15.135:0/1491388335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5419d570 con 0x7fac54107ec0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5ac10640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00eb10 tx=0x7fac4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac4b7fe640 1 -- 172.21.15.135:0/1491388335 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c004b20 con 0x7fac54107ec0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5419d860 con 0x7fac54107ec0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac4b7fe640 1 -- 172.21.15.135:0/1491388335 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c004cc0 con 0x7fac54107ec0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac4b7fe640 1 -- 172.21.15.135:0/1491388335 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c010760 con 0x7fac54107ec0 2024-05-20T17:37:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.281+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac541a51e0 con 0x7fac54107ec0 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.284+0000 7fac635f7740 1 Processor -- start 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.284+0000 7fac4b7fe640 1 -- 172.21.15.135:0/1491388335 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fac4c010900 con 0x7fac54107ec0 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.284+0000 7fac635f7740 1 -- start start 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x5652627805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x565262780b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5652626e5340 con 0x5652623b82f0 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56526268d290 con 0x5652623c04d0 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac635f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5652626e1300 con 0x5652623e11b0 2024-05-20T17:37:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x5652627805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:38532/0 (socket says 172.21.15.135:38532) 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 -- 172.21.15.135:0/661135298 learned_addr learned my addr 172.21.15.135:0/661135298 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x565262780b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac4b7fe640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 0x7fac400a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 -- 172.21.15.135:0/661135298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 msgr2=0x565262780b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x565262780b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 -- 172.21.15.135:0/661135298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 msgr2=0x5652627805c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.285+0000 7fac59c0e640 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x5652627805c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac59c0e640 1 -- 172.21.15.135:0/661135298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652626b18e0 con 0x5652623e11b0 2024-05-20T17:37:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac5a40f640 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x5652627805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac5ac10640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 0x7fac400a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac4b7fe640 1 -- 172.21.15.135:0/1491388335 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fac4c0cfb00 con 0x7fac54107ec0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac59c0e640 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac440058c0 tx=0x7fac44005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c83bfdc2943aa24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac48bfe640 1 -- 172.21.15.135:0/661135298 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44004030 con 0x5652623e11b0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac5ac10640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 0x7fac400a5200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac4c09bfb0 tx=0x7fac4c066c50 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac48bfe640 1 -- 172.21.15.135:0/661135298 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44005500 con 0x5652623e11b0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.286+0000 7fac48bfe640 1 -- 172.21.15.135:0/661135298 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44004ce0 con 0x5652623e11b0 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 -- 172.21.15.135:0/661135298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 msgr2=0x565262780080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac440058c0 tx=0x7fac44005850 comp rx=0 tx=0).stop 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 -- 172.21.15.135:0/661135298 shutdown_connections 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x565262780b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x5652627805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 --2- 172.21.15.135:0/661135298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x565262780080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 -- 172.21.15.135:0/661135298 >> 172.21.15.135:0/661135298 conn(0x5652623d5300 msgr2=0x56526277c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 -- 172.21.15.135:0/661135298 shutdown_connections 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.287+0000 7fac635f7740 1 -- 172.21.15.135:0/661135298 wait complete. 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 -- start start 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 Processor -- start 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623e11b0 0x56526278f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56526278d1b0 con 0x5652623b82f0 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5652626a0790 con 0x5652623e11b0 2024-05-20T17:37:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56526278d330 con 0x5652623c04d0 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac635f7740 10 client.0 _ll_register_callbacks cb 0x5652626dba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55800/0 (socket says 172.21.15.135:55800) 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:38534/0 (socket says 172.21.15.135:38534) 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac59c0e640 1 -- 172.21.15.135:0/741219367 learned_addr learned my addr 172.21.15.135:0/741219367 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac59c0e640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623e11b0 0x56526278f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 -- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623e11b0 msgr2=0x56526278f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623e11b0 0x56526278f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 -- 172.21.15.135:0/741219367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 msgr2=0x565262794cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac5a40f640 1 -- 172.21.15.135:0/741219367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652623f9210 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.288+0000 7fac59c0e640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac5a40f640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac5002a930 tx=0x7fac50032ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db8c6304cd43a023 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50035040 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac44005500 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fac500318b0 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac50004040 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac635f7740 10 client.25897 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5652624c5620 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.289+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44005500 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac50004750 con 0x5652623c04d0 2024-05-20T17:37:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 10 client.25897 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 10 client.25897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 20 client.25897 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56526239fd80 0x5652627a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 4 client.25897 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652626f2a70 con 0x56526239fd80 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac59c0e640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56526239fd80 0x5652627a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac59c0e640 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56526239fd80 0x5652627a0da0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96da7b60684c71ad server_cookie=5211c876d2ba322e in_seq=0 out_seq=0 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.290+0000 7fac3dffb640 10 client.25897 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac3dffb640 1 -- 172.21.15.135:0/741219367 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5652626f2a70 con 0x56526239fd80 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac3dffb640 10 client.25897 handle_command_reply: tid=0 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 client.25897 shutdown 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 msgr2=0x565262795200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac5002a930 tx=0x7fac50032ed0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 shutdown_connections 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56526239fd80 0x5652627a0da0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623e11b0 0x56526278f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac3dffb640 0 client.25897 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623c04d0 0x565262795200 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 --2- 172.21.15.135:0/741219367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623b82f0 0x565262794cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 >> 172.21.15.135:0/741219367 conn(0x5652623d5300 msgr2=0x56526277feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 shutdown_connections 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 1 -- 172.21.15.135:0/741219367 wait complete. 2024-05-20T17:37:30.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.291+0000 7fac635f7740 20 client.25897 trim_cache size 0 max 16384 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.307+0000 7fac635f7740 1 Processor -- start 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.307+0000 7fac635f7740 1 -- start start 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623b82f0 0x5652627a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x56526278e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac541af1c0 con 0x5652623c04d0 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac541aca90 con 0x5652623b82f0 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac635f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac541aa8e0 con 0x5652623e11b0 2024-05-20T17:37:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55812/0 (socket says 172.21.15.135:55812) 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 -- 172.21.15.135:0/135678797 learned_addr learned my addr 172.21.15.135:0/135678797 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac59c0e640 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623b82f0 0x5652627a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac59c0e640 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x56526278e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 -- 172.21.15.135:0/135678797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 msgr2=0x56526278e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x56526278e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 -- 172.21.15.135:0/135678797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623b82f0 msgr2=0x5652627a65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623b82f0 0x5652627a65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 -- 172.21.15.135:0/135678797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565262790570 con 0x5652623c04d0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac5a40f640 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac50004b20 tx=0x7fac5002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec525b49f48905ef server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.308+0000 7fac3ffff640 1 -- 172.21.15.135:0/135678797 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50035030 con 0x5652623c04d0 2024-05-20T17:37:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac3ffff640 1 -- 172.21.15.135:0/135678797 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac500043e0 con 0x5652623c04d0 2024-05-20T17:37:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac3ffff640 1 -- 172.21.15.135:0/135678797 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50053070 con 0x5652623c04d0 2024-05-20T17:37:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 -- 172.21.15.135:0/135678797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 msgr2=0x5652627a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac50004b20 tx=0x7fac5002a410 comp rx=0 tx=0).stop 2024-05-20T17:37:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 -- 172.21.15.135:0/135678797 shutdown_connections 2024-05-20T17:37:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623e11b0 0x56526278e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623c04d0 0x5652627a6ae0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 --2- 172.21.15.135:0/135678797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623b82f0 0x5652627a65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 -- 172.21.15.135:0/135678797 >> 172.21.15.135:0/135678797 conn(0x5652623d5300 msgr2=0x56526278d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 -- 172.21.15.135:0/135678797 shutdown_connections 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.309+0000 7fac635f7740 1 -- 172.21.15.135:0/135678797 wait complete. 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 -- start start 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 Processor -- start 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623b82f0 0x56526279aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623e11b0 0x565262798200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac541aaf50 con 0x5652623e11b0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac541ac3c0 con 0x5652623c04d0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac541ab620 con 0x5652623b82f0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac635f7740 10 client.0 _ll_register_callbacks cb 0x7fac50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623b82f0 0x56526279aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac5a40f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35688/0 (socket says 172.21.15.135:35688) 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac5a40f640 1 -- 172.21.15.135:0/4138463905 learned_addr learned my addr 172.21.15.135:0/4138463905 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.310+0000 7fac59c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623e11b0 0x565262798200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 -- 172.21.15.135:0/4138463905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623b82f0 msgr2=0x56526279aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623b82f0 0x56526279aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 -- 172.21.15.135:0/4138463905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623e11b0 msgr2=0x565262798200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623e11b0 0x565262798200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 -- 172.21.15.135:0/4138463905 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56526279b7a0 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac5a40f640 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac50004d10 tx=0x7fac500058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22781784eac04074 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50035030 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fac500038f0 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac500043e0 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac50065050 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac635f7740 10 client.26009 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.311+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5652627885c0 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac500043e0 con 0x5652623c04d0 2024-05-20T17:37:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac50005390 con 0x5652623c04d0 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 10 client.26009 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 10 client.26009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 20 client.26009 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5652623751c0 0x56526280f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 4 client.26009 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652626ecdc0 con 0x5652623751c0 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac59c0e640 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5652623751c0 0x56526280f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac3dffb640 10 client.26009 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:30.312+0000 7fac59c0e640 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5652623751c0 0x56526280f950 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef91f326efb441d server_cookie=52389f673df1655b in_seq=0 out_seq=0 2024-05-20T17:37:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:31 smithi135 ceph-mon[32027]: pgmap v128: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-05-20T17:37:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:31 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:37:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:31 smithi160 ceph-mon[36261]: pgmap v128: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-05-20T17:37:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:31 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:37:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.787+0000 7fac3dffb640 1 -- 172.21.15.135:0/4138463905 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652626ecdc0 con 0x5652623751c0 2024-05-20T17:37:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.787+0000 7fac3dffb640 10 client.26009 handle_command_reply: tid=0 2024-05-20T17:37:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.787+0000 7fac635f7740 1 client.26009 shutdown 2024-05-20T17:37:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.788+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 msgr2=0x56526279b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.788+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac50004d10 tx=0x7fac500058d0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 shutdown_connections 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5652623751c0 0x56526280f950 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652623e11b0 0x565262798200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652623c04d0 0x56526279b030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 --2- 172.21.15.135:0/4138463905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652623b82f0 0x56526279aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 >> 172.21.15.135:0/4138463905 conn(0x5652623d5300 msgr2=0x56526278d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac3dffb640 0 client.26009 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 shutdown_connections 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 1 -- 172.21.15.135:0/4138463905 wait complete. 2024-05-20T17:37:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.794+0000 7fac635f7740 20 client.26009 trim_cache size 0 max 16384 2024-05-20T17:37:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 msgr2=0x7fac400a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 0x7fac400a5200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac4c09bfb0 tx=0x7fac4c066c50 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 msgr2=0x7fac5419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00eb10 tx=0x7fac4c00c2d0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 shutdown_connections 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fac400a2cf0 0x7fac400a5200 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac54107ec0 0x7fac5419cf30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac54107a20 0x7fac54198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 --2- 172.21.15.135:0/1491388335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac54102180 0x7fac54198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.803+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 >> 172.21.15.135:0/1491388335 conn(0x7fac54077100 msgr2=0x7fac54103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.804+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 shutdown_connections 2024-05-20T17:37:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:31.805+0000 7fac5c673640 1 -- 172.21.15.135:0/1491388335 wait complete. 2024-05-20T17:37:31.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:31 smithi172 ceph-mon[36511]: pgmap v128: 97 pgs: 97 active+clean; 742 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-05-20T17:37:31.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:31 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:37:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:33 smithi135 ceph-mon[32027]: pgmap v129: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 608 op/s 2024-05-20T17:37:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:33 smithi160 ceph-mon[36261]: pgmap v129: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 608 op/s 2024-05-20T17:37:33.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:33 smithi172 ceph-mon[36511]: pgmap v129: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 608 op/s 2024-05-20T17:37:35.610 INFO:tasks.workunit.client.0.smithi135.stdout: 227 2181428 746 1527821 631 914036 1793 2024-05-20T17:37:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:35 smithi160 ceph-mon[36261]: pgmap v130: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:35.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:35 smithi172 ceph-mon[36511]: pgmap v130: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:35.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:35 smithi135 ceph-mon[32027]: pgmap v130: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:37 smithi160 ceph-mon[36261]: pgmap v131: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:37 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:37:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:37 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:37:37.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:37 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:37:37.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:37 smithi172 ceph-mon[36511]: pgmap v131: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:37 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:37:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:37 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:37:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:37 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:37:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:37 smithi135 ceph-mon[32027]: pgmap v131: 97 pgs: 97 active+clean; 754 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 333 op/s 2024-05-20T17:37:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:37 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:37:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:37 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:37:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:37 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:37:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:39 smithi160 ceph-mon[36261]: pgmap v132: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 800 op/s 2024-05-20T17:37:39.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:39 smithi172 ceph-mon[36511]: pgmap v132: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 800 op/s 2024-05-20T17:37:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:39 smithi135 ceph-mon[32027]: pgmap v132: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 800 op/s 2024-05-20T17:37:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:41 smithi160 ceph-mon[36261]: pgmap v133: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-20T17:37:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:41 smithi172 ceph-mon[36511]: pgmap v133: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-20T17:37:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:41 smithi135 ceph-mon[32027]: pgmap v133: 97 pgs: 97 active+clean; 798 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 764 op/s 2024-05-20T17:37:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:43 smithi160 ceph-mon[36261]: pgmap v134: 97 pgs: 97 active+clean; 863 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-05-20T17:37:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:43 smithi172 ceph-mon[36511]: pgmap v134: 97 pgs: 97 active+clean; 863 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-05-20T17:37:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:43 smithi135 ceph-mon[32027]: pgmap v134: 97 pgs: 97 active+clean; 863 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-05-20T17:37:45.609 INFO:tasks.workunit.client.0.smithi135.stdout: 245 1701495 1378 1192407 935 743331 1708 2024-05-20T17:37:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:45 smithi160 ceph-mon[36261]: pgmap v135: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:45.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:45 smithi172 ceph-mon[36511]: pgmap v135: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.906+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/4000847929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4119770 msgr2=0x7fd2f411bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.906+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/4000847929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4119770 0x7fd2f411bb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009ca0 tx=0x7fd2ec02a980 comp rx=0 tx=0).stop 2024-05-20T17:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/4000847929 shutdown_connections 2024-05-20T17:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/4000847929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f411c0d0 0x7fd2f411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/4000847929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f4119770 0x7fd2f411bb90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/4000847929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4108f70 0x7fd2f4109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/4000847929 >> 172.21.15.135:0/4000847929 conn(0x7fd2f406e600 msgr2=0x7fd2f406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/4000847929 shutdown_connections 2024-05-20T17:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.908+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/4000847929 wait complete. 2024-05-20T17:37:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.909+0000 7fd2fc2e9640 1 Processor -- start 2024-05-20T17:37:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.909+0000 7fd2fc2e9640 1 -- start start 2024-05-20T17:37:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 0x7fd2f41a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 0x7fd2f41a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 0x7fd2f41acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f4121aa0 con 0x7fd2f4108f70 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f4121920 con 0x7fd2f411c0d0 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fc2e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f4121c20 con 0x7fd2f4119770 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2f9884640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 0x7fd2f41a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2f9884640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 0x7fd2f41a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:35286/0 (socket says 172.21.15.135:35286) 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2f9884640 1 -- 172.21.15.135:0/908289236 learned_addr learned my addr 172.21.15.135:0/908289236 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fa085640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 0x7fd2f41a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fa886640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 0x7fd2f41acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.910+0000 7fd2fa085640 1 -- 172.21.15.135:0/908289236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 msgr2=0x7fd2f41a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa085640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 0x7fd2f41a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa085640 1 -- 172.21.15.135:0/908289236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 msgr2=0x7fd2f41acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa085640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 0x7fd2f41acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa085640 1 -- 172.21.15.135:0/908289236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f41ad260 con 0x7fd2f4108f70 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa886640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 0x7fd2f41acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.911+0000 7fd2fa085640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 0x7fd2f41a8400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000e9f0 tx=0x7fd2f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.916+0000 7fd2eb7fe640 1 -- 172.21.15.135:0/908289236 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000ccc0 con 0x7fd2f4108f70 2024-05-20T17:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.916+0000 7fd2eb7fe640 1 -- 172.21.15.135:0/908289236 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f0010910 con 0x7fd2f4108f70 2024-05-20T17:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.916+0000 7fd2eb7fe640 1 -- 172.21.15.135:0/908289236 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0018960 con 0x7fd2f4108f70 2024-05-20T17:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.916+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f41ad550 con 0x7fd2f4108f70 2024-05-20T17:37:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.916+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f41b4ed0 con 0x7fd2f4108f70 2024-05-20T17:37:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.921+0000 7fd2eb7fe640 1 -- 172.21.15.135:0/908289236 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd2f0010ac0 con 0x7fd2f4108f70 2024-05-20T17:37:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.924+0000 7fd2eb7fe640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 0x7fd2e00a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.925+0000 7fd2f9884640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 0x7fd2e00a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.926+0000 7fd30318c740 1 Processor -- start 2024-05-20T17:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.926+0000 7fd2eb7fe640 1 -- 172.21.15.135:0/908289236 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd2f00cf7b0 con 0x7fd2f4108f70 2024-05-20T17:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.927+0000 7fd2f9884640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 0x7fd2e00a5390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec02aef0 tx=0x7fd2ec02ae80 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.927+0000 7fd30318c740 1 -- start start 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6ff1b0 0x56059ba9e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059ba9e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56059ba03340 con 0x56059b6ff1b0 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56059b9ab290 con 0x56059b6de4d0 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd30318c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56059b9ff300 con 0x56059b6d62f0 2024-05-20T17:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd2fa886640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd2fa886640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:59400/0 (socket says 172.21.15.135:59400) 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd2fa886640 1 -- 172.21.15.135:0/2035337067 learned_addr learned my addr 172.21.15.135:0/2035337067 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.928+0000 7fd2f9884640 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059ba9e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 -- 172.21.15.135:0/2035337067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 msgr2=0x56059ba9e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059ba9e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 -- 172.21.15.135:0/2035337067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6ff1b0 msgr2=0x56059ba9e270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6ff1b0 0x56059ba9e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 -- 172.21.15.135:0/2035337067 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059b9cf8e0 con 0x56059b6de4d0 2024-05-20T17:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.929+0000 7fd2fa886640 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4010400 tx=0x7fd2e40108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63437149b47909cf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.933+0000 7fd2e8bfe640 1 -- 172.21.15.135:0/2035337067 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4011760 con 0x56059b6de4d0 2024-05-20T17:37:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.933+0000 7fd2e8bfe640 1 -- 172.21.15.135:0/2035337067 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e4011de0 con 0x56059b6de4d0 2024-05-20T17:37:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.933+0000 7fd2e8bfe640 1 -- 172.21.15.135:0/2035337067 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4018380 con 0x56059b6de4d0 2024-05-20T17:37:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.935+0000 7fd30318c740 1 -- 172.21.15.135:0/2035337067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 msgr2=0x56059ba9ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.935+0000 7fd30318c740 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4010400 tx=0x7fd2e40108c0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.943+0000 7fd30318c740 1 -- 172.21.15.135:0/2035337067 shutdown_connections 2024-05-20T17:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.943+0000 7fd30318c740 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9ecf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.943+0000 7fd30318c740 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059ba9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.943+0000 7fd30318c740 1 --2- 172.21.15.135:0/2035337067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6ff1b0 0x56059ba9e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.943+0000 7fd30318c740 1 -- 172.21.15.135:0/2035337067 >> 172.21.15.135:0/2035337067 conn(0x56059b6f3300 msgr2=0x56059ba9aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.947+0000 7fd30318c740 1 -- 172.21.15.135:0/2035337067 shutdown_connections 2024-05-20T17:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.947+0000 7fd30318c740 1 -- 172.21.15.135:0/2035337067 wait complete. 2024-05-20T17:37:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.948+0000 7fd30318c740 1 -- start start 2024-05-20T17:37:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.949+0000 7fd30318c740 1 Processor -- start 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.949+0000 7fd30318c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.949+0000 7fd30318c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2f9884640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2f9884640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43588/0 (socket says 172.21.15.135:43588) 2024-05-20T17:37:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:59406/0 (socket says 172.21.15.135:59406) 2024-05-20T17:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd30318c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6ff1b0 0x56059baa8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd30318c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56059baab3a0 con 0x56059b6de4d0 2024-05-20T17:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd30318c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56059b9be790 con 0x56059b6d62f0 2024-05-20T17:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd30318c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56059baab520 con 0x56059b6ff1b0 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd30318c740 10 client.0 _ll_register_callbacks cb 0x56059b9f9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2f9884640 1 -- 172.21.15.135:0/129933073 learned_addr learned my addr 172.21.15.135:0/129933073 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.950+0000 7fd2fa886640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6ff1b0 0x56059baa8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2fa085640 1 -- 172.21.15.135:0/129933073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6ff1b0 msgr2=0x56059baa8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2fa085640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6ff1b0 0x56059baa8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2fa085640 1 -- 172.21.15.135:0/129933073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 msgr2=0x56059baaa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:45.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:45 smithi135 ceph-mon[32027]: pgmap v135: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2fa085640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2fa085640 1 -- 172.21.15.135:0/129933073 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059b717210 con 0x56059b6d62f0 2024-05-20T17:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.951+0000 7fd2f9884640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.952+0000 7fd2fa085640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ccf00 tx=0x7fd2f009b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3acaa490b0ffdb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.975+0000 7fd2ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:37:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.975+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f009b320 con 0x56059b6d62f0 2024-05-20T17:37:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.975+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd2f0010430 con 0x56059b6d62f0 2024-05-20T17:37:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.975+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e4011de0 con 0x56059b6d62f0 2024-05-20T17:37:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.977+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2f00a0080 con 0x56059b6d62f0 2024-05-20T17:37:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.977+0000 7fd30318c740 10 client.26021 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.977+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56059b7e3620 con 0x56059b6d62f0 2024-05-20T17:37:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.978+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e4011de0 con 0x56059b6d62f0 2024-05-20T17:37:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd2f009ab90 con 0x56059b6d62f0 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 10 client.26021 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 20 client.26021 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6bdd80 0x56059babacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 4 client.26021 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.979+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059ba10a70 con 0x56059b6bdd80 2024-05-20T17:37:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.980+0000 7fd2f9884640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6bdd80 0x56059babacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.980+0000 7fd2f9884640 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6bdd80 0x56059babacd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8609450d7d36ecb server_cookie=bfa4f5f2cf8d4303 in_seq=0 out_seq=0 2024-05-20T17:37:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.981+0000 7fd2ddffb640 10 client.26021 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.982+0000 7fd2ddffb640 1 -- 172.21.15.135:0/129933073 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56059ba10a70 con 0x56059b6bdd80 2024-05-20T17:37:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.982+0000 7fd2ddffb640 10 client.26021 handle_command_reply: tid=0 2024-05-20T17:37:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.982+0000 7fd30318c740 1 client.26021 shutdown 2024-05-20T17:37:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.983+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 msgr2=0x56059baaa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.983+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ccf00 tx=0x7fd2f009b940 comp rx=0 tx=0).stop 2024-05-20T17:37:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 shutdown_connections 2024-05-20T17:37:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6bdd80 0x56059babacd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6ff1b0 0x56059baa8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6de4d0 0x56059baaa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 --2- 172.21.15.135:0/129933073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6d62f0 0x56059baaa3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.984+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 >> 172.21.15.135:0/129933073 conn(0x56059b6f3300 msgr2=0x56059ba9ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.988+0000 7fd2ddffb640 0 client.26021 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.988+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 shutdown_connections 2024-05-20T17:37:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.988+0000 7fd30318c740 1 -- 172.21.15.135:0/129933073 wait complete. 2024-05-20T17:37:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:45.988+0000 7fd30318c740 20 client.26021 trim_cache size 0 max 16384 2024-05-20T17:37:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.051+0000 7fd30318c740 1 Processor -- start 2024-05-20T17:37:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.063+0000 7fd30318c740 1 -- start start 2024-05-20T17:37:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6d62f0 0x56059ba9a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:35320/0 (socket says 172.21.15.135:35320) 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bff10 con 0x56059b6d62f0 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bd7e0 con 0x56059b6de4d0 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd30318c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bb6e0 con 0x56059b6f3300 2024-05-20T17:37:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.066+0000 7fd2fa085640 1 -- 172.21.15.135:0/2001245499 learned_addr learned my addr 172.21.15.135:0/2001245499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2f9884640 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6d62f0 0x56059ba9a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 -- 172.21.15.135:0/2001245499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 msgr2=0x56059ba9a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 -- 172.21.15.135:0/2001245499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6d62f0 msgr2=0x56059ba9a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6d62f0 0x56059ba9a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 -- 172.21.15.135:0/2001245499 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059ba9e000 con 0x56059b6f3300 2024-05-20T17:37:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.067+0000 7fd2fa085640 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ccfb0 tx=0x7fd2f0009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c67d3cbf78289c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.071+0000 7fd2dffff640 1 -- 172.21.15.135:0/2001245499 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a4b90 con 0x56059b6f3300 2024-05-20T17:37:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.071+0000 7fd2dffff640 1 -- 172.21.15.135:0/2001245499 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f009b120 con 0x56059b6f3300 2024-05-20T17:37:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.072+0000 7fd2dffff640 1 -- 172.21.15.135:0/2001245499 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0097c80 con 0x56059b6f3300 2024-05-20T17:37:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.074+0000 7fd30318c740 1 -- 172.21.15.135:0/2001245499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 msgr2=0x56059baa2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.074+0000 7fd30318c740 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ccfb0 tx=0x7fd2f0009700 comp rx=0 tx=0).stop 2024-05-20T17:37:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.075+0000 7fd30318c740 1 -- 172.21.15.135:0/2001245499 shutdown_connections 2024-05-20T17:37:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.075+0000 7fd30318c740 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059ba9a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.075+0000 7fd30318c740 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6d62f0 0x56059ba9a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.075+0000 7fd30318c740 1 --2- 172.21.15.135:0/2001245499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6f3300 0x56059baa2640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.075+0000 7fd30318c740 1 -- 172.21.15.135:0/2001245499 >> 172.21.15.135:0/2001245499 conn(0x56059babb000 msgr2=0x56059baa1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.082+0000 7fd30318c740 1 -- 172.21.15.135:0/2001245499 shutdown_connections 2024-05-20T17:37:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.083+0000 7fd30318c740 1 -- 172.21.15.135:0/2001245499 wait complete. 2024-05-20T17:37:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.084+0000 7fd30318c740 1 -- start start 2024-05-20T17:37:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.084+0000 7fd30318c740 1 Processor -- start 2024-05-20T17:37:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059bab1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059bab2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 0x56059bb21080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bbca0 con 0x56059b6f3300 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bd110 con 0x56059b6de4d0 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059bab1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f41bc370 con 0x56059b6d62f0 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd2fa085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059bab1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:35334/0 (socket says 172.21.15.135:35334) 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd2fa085640 1 -- 172.21.15.135:0/3761524854 learned_addr learned my addr 172.21.15.135:0/3761524854 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd30318c740 10 client.0 _ll_register_callbacks cb 0x7fd2f0010e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd2f9884640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059bab2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.085+0000 7fd2fa886640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 0x56059bb21080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 -- 172.21.15.135:0/3761524854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 msgr2=0x56059bab1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059bab1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 -- 172.21.15.135:0/3761524854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 msgr2=0x56059bb21080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 0x56059bb21080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 -- 172.21.15.135:0/3761524854 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059bab2de0 con 0x56059b6de4d0 2024-05-20T17:37:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2fa886640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 0x56059bb21080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:37:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.086+0000 7fd2f9884640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059bab2500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56059babb440 tx=0x7fd2ec0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668d1e6a5b5cba13 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:37:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.096+0000 7fd2ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:37:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.097+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec030b50 con 0x56059b6de4d0 2024-05-20T17:37:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.097+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd2ec030cf0 con 0x56059b6de4d0 2024-05-20T17:37:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.097+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f009b120 con 0x56059b6de4d0 2024-05-20T17:37:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2ec053450 con 0x56059b6de4d0 2024-05-20T17:37:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 10 client.26024 fetch_fsmap learned FSMap version 26 2024-05-20T17:37:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56059bb22660 con 0x56059b6de4d0 2024-05-20T17:37:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f009b120 con 0x56059b6de4d0 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd2ec0486e0 con 0x56059b6de4d0 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 10 client.26024 fetch_fsmap finished waiting for FSMap version 26 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 10 client.26024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 20 client.26024 populate_metadata read hostname 'smithi135' 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6ff1b0 0x56059bb24dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:37:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 4 client.26024 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:37:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.098+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56059ba0adc0 con 0x56059b6ff1b0 2024-05-20T17:37:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.099+0000 7fd2fa085640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6ff1b0 0x56059bb24dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:37:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.099+0000 7fd2ddffb640 10 client.26024 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.100+0000 7fd2fa085640 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6ff1b0 0x56059bb24dd0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=880fbcb5621fc413 server_cookie=cc762b751268d109 in_seq=0 out_seq=0 2024-05-20T17:37:46.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.874+0000 7fd2ddffb640 1 -- 172.21.15.135:0/3761524854 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56059ba0adc0 con 0x56059b6ff1b0 2024-05-20T17:37:46.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.874+0000 7fd2ddffb640 10 client.26024 handle_command_reply: tid=0 2024-05-20T17:37:46.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.875+0000 7fd30318c740 1 client.26024 shutdown 2024-05-20T17:37:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 msgr2=0x56059bab2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059bab2500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56059babb440 tx=0x7fd2ec0095c0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 shutdown_connections 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56059b6ff1b0 0x56059bb24dd0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56059b6f3300 0x56059bb21080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56059b6de4d0 0x56059bab2500 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 --2- 172.21.15.135:0/3761524854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56059b6d62f0 0x56059bab1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 >> 172.21.15.135:0/3761524854 conn(0x56059babb000 msgr2=0x56059baa9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd2ddffb640 0 client.26024 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:37:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 shutdown_connections 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.878+0000 7fd30318c740 1 -- 172.21.15.135:0/3761524854 wait complete. 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.879+0000 7fd30318c740 20 client.26024 trim_cache size 0 max 16384 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:37:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:37:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.929+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 msgr2=0x7fd2e00a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.929+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 0x7fd2e00a5390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec02aef0 tx=0x7fd2ec02ae80 comp rx=0 tx=0).stop 2024-05-20T17:37:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.929+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 msgr2=0x7fd2f41a8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:37:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.929+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 0x7fd2f41a8400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000e9f0 tx=0x7fd2f000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 shutdown_connections 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd2e00a2e80 0x7fd2e00a5390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2f411c0d0 0x7fd2f41acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f4119770 0x7fd2f41a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 --2- 172.21.15.135:0/908289236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f4108f70 0x7fd2f41a8400 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 >> 172.21.15.135:0/908289236 conn(0x7fd2f406e600 msgr2=0x7fd2f4119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 shutdown_connections 2024-05-20T17:37:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:37:46.932+0000 7fd2fc2e9640 1 -- 172.21.15.135:0/908289236 wait complete. 2024-05-20T17:37:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:47 smithi160 ceph-mon[36261]: pgmap v136: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:47.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:47 smithi172 ceph-mon[36511]: pgmap v136: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:47 smithi135 ceph-mon[32027]: pgmap v136: 97 pgs: 97 active+clean; 880 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 966 op/s 2024-05-20T17:37:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:49 smithi160 ceph-mon[36261]: pgmap v137: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2024-05-20T17:37:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:49 smithi172 ceph-mon[36511]: pgmap v137: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2024-05-20T17:37:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:49 smithi135 ceph-mon[32027]: pgmap v137: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 15 MiB/s wr, 1.15k op/s 2024-05-20T17:37:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:51 smithi160 ceph-mon[36261]: pgmap v138: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-05-20T17:37:51.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:51 smithi172 ceph-mon[36511]: pgmap v138: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-05-20T17:37:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:51 smithi135 ceph-mon[32027]: pgmap v138: 97 pgs: 97 active+clean; 895 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-05-20T17:37:53.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:53 smithi172 ceph-mon[36511]: pgmap v139: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 924 op/s 2024-05-20T17:37:53.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:53 smithi135 ceph-mon[32027]: pgmap v139: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 924 op/s 2024-05-20T17:37:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:53 smithi160 ceph-mon[36261]: pgmap v139: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 924 op/s 2024-05-20T17:37:55.610 INFO:tasks.workunit.client.0.smithi135.stdout: 266 2423133 1336 1662904 1135 1055124 2315 2024-05-20T17:37:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:55 smithi172 ceph-mon[36511]: pgmap v140: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-05-20T17:37:55.962 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:55 smithi135 ceph-mon[32027]: pgmap v140: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-05-20T17:37:56.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:55 smithi160 ceph-mon[36261]: pgmap v140: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-05-20T17:37:57.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:57 smithi172 ceph-mon[36511]: pgmap v141: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2024-05-20T17:37:57.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:57 smithi135 ceph-mon[32027]: pgmap v141: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2024-05-20T17:37:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:57 smithi160 ceph-mon[36261]: pgmap v141: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 483 op/s 2024-05-20T17:37:58.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:37:58 smithi172 ceph-mon[36511]: pgmap v142: 97 pgs: 97 active+clean; 943 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-05-20T17:37:58.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:37:58 smithi135 ceph-mon[32027]: pgmap v142: 97 pgs: 97 active+clean; 943 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-05-20T17:37:59.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:37:58 smithi160 ceph-mon[36261]: pgmap v142: 97 pgs: 97 active+clean; 943 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-05-20T17:38:00.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:00 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:00.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:00 smithi172 ceph-mon[36511]: pgmap v143: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 556 op/s 2024-05-20T17:38:00.960 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:00 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:00.960 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:00 smithi135 ceph-mon[32027]: pgmap v143: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 556 op/s 2024-05-20T17:38:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:00 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:00 smithi160 ceph-mon[36261]: pgmap v143: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 556 op/s 2024-05-20T17:38:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.147+0000 7f28d4e79640 1 -- 172.21.15.135:0/1602857317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 msgr2=0x7f28d011e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.147+0000 7f28d4e79640 1 --2- 172.21.15.135:0/1602857317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 0x7f28d011e4f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009860 tx=0x7f28c002a410 comp rx=0 tx=0).stop 2024-05-20T17:38:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.149+0000 7f28d4e79640 1 -- 172.21.15.135:0/1602857317 shutdown_connections 2024-05-20T17:38:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.149+0000 7f28d4e79640 1 --2- 172.21.15.135:0/1602857317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 0x7f28d011e4f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.149+0000 7f28d4e79640 1 --2- 172.21.15.135:0/1602857317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0119770 0x7f28d011bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.149+0000 7f28d4e79640 1 --2- 172.21.15.135:0/1602857317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0108f70 0x7f28d0109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.149+0000 7f28d4e79640 1 -- 172.21.15.135:0/1602857317 >> 172.21.15.135:0/1602857317 conn(0x7f28d006e600 msgr2=0x7f28d006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.156+0000 7f28d4e79640 1 -- 172.21.15.135:0/1602857317 shutdown_connections 2024-05-20T17:38:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.156+0000 7f28d4e79640 1 -- 172.21.15.135:0/1602857317 wait complete. 2024-05-20T17:38:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.157+0000 7f28d4e79640 1 Processor -- start 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.157+0000 7f28d4e79640 1 -- start start 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0119770 0x7f28d01a8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 0x7f28d01acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0121aa0 con 0x7f28d0119770 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0121920 con 0x7f28d011c0d0 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28d4e79640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0121c20 con 0x7f28d0108f70 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:39908/0 (socket says 172.21.15.135:39908) 2024-05-20T17:38:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.158+0000 7f28ce59c640 1 -- 172.21.15.135:0/3530470870 learned_addr learned my addr 172.21.15.135:0/3530470870 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 -- 172.21.15.135:0/3530470870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 msgr2=0x7f28d01acb20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 0x7f28d01acb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 -- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0119770 msgr2=0x7f28d01a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0119770 0x7f28d01a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 -- 172.21.15.135:0/3530470870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d01ad160 con 0x7f28d0108f70 2024-05-20T17:38:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.159+0000 7f28ce59c640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28c400e9c0 tx=0x7f28c400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.179+0000 7f28bf7fe640 1 -- 172.21.15.135:0/3530470870 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c400ccc0 con 0x7f28d0108f70 2024-05-20T17:38:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.179+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d01ad450 con 0x7f28d0108f70 2024-05-20T17:38:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.179+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d0110f60 con 0x7f28d0108f70 2024-05-20T17:38:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.183+0000 7f28dbdf4740 1 Processor -- start 2024-05-20T17:38:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.184+0000 7f28dbdf4740 1 -- start start 2024-05-20T17:38:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.184+0000 7f28bf7fe640 1 -- 172.21.15.135:0/3530470870 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28c4005500 con 0x7f28d0108f70 2024-05-20T17:38:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.184+0000 7f28bf7fe640 1 -- 172.21.15.135:0/3530470870 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4010430 con 0x7f28d0108f70 2024-05-20T17:38:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.189+0000 7f28bf7fe640 1 -- 172.21.15.135:0/3530470870 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f28c40105f0 con 0x7f28d0108f70 2024-05-20T17:38:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b954fcc340 con 0x55b954cc81b0 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b954f74290 con 0x55b954ca74d0 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.193+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b954fc8300 con 0x55b954c9f2f0 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57524/0 (socket says 172.21.15.135:57524) 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 -- 172.21.15.135:0/216030884 learned_addr learned my addr 172.21.15.135:0/216030884 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 -- 172.21.15.135:0/216030884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 msgr2=0x55b9550677e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:38:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550677e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 -- 172.21.15.135:0/216030884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 msgr2=0x55b9550672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.194+0000 7f28cdd9b640 1 -- 172.21.15.135:0/216030884 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b954f988e0 con 0x55b954ca74d0 2024-05-20T17:38:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.195+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009d50 tx=0x7f28c800e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6891e36ce55cf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.198+0000 7f28bf7fe640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 0x7f28b80a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.198+0000 7f28ced9d640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 0x7f28b80a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.199+0000 7f28bf7fe640 1 -- 172.21.15.135:0/3530470870 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f28c40d07c0 con 0x7f28d0108f70 2024-05-20T17:38:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.199+0000 7f28bcff9640 1 -- 172.21.15.135:0/216030884 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8016070 con 0x55b954ca74d0 2024-05-20T17:38:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.203+0000 7f28bcff9640 1 -- 172.21.15.135:0/216030884 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28c8005020 con 0x55b954ca74d0 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.204+0000 7f28dbdf4740 1 -- 172.21.15.135:0/216030884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 msgr2=0x55b955067d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.204+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009d50 tx=0x7f28c800e6c0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.205+0000 7f28dbdf4740 1 -- 172.21.15.135:0/216030884 shutdown_connections 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.205+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954ca74d0 0x55b955067d20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.205+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.205+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/216030884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.205+0000 7f28dbdf4740 1 -- 172.21.15.135:0/216030884 >> 172.21.15.135:0/216030884 conn(0x55b954cbc300 msgr2=0x55b955063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.207+0000 7f28dbdf4740 1 -- 172.21.15.135:0/216030884 shutdown_connections 2024-05-20T17:38:02.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.207+0000 7f28dbdf4740 1 -- 172.21.15.135:0/216030884 wait complete. 2024-05-20T17:38:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 -- start start 2024-05-20T17:38:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 Processor -- start 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 0x55b955071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c86d80 0x55b955071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b955074420 con 0x55b954cc81b0 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b954f87790 con 0x55b954c9f2f0 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b9550745a0 con 0x55b954c86d80 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.208+0000 7f28dbdf4740 10 client.0 _ll_register_callbacks cb 0x55b954fc2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.209+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.209+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37052/0 (socket says 172.21.15.135:37052) 2024-05-20T17:38:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.209+0000 7f28cdd9b640 1 -- 172.21.15.135:0/2874223703 learned_addr learned my addr 172.21.15.135:0/2874223703 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.216+0000 7f28ced9d640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c86d80 0x55b955071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28cdd9b640 1 -- 172.21.15.135:0/2874223703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c86d80 msgr2=0x55b955071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c86d80 0x55b955071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28cdd9b640 1 -- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 msgr2=0x55b955071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 0x55b955071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 0x55b955071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28cdd9b640 1 -- 172.21.15.135:0/2874223703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b954ce0210 con 0x55b954cc81b0 2024-05-20T17:38:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.217+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 0x55b955071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:38:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.220+0000 7f28ced9d640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 0x7f28b80a5410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28c00095f0 tx=0x7f28c0005850 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.220+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f28c80094b0 tx=0x7f28c8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99c0c53616d05ce server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.240+0000 7f28b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.241+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8016040 con 0x55b954cc81b0 2024-05-20T17:38:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.241+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f28c8003b80 con 0x55b954cc81b0 2024-05-20T17:38:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.241+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b954fd9a70 con 0x55b954cc81b0 2024-05-20T17:38:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.246+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28c8009970 con 0x55b954cc81b0 2024-05-20T17:38:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.250+0000 7f28dbdf4740 10 client.16395 fetch_fsmap learned FSMap version 27 2024-05-20T17:38:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.250+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b954dac620 con 0x55b954cc81b0 2024-05-20T17:38:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b954fd9a70 con 0x55b954cc81b0 2024-05-20T17:38:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f28c800f040 con 0x55b954cc81b0 2024-05-20T17:38:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 10 client.16395 fetch_fsmap finished waiting for FSMap version 27 2024-05-20T17:38:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 20 client.16395 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b954c5c1c0 0x55b955083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 4 client.16395 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b954fd3dc0 con 0x55b954c5c1c0 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.266+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b954c5c1c0 0x55b955083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.267+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b954c5c1c0 0x55b955083bd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f77b020b7df4d2 server_cookie=6414d80f1897d03d in_seq=0 out_seq=0 2024-05-20T17:38:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28b5ffb640 10 client.16395 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28b5ffb640 1 -- 172.21.15.135:0/2874223703 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b954fd3dc0 con 0x55b954c5c1c0 2024-05-20T17:38:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28b5ffb640 10 client.16395 handle_command_reply: tid=0 2024-05-20T17:38:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28dbdf4740 1 client.16395 shutdown 2024-05-20T17:38:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 msgr2=0x55b9550718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.272+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f28c80094b0 tx=0x7f28c8009880 comp rx=0 tx=0).stop 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 shutdown_connections 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b954c5c1c0 0x55b955083bd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c86d80 0x55b955071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b9550718b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2874223703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c9f2f0 0x55b955071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.276+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 >> 172.21.15.135:0/2874223703 conn(0x55b954cbc300 msgr2=0x55b955068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.278+0000 7f28b5ffb640 0 client.16395 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.278+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 shutdown_connections 2024-05-20T17:38:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.278+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2874223703 wait complete. 2024-05-20T17:38:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.278+0000 7f28dbdf4740 20 client.16395 trim_cache size 0 max 16384 2024-05-20T17:38:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.453+0000 7f28dbdf4740 1 Processor -- start 2024-05-20T17:38:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.458+0000 7f28dbdf4740 1 -- start start 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.458+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.458+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954c9f2f0 0x55b95507d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954cc81b0 0x55b955062df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0011230 con 0x55b954c9f2f0 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57530/0 (socket says 172.21.15.135:57530) 2024-05-20T17:38:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28dbdf4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28b000ead0 con 0x55b954c86d80 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 -- 172.21.15.135:0/2311189196 learned_addr learned my addr 172.21.15.135:0/2311189196 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28b000c920 con 0x55b954cc81b0 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ced9d640 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954cc81b0 0x55b955062df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 -- 172.21.15.135:0/2311189196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954cc81b0 msgr2=0x55b955062df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954cc81b0 0x55b955062df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 -- 172.21.15.135:0/2311189196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954c9f2f0 msgr2=0x55b95507d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954c9f2f0 0x55b95507d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.459+0000 7f28ce59c640 1 -- 172.21.15.135:0/2311189196 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95506cc30 con 0x55b954c86d80 2024-05-20T17:38:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.460+0000 7f28ce59c640 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28c40990e0 tx=0x7f28c4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf9b1945c0db75e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.480+0000 7f28b7fff640 1 -- 172.21.15.135:0/2311189196 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40b9020 con 0x55b954c86d80 2024-05-20T17:38:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.480+0000 7f28b7fff640 1 -- 172.21.15.135:0/2311189196 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28c40a1030 con 0x55b954c86d80 2024-05-20T17:38:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.480+0000 7f28b7fff640 1 -- 172.21.15.135:0/2311189196 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40992f0 con 0x55b954c86d80 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.481+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 msgr2=0x55b955068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.481+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28c40990e0 tx=0x7f28c4017000 comp rx=0 tx=0).stop 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.481+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 shutdown_connections 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.482+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954cc81b0 0x55b955062df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.482+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954c9f2f0 0x55b95507d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.482+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/2311189196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b955068040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.482+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 >> 172.21.15.135:0/2311189196 conn(0x55b954cbc300 msgr2=0x55b955063410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.485+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 shutdown_connections 2024-05-20T17:38:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.485+0000 7f28dbdf4740 1 -- 172.21.15.135:0/2311189196 wait complete. 2024-05-20T17:38:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.486+0000 7f28dbdf4740 1 -- start start 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.486+0000 7f28dbdf4740 1 Processor -- start 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b955088900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57542/0 (socket says 172.21.15.135:57542) 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28cdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:39946/0 (socket says 172.21.15.135:39946) 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28ce59c640 1 -- 172.21.15.135:0/1783364558 learned_addr learned my addr 172.21.15.135:0/1783364558 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28b000cf90 con 0x55b954cc81b0 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28ced9d640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b955088900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28b000e400 con 0x55b954c86d80 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.487+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28b000d660 con 0x55b954c9f2f0 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28dbdf4740 10 client.0 _ll_register_callbacks cb 0x7f28c8009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 -- 172.21.15.135:0/1783364558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 msgr2=0x55b9550883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 -- 172.21.15.135:0/1783364558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 msgr2=0x55b955088900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b955088900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b955072180 con 0x55b954c86d80 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c40a1030 con 0x55b954c86d80 2024-05-20T17:38:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.490+0000 7f28ce59c640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c6a0 tx=0x7f28c409c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff77250fd09401a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.501+0000 7f28b5ffb640 10 client.26036 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:38:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.501+0000 7f28b5ffb640 1 -- 172.21.15.135:0/1783364558 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40a9020 con 0x55b954c86d80 2024-05-20T17:38:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.504+0000 7f28b5ffb640 1 -- 172.21.15.135:0/1783364558 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f28c40ce130 con 0x55b954c86d80 2024-05-20T17:38:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.504+0000 7f28b5ffb640 1 -- 172.21.15.135:0/1783364558 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28c40b9050 con 0x55b954c86d80 2024-05-20T17:38:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.504+0000 7f28dbdf4740 10 client.26036 fetch_fsmap learned FSMap version 27 2024-05-20T17:38:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.504+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b955079470 con 0x55b954c86d80 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28b5ffb640 1 -- 172.21.15.135:0/1783364558 <== mon.2 v2:172.21.15.160:3300/0 4 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f28c40ac020 con 0x55b954c86d80 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 10 client.26036 fetch_fsmap finished waiting for FSMap version 27 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 10 client.26036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 20 client.26036 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b9550799f0 0x55b955079e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 4 client.26036 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b954f518e0 con 0x55b9550799f0 2024-05-20T17:38:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.505+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b9550799f0 0x55b955079e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.506+0000 7f28cdd9b640 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b9550799f0 0x55b955079e00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a59c5f41e3f4c47f server_cookie=6fb5ad9f425e8970 in_seq=0 out_seq=0 2024-05-20T17:38:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:02.506+0000 7f28b5ffb640 10 client.26036 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:03.206 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:02 smithi135 ceph-mon[32027]: pgmap v144: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-20T17:38:03.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:02 smithi160 ceph-mon[36261]: pgmap v144: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-20T17:38:03.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:02 smithi172 ceph-mon[36511]: pgmap v144: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.491+0000 7f28b5ffb640 1 -- 172.21.15.135:0/1783364558 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b954f518e0 con 0x55b9550799f0 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.491+0000 7f28b5ffb640 10 client.26036 handle_command_reply: tid=0 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.491+0000 7f28dbdf4740 1 client.26036 shutdown 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 msgr2=0x55b9550899d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28c400c6a0 tx=0x7f28c409c8e0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 shutdown_connections 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b9550799f0 0x55b955079e00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b954cc81b0 0x55b955088900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b954c9f2f0 0x55b9550883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 --2- 172.21.15.135:0/1783364558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b954c86d80 0x55b9550899d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 >> 172.21.15.135:0/1783364558 conn(0x55b954cbc300 msgr2=0x55b955063350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.492+0000 7f28b5ffb640 0 client.26036 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.493+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 shutdown_connections 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.493+0000 7f28dbdf4740 1 -- 172.21.15.135:0/1783364558 wait complete. 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.493+0000 7f28dbdf4740 20 client.26036 trim_cache size 0 max 16384 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:38:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:38:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.526+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 msgr2=0x7f28b80a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.526+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 0x7f28b80a5410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28c00095f0 tx=0x7f28c0005850 comp rx=0 tx=0).stop 2024-05-20T17:38:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.527+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 msgr2=0x7f28d01a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.527+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28c400e9c0 tx=0x7f28c400ee80 comp rx=0 tx=0).stop 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.527+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 shutdown_connections 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.527+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28b80a2f00 0x7f28b80a5410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.527+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d011c0d0 0x7f28d01acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.528+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0119770 0x7f28d01a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.528+0000 7f28d4e79640 1 --2- 172.21.15.135:0/3530470870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0108f70 0x7f28d01a8300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.528+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 >> 172.21.15.135:0/3530470870 conn(0x7f28d006e600 msgr2=0x7f28d011b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.528+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 shutdown_connections 2024-05-20T17:38:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:03.528+0000 7f28d4e79640 1 -- 172.21.15.135:0/3530470870 wait complete. 2024-05-20T17:38:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:04 smithi135 ceph-mon[32027]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 919 op/s 2024-05-20T17:38:05.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:04 smithi160 ceph-mon[36261]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 919 op/s 2024-05-20T17:38:05.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:04 smithi172 ceph-mon[36511]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 919 op/s 2024-05-20T17:38:05.610 INFO:tasks.workunit.client.0.smithi135.stdout: 277 1776003 466 1220296 429 795138 1208 2024-05-20T17:38:07.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:06 smithi135 ceph-mon[32027]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 914 op/s 2024-05-20T17:38:07.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:06 smithi160 ceph-mon[36261]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 914 op/s 2024-05-20T17:38:07.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:06 smithi172 ceph-mon[36511]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 914 op/s 2024-05-20T17:38:09.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:08 smithi160 ceph-mon[36261]: pgmap v147: 97 pgs: 97 active+clean; 1.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-05-20T17:38:09.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:08 smithi172 ceph-mon[36511]: pgmap v147: 97 pgs: 97 active+clean; 1.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-05-20T17:38:09.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:08 smithi135 ceph-mon[32027]: pgmap v147: 97 pgs: 97 active+clean; 1.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-05-20T17:38:11.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:10 smithi160 ceph-mon[36261]: pgmap v148: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-05-20T17:38:11.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:10 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:11.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:10 smithi172 ceph-mon[36511]: pgmap v148: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-05-20T17:38:11.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:10 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:10 smithi135 ceph-mon[32027]: pgmap v148: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-05-20T17:38:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:10 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:38:13.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:12 smithi160 ceph-mon[36261]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-05-20T17:38:13.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:12 smithi172 ceph-mon[36511]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-05-20T17:38:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:12 smithi135 ceph-mon[32027]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-05-20T17:38:15.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:14 smithi160 ceph-mon[36261]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-05-20T17:38:15.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:14 smithi172 ceph-mon[36511]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-05-20T17:38:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:14 smithi135 ceph-mon[32027]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-05-20T17:38:15.610 INFO:tasks.workunit.client.0.smithi135.stdout: 298 2034063 1140 1409658 1306 917102 1607 2024-05-20T17:38:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.772+0000 7f29f8bc7640 1 -- 172.21.15.135:0/253308160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 msgr2=0x7f29f4107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.772+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/253308160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 0x7f29f4107320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009900 tx=0x7f29e402a420 comp rx=0 tx=0).stop 2024-05-20T17:38:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.776+0000 7f29f8bc7640 1 -- 172.21.15.135:0/253308160 shutdown_connections 2024-05-20T17:38:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.776+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/253308160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 0x7f29f4107320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.776+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/253308160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4106460 0x7f29f4106870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.776+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/253308160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4101a10 0x7f29f4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.776+0000 7f29f8bc7640 1 -- 172.21.15.135:0/253308160 >> 172.21.15.135:0/253308160 conn(0x7f29f4077160 msgr2=0x7f29f40775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.778+0000 7f29f8bc7640 1 -- 172.21.15.135:0/253308160 shutdown_connections 2024-05-20T17:38:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.779+0000 7f29f8bc7640 1 -- 172.21.15.135:0/253308160 wait complete. 2024-05-20T17:38:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.780+0000 7f29f8bc7640 1 Processor -- start 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 -- start start 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 0x7f29f4072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 0x7f29f4072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 0x7f29f410af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29f41193f0 con 0x7f29f4106460 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4119270 con 0x7f29f4101a10 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f8bc7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4119570 con 0x7f29f4106e90 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 0x7f29f4072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 0x7f29f4072a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:37948/0 (socket says 172.21.15.135:37948) 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.783+0000 7f29f259c640 1 -- 172.21.15.135:0/1111003240 learned_addr learned my addr 172.21.15.135:0/1111003240 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 0x7f29f4072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 -- 172.21.15.135:0/1111003240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 msgr2=0x7f29f410af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 0x7f29f410af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 -- 172.21.15.135:0/1111003240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 msgr2=0x7f29f4072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 0x7f29f4072a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.784+0000 7f29f1d9b640 1 -- 172.21.15.135:0/1111003240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f410b580 con 0x7f29f4106460 2024-05-20T17:38:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.788+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 0x7f29f4072f80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d6d0 tx=0x7f29e800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.789+0000 7f29e37fe640 1 -- 172.21.15.135:0/1111003240 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8017070 con 0x7f29f4106460 2024-05-20T17:38:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.790+0000 7f29e37fe640 1 -- 172.21.15.135:0/1111003240 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e8009820 con 0x7f29f4106460 2024-05-20T17:38:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.790+0000 7f29e37fe640 1 -- 172.21.15.135:0/1111003240 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8004ca0 con 0x7f29f4106460 2024-05-20T17:38:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.791+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f410b870 con 0x7f29f4106460 2024-05-20T17:38:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.791+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f410bd70 con 0x7f29f4106460 2024-05-20T17:38:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.795+0000 7f29ffa73740 1 Processor -- start 2024-05-20T17:38:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 -- start start 2024-05-20T17:38:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdde080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bddeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d60bd43340 con 0x55d60ba3f1b0 2024-05-20T17:38:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d60bceb290 con 0x55d60ba162f0 2024-05-20T17:38:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.797+0000 7f29ffa73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d60bd3f300 con 0x55d60ba1e4d0 2024-05-20T17:38:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.798+0000 7f29f259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.798+0000 7f29f259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:37962/0 (socket says 172.21.15.135:37962) 2024-05-20T17:38:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.798+0000 7f29f259c640 1 -- 172.21.15.135:0/2570671043 learned_addr learned my addr 172.21.15.135:0/2570671043 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.798+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdde080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29e37fe640 1 -- 172.21.15.135:0/1111003240 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f29e8010460 con 0x7f29f4106460 2024-05-20T17:38:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bddeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f259c640 1 -- 172.21.15.135:0/2570671043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 msgr2=0x55d60bddeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f259c640 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bddeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f259c640 1 -- 172.21.15.135:0/2570671043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 msgr2=0x55d60bdde080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f259c640 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdde080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.799+0000 7f29f259c640 1 -- 172.21.15.135:0/2570671043 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d60bd0f8e0 con 0x55d60ba162f0 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.800+0000 7f29f259c640 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0103a0 tx=0x7f29ec010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e77447fb69d280 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.800+0000 7f29e0ff9640 1 -- 172.21.15.135:0/2570671043 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec016070 con 0x55d60ba162f0 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.803+0000 7f29e0ff9640 1 -- 172.21.15.135:0/2570671043 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec012bf0 con 0x55d60ba162f0 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.803+0000 7f29e0ff9640 1 -- 172.21.15.135:0/2570671043 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec01bdb0 con 0x55d60ba162f0 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.805+0000 7f29e37fe640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 0x7f29dc0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.805+0000 7f29e37fe640 1 -- 172.21.15.135:0/1111003240 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f29e80cede0 con 0x7f29f4106460 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.806+0000 7f29ffa73740 1 -- 172.21.15.135:0/2570671043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 msgr2=0x55d60bdde5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.806+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0103a0 tx=0x7f29ec010860 comp rx=0 tx=0).stop 2024-05-20T17:38:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.807+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 0x7f29dc0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.810+0000 7f29ffa73740 1 -- 172.21.15.135:0/2570671043 shutdown_connections 2024-05-20T17:38:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.810+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bddeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.810+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bdde5c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.810+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2570671043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdde080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.810+0000 7f29ffa73740 1 -- 172.21.15.135:0/2570671043 >> 172.21.15.135:0/2570671043 conn(0x55d60ba33300 msgr2=0x55d60bdda830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.813+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 0x7f29dc0a5410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29e402aa10 tx=0x7f29e402a920 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.817+0000 7f29ffa73740 1 -- 172.21.15.135:0/2570671043 shutdown_connections 2024-05-20T17:38:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.817+0000 7f29ffa73740 1 -- 172.21.15.135:0/2570671043 wait complete. 2024-05-20T17:38:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.818+0000 7f29ffa73740 1 -- start start 2024-05-20T17:38:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.818+0000 7f29ffa73740 1 Processor -- start 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.818+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bde8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bde8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d60bdeb1b0 con 0x55d60ba3f1b0 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d60bcfe790 con 0x55d60ba162f0 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d60bdeb330 con 0x55d60ba1e4d0 2024-05-20T17:38:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29ffa73740 10 client.0 _ll_register_callbacks cb 0x55d60bd39a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35512/0 (socket says 172.21.15.135:35512) 2024-05-20T17:38:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.819+0000 7f29f2d9d640 1 -- 172.21.15.135:0/2415881762 learned_addr learned my addr 172.21.15.135:0/2415881762 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.820+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bde8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 -- 172.21.15.135:0/2415881762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 msgr2=0x55d60bde8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bde8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 -- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 msgr2=0x55d60bde8740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bde8740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 -- 172.21.15.135:0/2415881762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d60ba57210 con 0x55d60ba3f1b0 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29f2d9d640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f29e40096c0 tx=0x7f29e4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecec52f46ac6dd56 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.823+0000 7f29d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.824+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e404e070 con 0x55d60ba3f1b0 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.824+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29ec012bf0 con 0x55d60ba3f1b0 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.824+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f29e40035f0 con 0x55d60ba3f1b0 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.824+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29e405a050 con 0x55d60ba3f1b0 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.826+0000 7f29ffa73740 10 client.16410 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.826+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d60bb23620 con 0x55d60ba3f1b0 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.827+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec012bf0 con 0x55d60ba3f1b0 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.827+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f29e404a740 con 0x55d60ba3f1b0 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 10 client.16410 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 20 client.16410 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9fdd80 0x55d60bdfaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 4 client.16410 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:38:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.829+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d60bd50a70 con 0x55d60b9fdd80 2024-05-20T17:38:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.830+0000 7f29f259c640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9fdd80 0x55d60bdfaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.831+0000 7f29f259c640 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9fdd80 0x55d60bdfaa90 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e90fe3a8001a87c3 server_cookie=f4df951c31f27d0e in_seq=0 out_seq=0 2024-05-20T17:38:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.832+0000 7f29d9ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.847+0000 7f29d9ffb640 1 -- 172.21.15.135:0/2415881762 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d60bd50a70 con 0x55d60b9fdd80 2024-05-20T17:38:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.847+0000 7f29d9ffb640 10 client.16410 handle_command_reply: tid=0 2024-05-20T17:38:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.850+0000 7f29ffa73740 1 client.16410 shutdown 2024-05-20T17:38:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.851+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 msgr2=0x55d60bdee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.851+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f29e40096c0 tx=0x7f29e4005fd0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 shutdown_connections 2024-05-20T17:38:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9fdd80 0x55d60bdfaa90 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba3f1b0 0x55d60bdee700 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60bde8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 --2- 172.21.15.135:0/2415881762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba162f0 0x55d60bde8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 >> 172.21.15.135:0/2415881762 conn(0x55d60ba33300 msgr2=0x55d60bddfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.856+0000 7f29d9ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.857+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 shutdown_connections 2024-05-20T17:38:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.858+0000 7f29ffa73740 1 -- 172.21.15.135:0/2415881762 wait complete. 2024-05-20T17:38:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.858+0000 7f29ffa73740 20 client.16410 trim_cache size 0 max 16384 2024-05-20T17:38:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.892+0000 7f29ffa73740 1 Processor -- start 2024-05-20T17:38:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.892+0000 7f29ffa73740 1 -- start start 2024-05-20T17:38:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 0x55d60bde23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60be00290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60be007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29d40111f0 con 0x55d60ba162f0 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29d400ea60 con 0x55d60ba3f1b0 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29ffa73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29d400c8b0 con 0x55d60ba1e4d0 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29f259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 0x55d60bde23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.893+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60be007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.894+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60be007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:37972/0 (socket says 172.21.15.135:37972) 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.894+0000 7f29f2d9d640 1 -- 172.21.15.135:0/1776043611 learned_addr learned my addr 172.21.15.135:0/1776043611 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.894+0000 7f29f259c640 1 -- 172.21.15.135:0/1776043611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 msgr2=0x55d60be00290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.894+0000 7f29f259c640 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60be00290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.895+0000 7f29f259c640 1 -- 172.21.15.135:0/1776043611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 msgr2=0x55d60be007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.895+0000 7f29f259c640 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60be007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.895+0000 7f29f259c640 1 -- 172.21.15.135:0/1776043611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d60bddb8f0 con 0x55d60ba162f0 2024-05-20T17:38:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.895+0000 7f29f259c640 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 0x55d60bde23e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55d60bddf430 tx=0x7f29ec01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64936f0a871bc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.896+0000 7f29dbfff640 1 -- 172.21.15.135:0/1776043611 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec02c070 con 0x55d60ba162f0 2024-05-20T17:38:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.897+0000 7f29dbfff640 1 -- 172.21.15.135:0/1776043611 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec003970 con 0x55d60ba162f0 2024-05-20T17:38:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.897+0000 7f29dbfff640 1 -- 172.21.15.135:0/1776043611 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec016040 con 0x55d60ba162f0 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 -- 172.21.15.135:0/1776043611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 msgr2=0x55d60bde23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 0x55d60bde23e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55d60bddf430 tx=0x7f29ec01b910 comp rx=0 tx=0).stop 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 -- 172.21.15.135:0/1776043611 shutdown_connections 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60be007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba1e4d0 0x55d60be00290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 --2- 172.21.15.135:0/1776043611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba162f0 0x55d60bde23e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.898+0000 7f29ffa73740 1 -- 172.21.15.135:0/1776043611 >> 172.21.15.135:0/1776043611 conn(0x55d60ba33300 msgr2=0x55d60bde1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.901+0000 7f29ffa73740 1 -- 172.21.15.135:0/1776043611 shutdown_connections 2024-05-20T17:38:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.904+0000 7f29ffa73740 1 -- 172.21.15.135:0/1776043611 wait complete. 2024-05-20T17:38:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.904+0000 7f29ffa73740 1 -- start start 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 Processor -- start 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba162f0 0x55d60bdf4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60bdf06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29d400cf20 con 0x55d60ba1e4d0 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29d400e390 con 0x55d60ba3f1b0 2024-05-20T17:38:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29d400d5f0 con 0x55d60ba162f0 2024-05-20T17:38:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.905+0000 7f29ffa73740 10 client.0 _ll_register_callbacks cb 0x7f29e4041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.906+0000 7f29f1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.906+0000 7f29f1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35544/0 (socket says 172.21.15.135:35544) 2024-05-20T17:38:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.906+0000 7f29f1d9b640 1 -- 172.21.15.135:0/3410215692 learned_addr learned my addr 172.21.15.135:0/3410215692 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.907+0000 7f29f1d9b640 1 -- 172.21.15.135:0/3410215692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba162f0 msgr2=0x55d60bdf4e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:38:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.907+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba162f0 0x55d60bdf4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.907+0000 7f29f1d9b640 1 -- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 msgr2=0x55d60bdf06f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:38:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.907+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60bdf06f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.907+0000 7f29f1d9b640 1 -- 172.21.15.135:0/3410215692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d60bdf0c30 con 0x55d60ba1e4d0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29f1d9b640 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009610 tx=0x7f29e809bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b4ce81a003ee1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8020040 con 0x55d60ba1e4d0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29ec003970 con 0x55d60ba1e4d0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f29e8009d20 con 0x55d60ba1e4d0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.908+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29e80a3fc0 con 0x55d60ba1e4d0 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.909+0000 7f29ffa73740 10 client.16416 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.909+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d60be62a40 con 0x55d60ba1e4d0 2024-05-20T17:38:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.912+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec003970 con 0x55d60ba1e4d0 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.913+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f29e80a1ce0 con 0x55d60ba1e4d0 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 10 client.16416 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 20 client.16416 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9d31c0 0x55d60be65230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 4 client.16416 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:38:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.914+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d60bd4adc0 con 0x55d60b9d31c0 2024-05-20T17:38:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.915+0000 7f29f259c640 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9d31c0 0x55d60be65230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.925+0000 7f29f259c640 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9d31c0 0x55d60be65230 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef768152dc995bb server_cookie=5e0d53fd01d62534 in_seq=0 out_seq=0 2024-05-20T17:38:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:16.925+0000 7f29d9ffb640 10 client.16416 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:17.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:16 smithi160 ceph-mon[36261]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-05-20T17:38:17.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:16 smithi172 ceph-mon[36511]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-05-20T17:38:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:16 smithi135 ceph-mon[32027]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-05-20T17:38:19.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:18 smithi160 ceph-mon[36261]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-05-20T17:38:19.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:18 smithi172 ceph-mon[36511]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-05-20T17:38:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:18 smithi135 ceph-mon[32027]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-05-20T17:38:21.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:20 smithi160 ceph-mon[36261]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 329 op/s 2024-05-20T17:38:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:20 smithi172 ceph-mon[36511]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 329 op/s 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29d9ffb640 1 -- 172.21.15.135:0/3410215692 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d60bd4adc0 con 0x55d60b9d31c0 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29d9ffb640 10 client.16416 handle_command_reply: tid=0 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 client.16416 shutdown 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 msgr2=0x55d60bdf01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009610 tx=0x7f29e809bdb0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 shutdown_connections 2024-05-20T17:38:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d60b9d31c0 0x55d60be65230 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d60ba3f1b0 0x55d60bdf06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d60ba1e4d0 0x55d60bdf01b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 --2- 172.21.15.135:0/3410215692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d60ba162f0 0x55d60bdf4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 >> 172.21.15.135:0/3410215692 conn(0x55d60ba33300 msgr2=0x55d60bddde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29d9ffb640 0 client.16416 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 shutdown_connections 2024-05-20T17:38:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.357+0000 7f29ffa73740 1 -- 172.21.15.135:0/3410215692 wait complete. 2024-05-20T17:38:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29ffa73740 20 client.16416 trim_cache size 0 max 16384 2024-05-20T17:38:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:38:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:38:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:38:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:38:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 msgr2=0x7f29dc0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 0x7f29dc0a5410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29e402aa10 tx=0x7f29e402a920 comp rx=0 tx=0).stop 2024-05-20T17:38:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 msgr2=0x7f29f4072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 0x7f29f4072f80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d6d0 tx=0x7f29e800db90 comp rx=0 tx=0).stop 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 shutdown_connections 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f29dc0a2f00 0x7f29dc0a5410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f4106e90 0x7f29f410af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29f4106460 0x7f29f4072f80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 --2- 172.21.15.135:0/1111003240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29f4101a10 0x7f29f4072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 >> 172.21.15.135:0/1111003240 conn(0x7f29f4077160 msgr2=0x7f29f4103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.358+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 shutdown_connections 2024-05-20T17:38:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:21.359+0000 7f29f8bc7640 1 -- 172.21.15.135:0/1111003240 wait complete. 2024-05-20T17:38:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:20 smithi135 ceph-mon[32027]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 329 op/s 2024-05-20T17:38:23.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:22 smithi160 ceph-mon[36261]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.20k op/s 2024-05-20T17:38:23.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:22 smithi172 ceph-mon[36511]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.20k op/s 2024-05-20T17:38:23.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:22 smithi135 ceph-mon[32027]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.20k op/s 2024-05-20T17:38:25.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:24 smithi160 ceph-mon[36261]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.65k op/s 2024-05-20T17:38:25.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:24 smithi172 ceph-mon[36511]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.65k op/s 2024-05-20T17:38:25.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:24 smithi135 ceph-mon[32027]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.65k op/s 2024-05-20T17:38:25.610 INFO:tasks.workunit.client.0.smithi135.stdout: 298 35258 158 23301 27 14667 374 2024-05-20T17:38:27.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:26 smithi160 ceph-mon[36261]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.64k op/s 2024-05-20T17:38:27.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:26 smithi172 ceph-mon[36511]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.64k op/s 2024-05-20T17:38:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:26 smithi135 ceph-mon[32027]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 1.64k op/s 2024-05-20T17:38:29.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:28 smithi160 ceph-mon[36261]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.82k op/s 2024-05-20T17:38:29.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:28 smithi172 ceph-mon[36511]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.82k op/s 2024-05-20T17:38:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:28 smithi135 ceph-mon[32027]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 1.82k op/s 2024-05-20T17:38:31.255 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:30 smithi135 ceph-mon[32027]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.73k op/s 2024-05-20T17:38:31.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:31 smithi160 ceph-mon[36261]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.73k op/s 2024-05-20T17:38:31.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:30 smithi172 ceph-mon[36511]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 1.73k op/s 2024-05-20T17:38:33.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:33 smithi160 ceph-mon[36261]: pgmap v159: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.65k op/s 2024-05-20T17:38:33.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:33 smithi172 ceph-mon[36511]: pgmap v159: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.65k op/s 2024-05-20T17:38:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:33 smithi135 ceph-mon[32027]: pgmap v159: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.65k op/s 2024-05-20T17:38:35.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.103+0000 7f36b895e640 1 -- 172.21.15.135:0/4159361314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 msgr2=0x7f36b410e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.103+0000 7f36b895e640 1 --2- 172.21.15.135:0/4159361314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b410e4a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009ca0 tx=0x7f36ac02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 -- 172.21.15.135:0/4159361314 shutdown_connections 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 --2- 172.21.15.135:0/4159361314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b410e4a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 --2- 172.21.15.135:0/4159361314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107eb0 0x7f36b4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 --2- 172.21.15.135:0/4159361314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107a10 0x7f36b41015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 -- 172.21.15.135:0/4159361314 >> 172.21.15.135:0/4159361314 conn(0x7f36b4077160 msgr2=0x7f36b40775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 -- 172.21.15.135:0/4159361314 shutdown_connections 2024-05-20T17:38:35.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.104+0000 7f36b895e640 1 -- 172.21.15.135:0/4159361314 wait complete. 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 Processor -- start 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 -- start start 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 0x7f36b419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4110c80 con 0x7f36b4102170 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4110b00 con 0x7f36b4107eb0 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.105+0000 7f36b895e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4110e00 con 0x7f36b4107a10 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:43850/0 (socket says 172.21.15.135:43850) 2024-05-20T17:38:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36568/0 (socket says 172.21.15.135:36568) 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b1d9b640 1 -- 172.21.15.135:0/1076511045 learned_addr learned my addr 172.21.15.135:0/1076511045 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 0x7f36b419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 -- 172.21.15.135:0/1076511045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 msgr2=0x7f36b4197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 -- 172.21.15.135:0/1076511045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 msgr2=0x7f36b419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 0x7f36b419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 -- 172.21.15.135:0/1076511045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b419c460 con 0x7f36b4102170 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 0x7f36b419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36b259c640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f36b4102700 tx=0x7f36a400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.106+0000 7f36a37fe640 1 -- 172.21.15.135:0/1076511045 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400cc40 con 0x7f36b4102170 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.107+0000 7f36a37fe640 1 -- 172.21.15.135:0/1076511045 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a400cde0 con 0x7f36b4102170 2024-05-20T17:38:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.107+0000 7f36a37fe640 1 -- 172.21.15.135:0/1076511045 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a40188e0 con 0x7f36b4102170 2024-05-20T17:38:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.107+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b419c750 con 0x7f36b4102170 2024-05-20T17:38:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.107+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b419cc50 con 0x7f36b4102170 2024-05-20T17:38:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.110+0000 7f36bf80a740 1 Processor -- start 2024-05-20T17:38:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 -- start start 2024-05-20T17:38:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ad995c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ad99b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55756acfe340 con 0x55756a9d94d0 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55756aca6290 con 0x55756a9d12f0 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36bf80a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55756acfa300 con 0x55756a9fa1b0 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ad99b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:43858/0 (socket says 172.21.15.135:43858) 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 -- 172.21.15.135:0/2799326112 learned_addr learned my addr 172.21.15.135:0/2799326112 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 -- 172.21.15.135:0/2799326112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 msgr2=0x55756ad995c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:38:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ad995c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 -- 172.21.15.135:0/2799326112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 msgr2=0x55756ad99b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ad99b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b2d9d640 1 -- 172.21.15.135:0/2799326112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756acca8e0 con 0x55756a9fa1b0 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.111+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ad99b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.112+0000 7f36a37fe640 1 -- 172.21.15.135:0/1076511045 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f36a4018a80 con 0x7f36b4102170 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.112+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009ca0 tx=0x7f36ac009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9530f3d32cee1a37 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.112+0000 7f36a0ff9640 1 -- 172.21.15.135:0/2799326112 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003b70 con 0x55756a9fa1b0 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.112+0000 7f36a0ff9640 1 -- 172.21.15.135:0/2799326112 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36ac036040 con 0x55756a9fa1b0 2024-05-20T17:38:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.112+0000 7f36a0ff9640 1 -- 172.21.15.135:0/2799326112 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004660 con 0x55756a9fa1b0 2024-05-20T17:38:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36a37fe640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 0x7f369c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36b259c640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 0x7f369c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36a37fe640 1 -- 172.21.15.135:0/1076511045 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f36a40cf680 con 0x7f36b4102170 2024-05-20T17:38:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 -- 172.21.15.135:0/2799326112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 msgr2=0x55756ad99080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009ca0 tx=0x7f36ac009440 comp rx=0 tx=0).stop 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36b259c640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 0x7f369c0a5280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55756ad96b70 tx=0x7f36a40910e0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 -- 172.21.15.135:0/2799326112 shutdown_connections 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ad99b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ad995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 --2- 172.21.15.135:0/2799326112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ad99080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.113+0000 7f36bf80a740 1 -- 172.21.15.135:0/2799326112 >> 172.21.15.135:0/2799326112 conn(0x55756a9ee300 msgr2=0x55756ad95830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 -- 172.21.15.135:0/2799326112 shutdown_connections 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 -- 172.21.15.135:0/2799326112 wait complete. 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 -- start start 2024-05-20T17:38:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 Processor -- start 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ada3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.114+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ada94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36bf80a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55756ada5fd0 con 0x55756a9d94d0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36bf80a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55756acb9790 con 0x55756a9d12f0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36bf80a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55756ada6150 con 0x55756a9fa1b0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36bf80a740 10 client.0 _ll_register_callbacks cb 0x55756acf4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ada94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36590/0 (socket says 172.21.15.135:36590) 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 -- 172.21.15.135:0/495373912 learned_addr learned my addr 172.21.15.135:0/495373912 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ada3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 -- 172.21.15.135:0/495373912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 msgr2=0x55756ada94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ada94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 -- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 msgr2=0x55756ada3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ada3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 -- 172.21.15.135:0/495373912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55756aa12210 con 0x55756a9d94d0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36a8015db0 tx=0x7f36a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828795439c950172 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f3699ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.115+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a800ae40 con 0x55756a9d94d0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f36a8004050 con 0x55756a9d94d0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36ac036040 con 0x55756a9d94d0 2024-05-20T17:38:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36a8004250 con 0x55756a9d94d0 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 10 client.16428 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55756aade620 con 0x55756a9d94d0 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36ac036040 con 0x55756a9d94d0 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f36a80286c0 con 0x55756a9d94d0 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 10 client.16428 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 10 client.16428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 20 client.16428 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9b8d80 0x55756adb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 4 client.16428 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55756ad0ba70 con 0x55756a9b8d80 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.116+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9b8d80 0x55756adb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.117+0000 7f3699ffb640 10 client.16428 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.117+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9b8d80 0x55756adb5800 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a89834249ecbea9 server_cookie=20157c3544c5aa87 in_seq=0 out_seq=0 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f3699ffb640 1 -- 172.21.15.135:0/495373912 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55756ad0ba70 con 0x55756a9b8d80 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f3699ffb640 10 client.16428 handle_command_reply: tid=0 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 client.16428 shutdown 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 msgr2=0x55756ada3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36a8015db0 tx=0x7f36a800a620 comp rx=0 tx=0).stop 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 shutdown_connections 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9b8d80 0x55756adb5800 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f3699ffb640 0 client.16428 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9fa1b0 0x55756ada94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9d94d0 0x55756ada3ce0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 --2- 172.21.15.135:0/495373912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756ada3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 >> 172.21.15.135:0/495373912 conn(0x55756a9ee300 msgr2=0x55756ad98eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 shutdown_connections 2024-05-20T17:38:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.118+0000 7f36bf80a740 1 -- 172.21.15.135:0/495373912 wait complete. 2024-05-20T17:38:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.119+0000 7f36bf80a740 20 client.16428 trim_cache size 0 max 16384 2024-05-20T17:38:35.137 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 Processor -- start 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 -- start start 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d12f0 0x55756ada93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d94d0 0x55756ada9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41af300 con 0x55756a9b8d80 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41acb70 con 0x55756a9d94d0 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36bf80a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41aa9c0 con 0x55756a9d12f0 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36b1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d12f0 0x55756ada93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36600/0 (socket says 172.21.15.135:36600) 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.135+0000 7f36b2d9d640 1 -- 172.21.15.135:0/1204533998 learned_addr learned my addr 172.21.15.135:0/1204533998 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d94d0 0x55756ada9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 -- 172.21.15.135:0/1204533998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d12f0 msgr2=0x55756ada93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d12f0 0x55756ada93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 -- 172.21.15.135:0/1204533998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d94d0 msgr2=0x55756ada9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d94d0 0x55756ada9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 -- 172.21.15.135:0/1204533998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756ada5e10 con 0x55756a9b8d80 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0042d0 tx=0x7f36ac02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f65339f9cd242f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f369bfff640 1 -- 172.21.15.135:0/1204533998 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004660 con 0x55756a9b8d80 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f369bfff640 1 -- 172.21.15.135:0/1204533998 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36ac036050 con 0x55756a9b8d80 2024-05-20T17:38:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.136+0000 7f369bfff640 1 -- 172.21.15.135:0/1204533998 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac02f610 con 0x55756a9b8d80 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 -- 172.21.15.135:0/1204533998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 msgr2=0x55756ad9d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0042d0 tx=0x7f36ac02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 -- 172.21.15.135:0/1204533998 shutdown_connections 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d94d0 0x55756ada9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d12f0 0x55756ada93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 --2- 172.21.15.135:0/1204533998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756ad9d450 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 -- 172.21.15.135:0/1204533998 >> 172.21.15.135:0/1204533998 conn(0x55756a9ee300 msgr2=0x55756ad9cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 -- 172.21.15.135:0/1204533998 shutdown_connections 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.137+0000 7f36bf80a740 1 -- 172.21.15.135:0/1204533998 wait complete. 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36bf80a740 1 -- start start 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36bf80a740 1 Processor -- start 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756adacc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36b2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36612/0 (socket says 172.21.15.135:36612) 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36bf80a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d94d0 0x55756adad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.138+0000 7f36b2d9d640 1 -- 172.21.15.135:0/493511189 learned_addr learned my addr 172.21.15.135:0/493511189 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41ab030 con 0x55756a9b8d80 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41ac4a0 con 0x55756a9d12f0 2024-05-20T17:38:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41ab700 con 0x55756a9d94d0 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36bf80a740 10 client.0 _ll_register_callbacks cb 0x7f36a800bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756adacc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d94d0 0x55756adad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 -- 172.21.15.135:0/493511189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d94d0 msgr2=0x55756adad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d94d0 0x55756adad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 -- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 msgr2=0x55756adacc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756adacc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55756adad9a0 con 0x55756a9b8d80 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756adacc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36b2d9d640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55756adb2370 tx=0x7f36ac004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0a6c883c8e49db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f3699ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004720 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f36ac0317c0 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.139+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36ac036050 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36ac0319c0 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 10 client.16434 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55756ae1dbc0 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36ac036050 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f36ac050040 con 0x55756a9b8d80 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 10 client.16434 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 10 client.16434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 20 client.16434 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9fa1b0 0x55756ae20090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 4 client.16434 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:38:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.140+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55756ad05dc0 con 0x55756a9fa1b0 2024-05-20T17:38:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.141+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9fa1b0 0x55756ae20090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.141+0000 7f3699ffb640 10 client.16434 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.141+0000 7f36b1d9b640 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9fa1b0 0x55756ae20090 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf49bb8f264dc973 server_cookie=482b8f932712941 in_seq=0 out_seq=0 2024-05-20T17:38:35.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:35 smithi172 ceph-mon[36511]: pgmap v160: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 772 op/s 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.404+0000 7f3699ffb640 1 -- 172.21.15.135:0/493511189 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55756ad05dc0 con 0x55756a9fa1b0 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.404+0000 7f3699ffb640 10 client.16434 handle_command_reply: tid=0 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.404+0000 7f36bf80a740 1 client.16434 shutdown 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.410+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 msgr2=0x55756adaf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.410+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55756adb2370 tx=0x7f36ac004300 comp rx=0 tx=0).stop 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 shutdown_connections 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55756a9fa1b0 0x55756ae20090 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55756a9d94d0 0x55756adad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55756a9d12f0 0x55756adacc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 --2- 172.21.15.135:0/493511189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55756a9b8d80 0x55756adaf8a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f3699ffb640 0 client.16434 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 >> 172.21.15.135:0/493511189 conn(0x55756a9ee300 msgr2=0x55756ad98e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 shutdown_connections 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 1 -- 172.21.15.135:0/493511189 wait complete. 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.412+0000 7f36bf80a740 20 client.16434 trim_cache size 0 max 16384 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:38:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.414+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 msgr2=0x7f369c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.414+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 0x7f369c0a5280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55756ad96b70 tx=0x7f36a40910e0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.414+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 msgr2=0x7f36b4197600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.414+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f36b4102700 tx=0x7f36a400ee50 comp rx=0 tx=0).stop 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 shutdown_connections 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f369c0a2d70 0x7f369c0a5280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36b4107eb0 0x7f36b419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36b4107a10 0x7f36b4197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 --2- 172.21.15.135:0/1076511045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36b4102170 0x7f36b4197600 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 >> 172.21.15.135:0/1076511045 conn(0x7f36b4077160 msgr2=0x7f36b40ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:35.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 shutdown_connections 2024-05-20T17:38:35.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:35.416+0000 7f36b895e640 1 -- 172.21.15.135:0/1076511045 wait complete. 2024-05-20T17:38:35.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:35 smithi135 ceph-mon[32027]: pgmap v160: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 772 op/s 2024-05-20T17:38:35.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:35 smithi160 ceph-mon[36261]: pgmap v160: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 772 op/s 2024-05-20T17:38:35.610 INFO:tasks.workunit.client.0.smithi135.stdout: 307 1709439 459 1188933 752 772607 967 2024-05-20T17:38:37.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:37 smithi172 ceph-mon[36511]: pgmap v161: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 238 op/s 2024-05-20T17:38:37.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:37 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:38:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:37 smithi135 ceph-mon[32027]: pgmap v161: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 238 op/s 2024-05-20T17:38:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:37 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:38:37.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:37 smithi160 ceph-mon[36261]: pgmap v161: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 238 op/s 2024-05-20T17:38:37.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:37 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:38:39.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:39 smithi172 ceph-mon[36511]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 395 op/s 2024-05-20T17:38:39.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:39 smithi135 ceph-mon[32027]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 395 op/s 2024-05-20T17:38:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:39 smithi160 ceph-mon[36261]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 395 op/s 2024-05-20T17:38:41.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:41 smithi172 ceph-mon[36511]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-20T17:38:41.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:41 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:38:41.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:41 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:38:41.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:41 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:38:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:41 smithi135 ceph-mon[32027]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-20T17:38:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:41 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:38:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:41 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:38:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:41 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:38:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:41 smithi160 ceph-mon[36261]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-20T17:38:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:41 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:38:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:41 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:38:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:41 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:38:43.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:43 smithi172 ceph-mon[36511]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-05-20T17:38:43.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:43 smithi135 ceph-mon[32027]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-05-20T17:38:43.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:43 smithi160 ceph-mon[36261]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-05-20T17:38:45.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:45 smithi172 ceph-mon[36511]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-05-20T17:38:45.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:45 smithi135 ceph-mon[32027]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-05-20T17:38:45.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:45 smithi160 ceph-mon[36261]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-05-20T17:38:45.610 INFO:tasks.workunit.client.0.smithi135.stdout: 317 2149792 729 1508449 663 972892 1125 2024-05-20T17:38:47.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:47 smithi172 ceph-mon[36511]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 313 op/s 2024-05-20T17:38:47.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:47 smithi135 ceph-mon[32027]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 313 op/s 2024-05-20T17:38:47.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:47 smithi160 ceph-mon[36261]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 313 op/s 2024-05-20T17:38:49.307 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:49 smithi160 ceph-mon[36261]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.5 MiB/s wr, 534 op/s 2024-05-20T17:38:49.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:49 smithi172 ceph-mon[36511]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.5 MiB/s wr, 534 op/s 2024-05-20T17:38:49.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:49 smithi135 ceph-mon[32027]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.5 MiB/s wr, 534 op/s 2024-05-20T17:38:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.144+0000 7f53f1ffb640 1 -- 172.21.15.135:0/1891901848 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40319b0 con 0x7f53f411c0d0 2024-05-20T17:38:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.144+0000 7f53f94c3640 1 -- 172.21.15.135:0/1891901848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 msgr2=0x7f53f411e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.144+0000 7f53f94c3640 1 --2- 172.21.15.135:0/1891901848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f411e4f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009950 tx=0x7f53e402a4f0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.158+0000 7f53f94c3640 1 -- 172.21.15.135:0/1891901848 shutdown_connections 2024-05-20T17:38:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.158+0000 7f53f94c3640 1 --2- 172.21.15.135:0/1891901848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f411e4f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.158+0000 7f53f94c3640 1 --2- 172.21.15.135:0/1891901848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f411bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.158+0000 7f53f94c3640 1 --2- 172.21.15.135:0/1891901848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.158+0000 7f53f94c3640 1 -- 172.21.15.135:0/1891901848 >> 172.21.15.135:0/1891901848 conn(0x7f53f406e600 msgr2=0x7f53f406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.160+0000 7f53f94c3640 1 -- 172.21.15.135:0/1891901848 shutdown_connections 2024-05-20T17:38:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.161+0000 7f53f94c3640 1 -- 172.21.15.135:0/1891901848 wait complete. 2024-05-20T17:38:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.162+0000 7f53f94c3640 1 Processor -- start 2024-05-20T17:38:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.162+0000 7f53f94c3640 1 -- start start 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4118eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f4113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4111570 con 0x7f53f411c0d0 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41113f0 con 0x7f53f4119770 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f94c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41116f0 con 0x7f53f4108f70 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4118eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51376/0 (socket says 172.21.15.135:51376) 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4118eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:39598/0 (socket says 172.21.15.135:39598) 2024-05-20T17:38:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 -- 172.21.15.135:0/3953397715 learned_addr learned my addr 172.21.15.135:0/3953397715 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f37fe640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f4113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 -- 172.21.15.135:0/3953397715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 msgr2=0x7f53f4118eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4118eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.163+0000 7f53f27fc640 1 -- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 msgr2=0x7f53f4113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.164+0000 7f53f27fc640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f4113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.164+0000 7f53f27fc640 1 -- 172.21.15.135:0/3953397715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f4113b40 con 0x7f53f4119770 2024-05-20T17:38:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.164+0000 7f53f37fe640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f4113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:38:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.164+0000 7f53f27fc640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00ba50 tx=0x7f53ec00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.199+0000 7f53e3fff640 1 -- 172.21.15.135:0/3953397715 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec019070 con 0x7f53f4119770 2024-05-20T17:38:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.200+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f41bd240 con 0x7f53f4119770 2024-05-20T17:38:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.200+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f41bd5f0 con 0x7f53f4119770 2024-05-20T17:38:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.205+0000 7f5400366740 1 Processor -- start 2024-05-20T17:38:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.205+0000 7f5400366740 1 -- start start 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557891a121b0 0x557891db1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891db1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557891d16340 con 0x557891a121b0 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557891cbe290 con 0x5578919f14d0 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f5400366740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557891d12300 con 0x5578919e92f0 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:39614/0 (socket says 172.21.15.135:39614) 2024-05-20T17:38:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.206+0000 7f53f2ffd640 1 -- 172.21.15.135:0/793009375 learned_addr learned my addr 172.21.15.135:0/793009375 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 -- 172.21.15.135:0/793009375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 msgr2=0x557891db1cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891db1cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 -- 172.21.15.135:0/793009375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557891a121b0 msgr2=0x557891db1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557891a121b0 0x557891db1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 -- 172.21.15.135:0/793009375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557891ce28e0 con 0x5578919e92f0 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.208+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53e800ac20 tx=0x7f53e800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c083efad2d0d10 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.209+0000 7f53e3fff640 1 -- 172.21.15.135:0/3953397715 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ec00cbe0 con 0x7f53f4119770 2024-05-20T17:38:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.210+0000 7f53e3fff640 1 -- 172.21.15.135:0/3953397715 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec007750 con 0x7f53f4119770 2024-05-20T17:38:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.213+0000 7f53e3fff640 1 -- 172.21.15.135:0/3953397715 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f53ec01c070 con 0x7f53f4119770 2024-05-20T17:38:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.214+0000 7f53e3fff640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 0x7f53dc0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.231+0000 7f53f37fe640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 0x7f53dc0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.232+0000 7f53f37fe640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 0x7f53dc0a5440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557891dae3e0 tx=0x7f53e402a9f0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.233+0000 7f53e3fff640 1 -- 172.21.15.135:0/3953397715 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f53ec0cf9a0 con 0x7f53f4119770 2024-05-20T17:38:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.259+0000 7f53e17fa640 1 -- 172.21.15.135:0/793009375 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e801d070 con 0x5578919e92f0 2024-05-20T17:38:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.259+0000 7f53e17fa640 1 -- 172.21.15.135:0/793009375 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8018b20 con 0x5578919e92f0 2024-05-20T17:38:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 -- 172.21.15.135:0/793009375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 msgr2=0x557891db17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53e800ac20 tx=0x7f53e800f790 comp rx=0 tx=0).stop 2024-05-20T17:38:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 -- 172.21.15.135:0/793009375 shutdown_connections 2024-05-20T17:38:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891db1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578919e92f0 0x557891db17b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 --2- 172.21.15.135:0/793009375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557891a121b0 0x557891db1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.261+0000 7f5400366740 1 -- 172.21.15.135:0/793009375 >> 172.21.15.135:0/793009375 conn(0x557891a06300 msgr2=0x557891dada20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.264+0000 7f5400366740 1 -- 172.21.15.135:0/793009375 shutdown_connections 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.264+0000 7f5400366740 1 -- 172.21.15.135:0/793009375 wait complete. 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.264+0000 7f5400366740 1 -- start start 2024-05-20T17:38:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 Processor -- start 2024-05-20T17:38:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891dbd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dbb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557891dbe3f0 con 0x5578919e92f0 2024-05-20T17:38:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x557891cd1790 con 0x5578919f14d0 2024-05-20T17:38:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557891dbe570 con 0x557891a121b0 2024-05-20T17:38:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.265+0000 7f5400366740 10 client.0 _ll_register_callbacks cb 0x557891d0ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51132/0 (socket says 172.21.15.135:51132) 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 -- 172.21.15.135:0/3794442534 learned_addr learned my addr 172.21.15.135:0/3794442534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 -- 172.21.15.135:0/3794442534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 msgr2=0x557891dbb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dbb7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 -- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 msgr2=0x557891dbd840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.266+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891dbd840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.267+0000 7f53f2ffd640 1 -- 172.21.15.135:0/3794442534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557891a2a210 con 0x5578919e92f0 2024-05-20T17:38:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.267+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f53e801b040 tx=0x7f53e80189e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25efe2863842b6f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.296+0000 7f53da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:38:50.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.296+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e801d050 con 0x5578919e92f0 2024-05-20T17:38:50.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.296+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e8018b20 con 0x5578919e92f0 2024-05-20T17:38:50.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.296+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f53e8005240 con 0x5578919e92f0 2024-05-20T17:38:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.300+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53e8032050 con 0x5578919e92f0 2024-05-20T17:38:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.300+0000 7f5400366740 10 client.16443 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.300+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557891af6620 con 0x5578919e92f0 2024-05-20T17:38:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.303+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8018b20 con 0x5578919e92f0 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.304+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f53e8004c50 con 0x5578919e92f0 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 10 client.16443 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 20 client.16443 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919d0d80 0x557891dce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 4 client.16443 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:38:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557891d23a70 con 0x5578919d0d80 2024-05-20T17:38:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.305+0000 7f53f27fc640 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919d0d80 0x557891dce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.306+0000 7f53f27fc640 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919d0d80 0x557891dce200 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcadbdc23256d493 server_cookie=74d971310bc88b44 in_seq=0 out_seq=0 2024-05-20T17:38:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.306+0000 7f53da7fc640 10 client.16443 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.307+0000 7f53da7fc640 1 -- 172.21.15.135:0/3794442534 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557891d23a70 con 0x5578919d0d80 2024-05-20T17:38:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.307+0000 7f53da7fc640 10 client.16443 handle_command_reply: tid=0 2024-05-20T17:38:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.308+0000 7f5400366740 1 client.16443 shutdown 2024-05-20T17:38:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.313+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 msgr2=0x557891dbd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.313+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f53e801b040 tx=0x7f53e80189e0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 shutdown_connections 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919d0d80 0x557891dce200 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dbb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919f14d0 0x557891dbd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 --2- 172.21.15.135:0/3794442534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919e92f0 0x557891dbd300 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.315+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 >> 172.21.15.135:0/3794442534 conn(0x557891a06300 msgr2=0x557891db2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.317+0000 7f53da7fc640 0 client.16443 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.317+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 shutdown_connections 2024-05-20T17:38:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.317+0000 7f5400366740 1 -- 172.21.15.135:0/3794442534 wait complete. 2024-05-20T17:38:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.320+0000 7f5400366740 20 client.16443 trim_cache size 0 max 16384 2024-05-20T17:38:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.509+0000 7f5400366740 1 Processor -- start 2024-05-20T17:38:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.512+0000 7f5400366740 1 -- start start 2024-05-20T17:38:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.518+0000 7f5400366740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f5400366740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dd3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f5400366740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dd3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51390/0 (socket says 172.21.15.135:51390) 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 -- 172.21.15.135:0/401133528 learned_addr learned my addr 172.21.15.135:0/401133528 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40110c0 con 0x5578919f14d0 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400e930 con 0x5578919e92f0 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400c830 con 0x557891a121b0 2024-05-20T17:38:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f27fc640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dd3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f37fe640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dd3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 -- 172.21.15.135:0/401133528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 msgr2=0x557891dd3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dd3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.519+0000 7f53f2ffd640 1 -- 172.21.15.135:0/401133528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 msgr2=0x557891dd3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.520+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dd3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.520+0000 7f53f2ffd640 1 -- 172.21.15.135:0/401133528 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557891dbcc90 con 0x5578919e92f0 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.520+0000 7f53f27fc640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dd3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.520+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53e8024620 tx=0x7f53e800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8711bbdd20c08 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.545+0000 7f53e0ff9640 1 -- 172.21.15.135:0/401133528 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e801d040 con 0x5578919e92f0 2024-05-20T17:38:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.545+0000 7f53e0ff9640 1 -- 172.21.15.135:0/401133528 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8029070 con 0x5578919e92f0 2024-05-20T17:38:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.545+0000 7f53e0ff9640 1 -- 172.21.15.135:0/401133528 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80249c0 con 0x5578919e92f0 2024-05-20T17:38:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.547+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 msgr2=0x557891db5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.547+0000 7f5400366740 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53e8024620 tx=0x7f53e800f790 comp rx=0 tx=0).stop 2024-05-20T17:38:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.548+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 shutdown_connections 2024-05-20T17:38:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.548+0000 7f5400366740 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891dd3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.548+0000 7f5400366740 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dd3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.548+0000 7f5400366740 1 --2- 172.21.15.135:0/401133528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891db5650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.549+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 >> 172.21.15.135:0/401133528 conn(0x557891a06300 msgr2=0x557891db4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.560+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 shutdown_connections 2024-05-20T17:38:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.560+0000 7f5400366740 1 -- 172.21.15.135:0/401133528 wait complete. 2024-05-20T17:38:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.560+0000 7f5400366740 1 -- start start 2024-05-20T17:38:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.561+0000 7f5400366740 1 Processor -- start 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.561+0000 7f5400366740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.561+0000 7f5400366740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51400/0 (socket says 172.21.15.135:51400) 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51144/0 (socket says 172.21.15.135:51144) 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f2ffd640 1 -- 172.21.15.135:0/1031699595 learned_addr learned my addr 172.21.15.135:0/1031699595 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891e2d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400cdf0 con 0x5578919f14d0 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400e260 con 0x5578919e92f0 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400d4c0 con 0x557891a121b0 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.562+0000 7f53f37fe640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891e2d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 -- 172.21.15.135:0/1031699595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 msgr2=0x557891e2d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891e2d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 -- 172.21.15.135:0/1031699595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 msgr2=0x557891dc0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:38:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557891e2dab0 con 0x5578919e92f0 2024-05-20T17:38:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f27fc640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:38:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.563+0000 7f53f2ffd640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e8018c20 tx=0x7f53e8018c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd65de2a803c2db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:38:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.567+0000 7f5400366740 10 client.0 _ll_register_callbacks cb 0x7f53e801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:38:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.567+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e8029070 con 0x5578919e92f0 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f53da7fc640 10 client.26069 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f53da7fc640 1 -- 172.21.15.135:0/1031699595 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8045060 con 0x5578919e92f0 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f53da7fc640 1 -- 172.21.15.135:0/1031699595 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f53e8024bc0 con 0x5578919e92f0 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f53da7fc640 1 -- 172.21.15.135:0/1031699595 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53e801d040 con 0x5578919e92f0 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f5400366740 10 client.26069 fetch_fsmap learned FSMap version 28 2024-05-20T17:38:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.596+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557891e34ba0 con 0x5578919e92f0 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f53da7fc640 1 -- 172.21.15.135:0/1031699595 <== mon.2 v2:172.21.15.160:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f53e8005040 con 0x5578919e92f0 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 10 client.26069 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 20 client.26069 populate_metadata read hostname 'smithi135' 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919a61c0 0x557891e37200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 4 client.26069 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f53e8029070 con 0x5578919a61c0 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.598+0000 7f53f27fc640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919a61c0 0x557891e37200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:38:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.599+0000 7f53f27fc640 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919a61c0 0x557891e37200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e696ca84513bd4d1 server_cookie=f87ad0312c0d53d3 in_seq=0 out_seq=0 2024-05-20T17:38:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:50.600+0000 7f53da7fc640 10 client.26069 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f53da7fc640 1 -- 172.21.15.135:0/1031699595 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f53e8029070 con 0x5578919a61c0 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f53da7fc640 10 client.26069 handle_command_reply: tid=0 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 client.26069 shutdown 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 msgr2=0x557891dbfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e8018c20 tx=0x7f53e8018c50 comp rx=0 tx=0).stop 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 shutdown_connections 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5578919a61c0 0x557891e37200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557891a121b0 0x557891e2d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578919f14d0 0x557891dc0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.102+0000 7f5400366740 1 --2- 172.21.15.135:0/1031699595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578919e92f0 0x557891dbfce0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.103+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 >> 172.21.15.135:0/1031699595 conn(0x557891a06300 msgr2=0x557891dbce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.103+0000 7f53da7fc640 0 client.26069 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.103+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 shutdown_connections 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.103+0000 7f5400366740 1 -- 172.21.15.135:0/1031699595 wait complete. 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.103+0000 7f5400366740 20 client.26069 trim_cache size 0 max 16384 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:38:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:38:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:38:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.144+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 msgr2=0x7f53dc0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.144+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 0x7f53dc0a5440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557891dae3e0 tx=0x7f53e402a9f0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.144+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 msgr2=0x7f53f4112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:38:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.144+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00ba50 tx=0x7f53ec00bf10 comp rx=0 tx=0).stop 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 shutdown_connections 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f53dc0a2f30 0x7f53dc0a5440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53f411c0d0 0x7f53f4113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53f4119770 0x7f53f4112fc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 --2- 172.21.15.135:0/3953397715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f4108f70 0x7f53f4118eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 >> 172.21.15.135:0/3953397715 conn(0x7f53f406e600 msgr2=0x7f53f411b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 shutdown_connections 2024-05-20T17:38:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:38:51.150+0000 7f53f94c3640 1 -- 172.21.15.135:0/3953397715 wait complete. 2024-05-20T17:38:51.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:51 smithi172 ceph-mon[36511]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 440 op/s 2024-05-20T17:38:51.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:51 smithi135 ceph-mon[32027]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 440 op/s 2024-05-20T17:38:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:51 smithi160 ceph-mon[36261]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 440 op/s 2024-05-20T17:38:53.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:53 smithi172 ceph-mon[36511]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 613 op/s 2024-05-20T17:38:53.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:53 smithi135 ceph-mon[32027]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 613 op/s 2024-05-20T17:38:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:53 smithi160 ceph-mon[36261]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 613 op/s 2024-05-20T17:38:55.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:55 smithi172 ceph-mon[36511]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 624 op/s 2024-05-20T17:38:55.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:55 smithi135 ceph-mon[32027]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 624 op/s 2024-05-20T17:38:55.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:55 smithi160 ceph-mon[36261]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.6 MiB/s wr, 624 op/s 2024-05-20T17:38:55.610 INFO:tasks.workunit.client.0.smithi135.stdout: 340 2334942 1316 1658352 1404 1052225 1548 2024-05-20T17:38:57.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:57 smithi172 ceph-mon[36511]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 598 op/s 2024-05-20T17:38:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:57 smithi135 ceph-mon[32027]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 598 op/s 2024-05-20T17:38:57.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:57 smithi160 ceph-mon[36261]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 598 op/s 2024-05-20T17:38:59.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:38:59 smithi172 ceph-mon[36511]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-05-20T17:38:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:38:59 smithi135 ceph-mon[32027]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-05-20T17:38:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:38:59 smithi160 ceph-mon[36261]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-05-20T17:39:01.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:01 smithi172 ceph-mon[36511]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 450 op/s 2024-05-20T17:39:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:01 smithi135 ceph-mon[32027]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 450 op/s 2024-05-20T17:39:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:01 smithi160 ceph-mon[36261]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 450 op/s 2024-05-20T17:39:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:03 smithi172 ceph-mon[36511]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 496 op/s 2024-05-20T17:39:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:03 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:03.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:03 smithi135 ceph-mon[32027]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 496 op/s 2024-05-20T17:39:03.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:03 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:03 smithi160 ceph-mon[36261]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 496 op/s 2024-05-20T17:39:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:03 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.495+0000 7f83afae9640 1 -- 172.21.15.135:0/913523714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8119770 msgr2=0x7f83a811bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.495+0000 7f83afae9640 1 --2- 172.21.15.135:0/913523714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8119770 0x7f83a811bb90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009ca0 tx=0x7f83a002a970 comp rx=0 tx=0).stop 2024-05-20T17:39:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.497+0000 7f83afae9640 1 -- 172.21.15.135:0/913523714 shutdown_connections 2024-05-20T17:39:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.497+0000 7f83afae9640 1 --2- 172.21.15.135:0/913523714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a811c0d0 0x7f83a811e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.497+0000 7f83afae9640 1 --2- 172.21.15.135:0/913523714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8119770 0x7f83a811bb90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.497+0000 7f83afae9640 1 --2- 172.21.15.135:0/913523714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8108f70 0x7f83a8109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.497+0000 7f83afae9640 1 -- 172.21.15.135:0/913523714 >> 172.21.15.135:0/913523714 conn(0x7f83a806e600 msgr2=0x7f83a806ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.500+0000 7f83afae9640 1 -- 172.21.15.135:0/913523714 shutdown_connections 2024-05-20T17:39:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.503+0000 7f83afae9640 1 -- 172.21.15.135:0/913523714 wait complete. 2024-05-20T17:39:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.504+0000 7f83afae9640 1 Processor -- start 2024-05-20T17:39:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.504+0000 7f83afae9640 1 -- start start 2024-05-20T17:39:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8108f70 0x7f83a81134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a811c0d0 0x7f83a8113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81119b0 con 0x7f83a811c0d0 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8111830 con 0x7f83a8108f70 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83afae9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8111b30 con 0x7f83a8119770 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83ad084640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83ad084640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:36946/0 (socket says 172.21.15.135:36946) 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.505+0000 7f83ad084640 1 -- 172.21.15.135:0/3733535064 learned_addr learned my addr 172.21.15.135:0/3733535064 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad885640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8108f70 0x7f83a81134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad084640 1 -- 172.21.15.135:0/3733535064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8108f70 msgr2=0x7f83a81134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad084640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8108f70 0x7f83a81134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad084640 1 -- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a811c0d0 msgr2=0x7f83a8113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad084640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a811c0d0 0x7f83a8113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.506+0000 7f83ad084640 1 -- 172.21.15.135:0/3733535064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a8127160 con 0x7f83a8119770 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.507+0000 7f83ad084640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83a002af60 tx=0x7f83a0030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.507+0000 7f839effd640 1 -- 172.21.15.135:0/3733535064 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0034050 con 0x7f83a8119770 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.507+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a81273f0 con 0x7f83a8119770 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.507+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a8127930 con 0x7f83a8119770 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.508+0000 7f839effd640 1 -- 172.21.15.135:0/3733535064 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a0039900 con 0x7f83a8119770 2024-05-20T17:39:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.508+0000 7f839effd640 1 -- 172.21.15.135:0/3733535064 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0042940 con 0x7f83a8119770 2024-05-20T17:39:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.513+0000 7f83b6990740 1 Processor -- start 2024-05-20T17:39:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.514+0000 7f83b6990740 1 -- start start 2024-05-20T17:39:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.515+0000 7f839effd640 1 -- 172.21.15.135:0/3733535064 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f83a0037020 con 0x7f83a8119770 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.515+0000 7f83b6990740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.515+0000 7f83b6990740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83ae086640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83ae086640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:36962/0 (socket says 172.21.15.135:36962) 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83b6990740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f164d0 0x560fc22d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83ae086640 1 -- 172.21.15.135:0/939765634 learned_addr learned my addr 172.21.15.135:0/939765634 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83ad885640 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f839effd640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 0x7f83940a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83ad084640 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f164d0 0x560fc22d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.516+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560fc223b340 con 0x560fc1f164d0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560fc21e3290 con 0x560fc1f0e2f0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fc2237300 con 0x560fc1f371b0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 0x7f83940a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 -- 172.21.15.135:0/939765634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 msgr2=0x560fc22d67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22d67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 -- 172.21.15.135:0/939765634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f164d0 msgr2=0x560fc22d6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f164d0 0x560fc22d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 -- 172.21.15.135:0/939765634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc22078e0 con 0x560fc1f371b0 2024-05-20T17:39:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.517+0000 7f83ae086640 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a40126a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1807167f929019a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.518+0000 7f8393fff640 1 -- 172.21.15.135:0/939765634 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a401a070 con 0x560fc1f371b0 2024-05-20T17:39:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.518+0000 7f8393fff640 1 -- 172.21.15.135:0/939765634 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a4010040 con 0x560fc1f371b0 2024-05-20T17:39:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.519+0000 7f839effd640 1 -- 172.21.15.135:0/3733535064 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f83a00f0370 con 0x7f83a8119770 2024-05-20T17:39:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.520+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 msgr2=0x560fc22d6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.520+0000 7f83b6990740 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a40126a0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 shutdown_connections 2024-05-20T17:39:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83b6990740 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f164d0 0x560fc22d6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83b6990740 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83b6990740 1 --2- 172.21.15.135:0/939765634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22d6270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 >> 172.21.15.135:0/939765634 conn(0x560fc1f2b300 msgr2=0x560fc22d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.521+0000 7f83ae086640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 0x7f83940a5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83a401c000 tx=0x7f83a4015d70 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.523+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 shutdown_connections 2024-05-20T17:39:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.523+0000 7f83b6990740 1 -- 172.21.15.135:0/939765634 wait complete. 2024-05-20T17:39:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.524+0000 7f83b6990740 1 -- start start 2024-05-20T17:39:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.524+0000 7f83b6990740 1 Processor -- start 2024-05-20T17:39:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.525+0000 7f83b6990740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f0e2f0 0x560fc22e0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.525+0000 7f83b6990740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.525+0000 7f83b6990740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22ec980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83b6990740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560fc22e33f0 con 0x560fc1f0e2f0 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83b6990740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560fc21f6790 con 0x560fc1f164d0 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ad084640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ad084640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35832/0 (socket says 172.21.15.135:35832) 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ad084640 1 -- 172.21.15.135:0/2384429376 learned_addr learned my addr 172.21.15.135:0/2384429376 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ae086640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fc22e3570 con 0x560fc1f371b0 2024-05-20T17:39:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83b6990740 10 client.0 _ll_register_callbacks cb 0x560fc2231a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ae086640 1 -- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 msgr2=0x560fc22e0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.526+0000 7f83ae086640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.527+0000 7f83ae086640 1 -- 172.21.15.135:0/2384429376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f0e2f0 msgr2=0x560fc22e0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.527+0000 7f83ae086640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f0e2f0 0x560fc22e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.527+0000 7f83ae086640 1 -- 172.21.15.135:0/2384429376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc1f4f210 con 0x560fc1f371b0 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.527+0000 7f83ad084640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.527+0000 7f83ae086640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22ec980 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a4009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9af56a4de0590f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.528+0000 7f83917fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:39:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.528+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a402d020 con 0x560fc1f371b0 2024-05-20T17:39:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.528+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a4010040 con 0x560fc1f371b0 2024-05-20T17:39:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.529+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f83a401fb30 con 0x560fc1f371b0 2024-05-20T17:39:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.529+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83a4038050 con 0x560fc1f371b0 2024-05-20T17:39:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.529+0000 7f83b6990740 10 client.25987 fetch_fsmap learned FSMap version 29 2024-05-20T17:39:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.529+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560fc201b620 con 0x560fc1f371b0 2024-05-20T17:39:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a4010040 con 0x560fc1f371b0 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f83a4015070 con 0x560fc1f371b0 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 10 client.25987 fetch_fsmap finished waiting for FSMap version 29 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 10 client.25987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 20 client.25987 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ef5d80 0x560fc22f3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 4 client.25987 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:39:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.530+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fc2248a70 con 0x560fc1ef5d80 2024-05-20T17:39:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.535+0000 7f83ad885640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ef5d80 0x560fc22f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.537+0000 7f83ad885640 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ef5d80 0x560fc22f3210 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b9c8bfd36e39e2a server_cookie=97111de4ed4139b2 in_seq=0 out_seq=0 2024-05-20T17:39:04.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.537+0000 7f83917fa640 10 client.25987 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.902+0000 7f83917fa640 1 -- 172.21.15.135:0/2384429376 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560fc2248a70 con 0x560fc1ef5d80 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.902+0000 7f83917fa640 10 client.25987 handle_command_reply: tid=0 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.902+0000 7f83b6990740 1 client.25987 shutdown 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.902+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 msgr2=0x560fc22ec980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.902+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22ec980 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a4009290 comp rx=0 tx=0).stop 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 shutdown_connections 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ef5d80 0x560fc22f3210 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f371b0 0x560fc22ec980 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 --2- 172.21.15.135:0/2384429376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f0e2f0 0x560fc22e0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 >> 172.21.15.135:0/2384429376 conn(0x560fc1f2b300 msgr2=0x560fc22d60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83917fa640 0 client.25987 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 shutdown_connections 2024-05-20T17:39:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 1 -- 172.21.15.135:0/2384429376 wait complete. 2024-05-20T17:39:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.903+0000 7f83b6990740 20 client.25987 trim_cache size 0 max 16384 2024-05-20T17:39:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.918+0000 7f83b6990740 1 Processor -- start 2024-05-20T17:39:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.918+0000 7f83b6990740 1 -- start start 2024-05-20T17:39:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f164d0 0x560fc22e2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f838c011170 con 0x560fc1f371b0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f838c00e9b0 con 0x560fc1f0e2f0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83b6990740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f838c00c800 con 0x560fc1f164d0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52954/0 (socket says 172.21.15.135:52954) 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 -- 172.21.15.135:0/794891290 learned_addr learned my addr 172.21.15.135:0/794891290 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ad885640 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ad084640 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f164d0 0x560fc22e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 -- 172.21.15.135:0/794891290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f164d0 msgr2=0x560fc22e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f164d0 0x560fc22e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 -- 172.21.15.135:0/794891290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 msgr2=0x560fc22daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22daed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 -- 172.21.15.135:0/794891290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc22e2f20 con 0x560fc1f371b0 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.919+0000 7f83ae086640 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f40 tx=0x7f83a401f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61b72446f6b8169 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.920+0000 7f83937fe640 1 -- 172.21.15.135:0/794891290 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a402d040 con 0x560fc1f371b0 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.920+0000 7f83937fe640 1 -- 172.21.15.135:0/794891290 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a4041070 con 0x560fc1f371b0 2024-05-20T17:39:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.920+0000 7f83937fe640 1 -- 172.21.15.135:0/794891290 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a401a070 con 0x560fc1f371b0 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- 172.21.15.135:0/794891290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 msgr2=0x560fc22e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f40 tx=0x7f83a401f450 comp rx=0 tx=0).stop 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- 172.21.15.135:0/794891290 shutdown_connections 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e88d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f164d0 0x560fc22e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- 172.21.15.135:0/794891290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f0e2f0 0x560fc22daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- 172.21.15.135:0/794891290 >> 172.21.15.135:0/794891290 conn(0x560fc1f2b300 msgr2=0x560fc22e0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- 172.21.15.135:0/794891290 shutdown_connections 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- 172.21.15.135:0/794891290 wait complete. 2024-05-20T17:39:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 -- start start 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 Processor -- start 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f0e2f0 0x560fc22e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.921+0000 7f83b6990740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f838c00ce70 con 0x560fc1f371b0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f838c00e2e0 con 0x560fc1f164d0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f838c00d540 con 0x560fc1f0e2f0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 10 client.0 _ll_register_callbacks cb 0x7f8398004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ad885640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f0e2f0 0x560fc22e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52956/0 (socket says 172.21.15.135:52956) 2024-05-20T17:39:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 -- 172.21.15.135:0/1529010684 learned_addr learned my addr 172.21.15.135:0/1529010684 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ad084640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 -- 172.21.15.135:0/1529010684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f0e2f0 msgr2=0x560fc22e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f0e2f0 0x560fc22e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 -- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 msgr2=0x560fc22e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 -- 172.21.15.135:0/1529010684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc2359730 con 0x560fc1f371b0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83ae086640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5e58a490a52e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83917fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a404c060 con 0x560fc1f371b0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f83a4029480 con 0x560fc1f371b0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.922+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a4041070 con 0x560fc1f371b0 2024-05-20T17:39:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83a402d070 con 0x560fc1f371b0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 10 client.16455 fetch_fsmap learned FSMap version 29 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560fc235a9c0 con 0x560fc1f371b0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a4041070 con 0x560fc1f371b0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f83a4015040 con 0x560fc1f371b0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 10 client.16455 fetch_fsmap finished waiting for FSMap version 29 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 20 client.16455 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ecb1c0 0x560fc235d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 4 client.16455 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560fc2242dc0 con 0x560fc1ecb1c0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.923+0000 7f83ad885640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ecb1c0 0x560fc235d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.924+0000 7f83917fa640 10 client.16455 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:04.924+0000 7f83ad885640 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ecb1c0 0x560fc235d0f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb664ecd85e9c3e9 server_cookie=ff0ea88eba81be19 in_seq=0 out_seq=0 2024-05-20T17:39:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:05 smithi135 ceph-mon[32027]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 342 op/s 2024-05-20T17:39:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:05 smithi160 ceph-mon[36261]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 342 op/s 2024-05-20T17:39:05.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:05 smithi172 ceph-mon[36511]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 342 op/s 2024-05-20T17:39:05.611 INFO:tasks.workunit.client.0.smithi135.stdout: 351 1558280 605 1123071 673 692650 1184 2024-05-20T17:39:07.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:07 smithi135 ceph-mon[32027]: pgmap v176: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-05-20T17:39:07.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:07 smithi160 ceph-mon[36261]: pgmap v176: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-05-20T17:39:07.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:07 smithi172 ceph-mon[36511]: pgmap v176: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-05-20T17:39:08.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:08 smithi135 ceph-mon[32027]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:08.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:08 smithi160 ceph-mon[36261]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:08.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:08 smithi172 ceph-mon[36511]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-20T17:39:09.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:09 smithi135 ceph-mon[32027]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-20T17:39:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:09 smithi160 ceph-mon[36261]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-20T17:39:09.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:09 smithi172 ceph-mon[36511]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-20T17:39:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:11 smithi135 ceph-mon[32027]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.15k op/s 2024-05-20T17:39:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:11 smithi160 ceph-mon[36261]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.15k op/s 2024-05-20T17:39:11.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:11 smithi172 ceph-mon[36511]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.15k op/s 2024-05-20T17:39:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83917fa640 1 -- 172.21.15.135:0/1529010684 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fc2242dc0 con 0x560fc1ecb1c0 2024-05-20T17:39:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83917fa640 10 client.16455 handle_command_reply: tid=0 2024-05-20T17:39:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 client.16455 shutdown 2024-05-20T17:39:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 msgr2=0x560fc22e4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009f70 tx=0x7f83a4009ed0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 shutdown_connections 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560fc1ecb1c0 0x560fc235d0f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc1f371b0 0x560fc22e4320 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83917fa640 0 client.16455 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fc1f164d0 0x560fc22e3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 --2- 172.21.15.135:0/1529010684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fc1f0e2f0 0x560fc22e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.321+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 >> 172.21.15.135:0/1529010684 conn(0x560fc1f2b300 msgr2=0x560fc22d9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 shutdown_connections 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83b6990740 1 -- 172.21.15.135:0/1529010684 wait complete. 2024-05-20T17:39:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83b6990740 20 client.16455 trim_cache size 0 max 16384 2024-05-20T17:39:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:39:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:39:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:39:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:39:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 msgr2=0x7f83940a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 0x7f83940a5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83a401c000 tx=0x7f83a4015d70 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 msgr2=0x7f83a8113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.322+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83a002af60 tx=0x7f83a0030ce0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 shutdown_connections 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f83940a2df0 0x7f83940a5300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a811c0d0 0x7f83a8113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a8119770 0x7f83a8113a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 --2- 172.21.15.135:0/3733535064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a8108f70 0x7f83a81134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 >> 172.21.15.135:0/3733535064 conn(0x7f83a806e600 msgr2=0x7f83a8119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 shutdown_connections 2024-05-20T17:39:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:12.323+0000 7f83afae9640 1 -- 172.21.15.135:0/3733535064 wait complete. 2024-05-20T17:39:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:13 smithi135 ceph-mon[32027]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-05-20T17:39:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:13 smithi160 ceph-mon[36261]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-05-20T17:39:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:13 smithi172 ceph-mon[36511]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-05-20T17:39:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:15 smithi135 ceph-mon[32027]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.97k op/s 2024-05-20T17:39:15.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:15 smithi160 ceph-mon[36261]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.97k op/s 2024-05-20T17:39:15.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:15 smithi172 ceph-mon[36511]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 16 MiB/s wr, 1.97k op/s 2024-05-20T17:39:15.611 INFO:tasks.workunit.client.0.smithi135.stdout: 359 644384 476 460596 413 283782 400 2024-05-20T17:39:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:17 smithi135 ceph-mon[32027]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 1.92k op/s 2024-05-20T17:39:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:17 smithi160 ceph-mon[36261]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 1.92k op/s 2024-05-20T17:39:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:17 smithi172 ceph-mon[36511]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 1.92k op/s 2024-05-20T17:39:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:19 smithi135 ceph-mon[32027]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 2.03k op/s 2024-05-20T17:39:19.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:19 smithi160 ceph-mon[36261]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 2.03k op/s 2024-05-20T17:39:19.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:19 smithi172 ceph-mon[36511]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 2.03k op/s 2024-05-20T17:39:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:21 smithi135 ceph-mon[32027]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.2 MiB/s wr, 1.49k op/s 2024-05-20T17:39:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:21 smithi160 ceph-mon[36261]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.2 MiB/s wr, 1.49k op/s 2024-05-20T17:39:21.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:21 smithi172 ceph-mon[36511]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 9.2 MiB/s wr, 1.49k op/s 2024-05-20T17:39:23.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:23 smithi135 ceph-mon[32027]: pgmap v184: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.8 MiB/s wr, 1.25k op/s 2024-05-20T17:39:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:23 smithi160 ceph-mon[36261]: pgmap v184: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.8 MiB/s wr, 1.25k op/s 2024-05-20T17:39:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:23 smithi172 ceph-mon[36511]: pgmap v184: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.8 MiB/s wr, 1.25k op/s 2024-05-20T17:39:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:25 smithi160 ceph-mon[36261]: pgmap v185: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-05-20T17:39:25.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:25 smithi172 ceph-mon[36511]: pgmap v185: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-05-20T17:39:25.616 INFO:tasks.workunit.client.0.smithi135.stdout: 378 2388500 1118 1704755 1097 1057263 2193 2024-05-20T17:39:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:25 smithi135 ceph-mon[32027]: pgmap v185: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-05-20T17:39:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:27 smithi160 ceph-mon[36261]: pgmap v186: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-05-20T17:39:27.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:27 smithi172 ceph-mon[36511]: pgmap v186: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-05-20T17:39:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:27 smithi135 ceph-mon[32027]: pgmap v186: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-05-20T17:39:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.841+0000 7f688b59e640 1 -- 172.21.15.135:0/3062731051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c10f270 msgr2=0x7f688c108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.841+0000 7f688b59e640 1 --2- 172.21.15.135:0/3062731051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c10f270 0x7f688c108b50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f687c009950 tx=0x7f687c02a480 comp rx=0 tx=0).stop 2024-05-20T17:39:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.856+0000 7f688b59e640 1 -- 172.21.15.135:0/3062731051 shutdown_connections 2024-05-20T17:39:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.856+0000 7f688b59e640 1 --2- 172.21.15.135:0/3062731051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c109090 0x7f688c109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.856+0000 7f688b59e640 1 --2- 172.21.15.135:0/3062731051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c10f270 0x7f688c108b50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.856+0000 7f688b59e640 1 --2- 172.21.15.135:0/3062731051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c10eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.856+0000 7f688b59e640 1 -- 172.21.15.135:0/3062731051 >> 172.21.15.135:0/3062731051 conn(0x7f688c06e690 msgr2=0x7f688c06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.888+0000 7f688b59e640 1 -- 172.21.15.135:0/3062731051 shutdown_connections 2024-05-20T17:39:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.889+0000 7f688b59e640 1 -- 172.21.15.135:0/3062731051 wait complete. 2024-05-20T17:39:27.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.891+0000 7f688b59e640 1 Processor -- start 2024-05-20T17:39:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.891+0000 7f688b59e640 1 -- start start 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 0x7f688c1a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c1a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 0x7f688c1acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f688c121b70 con 0x7f688c109090 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1219f0 con 0x7f688c10f270 2024-05-20T17:39:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688b59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f688c121cf0 con 0x7f688c10e890 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f6889d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c1a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f6889d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c1a8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:52530/0 (socket says 172.21.15.135:52530) 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f6889d9b640 1 -- 172.21.15.135:0/2215203518 learned_addr learned my addr 172.21.15.135:0/2215203518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.892+0000 7f688ad9d640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 0x7f688c1acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688a59c640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 0x7f688c1a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688ad9d640 1 -- 172.21.15.135:0/2215203518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 msgr2=0x7f688c1a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688ad9d640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c1a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688ad9d640 1 -- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 msgr2=0x7f688c1a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688ad9d640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 0x7f688c1a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.893+0000 7f688ad9d640 1 -- 172.21.15.135:0/2215203518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c1ad3f0 con 0x7f688c10f270 2024-05-20T17:39:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.894+0000 7f688ad9d640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 0x7f688c1acdb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688400be20 tx=0x7f688400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:27.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.894+0000 7f688a59c640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 0x7f688c1a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:27.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.900+0000 7f687b7fe640 1 -- 172.21.15.135:0/2215203518 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884019070 con 0x7f688c10f270 2024-05-20T17:39:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.900+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c1ad6e0 con 0x7f688c10f270 2024-05-20T17:39:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.900+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c1b5060 con 0x7f688c10f270 2024-05-20T17:39:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.913+0000 7f6897d66740 1 Processor -- start 2024-05-20T17:39:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.914+0000 7f6897d66740 1 -- start start 2024-05-20T17:39:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.915+0000 7f6897d66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.916+0000 7f6889d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.916+0000 7f6889d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32856/0 (socket says 172.21.15.135:32856) 2024-05-20T17:39:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.916+0000 7f6889d9b640 1 -- 172.21.15.135:0/1495523980 learned_addr learned my addr 172.21.15.135:0/1495523980 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78712f0 0x55cee7c397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c39d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee7b9e340 con 0x55cee789a1b0 2024-05-20T17:39:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cee7b46290 con 0x55cee78712f0 2024-05-20T17:39:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cee7b9a300 con 0x55cee78794d0 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6889d9b640 1 -- 172.21.15.135:0/1495523980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 msgr2=0x55cee7c39d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6889d9b640 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c39d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6889d9b640 1 -- 172.21.15.135:0/1495523980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78712f0 msgr2=0x55cee7c397c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6889d9b640 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78712f0 0x55cee7c397c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.917+0000 7f6889d9b640 1 -- 172.21.15.135:0/1495523980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee7b6a8e0 con 0x55cee789a1b0 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.918+0000 7f6889d9b640 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f687c005ab0 tx=0x7f687c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ceab91638acfb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.918+0000 7f687b7fe640 1 -- 172.21.15.135:0/2215203518 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6884014920 con 0x7f688c10f270 2024-05-20T17:39:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.918+0000 7f687b7fe640 1 -- 172.21.15.135:0/2215203518 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68840129e0 con 0x7f688c10f270 2024-05-20T17:39:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.919+0000 7f687b7fe640 1 -- 172.21.15.135:0/2215203518 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f688401c070 con 0x7f688c10f270 2024-05-20T17:39:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.922+0000 7f687b7fe640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 0x7f68740a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.922+0000 7f688a59c640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 0x7f68740a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.923+0000 7f688a59c640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 0x7f68740a5440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6880006fd0 tx=0x7f6880008040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.923+0000 7f687b7fe640 1 -- 172.21.15.135:0/2215203518 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f68840cfb70 con 0x7f688c10f270 2024-05-20T17:39:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.956+0000 7f6878ff9640 1 -- 172.21.15.135:0/1495523980 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c040070 con 0x55cee789a1b0 2024-05-20T17:39:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.960+0000 7f6878ff9640 1 -- 172.21.15.135:0/1495523980 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687c005500 con 0x55cee789a1b0 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.965+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 msgr2=0x55cee7c39280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.965+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f687c005ab0 tx=0x7f687c004180 comp rx=0 tx=0).stop 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.966+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 shutdown_connections 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.966+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c39d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.966+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78712f0 0x55cee7c397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.966+0000 7f6897d66740 1 --2- 172.21.15.135:0/1495523980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee789a1b0 0x55cee7c39280 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.966+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 >> 172.21.15.135:0/1495523980 conn(0x55cee788e300 msgr2=0x55cee7c35a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.967+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 shutdown_connections 2024-05-20T17:39:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.967+0000 7f6897d66740 1 -- 172.21.15.135:0/1495523980 wait complete. 2024-05-20T17:39:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.968+0000 7f6897d66740 1 -- start start 2024-05-20T17:39:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.968+0000 7f6897d66740 1 Processor -- start 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 0x55cee7c43960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c4f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee7c463a0 con 0x55cee78794d0 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cee7b59790 con 0x55cee7858d80 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cee7c46520 con 0x55cee78712f0 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6897d66740 10 client.0 _ll_register_callbacks cb 0x55cee7b94a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f688a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f688a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:52544/0 (socket says 172.21.15.135:52544) 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f688a59c640 1 -- 172.21.15.135:0/434318274 learned_addr learned my addr 172.21.15.135:0/434318274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f6889d9b640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 0x55cee7c43960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.969+0000 7f688ad9d640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c4f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 -- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 msgr2=0x55cee7c4f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c4f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 -- 172.21.15.135:0/434318274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 msgr2=0x55cee7c43960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 0x55cee7c43960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 -- 172.21.15.135:0/434318274 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee78b2210 con 0x55cee78712f0 2024-05-20T17:39:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f6889d9b640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 0x55cee7c43960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.970+0000 7f688a59c640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f688000de10 tx=0x7f6880004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=347f14d2b464b724 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.980+0000 7f6871ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:39:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.981+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880024060 con 0x55cee78712f0 2024-05-20T17:39:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.982+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cee7baba70 con 0x55cee78712f0 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.982+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f688001f400 con 0x55cee78712f0 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.982+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f688001f600 con 0x55cee78712f0 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.982+0000 7f6897d66740 10 client.25999 fetch_fsmap learned FSMap version 30 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.982+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cee797e620 con 0x55cee78712f0 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.983+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cee7baba70 con 0x55cee78712f0 2024-05-20T17:39:27.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.983+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6880013070 con 0x55cee78712f0 2024-05-20T17:39:27.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 10 client.25999 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 10 client.25999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 20 client.25999 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee782e1c0 0x55cee7c55e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 4 client.25999 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cee7ba5dc0 con 0x55cee782e1c0 2024-05-20T17:39:27.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.985+0000 7f6889d9b640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee782e1c0 0x55cee7c55e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.986+0000 7f6889d9b640 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee782e1c0 0x55cee7c55e10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac9cc60a1ed31c5 server_cookie=3f9129b0a84c64ab in_seq=0 out_seq=0 2024-05-20T17:39:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.986+0000 7f6871ffb640 10 client.25999 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.987+0000 7f6871ffb640 1 -- 172.21.15.135:0/434318274 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cee7ba5dc0 con 0x55cee782e1c0 2024-05-20T17:39:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.987+0000 7f6871ffb640 10 client.25999 handle_command_reply: tid=0 2024-05-20T17:39:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.987+0000 7f6897d66740 1 client.25999 shutdown 2024-05-20T17:39:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.995+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 msgr2=0x55cee7c43420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:27.995+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f688000de10 tx=0x7f6880004770 comp rx=0 tx=0).stop 2024-05-20T17:39:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 shutdown_connections 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee782e1c0 0x55cee7c55e10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c4f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78794d0 0x55cee7c43960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 --2- 172.21.15.135:0/434318274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c43420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 >> 172.21.15.135:0/434318274 conn(0x55cee788e300 msgr2=0x55cee7c39010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6871ffb640 0 client.25999 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.019+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 shutdown_connections 2024-05-20T17:39:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.020+0000 7f6897d66740 1 -- 172.21.15.135:0/434318274 wait complete. 2024-05-20T17:39:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.020+0000 7f6897d66740 20 client.25999 trim_cache size 0 max 16384 2024-05-20T17:39:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.378+0000 7f6897d66740 1 Processor -- start 2024-05-20T17:39:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.378+0000 7f6897d66740 1 -- start start 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.379+0000 7f6897d66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.379+0000 7f6897d66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78712f0 0x55cee7c39c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.379+0000 7f6897d66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c5b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.379+0000 7f6897d66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f686c011260 con 0x55cee78712f0 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f6897d66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00ea70 con 0x55cee7858d80 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f6897d66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00c8c0 con 0x55cee78794d0 2024-05-20T17:39:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:38062/0 (socket says 172.21.15.135:38062) 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 -- 172.21.15.135:0/1299990829 learned_addr learned my addr 172.21.15.135:0/1299990829 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688ad9d640 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c5b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 -- 172.21.15.135:0/1299990829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 msgr2=0x55cee7c5b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c5b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 -- 172.21.15.135:0/1299990829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78712f0 msgr2=0x55cee7c39c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78712f0 0x55cee7c39c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 -- 172.21.15.135:0/1299990829 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee782e3f0 con 0x55cee7858d80 2024-05-20T17:39:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.380+0000 7f688a59c640 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6880027740 tx=0x7f688000d6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37b69d688d92764 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.409+0000 7f6873fff640 1 -- 172.21.15.135:0/1299990829 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880009e20 con 0x55cee7858d80 2024-05-20T17:39:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.409+0000 7f6873fff640 1 -- 172.21.15.135:0/1299990829 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688001f7a0 con 0x55cee7858d80 2024-05-20T17:39:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.409+0000 7f6873fff640 1 -- 172.21.15.135:0/1299990829 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880027a20 con 0x55cee7858d80 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.411+0000 7f6897d66740 1 -- 172.21.15.135:0/1299990829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 msgr2=0x55cee7c39720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.411+0000 7f6897d66740 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6880027740 tx=0x7f688000d6d0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.411+0000 7f6897d66740 1 -- 172.21.15.135:0/1299990829 shutdown_connections 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.412+0000 7f6897d66740 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78794d0 0x55cee7c5b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.412+0000 7f6897d66740 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee78712f0 0x55cee7c39c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.412+0000 7f6897d66740 1 --2- 172.21.15.135:0/1299990829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee7858d80 0x55cee7c39720 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.412+0000 7f6897d66740 1 -- 172.21.15.135:0/1299990829 >> 172.21.15.135:0/1299990829 conn(0x55cee788e300 msgr2=0x55cee7c39010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.414+0000 7f6897d66740 1 -- 172.21.15.135:0/1299990829 shutdown_connections 2024-05-20T17:39:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.414+0000 7f6897d66740 1 -- 172.21.15.135:0/1299990829 wait complete. 2024-05-20T17:39:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.415+0000 7f6897d66740 1 -- start start 2024-05-20T17:39:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.415+0000 7f6897d66740 1 Processor -- start 2024-05-20T17:39:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.416+0000 7f6897d66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 0x55cee7c485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.416+0000 7f6897d66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c48b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.416+0000 7f6897d66740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 0x55cee7c49060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.416+0000 7f6897d66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00cf30 con 0x55cee7858d80 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f6897d66740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00e3a0 con 0x55cee78794d0 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f6897d66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00d600 con 0x55cee78712f0 2024-05-20T17:39:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f6897d66740 10 client.0 _ll_register_callbacks cb 0x7f6880009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f688a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 0x55cee7c485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f688a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 0x55cee7c485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32880/0 (socket says 172.21.15.135:32880) 2024-05-20T17:39:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.417+0000 7f688a59c640 1 -- 172.21.15.135:0/3572342085 learned_addr learned my addr 172.21.15.135:0/3572342085 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.419+0000 7f6889d9b640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c48b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.419+0000 7f688ad9d640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 0x55cee7c49060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.431+0000 7f6889d9b640 1 -- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 msgr2=0x55cee7c49060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.431+0000 7f6889d9b640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 0x55cee7c49060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.431+0000 7f6889d9b640 1 -- 172.21.15.135:0/3572342085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 msgr2=0x55cee7c485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.431+0000 7f6889d9b640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 0x55cee7c485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.431+0000 7f6889d9b640 1 -- 172.21.15.135:0/3572342085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee7cbc2c0 con 0x55cee78712f0 2024-05-20T17:39:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.432+0000 7f6889d9b640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c48b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f687c0058c0 tx=0x7f687c031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d94003e18e80f304 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:28.438 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.437+0000 7f688ad9d640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 0x55cee7c49060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:39:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.440+0000 7f6871ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:39:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.441+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c051030 con 0x55cee78712f0 2024-05-20T17:39:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.441+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f687c003b80 con 0x55cee78712f0 2024-05-20T17:39:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.441+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f688001f7a0 con 0x55cee78712f0 2024-05-20T17:39:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.442+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f687c040050 con 0x55cee78712f0 2024-05-20T17:39:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.442+0000 7f6897d66740 10 client.26005 fetch_fsmap learned FSMap version 30 2024-05-20T17:39:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.442+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cee7cbd530 con 0x55cee78712f0 2024-05-20T17:39:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.444+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688001f7a0 con 0x55cee78712f0 2024-05-20T17:39:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.445+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f687c0048c0 con 0x55cee78712f0 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.445+0000 7f6897d66740 10 client.26005 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f6897d66740 10 client.26005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f6897d66740 20 client.26005 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee7cbd870 0x55cee7cbfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f6897d66740 4 client.26005 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cee7b238e0 con 0x55cee7cbd870 2024-05-20T17:39:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.446+0000 7f688a59c640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee7cbd870 0x55cee7cbfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.451+0000 7f688a59c640 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee7cbd870 0x55cee7cbfc90 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32fa7e1ceaf202f9 server_cookie=f1753937482dba5b in_seq=0 out_seq=0 2024-05-20T17:39:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:28.451+0000 7f6871ffb640 10 client.26005 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:29 smithi160 ceph-mon[36261]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 473 op/s 2024-05-20T17:39:29.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:29 smithi172 ceph-mon[36511]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 473 op/s 2024-05-20T17:39:29.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:29 smithi135 ceph-mon[32027]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 473 op/s 2024-05-20T17:39:31.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:31 smithi135 ceph-mon[32027]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:39:31.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:31 smithi160 ceph-mon[36261]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:39:31.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:31 smithi172 ceph-mon[36511]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-05-20T17:39:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.608+0000 7f6871ffb640 1 -- 172.21.15.135:0/3572342085 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cee7b238e0 con 0x55cee7cbd870 2024-05-20T17:39:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.608+0000 7f6871ffb640 10 client.26005 handle_command_reply: tid=0 2024-05-20T17:39:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.608+0000 7f6897d66740 1 client.26005 shutdown 2024-05-20T17:39:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.608+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 msgr2=0x55cee7c48b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.608+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c48b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f687c0058c0 tx=0x7f687c031400 comp rx=0 tx=0).stop 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 shutdown_connections 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55cee7cbd870 0x55cee7cbfc90 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cee78794d0 0x55cee7c49060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cee78712f0 0x55cee7c48b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 --2- 172.21.15.135:0/3572342085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee7858d80 0x55cee7c485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 >> 172.21.15.135:0/3572342085 conn(0x55cee788e300 msgr2=0x55cee7c435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6871ffb640 0 client.26005 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 shutdown_connections 2024-05-20T17:39:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 1 -- 172.21.15.135:0/3572342085 wait complete. 2024-05-20T17:39:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.609+0000 7f6897d66740 20 client.26005 trim_cache size 0 max 16384 2024-05-20T17:39:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:39:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:39:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:39:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:39:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.659+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 msgr2=0x7f68740a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.659+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 0x7f68740a5440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6880006fd0 tx=0x7f6880008040 comp rx=0 tx=0).stop 2024-05-20T17:39:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.659+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 msgr2=0x7f688c1acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.659+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 0x7f688c1acdb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688400be20 tx=0x7f688400bf10 comp rx=0 tx=0).stop 2024-05-20T17:39:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.660+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 shutdown_connections 2024-05-20T17:39:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.660+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f68740a2f30 0x7f68740a5440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c10f270 0x7f688c1acdb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f688c10e890 0x7f688c1a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 --2- 172.21.15.135:0/2215203518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688c109090 0x7f688c1a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 >> 172.21.15.135:0/2215203518 conn(0x7f688c06e690 msgr2=0x7f688c10c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 shutdown_connections 2024-05-20T17:39:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:32.665+0000 7f688b59e640 1 -- 172.21.15.135:0/2215203518 wait complete. 2024-05-20T17:39:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:33 smithi160 ceph-mon[36261]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.0 MiB/s wr, 644 op/s 2024-05-20T17:39:33.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:33 smithi172 ceph-mon[36511]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.0 MiB/s wr, 644 op/s 2024-05-20T17:39:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:33 smithi135 ceph-mon[32027]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.0 MiB/s wr, 644 op/s 2024-05-20T17:39:35.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:35 smithi160 ceph-mon[36261]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 771 op/s 2024-05-20T17:39:35.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:35 smithi172 ceph-mon[36511]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 771 op/s 2024-05-20T17:39:35.611 INFO:tasks.workunit.client.0.smithi135.stdout: 384 1639978 560 1168479 534 720139 535 2024-05-20T17:39:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:35 smithi135 ceph-mon[32027]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 771 op/s 2024-05-20T17:39:37.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:37 smithi160 ceph-mon[36261]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 975 op/s 2024-05-20T17:39:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:37 smithi172 ceph-mon[36511]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 975 op/s 2024-05-20T17:39:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:37 smithi135 ceph-mon[32027]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 975 op/s 2024-05-20T17:39:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:39 smithi160 ceph-mon[36261]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2024-05-20T17:39:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:39 smithi172 ceph-mon[36511]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2024-05-20T17:39:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:39 smithi135 ceph-mon[32027]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2024-05-20T17:39:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:41 smithi160 ceph-mon[36261]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-05-20T17:39:41.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:41 smithi172 ceph-mon[36511]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-05-20T17:39:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:41 smithi135 ceph-mon[32027]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-05-20T17:39:42.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:42 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:39:42.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:42 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:39:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:42 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:39:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:43 smithi172 ceph-mon[36511]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2024-05-20T17:39:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:43 smithi135 ceph-mon[32027]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2024-05-20T17:39:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:43 smithi160 ceph-mon[36261]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2024-05-20T17:39:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:45 smithi172 ceph-mon[36511]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.12k op/s 2024-05-20T17:39:45.611 INFO:tasks.workunit.client.0.smithi135.stdout: 399 2369098 995 1692740 703 1017036 1575 2024-05-20T17:39:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:45 smithi135 ceph-mon[32027]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.12k op/s 2024-05-20T17:39:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:45 smithi160 ceph-mon[36261]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.12k op/s 2024-05-20T17:39:47.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:47 smithi172 ceph-mon[36511]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.3 MiB/s wr, 914 op/s 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 -- 172.21.15.135:0/3135694304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010e890 msgr2=0x7fd54010eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 --2- 172.21.15.135:0/3135694304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010e890 0x7fd54010eca0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd530009950 tx=0x7fd53002a480 comp rx=0 tx=0).stop 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 -- 172.21.15.135:0/3135694304 shutdown_connections 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 --2- 172.21.15.135:0/3135694304 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd540109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 --2- 172.21.15.135:0/3135694304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010f270 0x7fd540108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 --2- 172.21.15.135:0/3135694304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010e890 0x7fd54010eca0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.601+0000 7fd545c75640 1 -- 172.21.15.135:0/3135694304 >> 172.21.15.135:0/3135694304 conn(0x7fd54006e690 msgr2=0x7fd54006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.604+0000 7fd545c75640 1 -- 172.21.15.135:0/3135694304 shutdown_connections 2024-05-20T17:39:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.608+0000 7fd545c75640 1 -- 172.21.15.135:0/3135694304 wait complete. 2024-05-20T17:39:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 Processor -- start 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 -- start start 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 0x7fd5401acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd540121b70 con 0x7fd54010f270 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5401219f0 con 0x7fd540109090 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.609+0000 7fd545c75640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd540121cf0 con 0x7fd54010e890 2024-05-20T17:39:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd544c73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd544c73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53512/0 (socket says 172.21.15.135:53512) 2024-05-20T17:39:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd544c73640 1 -- 172.21.15.135:0/1695149107 learned_addr learned my addr 172.21.15.135:0/1695149107 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:47.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:34346/0 (socket says 172.21.15.135:34346) 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd545474640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 0x7fd5401acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 -- 172.21.15.135:0/1695149107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 msgr2=0x7fd5401a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 -- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 msgr2=0x7fd5401acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 0x7fd5401acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd53ffff640 1 -- 172.21.15.135:0/1695149107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5401ad270 con 0x7fd54010e890 2024-05-20T17:39:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.610+0000 7fd544c73640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:39:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.611+0000 7fd545474640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 0x7fd5401acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:39:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.612+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd534009fd0 tx=0x7fd53400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.630+0000 7fd53dffb640 1 -- 172.21.15.135:0/1695149107 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534015020 con 0x7fd54010e890 2024-05-20T17:39:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.631+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5401ad560 con 0x7fd54010e890 2024-05-20T17:39:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.631+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd540110f60 con 0x7fd54010e890 2024-05-20T17:39:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 Processor -- start 2024-05-20T17:39:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 -- start start 2024-05-20T17:39:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845bb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558884520340 con 0x5588841f32f0 2024-05-20T17:39:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5588844c8290 con 0x55888421c1b0 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.636+0000 7fd545474640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55888451c300 con 0x5588841fb4d0 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd53dffb640 1 -- 172.21.15.135:0/1695149107 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd534011d10 con 0x7fd54010e890 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd545474640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53524/0 (socket says 172.21.15.135:53524) 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd545474640 1 -- 172.21.15.135:0/1795962058 learned_addr learned my addr 172.21.15.135:0/1795962058 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd544c73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845bb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.637+0000 7fd53dffb640 1 -- 172.21.15.135:0/1695149107 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53400f2e0 con 0x7fd54010e890 2024-05-20T17:39:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.638+0000 7fd545474640 1 -- 172.21.15.135:0/1795962058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 msgr2=0x5588845bbd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:39:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.638+0000 7fd545474640 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845bbd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.638+0000 7fd545474640 1 -- 172.21.15.135:0/1795962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 msgr2=0x5588845bb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.638+0000 7fd545474640 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845bb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.640+0000 7fd545474640 1 -- 172.21.15.135:0/1795962058 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588844ec8e0 con 0x55888421c1b0 2024-05-20T17:39:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.640+0000 7fd544c73640 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:39:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.641+0000 7fd53dffb640 1 -- 172.21.15.135:0/1695149107 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd534018020 con 0x7fd54010e890 2024-05-20T17:39:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.641+0000 7fd545474640 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b8a0 tx=0x7fd538009630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66289d48d03b417d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.644+0000 7fd53dffb640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 0x7fd5280a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.645+0000 7fd544c73640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 0x7fd5280a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.646+0000 7fd544c73640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 0x7fd5280a5410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5588845b8d70 tx=0x7fd530005850 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.648+0000 7fd526ffd640 1 -- 172.21.15.135:0/1795962058 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53800add0 con 0x55888421c1b0 2024-05-20T17:39:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.648+0000 7fd526ffd640 1 -- 172.21.15.135:0/1795962058 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd538019070 con 0x55888421c1b0 2024-05-20T17:39:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.649+0000 7fd53dffb640 1 -- 172.21.15.135:0/1695149107 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd5340cfa90 con 0x7fd54010e890 2024-05-20T17:39:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.650+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1795962058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 msgr2=0x5588845bb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.650+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b8a0 tx=0x7fd538009630 comp rx=0 tx=0).stop 2024-05-20T17:39:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.656+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1795962058 shutdown_connections 2024-05-20T17:39:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.656+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845bbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.656+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.656+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1795962058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845bb280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.656+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1795962058 >> 172.21.15.135:0/1795962058 conn(0x558884210300 msgr2=0x5588845b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.657+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1795962058 shutdown_connections 2024-05-20T17:39:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.657+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1795962058 wait complete. 2024-05-20T17:39:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.657+0000 7fd54dd7b740 1 -- start start 2024-05-20T17:39:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 Processor -- start 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588845c8400 con 0x5588841f32f0 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5588844db790 con 0x55888421c1b0 2024-05-20T17:39:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5588845c8580 con 0x5588841fb4d0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.658+0000 7fd54dd7b740 10 client.0 _ll_register_callbacks cb 0x558884516a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.659+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.659+0000 7fd544c73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.659+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:34362/0 (socket says 172.21.15.135:34362) 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.659+0000 7fd53ffff640 1 -- 172.21.15.135:0/1995209300 learned_addr learned my addr 172.21.15.135:0/1995209300 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.659+0000 7fd545474640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 -- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 msgr2=0x5588845cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 -- 172.21.15.135:0/1995209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 msgr2=0x5588845c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 -- 172.21.15.135:0/1995209300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558884234210 con 0x5588841fb4d0 2024-05-20T17:39:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd544c73640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5340a47a0 tx=0x7fd5340092f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49c9fb65b0354b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.660+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd538019070 con 0x5588841fb4d0 2024-05-20T17:39:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.666+0000 7fd5247f8640 10 client.26011 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:39:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.666+0000 7fd5247f8640 1 -- 172.21.15.135:0/1995209300 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5340a4cd0 con 0x5588841fb4d0 2024-05-20T17:39:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.666+0000 7fd5247f8640 1 -- 172.21.15.135:0/1995209300 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd5340a00d0 con 0x5588841fb4d0 2024-05-20T17:39:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.667+0000 7fd5247f8640 1 -- 172.21.15.135:0/1995209300 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5340986d0 con 0x5588841fb4d0 2024-05-20T17:39:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.667+0000 7fd54dd7b740 10 client.26011 fetch_fsmap learned FSMap version 30 2024-05-20T17:39:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.667+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=30}) -- 0x558884300620 con 0x5588841fb4d0 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd5247f8640 1 -- 172.21.15.135:0/1995209300 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd5340cd400 con 0x5588841fb4d0 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 10 client.26011 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 20 client.26011 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841dad80 0x5588845d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 4 client.26011 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55888452da70 con 0x5588841dad80 2024-05-20T17:39:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.668+0000 7fd544c73640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841dad80 0x5588845d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.669+0000 7fd544c73640 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841dad80 0x5588845d7f30 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f35f956a457ac3 server_cookie=efdfe7436a142c33 in_seq=0 out_seq=0 2024-05-20T17:39:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.669+0000 7fd5247f8640 10 client.26011 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.670+0000 7fd5247f8640 1 -- 172.21.15.135:0/1995209300 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55888452da70 con 0x5588841dad80 2024-05-20T17:39:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.670+0000 7fd5247f8640 10 client.26011 handle_command_reply: tid=0 2024-05-20T17:39:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.670+0000 7fd54dd7b740 1 client.26011 shutdown 2024-05-20T17:39:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.678+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 msgr2=0x5588845c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.678+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5340a47a0 tx=0x7fd5340092f0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 shutdown_connections 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841dad80 0x5588845d7f30 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55888421c1b0 0x5588845cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841fb4d0 0x5588845c5e40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1995209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 >> 172.21.15.135:0/1995209300 conn(0x558884210300 msgr2=0x5588845bb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:47.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.684+0000 7fd5247f8640 0 client.26011 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.686+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 shutdown_connections 2024-05-20T17:39:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.686+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1995209300 wait complete. 2024-05-20T17:39:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.686+0000 7fd54dd7b740 20 client.26011 trim_cache size 0 max 16384 2024-05-20T17:39:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:47 smithi135 ceph-mon[32027]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.3 MiB/s wr, 914 op/s 2024-05-20T17:39:47.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 Processor -- start 2024-05-20T17:39:47.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 -- start start 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845dd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c011260 con 0x5588841f32f0 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c00ea70 con 0x5588841fb4d0 2024-05-20T17:39:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.734+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c00c8c0 con 0x55888421c1b0 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd544c73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845dd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:34378/0 (socket says 172.21.15.135:34378) 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 -- 172.21.15.135:0/2623723045 learned_addr learned my addr 172.21.15.135:0/2623723045 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd53ffff640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 -- 172.21.15.135:0/2623723045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 msgr2=0x5588845ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 -- 172.21.15.135:0/2623723045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 msgr2=0x5588845dd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845dd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd545474640 1 -- 172.21.15.135:0/2623723045 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588845bc380 con 0x55888421c1b0 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd53ffff640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.735+0000 7fd544c73640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845dd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.736+0000 7fd545474640 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b8a0 tx=0x7fd53800b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c21817f26f5c6fe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.736+0000 7fd5267fc640 1 -- 172.21.15.135:0/2623723045 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53800abd0 con 0x55888421c1b0 2024-05-20T17:39:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.736+0000 7fd5267fc640 1 -- 172.21.15.135:0/2623723045 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd53800ad70 con 0x55888421c1b0 2024-05-20T17:39:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.738+0000 7fd54dd7b740 1 -- 172.21.15.135:0/2623723045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 msgr2=0x5588845c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.738+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b8a0 tx=0x7fd53800b450 comp rx=0 tx=0).stop 2024-05-20T17:39:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.741+0000 7fd54dd7b740 1 -- 172.21.15.135:0/2623723045 shutdown_connections 2024-05-20T17:39:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.741+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888421c1b0 0x5588845c73d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.741+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.741+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/2623723045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588841f32f0 0x5588845dd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.741+0000 7fd54dd7b740 1 -- 172.21.15.135:0/2623723045 >> 172.21.15.135:0/2623723045 conn(0x558884210300 msgr2=0x5588845c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.743+0000 7fd54dd7b740 1 -- 172.21.15.135:0/2623723045 shutdown_connections 2024-05-20T17:39:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.744+0000 7fd54dd7b740 1 -- 172.21.15.135:0/2623723045 wait complete. 2024-05-20T17:39:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.744+0000 7fd54dd7b740 1 -- start start 2024-05-20T17:39:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.744+0000 7fd54dd7b740 1 Processor -- start 2024-05-20T17:39:47.747 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841f32f0 0x5588845cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.747 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.747 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 0x55888463e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.747 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c00cf30 con 0x55888421c1b0 2024-05-20T17:39:47.747 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c00e3a0 con 0x5588841fb4d0 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c00d600 con 0x5588841f32f0 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd54dd7b740 10 client.0 _ll_register_callbacks cb 0x7fd534010f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.745+0000 7fd544c73640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841f32f0 0x5588845cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:53548/0 (socket says 172.21.15.135:53548) 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 -- 172.21.15.135:0/1075766254 learned_addr learned my addr 172.21.15.135:0/1075766254 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:39:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd545474640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 0x55888463e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 -- 172.21.15.135:0/1075766254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841f32f0 msgr2=0x5588845cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841f32f0 0x5588845cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 -- 172.21.15.135:0/1075766254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 msgr2=0x55888463e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 0x55888463e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd53ffff640 1 -- 172.21.15.135:0/1075766254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888463e820 con 0x5588841fb4d0 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.746+0000 7fd545474640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 0x55888463e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:39:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.747+0000 7fd53ffff640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd53400bfb0 tx=0x7fd534004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64c89aafc95a853 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd5247f8640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5340a8020 con 0x5588841fb4d0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd53800ad70 con 0x5588841fb4d0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd534096dd0 con 0x5588841fb4d0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5340a4cd0 con 0x5588841fb4d0 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd54dd7b740 10 client.26111 fetch_fsmap learned FSMap version 30 2024-05-20T17:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.754+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55888463f9c0 con 0x5588841fb4d0 2024-05-20T17:39:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:47 smithi160 ceph-mon[36261]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.3 MiB/s wr, 914 op/s 2024-05-20T17:39:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd53800ad70 con 0x5588841fb4d0 2024-05-20T17:39:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd53409b4b0 con 0x5588841fb4d0 2024-05-20T17:39:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 10 client.26111 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:39:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 10 client.26111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 20 client.26111 populate_metadata read hostname 'smithi135' 2024-05-20T17:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841b01c0 0x5588846421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 4 client.26111 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558884527dc0 con 0x5588841b01c0 2024-05-20T17:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.756+0000 7fd544c73640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841b01c0 0x5588846421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:39:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.759+0000 7fd5247f8640 10 client.26111 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:47.759+0000 7fd544c73640 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841b01c0 0x5588846421e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5599a3485d7381 server_cookie=6e9f3c5df5ed46e3 in_seq=0 out_seq=0 2024-05-20T17:39:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:49 smithi172 ceph-mon[36511]: pgmap v197: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 883 op/s 2024-05-20T17:39:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:49 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:39:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:49 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:39:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:49 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:39:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:49 smithi135 ceph-mon[32027]: pgmap v197: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 883 op/s 2024-05-20T17:39:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:49 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:39:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:49 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:39:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:49 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:39:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:49 smithi160 ceph-mon[36261]: pgmap v197: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 883 op/s 2024-05-20T17:39:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:49 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:39:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:49 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:39:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:49 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.136+0000 7fd5247f8640 1 -- 172.21.15.135:0/1075766254 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558884527dc0 con 0x5588841b01c0 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.136+0000 7fd5247f8640 10 client.26111 handle_command_reply: tid=0 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.136+0000 7fd54dd7b740 1 client.26111 shutdown 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 msgr2=0x5588845cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd53400bfb0 tx=0x7fd534004700 comp rx=0 tx=0).stop 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 shutdown_connections 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5588841b01c0 0x5588846421e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55888421c1b0 0x55888463e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5588841fb4d0 0x5588845cf730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 --2- 172.21.15.135:0/1075766254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588841f32f0 0x5588845cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 >> 172.21.15.135:0/1075766254 conn(0x558884210300 msgr2=0x5588845c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd5247f8640 0 client.26111 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 shutdown_connections 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 1 -- 172.21.15.135:0/1075766254 wait complete. 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.137+0000 7fd54dd7b740 20 client.26111 trim_cache size 0 max 16384 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:39:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:39:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:39:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:39:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 msgr2=0x7fd5280a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 0x7fd5280a5410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5588845b8d70 tx=0x7fd530005850 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 msgr2=0x7fd5401a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd534009fd0 tx=0x7fd53400b870 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 shutdown_connections 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd5280a2f00 0x7fd5280a5410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54010f270 0x7fd5401acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd54010e890 0x7fd5401a8970 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 --2- 172.21.15.135:0/1695149107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd540109090 0x7fd5401a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 >> 172.21.15.135:0/1695149107 conn(0x7fd54006e690 msgr2=0x7fd54010bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:39:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 shutdown_connections 2024-05-20T17:39:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:39:51.138+0000 7fd545c75640 1 -- 172.21.15.135:0/1695149107 wait complete. 2024-05-20T17:39:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:51 smithi172 ceph-mon[36511]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-05-20T17:39:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:51 smithi135 ceph-mon[32027]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-05-20T17:39:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:51 smithi160 ceph-mon[36261]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-05-20T17:39:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:53 smithi172 ceph-mon[36511]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-05-20T17:39:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:53 smithi135 ceph-mon[32027]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-05-20T17:39:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:53 smithi160 ceph-mon[36261]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-05-20T17:39:55.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:55 smithi172 ceph-mon[36511]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-05-20T17:39:55.611 INFO:tasks.workunit.client.0.smithi135.stdout: 406 762608 399 547329 409 337595 769 2024-05-20T17:39:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:55 smithi135 ceph-mon[32027]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-05-20T17:39:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:55 smithi160 ceph-mon[36261]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-05-20T17:39:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:57 smithi172 ceph-mon[36511]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-05-20T17:39:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:57 smithi135 ceph-mon[32027]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-05-20T17:39:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:57 smithi160 ceph-mon[36261]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-05-20T17:39:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:39:59 smithi135 ceph-mon[32027]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-05-20T17:39:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:39:59 smithi160 ceph-mon[36261]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-05-20T17:39:59.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:39:59 smithi172 ceph-mon[36511]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-05-20T17:40:00.346 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:39:59.999+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:39:59.999+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:39:59.999+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : mds.h(mds.2): Metadata damage detected 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:39:59.999+0000 7f8e91e62700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-mon[32027]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-mon[32027]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-mon[32027]: mds.h(mds.2): Metadata damage detected 2024-05-20T17:40:00.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:00 smithi135 ceph-mon[32027]: mds.i(mds.1): Metadata damage detected 2024-05-20T17:40:00.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:00 smithi160 ceph-mon[36261]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-05-20T17:40:00.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:00 smithi160 ceph-mon[36261]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-05-20T17:40:00.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:00 smithi160 ceph-mon[36261]: mds.h(mds.2): Metadata damage detected 2024-05-20T17:40:00.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:00 smithi160 ceph-mon[36261]: mds.i(mds.1): Metadata damage detected 2024-05-20T17:40:00.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:00 smithi172 ceph-mon[36511]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-05-20T17:40:00.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:00 smithi172 ceph-mon[36511]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-05-20T17:40:00.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:00 smithi172 ceph-mon[36511]: mds.h(mds.2): Metadata damage detected 2024-05-20T17:40:00.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:00 smithi172 ceph-mon[36511]: mds.i(mds.1): Metadata damage detected 2024-05-20T17:40:01.604 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:01 smithi135 ceph-mon[32027]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 1.03k op/s 2024-05-20T17:40:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:01 smithi160 ceph-mon[36261]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 1.03k op/s 2024-05-20T17:40:01.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:01 smithi172 ceph-mon[36511]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 1.03k op/s 2024-05-20T17:40:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:03 smithi135 ceph-mon[32027]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-05-20T17:40:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:03 smithi160 ceph-mon[36261]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-05-20T17:40:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:03 smithi172 ceph-mon[36511]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-05-20T17:40:05.611 INFO:tasks.workunit.client.0.smithi135.stdout: 423 2281025 966 1638634 1252 1000160 1415 2024-05-20T17:40:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:05 smithi135 ceph-mon[32027]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 542 op/s 2024-05-20T17:40:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:05 smithi135 ceph-mon[32027]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:40:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.729+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/2141000831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68105990 msgr2=0x7f0b68105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.729+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/2141000831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68105990 0x7f0b68105dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b5801a910 tx=0x7f0b5803f840 comp rx=0 tx=0).stop 2024-05-20T17:40:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/2141000831 shutdown_connections 2024-05-20T17:40:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/2141000831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68106450 0x7f0b6810dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/2141000831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68105990 0x7f0b68105dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/2141000831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68101400 0x7f0b68101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/2141000831 >> 172.21.15.135:0/2141000831 conn(0x7f0b68076860 msgr2=0x7f0b68076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/2141000831 shutdown_connections 2024-05-20T17:40:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.730+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/2141000831 wait complete. 2024-05-20T17:40:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.731+0000 7f0b6e8b8640 1 Processor -- start 2024-05-20T17:40:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.731+0000 7f0b6e8b8640 1 -- start start 2024-05-20T17:40:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68101400 0x7f0b6806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68106450 0x7f0b6819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806d6d0 con 0x7f0b68105990 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806d550 con 0x7f0b68106450 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.732+0000 7f0b6e8b8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806d850 con 0x7f0b68101400 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68106450 0x7f0b6819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33494/0 (socket says 172.21.15.135:33494) 2024-05-20T17:40:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b677fe640 1 -- 172.21.15.135:0/3088836604 learned_addr learned my addr 172.21.15.135:0/3088836604 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68101400 0x7f0b6806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b677fe640 1 -- 172.21.15.135:0/3088836604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68101400 msgr2=0x7f0b6806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.733+0000 7f0b677fe640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68101400 0x7f0b6806f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.734+0000 7f0b677fe640 1 -- 172.21.15.135:0/3088836604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68106450 msgr2=0x7f0b6819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.734+0000 7f0b677fe640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68106450 0x7f0b6819b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.734+0000 7f0b677fe640 1 -- 172.21.15.135:0/3088836604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b681948b0 con 0x7f0b68105990 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.734+0000 7f0b677fe640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0b5803fe30 tx=0x7f0b58004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.735+0000 7f0b657fa640 1 -- 172.21.15.135:0/3088836604 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5804b030 con 0x7f0b68105990 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.735+0000 7f0b657fa640 1 -- 172.21.15.135:0/3088836604 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b58004ba0 con 0x7f0b68105990 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.735+0000 7f0b657fa640 1 -- 172.21.15.135:0/3088836604 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5804b030 con 0x7f0b68105990 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.735+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b68194b40 con 0x7f0b68105990 2024-05-20T17:40:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.735+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b68194fe0 con 0x7f0b68105990 2024-05-20T17:40:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.739+0000 7f0b75833740 1 Processor -- start 2024-05-20T17:40:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.739+0000 7f0b75833740 1 -- start start 2024-05-20T17:40:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0c62f0 0x559c5a48e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0ce4d0 0x559c5a48eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c5a3f3340 con 0x559c5a0ef1b0 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559c5a39b290 con 0x559c5a0c62f0 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b75833740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559c5a3ef300 con 0x559c5a0ce4d0 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33504/0 (socket says 172.21.15.135:33504) 2024-05-20T17:40:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.740+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2836888861 learned_addr learned my addr 172.21.15.135:0/2836888861 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2836888861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0ce4d0 msgr2=0x559c5a48eb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0ce4d0 0x559c5a48eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2836888861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0c62f0 msgr2=0x559c5a48e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0c62f0 0x559c5a48e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2836888861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5a3bf8e0 con 0x559c5a0ef1b0 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0b60003fa0 tx=0x7f0b6000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3e482b1ef03135 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.741+0000 7f0b657fa640 1 -- 172.21.15.135:0/3088836604 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0b580046c0 con 0x7f0b68105990 2024-05-20T17:40:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.742+0000 7f0b657fa640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 0x7f0b500a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.743+0000 7f0b657fa640 1 -- 172.21.15.135:0/3088836604 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8615+0+0 (secure 0 0 0) 0x7f0b58019040 con 0x7f0b68105990 2024-05-20T17:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.743+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 0x7f0b500a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.744+0000 7f0b4e7fc640 1 -- 172.21.15.135:0/2836888861 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60004800 con 0x559c5a0ef1b0 2024-05-20T17:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.744+0000 7f0b4e7fc640 1 -- 172.21.15.135:0/2836888861 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b6000d440 con 0x559c5a0ef1b0 2024-05-20T17:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.744+0000 7f0b4e7fc640 1 -- 172.21.15.135:0/2836888861 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60016680 con 0x559c5a0ef1b0 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.745+0000 7f0b75833740 1 -- 172.21.15.135:0/2836888861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 msgr2=0x559c5a48e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.745+0000 7f0b75833740 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0b60003fa0 tx=0x7f0b6000a560 comp rx=0 tx=0).stop 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.745+0000 7f0b75833740 1 -- 172.21.15.135:0/2836888861 shutdown_connections 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.745+0000 7f0b75833740 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0ce4d0 0x559c5a48eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.746+0000 7f0b75833740 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0c62f0 0x559c5a48e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.746+0000 7f0b75833740 1 --2- 172.21.15.135:0/2836888861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a48e080 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.746+0000 7f0b75833740 1 -- 172.21.15.135:0/2836888861 >> 172.21.15.135:0/2836888861 conn(0x559c5a0e3300 msgr2=0x559c5a48a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.747+0000 7f0b75833740 1 -- 172.21.15.135:0/2836888861 shutdown_connections 2024-05-20T17:40:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.748+0000 7f0b75833740 1 -- 172.21.15.135:0/2836888861 wait complete. 2024-05-20T17:40:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.749+0000 7f0b75833740 1 -- start start 2024-05-20T17:40:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.749+0000 7f0b75833740 1 Processor -- start 2024-05-20T17:40:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.749+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 0x7f0b500a5640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x559c5a48f430 tx=0x7f0b5c005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a498c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c5a49b1b0 con 0x559c5a0ef1b0 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559c5a3ae790 con 0x559c5a0ce4d0 2024-05-20T17:40:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559c5a49b330 con 0x559c5a0c62f0 2024-05-20T17:40:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.750+0000 7f0b75833740 10 client.0 _ll_register_callbacks cb 0x559c5a3e9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:57254/0 (socket says 172.21.15.135:57254) 2024-05-20T17:40:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 -- 172.21.15.135:0/1150508541 learned_addr learned my addr 172.21.15.135:0/1150508541 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b677fe640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a498c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 -- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 msgr2=0x559c5a498c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a498c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 -- 172.21.15.135:0/1150508541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 msgr2=0x559c5a49e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.751+0000 7f0b67fff640 1 -- 172.21.15.135:0/1150508541 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5a107210 con 0x559c5a0c62f0 2024-05-20T17:40:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:05 smithi160 ceph-mon[36261]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 542 op/s 2024-05-20T17:40:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:05 smithi160 ceph-mon[36261]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:40:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.758+0000 7f0b67fff640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0045b0 tx=0x7f0b5c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47280ed1112a8b00 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.759+0000 7f0b477fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:40:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.759+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c005220 con 0x559c5a0c62f0 2024-05-20T17:40:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.759+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b6000d440 con 0x559c5a0c62f0 2024-05-20T17:40:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.759+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8615+0+0 (secure 0 0 0) 0x7f0b5c0053c0 con 0x559c5a0c62f0 2024-05-20T17:40:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.765+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b5c005600 con 0x559c5a0c62f0 2024-05-20T17:40:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.765+0000 7f0b75833740 10 client.26026 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.765+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c5a1d3620 con 0x559c5a0c62f0 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b6000d440 con 0x559c5a0c62f0 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0b5c030420 con 0x559c5a0c62f0 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b75833740 10 client.26026 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b75833740 10 client.26026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b75833740 20 client.26026 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.766+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0add80 0x559c5a4aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.767+0000 7f0b75833740 4 client.26026 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:40:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.767+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c5a400a70 con 0x559c5a0add80 2024-05-20T17:40:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.771+0000 7f0b677fe640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0add80 0x559c5a4aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.777+0000 7f0b677fe640 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0add80 0x559c5a4aace0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8f5c2dcd9c487dc server_cookie=2e1cae1e01646145 in_seq=0 out_seq=0 2024-05-20T17:40:05.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.777+0000 7f0b477fe640 10 client.26026 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:05.780 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.778+0000 7f0b477fe640 1 -- 172.21.15.135:0/1150508541 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559c5a400a70 con 0x559c5a0add80 2024-05-20T17:40:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.778+0000 7f0b477fe640 10 client.26026 handle_command_reply: tid=0 2024-05-20T17:40:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.778+0000 7f0b75833740 1 client.26026 shutdown 2024-05-20T17:40:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.779+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 msgr2=0x559c5a498700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.779+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0045b0 tx=0x7f0b5c004730 comp rx=0 tx=0).stop 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 shutdown_connections 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0add80 0x559c5a4aace0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a498c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 --2- 172.21.15.135:0/1150508541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 >> 172.21.15.135:0/1150508541 conn(0x559c5a0e3300 msgr2=0x559c5a48fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b477fe640 0 client.26026 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 shutdown_connections 2024-05-20T17:40:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.781+0000 7f0b75833740 1 -- 172.21.15.135:0/1150508541 wait complete. 2024-05-20T17:40:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.783+0000 7f0b75833740 20 client.26026 trim_cache size 0 max 16384 2024-05-20T17:40:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.813+0000 7f0b75833740 1 Processor -- start 2024-05-20T17:40:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.813+0000 7f0b75833740 1 -- start start 2024-05-20T17:40:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a491d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b7c70 con 0x559c5a0ef1b0 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b5480 con 0x559c5a0ce4d0 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.814+0000 7f0b75833740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b32f0 con 0x559c5a0c62f0 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33530/0 (socket says 172.21.15.135:33530) 2024-05-20T17:40:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2790079372 learned_addr learned my addr 172.21.15.135:0/2790079372 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2790079372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 msgr2=0x559c5a498490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:40:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2790079372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 msgr2=0x559c5a491d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:40:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a491d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.815+0000 7f0b6ce55640 1 -- 172.21.15.135:0/2790079372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5a48f460 con 0x559c5a0ef1b0 2024-05-20T17:40:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.816+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0b60019000 tx=0x7f0b6000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa65c710768a5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.818+0000 7f0b4dffb640 1 -- 172.21.15.135:0/2790079372 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60024070 con 0x559c5a0ef1b0 2024-05-20T17:40:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.818+0000 7f0b4dffb640 1 -- 172.21.15.135:0/2790079372 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b60004b70 con 0x559c5a0ef1b0 2024-05-20T17:40:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.818+0000 7f0b4dffb640 1 -- 172.21.15.135:0/2790079372 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600299a0 con 0x559c5a0ef1b0 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.819+0000 7f0b75833740 1 -- 172.21.15.135:0/2790079372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 msgr2=0x559c5a492270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.819+0000 7f0b75833740 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0b60019000 tx=0x7f0b6000ddc0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.820+0000 7f0b75833740 1 -- 172.21.15.135:0/2790079372 shutdown_connections 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.820+0000 7f0b75833740 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a492270 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.820+0000 7f0b75833740 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a491d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.820+0000 7f0b75833740 1 --2- 172.21.15.135:0/2790079372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a498490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.820+0000 7f0b75833740 1 -- 172.21.15.135:0/2790079372 >> 172.21.15.135:0/2790079372 conn(0x559c5a0e3300 msgr2=0x559c5a497d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.821+0000 7f0b75833740 1 -- 172.21.15.135:0/2790079372 shutdown_connections 2024-05-20T17:40:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.821+0000 7f0b75833740 1 -- 172.21.15.135:0/2790079372 wait complete. 2024-05-20T17:40:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 -- start start 2024-05-20T17:40:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 Processor -- start 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a4a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a49ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b3940 con 0x559c5a0ef1b0 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b4db0 con 0x559c5a0ce4d0 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.822+0000 7f0b75833740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681b4010 con 0x559c5a0c62f0 2024-05-20T17:40:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.823+0000 7f0b75833740 10 client.0 _ll_register_callbacks cb 0x7f0b5c0044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.823+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.823+0000 7f0b6ce55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33542/0 (socket says 172.21.15.135:33542) 2024-05-20T17:40:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.823+0000 7f0b6ce55640 1 -- 172.21.15.135:0/3356431046 learned_addr learned my addr 172.21.15.135:0/3356431046 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.823+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a4a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 -- 172.21.15.135:0/3356431046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 msgr2=0x559c5a4a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a4a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 -- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 msgr2=0x559c5a49ed40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a49ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 -- 172.21.15.135:0/3356431046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5a49fa50 con 0x559c5a0ef1b0 2024-05-20T17:40:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a4a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b6ce55640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0b60004f50 tx=0x7f0b60004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5026c4c70471e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.824+0000 7f0b477fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.825+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60024070 con 0x559c5a0ef1b0 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.825+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b60004b70 con 0x559c5a0ef1b0 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.825+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8615+0+0 (secure 0 0 0) 0x7f0b6000d650 con 0x559c5a0ef1b0 2024-05-20T17:40:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.825+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b6000d850 con 0x559c5a0ef1b0 2024-05-20T17:40:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.827+0000 7f0b75833740 10 client.16506 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.827+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c5a511fd0 con 0x559c5a0ef1b0 2024-05-20T17:40:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:05 smithi172 ceph-mon[36511]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.5 MiB/s wr, 542 op/s 2024-05-20T17:40:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:05 smithi172 ceph-mon[36511]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:40:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b60004b70 con 0x559c5a0ef1b0 2024-05-20T17:40:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0b6000b040 con 0x559c5a0ef1b0 2024-05-20T17:40:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 10 client.16506 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 10 client.16506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 20 client.16506 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0831c0 0x559c5a514580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 4 client.16506 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:40:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.828+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c5a3fadc0 con 0x559c5a0831c0 2024-05-20T17:40:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.831+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0831c0 0x559c5a514580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.837+0000 7f0b67fff640 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0831c0 0x559c5a514580 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7071d592c133b114 server_cookie=d64d1a1d66aa1156 in_seq=0 out_seq=0 2024-05-20T17:40:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:05.837+0000 7f0b477fe640 10 client.16506 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:07 smithi135 ceph-mon[32027]: pgmap v207: 97 pgs: 4 active+clean+snaptrim, 81 active+clean, 12 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 307 op/s 2024-05-20T17:40:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:07 smithi160 ceph-mon[36261]: pgmap v207: 97 pgs: 4 active+clean+snaptrim, 81 active+clean, 12 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 307 op/s 2024-05-20T17:40:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:07 smithi172 ceph-mon[36511]: pgmap v207: 97 pgs: 4 active+clean+snaptrim, 81 active+clean, 12 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 307 op/s 2024-05-20T17:40:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:09 smithi135 ceph-mon[32027]: pgmap v208: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-05-20T17:40:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:09 smithi160 ceph-mon[36261]: pgmap v208: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-05-20T17:40:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:09 smithi172 ceph-mon[36511]: pgmap v208: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 573 op/s 2024-05-20T17:40:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:11 smithi135 ceph-mon[32027]: pgmap v209: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-05-20T17:40:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:11 smithi160 ceph-mon[36261]: pgmap v209: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-05-20T17:40:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:11 smithi172 ceph-mon[36511]: pgmap v209: 97 pgs: 24 active+clean+snaptrim, 33 active+clean, 40 active+clean+snaptrim_wait; 1.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 564 op/s 2024-05-20T17:40:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:13 smithi135 ceph-mon[32027]: pgmap v210: 97 pgs: 21 active+clean+snaptrim, 36 active+clean, 40 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.4 MiB/s wr, 950 op/s 2024-05-20T17:40:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:13 smithi160 ceph-mon[36261]: pgmap v210: 97 pgs: 21 active+clean+snaptrim, 36 active+clean, 40 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.4 MiB/s wr, 950 op/s 2024-05-20T17:40:13.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:13 smithi172 ceph-mon[36511]: pgmap v210: 97 pgs: 21 active+clean+snaptrim, 36 active+clean, 40 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.4 MiB/s wr, 950 op/s 2024-05-20T17:40:14.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b477fe640 1 -- 172.21.15.135:0/3356431046 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c5a3fadc0 con 0x559c5a0831c0 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b477fe640 10 client.16506 handle_command_reply: tid=0 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 client.16506 shutdown 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 msgr2=0x559c5a49f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0b60004f50 tx=0x7f0b60004f80 comp rx=0 tx=0).stop 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 shutdown_connections 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559c5a0831c0 0x559c5a514580 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5a0ef1b0 0x559c5a49f2c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559c5a0ce4d0 0x559c5a49ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b477fe640 0 client.16506 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 --2- 172.21.15.135:0/3356431046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c5a0c62f0 0x559c5a4a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.858+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 >> 172.21.15.135:0/3356431046 conn(0x559c5a0e3300 msgr2=0x559c5a4999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 shutdown_connections 2024-05-20T17:40:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b75833740 1 -- 172.21.15.135:0/3356431046 wait complete. 2024-05-20T17:40:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b75833740 20 client.16506 trim_cache size 0 max 16384 2024-05-20T17:40:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:40:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:40:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:40:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 msgr2=0x7f0b500a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 0x7f0b500a5640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x559c5a48f430 tx=0x7f0b5c005f90 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 msgr2=0x7f0b6806f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0b5803fe30 tx=0x7f0b58004570 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 shutdown_connections 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0b500a3130 0x7f0b500a5640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b68106450 0x7f0b6819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b68105990 0x7f0b6806f8b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 --2- 172.21.15.135:0/3088836604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b68101400 0x7f0b6806f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 >> 172.21.15.135:0/3088836604 conn(0x7f0b68076860 msgr2=0x7f0b680ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 shutdown_connections 2024-05-20T17:40:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:14.859+0000 7f0b6e8b8640 1 -- 172.21.15.135:0/3088836604 wait complete. 2024-05-20T17:40:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:15 smithi135 ceph-mon[32027]: pgmap v211: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-05-20T17:40:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:15 smithi160 ceph-mon[36261]: pgmap v211: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-05-20T17:40:15.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:15 smithi172 ceph-mon[36511]: pgmap v211: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-05-20T17:40:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:17 smithi135 ceph-mon[32027]: pgmap v212: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 963 op/s 2024-05-20T17:40:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:17 smithi160 ceph-mon[36261]: pgmap v212: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 963 op/s 2024-05-20T17:40:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:17 smithi172 ceph-mon[36511]: pgmap v212: 97 pgs: 20 active+clean+snaptrim, 39 active+clean, 38 active+clean+snaptrim_wait; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 963 op/s 2024-05-20T17:40:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:19 smithi135 ceph-mon[32027]: pgmap v213: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-05-20T17:40:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:19 smithi160 ceph-mon[36261]: pgmap v213: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-05-20T17:40:19.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:19 smithi172 ceph-mon[36511]: pgmap v213: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-05-20T17:40:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:21 smithi135 ceph-mon[32027]: pgmap v214: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.7 MiB/s wr, 708 op/s 2024-05-20T17:40:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:21 smithi160 ceph-mon[36261]: pgmap v214: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.7 MiB/s wr, 708 op/s 2024-05-20T17:40:21.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:21 smithi172 ceph-mon[36511]: pgmap v214: 97 pgs: 7 active+clean+snaptrim, 72 active+clean, 18 active+clean+snaptrim_wait; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.7 MiB/s wr, 708 op/s 2024-05-20T17:40:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:23 smithi135 ceph-mon[32027]: pgmap v215: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2024-05-20T17:40:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:23 smithi135 ceph-mon[32027]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:40:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:23 smithi160 ceph-mon[36261]: pgmap v215: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2024-05-20T17:40:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:23 smithi160 ceph-mon[36261]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:40:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:23 smithi172 ceph-mon[36511]: pgmap v215: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2024-05-20T17:40:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:23 smithi172 ceph-mon[36511]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:40:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:25 smithi135 ceph-mon[32027]: pgmap v217: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-20T17:40:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:25 smithi160 ceph-mon[36261]: pgmap v217: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-20T17:40:25.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:25 smithi172 ceph-mon[36511]: pgmap v217: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-20T17:40:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:27 smithi135 ceph-mon[32027]: pgmap v218: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-05-20T17:40:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:27 smithi160 ceph-mon[36261]: pgmap v218: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-05-20T17:40:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:27 smithi172 ceph-mon[36511]: pgmap v218: 97 pgs: 97 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-05-20T17:40:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 -- 172.21.15.135:0/1940126578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4102180 msgr2=0x7fdfd410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 --2- 172.21.15.135:0/1940126578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4102180 0x7fdfd410e4b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009ca0 tx=0x7fdfcc02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 -- 172.21.15.135:0/1940126578 shutdown_connections 2024-05-20T17:40:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 --2- 172.21.15.135:0/1940126578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4102180 0x7fdfd410e4b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 --2- 172.21.15.135:0/1940126578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 --2- 172.21.15.135:0/1940126578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4107a20 0x7fdfd41015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 -- 172.21.15.135:0/1940126578 >> 172.21.15.135:0/1940126578 conn(0x7fdfd4077160 msgr2=0x7fdfd40775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 -- 172.21.15.135:0/1940126578 shutdown_connections 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.974+0000 7fdfd9996640 1 -- 172.21.15.135:0/1940126578 wait complete. 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 Processor -- start 2024-05-20T17:40:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 -- start start 2024-05-20T17:40:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 0x7fdfd419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107a20 0x7fdfd419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd4111db0 con 0x7fdfd4107ec0 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd4111c30 con 0x7fdfd4107a20 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd9996640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd4111f30 con 0x7fdfd4102180 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47614/0 (socket says 172.21.15.135:47614) 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd37fe640 1 -- 172.21.15.135:0/3869811283 learned_addr learned my addr 172.21.15.135:0/3869811283 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 0x7fdfd419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.975+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107a20 0x7fdfd419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 -- 172.21.15.135:0/3869811283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 msgr2=0x7fdfd419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 0x7fdfd419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 -- 172.21.15.135:0/3869811283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107a20 msgr2=0x7fdfd419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107a20 0x7fdfd419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 -- 172.21.15.135:0/3869811283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd4199db0 con 0x7fdfd4107ec0 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 0x7fdfd419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd37fe640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc031a20 tx=0x7fdfcc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd8994640 1 -- 172.21.15.135:0/3869811283 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc003c30 con 0x7fdfd4107ec0 2024-05-20T17:40:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd8994640 1 -- 172.21.15.135:0/3869811283 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfcc003dd0 con 0x7fdfd4107ec0 2024-05-20T17:40:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd4199fe0 con 0x7fdfd4107ec0 2024-05-20T17:40:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd8994640 1 -- 172.21.15.135:0/3869811283 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc02fc40 con 0x7fdfd4107ec0 2024-05-20T17:40:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.976+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd41a62a0 con 0x7fdfd4107ec0 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfd8994640 1 -- 172.21.15.135:0/3869811283 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdfcc004050 con 0x7fdfd4107ec0 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 Processor -- start 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 -- start start 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f4d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b8d4d0 0x555b75f4d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b75eb2340 con 0x555b75bae1b0 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555b75e5a290 con 0x555b75b8d4d0 2024-05-20T17:40:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfe083f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555b75eae300 con 0x555b75b852f0 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47622/0 (socket says 172.21.15.135:47622) 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfcbfff640 1 -- 172.21.15.135:0/3180701295 learned_addr learned my addr 172.21.15.135:0/3180701295 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfd8994640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 0x7fdfc00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.979+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f4d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b8d4d0 0x555b75f4d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfd37fe640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 0x7fdfc00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 -- 172.21.15.135:0/3180701295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 msgr2=0x555b75f4d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f4d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 -- 172.21.15.135:0/3180701295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b8d4d0 msgr2=0x555b75f4d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:27.994 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b8d4d0 0x555b75f4d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 -- 172.21.15.135:0/3180701295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b75e7e8e0 con 0x555b75bae1b0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfd8994640 1 -- 172.21.15.135:0/3869811283 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fdfcc0f0620 con 0x7fdfd4107ec0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0134b0 tx=0x7fdfbc00b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6918d7f44d4a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfc9ffb640 1 -- 172.21.15.135:0/3180701295 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc019030 con 0x555b75bae1b0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfc9ffb640 1 -- 172.21.15.135:0/3180701295 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfbc0035f0 con 0x555b75bae1b0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.980+0000 7fdfc9ffb640 1 -- 172.21.15.135:0/3180701295 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0106c0 con 0x555b75bae1b0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- 172.21.15.135:0/3180701295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 msgr2=0x555b75f4cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0134b0 tx=0x7fdfbc00b570 comp rx=0 tx=0).stop 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfd37fe640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 0x7fdfc00a5280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ee340 tx=0x7fdfcc0a77e0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- 172.21.15.135:0/3180701295 shutdown_connections 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b8d4d0 0x555b75f4d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f4d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.995 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 --2- 172.21.15.135:0/3180701295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75bae1b0 0x555b75f4cf10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- 172.21.15.135:0/3180701295 >> 172.21.15.135:0/3180701295 conn(0x555b75ba2300 msgr2=0x555b75f49830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- 172.21.15.135:0/3180701295 shutdown_connections 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- 172.21.15.135:0/3180701295 wait complete. 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.981+0000 7fdfe083f740 1 -- start start 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 Processor -- start 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f5b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b75f5e620 con 0x555b75b8d4d0 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555b75e6d790 con 0x555b75b852f0 2024-05-20T17:40:27.996 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555b75f5e7a0 con 0x555b75bae1b0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfe083f740 10 client.0 _ll_register_callbacks cb 0x555b75ea8a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47636/0 (socket says 172.21.15.135:47636) 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/603448277 learned_addr learned my addr 172.21.15.135:0/603448277 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f5b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/603448277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 msgr2=0x555b75f5b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f5b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 msgr2=0x555b75f5d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f5d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/603448277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b75bc6210 con 0x555b75b8d4d0 2024-05-20T17:40:27.997 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.982+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f5d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40126b0 tx=0x7fdfc4012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84acd63a4b97ee66 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4011c70 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fdfc4011e10 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfbc0035f0 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdfc4005020 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 10 client.16518 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555b75c92620 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfbc0035f0 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdfc401c470 con 0x555b75b8d4d0 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 10 client.16518 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:27.998 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 20 client.16518 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b6cd80 0x555b75f6dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 4 client.16518 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.983+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b75ebfa70 con 0x555b75b6cd80 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.984+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b6cd80 0x555b75f6dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.984+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b6cd80 0x555b75f6dee0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e1e65c8a2fb07a server_cookie=75812c74911837f3 in_seq=0 out_seq=0 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.984+0000 7fdfb2ffd640 10 client.16518 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/603448277 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555b75ebfa70 con 0x555b75b6cd80 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfb2ffd640 10 client.16518 handle_command_reply: tid=0 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 client.16518 shutdown 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 msgr2=0x555b75f5da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40126b0 tx=0x7fdfc4012b70 comp rx=0 tx=0).stop 2024-05-20T17:40:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 shutdown_connections 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b6cd80 0x555b75f6dee0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f5b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5da30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfb2ffd640 0 client.16518 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 --2- 172.21.15.135:0/603448277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f5d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 >> 172.21.15.135:0/603448277 conn(0x555b75ba2300 msgr2=0x555b75f4ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 shutdown_connections 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 1 -- 172.21.15.135:0/603448277 wait complete. 2024-05-20T17:40:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:27.985+0000 7fdfe083f740 20 client.16518 trim_cache size 0 max 16384 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.000+0000 7fdfe083f740 1 Processor -- start 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.000+0000 7fdfe083f740 1 -- start start 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41af2f0 con 0x555b75b8d4d0 2024-05-20T17:40:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41acb00 con 0x555b75b852f0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfe083f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41aa970 con 0x555b75bae1b0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47648/0 (socket says 172.21.15.135:47648) 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/412635007 learned_addr learned my addr 172.21.15.135:0/412635007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/412635007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 msgr2=0x555b75f736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/412635007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 msgr2=0x555b75f552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/412635007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b75f4a8a0 con 0x555b75b8d4d0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40092e0 tx=0x7fdfc401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f5a8c82661d85b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfc97fa640 1 -- 172.21.15.135:0/412635007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4028040 con 0x555b75b8d4d0 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfc97fa640 1 -- 172.21.15.135:0/412635007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc4011c70 con 0x555b75b8d4d0 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.001+0000 7fdfc97fa640 1 -- 172.21.15.135:0/412635007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40048c0 con 0x555b75b8d4d0 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 -- 172.21.15.135:0/412635007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 msgr2=0x555b75f55800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40092e0 tx=0x7fdfc401cdc0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 -- 172.21.15.135:0/412635007 shutdown_connections 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75bae1b0 0x555b75f736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f55800 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 --2- 172.21.15.135:0/412635007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75b852f0 0x555b75f552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 -- 172.21.15.135:0/412635007 >> 172.21.15.135:0/412635007 conn(0x555b75ba2300 msgr2=0x555b75f5d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 -- 172.21.15.135:0/412635007 shutdown_connections 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.002+0000 7fdfe083f740 1 -- 172.21.15.135:0/412635007 wait complete. 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 -- start start 2024-05-20T17:40:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 Processor -- start 2024-05-20T17:40:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75bae1b0 0x555b75f5fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41aafc0 con 0x555b75b8d4d0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41ac430 con 0x555b75bae1b0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41ab690 con 0x555b75b852f0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfe083f740 10 client.0 _ll_register_callbacks cb 0x7fdfc4009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47660/0 (socket says 172.21.15.135:47660) 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/2590238665 learned_addr learned my addr 172.21.15.135:0/2590238665 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75bae1b0 0x555b75f5fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/2590238665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 msgr2=0x555b75f64120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f64120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75bae1b0 msgr2=0x555b75f5fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75bae1b0 0x555b75f5fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.003+0000 7fdfd2ffd640 1 -- 172.21.15.135:0/2590238665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b75f60250 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfd2ffd640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdfc401c890 tx=0x7fdfc4005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354d70db09236a47 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4039070 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fdfc401c620 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc4011c70 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdfc4045050 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 10 client.16524 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555b75fd6220 con 0x555b75b8d4d0 2024-05-20T17:40:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc4011c70 con 0x555b75b8d4d0 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdfc402c760 con 0x555b75b8d4d0 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 10 client.16524 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 20 client.16524 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b421c0 0x555b75fd88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 4 client.16524 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.004+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b75eb9dc0 con 0x555b75b421c0 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.005+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b421c0 0x555b75fd88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.005+0000 7fdfb2ffd640 10 client.16524 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.005+0000 7fdfcbfff640 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b421c0 0x555b75fd88d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35ac3c9ca70c226 server_cookie=6639239049b8a8b9 in_seq=0 out_seq=0 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.200+0000 7fdfb2ffd640 1 -- 172.21.15.135:0/2590238665 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b75eb9dc0 con 0x555b75b421c0 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.200+0000 7fdfb2ffd640 10 client.16524 handle_command_reply: tid=0 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.200+0000 7fdfe083f740 1 client.16524 shutdown 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.200+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 msgr2=0x555b75f5f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.200+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdfc401c890 tx=0x7fdfc4005590 comp rx=0 tx=0).stop 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 shutdown_connections 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555b75b421c0 0x555b75fd88d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b75bae1b0 0x555b75f5fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfb2ffd640 0 client.16524 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b75b8d4d0 0x555b75f5f470 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 --2- 172.21.15.135:0/2590238665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555b75b852f0 0x555b75f64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 >> 172.21.15.135:0/2590238665 conn(0x555b75ba2300 msgr2=0x555b75f4d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 shutdown_connections 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 1 -- 172.21.15.135:0/2590238665 wait complete. 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.201+0000 7fdfe083f740 20 client.16524 trim_cache size 0 max 16384 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:40:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:40:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 msgr2=0x7fdfc00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 0x7fdfc00a5280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ee340 tx=0x7fdfcc0a77e0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 msgr2=0x7fdfd4199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc031a20 tx=0x7fdfcc031a50 comp rx=0 tx=0).stop 2024-05-20T17:40:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 shutdown_connections 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdfc00a2d70 0x7fdfc00a5280 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd4107ec0 0x7fdfd4199680 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfd4107a20 0x7fdfd419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 --2- 172.21.15.135:0/3869811283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfd4102180 0x7fdfd419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 >> 172.21.15.135:0/3869811283 conn(0x7fdfd4077160 msgr2=0x7fdfd4105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 shutdown_connections 2024-05-20T17:40:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:28.202+0000 7fdfd9996640 1 -- 172.21.15.135:0/3869811283 wait complete. 2024-05-20T17:40:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:29 smithi135 ceph-mon[32027]: pgmap v219: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:29 smithi160 ceph-mon[36261]: pgmap v219: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:29 smithi172 ceph-mon[36511]: pgmap v219: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:31 smithi135 ceph-mon[32027]: pgmap v220: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:31 smithi160 ceph-mon[36261]: pgmap v220: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:31 smithi172 ceph-mon[36511]: pgmap v220: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 474 KiB/s wr, 53 op/s 2024-05-20T17:40:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:33 smithi135 ceph-mon[32027]: pgmap v221: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 560 KiB/s wr, 90 op/s 2024-05-20T17:40:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:33 smithi160 ceph-mon[36261]: pgmap v221: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 560 KiB/s wr, 90 op/s 2024-05-20T17:40:33.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:33 smithi172 ceph-mon[36511]: pgmap v221: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 560 KiB/s wr, 90 op/s 2024-05-20T17:40:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:35 smithi135 ceph-mon[32027]: pgmap v222: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 559 KiB/s wr, 100 op/s 2024-05-20T17:40:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:35 smithi160 ceph-mon[36261]: pgmap v222: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 559 KiB/s wr, 100 op/s 2024-05-20T17:40:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:35 smithi172 ceph-mon[36511]: pgmap v222: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 559 KiB/s wr, 100 op/s 2024-05-20T17:40:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:37 smithi135 ceph-mon[32027]: pgmap v223: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 719 KiB/s wr, 96 op/s 2024-05-20T17:40:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:37 smithi160 ceph-mon[36261]: pgmap v223: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 719 KiB/s wr, 96 op/s 2024-05-20T17:40:37.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:37 smithi172 ceph-mon[36511]: pgmap v223: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 719 KiB/s wr, 96 op/s 2024-05-20T17:40:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:39 smithi135 ceph-mon[32027]: pgmap v224: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:39 smithi160 ceph-mon[36261]: pgmap v224: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:39 smithi172 ceph-mon[36511]: pgmap v224: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- 172.21.15.135:0/3877838941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec107a40 msgr2=0x7fe3ec1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 --2- 172.21.15.135:0/3877838941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec107a40 0x7fe3ec1015d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009900 tx=0x7fe3e802a410 comp rx=0 tx=0).stop 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- 172.21.15.135:0/3877838941 shutdown_connections 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 --2- 172.21.15.135:0/3877838941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 0x7fe3ec10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 --2- 172.21.15.135:0/3877838941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec101b10 0x7fe3ec101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 --2- 172.21.15.135:0/3877838941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec107a40 0x7fe3ec1015d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- 172.21.15.135:0/3877838941 >> 172.21.15.135:0/3877838941 conn(0x7fe3ec0fd210 msgr2=0x7fe3ec0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- 172.21.15.135:0/3877838941 shutdown_connections 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- 172.21.15.135:0/3877838941 wait complete. 2024-05-20T17:40:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 Processor -- start 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.311+0000 7fe3f3396640 1 -- start start 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 0x7fe3ec19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 0x7fe3ec19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111d50 con 0x7fe3ec101b10 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111bd0 con 0x7fe3ec107a40 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f3396640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111ed0 con 0x7fe3ec10c3a0 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46240/0 (socket says 172.21.15.135:46240) 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 -- 172.21.15.135:0/2508122356 learned_addr learned my addr 172.21.15.135:0/2508122356 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f0931640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 0x7fe3ec19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1933640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 0x7fe3ec19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 -- 172.21.15.135:0/2508122356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 msgr2=0x7fe3ec19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 0x7fe3ec19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 -- 172.21.15.135:0/2508122356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 msgr2=0x7fe3ec19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 0x7fe3ec19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 -- 172.21.15.135:0/2508122356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec1a59b0 con 0x7fe3ec101b10 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f0931640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 0x7fe3ec19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3f1132640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8005940 tx=0x7fe3e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.312+0000 7fe3e27fc640 1 -- 172.21.15.135:0/2508122356 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e803f030 con 0x7fe3ec101b10 2024-05-20T17:40:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.313+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec1a5c40 con 0x7fe3ec101b10 2024-05-20T17:40:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.313+0000 7fe3e27fc640 1 -- 172.21.15.135:0/2508122356 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e8003ce0 con 0x7fe3ec101b10 2024-05-20T17:40:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.313+0000 7fe3e27fc640 1 -- 172.21.15.135:0/2508122356 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8035070 con 0x7fe3ec101b10 2024-05-20T17:40:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.313+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1a6130 con 0x7fe3ec101b10 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.315+0000 7fe3e27fc640 1 -- 172.21.15.135:0/2508122356 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe3e8042030 con 0x7fe3ec101b10 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.315+0000 7fe3fa244740 1 Processor -- start 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 -- start start 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 0x5617cbcb2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbcb25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcb2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617cbc17340 con 0x5617cb8ea2f0 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5617cbbbf290 con 0x5617cb9131b0 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3fa244740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5617cbc13300 con 0x5617cb8f24d0 2024-05-20T17:40:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3e27fc640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 0x7fe3d80a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbcb25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 0x5617cbcb2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbcb25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46242/0 (socket says 172.21.15.135:46242) 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1132640 1 -- 172.21.15.135:0/3867043091 learned_addr learned my addr 172.21.15.135:0/3867043091 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 0x7fe3d80a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f0931640 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcb2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3e27fc640 1 -- 172.21.15.135:0/2508122356 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fe3e80efab0 con 0x7fe3ec101b10 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 -- 172.21.15.135:0/3867043091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 msgr2=0x5617cbcb2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcb2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 -- 172.21.15.135:0/3867043091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 msgr2=0x5617cbcb25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbcb25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f1933640 1 -- 172.21.15.135:0/3867043091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cbbe38e0 con 0x5617cb9131b0 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.316+0000 7fe3f0931640 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcb2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.317+0000 7fe3f1933640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 0x7fe3d80a5200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009fd0 tx=0x7fe3e4016000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.317+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 0x5617cbcb2080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec074e60 tx=0x7fe3e4011750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb7128045668e8f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.317+0000 7fe3d77fe640 1 -- 172.21.15.135:0/3867043091 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4009a70 con 0x5617cb9131b0 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.317+0000 7fe3d77fe640 1 -- 172.21.15.135:0/3867043091 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e4023070 con 0x5617cb9131b0 2024-05-20T17:40:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.317+0000 7fe3d77fe640 1 -- 172.21.15.135:0/3867043091 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e401e910 con 0x5617cb9131b0 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- 172.21.15.135:0/3867043091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 msgr2=0x5617cbcb2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 0x5617cbcb2080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec074e60 tx=0x7fe3e4011750 comp rx=0 tx=0).stop 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- 172.21.15.135:0/3867043091 shutdown_connections 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcb2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbcb25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3867043091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb9131b0 0x5617cbcb2080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- 172.21.15.135:0/3867043091 >> 172.21.15.135:0/3867043091 conn(0x5617cb907300 msgr2=0x5617cbcae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- 172.21.15.135:0/3867043091 shutdown_connections 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- 172.21.15.135:0/3867043091 wait complete. 2024-05-20T17:40:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 -- start start 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.318+0000 7fe3fa244740 1 Processor -- start 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcbe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcbe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617cbcbf150 con 0x5617cb9131b0 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5617cbbd2790 con 0x5617cb8ea2f0 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5617cbcbf2d0 con 0x5617cb8f24d0 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3fa244740 10 client.0 _ll_register_callbacks cb 0x5617cbc0da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46252/0 (socket says 172.21.15.135:46252) 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 -- 172.21.15.135:0/3494915908 learned_addr learned my addr 172.21.15.135:0/3494915908 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1132640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcbe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f0931640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcbe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 -- 172.21.15.135:0/3494915908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 msgr2=0x5617cbcbe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcbe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 -- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 msgr2=0x5617cbcbe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcbe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.319+0000 7fe3f1933640 1 -- 172.21.15.135:0/3494915908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cb92b210 con 0x5617cb9131b0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3f1933640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40143d0 tx=0x7fe3e4014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67912ddf3aa7aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e401eb80 con 0x5617cb9131b0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fe3e401ed20 con 0x5617cb9131b0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e4023070 con 0x5617cb9131b0 2024-05-20T17:40:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3e4003970 con 0x5617cb9131b0 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 10 client.16536 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5617cb9f7620 con 0x5617cb9131b0 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e4023070 con 0x5617cb9131b0 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe3e401d070 con 0x5617cb9131b0 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 10 client.16536 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 10 client.16536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 20 client.16536 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb8d1d80 0x5617cbcce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 4 client.16536 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.320+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617cbc24a70 con 0x5617cb8d1d80 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.321+0000 7fe3f1132640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb8d1d80 0x5617cbcce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.321+0000 7fe3d4ff9640 10 client.16536 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.321+0000 7fe3f1132640 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb8d1d80 0x5617cbcce860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77497f151779bbe server_cookie=b54c9f929dd0df01 in_seq=0 out_seq=0 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/3494915908 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5617cbc24a70 con 0x5617cb8d1d80 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3d4ff9640 10 client.16536 handle_command_reply: tid=0 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 client.16536 shutdown 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 msgr2=0x5617cbcbc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40143d0 tx=0x7fe3e4014400 comp rx=0 tx=0).stop 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 shutdown_connections 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb8d1d80 0x5617cbcce860 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb9131b0 0x5617cbcbc580 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcbe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3d4ff9640 0 client.16536 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 --2- 172.21.15.135:0/3494915908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcbe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 >> 172.21.15.135:0/3494915908 conn(0x5617cb907300 msgr2=0x5617cbcb1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 shutdown_connections 2024-05-20T17:40:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 1 -- 172.21.15.135:0/3494915908 wait complete. 2024-05-20T17:40:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.322+0000 7fe3fa244740 20 client.16536 trim_cache size 0 max 16384 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 Processor -- start 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 -- start start 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcd3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcd4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b15d0 con 0x5617cb8d1d80 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1aede0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3fa244740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1acc50 con 0x5617cb8f24d0 2024-05-20T17:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.337+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46258/0 (socket says 172.21.15.135:46258) 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 -- 172.21.15.135:0/424506971 learned_addr learned my addr 172.21.15.135:0/424506971 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1933640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcd4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f0931640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcd3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 -- 172.21.15.135:0/424506971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 msgr2=0x5617cbcd4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcd4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 -- 172.21.15.135:0/424506971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 msgr2=0x5617cbcd3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcd3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 -- 172.21.15.135:0/424506971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cbcbf2c0 con 0x5617cb8d1d80 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f0931640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcd3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3f1132640 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8005f70 tx=0x7fe3e80044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e77865ab84e2aae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3d6ffd640 1 -- 172.21.15.135:0/424506971 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8049040 con 0x5617cb8d1d80 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3d6ffd640 1 -- 172.21.15.135:0/424506971 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e80c0350 con 0x5617cb8d1d80 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.338+0000 7fe3d6ffd640 1 -- 172.21.15.135:0/424506971 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80b8610 con 0x5617cb8d1d80 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- 172.21.15.135:0/424506971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 msgr2=0x5617cbcb2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8005f70 tx=0x7fe3e80044e0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- 172.21.15.135:0/424506971 shutdown_connections 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8f24d0 0x5617cbcd4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8ea2f0 0x5617cbcd3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 --2- 172.21.15.135:0/424506971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8d1d80 0x5617cbcb2520 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- 172.21.15.135:0/424506971 >> 172.21.15.135:0/424506971 conn(0x5617cb907300 msgr2=0x5617cbcb1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- 172.21.15.135:0/424506971 shutdown_connections 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- 172.21.15.135:0/424506971 wait complete. 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 -- start start 2024-05-20T17:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.339+0000 7fe3fa244740 1 Processor -- start 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 0x5617cbd2f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 0x5617cbcc40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1ad2a0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1ae710 con 0x5617cb8f24d0 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1ad970 con 0x5617cb8d1d80 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 10 client.0 _ll_register_callbacks cb 0x7fe3e80b7ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46268/0 (socket says 172.21.15.135:46268) 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 -- 172.21.15.135:0/134992313 learned_addr learned my addr 172.21.15.135:0/134992313 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f1933640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 0x5617cbcc40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f1132640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 0x5617cbd2f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 -- 172.21.15.135:0/134992313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 msgr2=0x5617cbd2f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 0x5617cbd2f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 -- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 msgr2=0x5617cbcc40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 0x5617cbcc40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 -- 172.21.15.135:0/134992313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cbcc4720 con 0x5617cb8ea2f0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f1933640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 0x5617cbcc40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f1132640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 0x5617cbd2f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3f0931640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec074fb0 tx=0x7fe3dc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7c8a2e76b92f98 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc004020 con 0x5617cb8ea2f0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fe3dc0041c0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.340+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e80c0350 con 0x5617cb8ea2f0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3dc0043c0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 10 client.16542 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5617cbd36bb0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e80c0350 con 0x5617cb8ea2f0 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe3dc0109d0 con 0x5617cb8ea2f0 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 10 client.16542 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 20 client.16542 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb9131b0 0x5617cbd39480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 4 client.16542 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617cbc1edc0 con 0x5617cb9131b0 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.341+0000 7fe3f1132640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb9131b0 0x5617cbd39480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.342+0000 7fe3d4ff9640 10 client.16542 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.342+0000 7fe3f1132640 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb9131b0 0x5617cbd39480 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a1c16568ba95ab server_cookie=f6bf849b543bb6b0 in_seq=0 out_seq=0 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.438+0000 7fe3d4ff9640 1 -- 172.21.15.135:0/134992313 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617cbc1edc0 con 0x5617cb9131b0 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.438+0000 7fe3d4ff9640 10 client.16542 handle_command_reply: tid=0 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.438+0000 7fe3fa244740 1 client.16542 shutdown 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 msgr2=0x5617cbd2fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec074fb0 tx=0x7fe3dc0127c0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 shutdown_connections 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5617cb9131b0 0x5617cbd39480 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617cb8f24d0 0x5617cbcc40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617cb8ea2f0 0x5617cbd2fb40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3d4ff9640 0 client.16542 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 --2- 172.21.15.135:0/134992313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617cb8d1d80 0x5617cbd2f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 >> 172.21.15.135:0/134992313 conn(0x5617cb907300 msgr2=0x5617cbcd38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 shutdown_connections 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 1 -- 172.21.15.135:0/134992313 wait complete. 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.439+0000 7fe3fa244740 20 client.16542 trim_cache size 0 max 16384 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:40:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:40:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:40:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 msgr2=0x7fe3d80a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 0x7fe3d80a5200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009fd0 tx=0x7fe3e4016000 comp rx=0 tx=0).stop 2024-05-20T17:40:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 msgr2=0x7fe3ec19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8005940 tx=0x7fe3e80042f0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 shutdown_connections 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3d80a2cf0 0x7fe3d80a5200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3ec10c3a0 0x7fe3ec19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3ec107a40 0x7fe3ec19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 --2- 172.21.15.135:0/2508122356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3ec101b10 0x7fe3ec19a670 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 >> 172.21.15.135:0/2508122356 conn(0x7fe3ec0fd210 msgr2=0x7fe3ec0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 shutdown_connections 2024-05-20T17:40:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:41.440+0000 7fe3f3396640 1 -- 172.21.15.135:0/2508122356 wait complete. 2024-05-20T17:40:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:41 smithi135 ceph-mon[32027]: pgmap v225: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 101 op/s 2024-05-20T17:40:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:41 smithi160 ceph-mon[36261]: pgmap v225: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 101 op/s 2024-05-20T17:40:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:41 smithi172 ceph-mon[36511]: pgmap v225: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 101 op/s 2024-05-20T17:40:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:43 smithi160 ceph-mon[36261]: pgmap v226: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:43 smithi172 ceph-mon[36511]: pgmap v226: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:43 smithi135 ceph-mon[32027]: pgmap v226: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 118 op/s 2024-05-20T17:40:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:45 smithi160 ceph-mon[36261]: pgmap v227: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2024-05-20T17:40:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:45 smithi172 ceph-mon[36511]: pgmap v227: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2024-05-20T17:40:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:45 smithi135 ceph-mon[32027]: pgmap v227: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2024-05-20T17:40:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:47 smithi160 ceph-mon[36261]: pgmap v228: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-20T17:40:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:47 smithi172 ceph-mon[36511]: pgmap v228: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-20T17:40:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:47 smithi135 ceph-mon[32027]: pgmap v228: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2024-05-20T17:40:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:49 smithi160 ceph-mon[36261]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 75 op/s 2024-05-20T17:40:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:49 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:40:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:49 smithi172 ceph-mon[36511]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 75 op/s 2024-05-20T17:40:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:49 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:40:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:49 smithi135 ceph-mon[32027]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 75 op/s 2024-05-20T17:40:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:49 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:40:50.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:50 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:40:50.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:50 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:40:50.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:50 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:40:50.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:50 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:40:50.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:50 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:40:50.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:50 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:40:50.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:50 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:40:50.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:50 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:40:50.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:50 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:40:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:51 smithi160 ceph-mon[36261]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 443 KiB/s wr, 50 op/s 2024-05-20T17:40:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:51 smithi172 ceph-mon[36511]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 443 KiB/s wr, 50 op/s 2024-05-20T17:40:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:51 smithi135 ceph-mon[32027]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 443 KiB/s wr, 50 op/s 2024-05-20T17:40:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:53 smithi160 ceph-mon[36261]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 493 KiB/s wr, 58 op/s 2024-05-20T17:40:53.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:53 smithi172 ceph-mon[36511]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 493 KiB/s wr, 58 op/s 2024-05-20T17:40:53.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:53 smithi135 ceph-mon[32027]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 493 KiB/s wr, 58 op/s 2024-05-20T17:40:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.551+0000 7f1692a0d640 1 -- 172.21.15.135:0/3149250966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c107eb0 msgr2=0x7f168c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.551+0000 7f1692a0d640 1 --2- 172.21.15.135:0/3149250966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c107eb0 0x7f168c101b00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1680009900 tx=0x7f168002a410 comp rx=0 tx=0).stop 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 -- 172.21.15.135:0/3149250966 shutdown_connections 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 --2- 172.21.15.135:0/3149250966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c102170 0x7f168c10e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 --2- 172.21.15.135:0/3149250966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c107eb0 0x7f168c101b00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 --2- 172.21.15.135:0/3149250966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 0x7f168c1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 -- 172.21.15.135:0/3149250966 >> 172.21.15.135:0/3149250966 conn(0x7f168c077160 msgr2=0x7f168c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 -- 172.21.15.135:0/3149250966 shutdown_connections 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 -- 172.21.15.135:0/3149250966 wait complete. 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 Processor -- start 2024-05-20T17:40:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.552+0000 7f1692a0d640 1 -- start start 2024-05-20T17:40:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 0x7f168c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c107eb0 0x7f168c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f168c111d80 con 0x7f168c102170 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f168c111c00 con 0x7f168c107eb0 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1692a0d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f168c111f00 con 0x7f168c107a10 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57550/0 (socket says 172.21.15.135:57550) 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 -- 172.21.15.135:0/1020320055 learned_addr learned my addr 172.21.15.135:0/1020320055 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f1690faa640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c107eb0 0x7f168c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168b7fe640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 0x7f168c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 -- 172.21.15.135:0/1020320055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 msgr2=0x7f168c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 0x7f168c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 -- 172.21.15.135:0/1020320055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c107eb0 msgr2=0x7f168c19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c107eb0 0x7f168c19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.553+0000 7f168bfff640 1 -- 172.21.15.135:0/1020320055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c1a5a10 con 0x7f168c102170 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f168bfff640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d750 tx=0x7f167c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f16897fa640 1 -- 172.21.15.135:0/1020320055 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c017070 con 0x7f168c102170 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c1a5d00 con 0x7f168c102170 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f16897fa640 1 -- 172.21.15.135:0/1020320055 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c005500 con 0x7f168c102170 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f16897fa640 1 -- 172.21.15.135:0/1020320055 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c004e00 con 0x7f168c102170 2024-05-20T17:40:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.554+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c1a61a0 con 0x7f168c102170 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.556+0000 7f16897fa640 1 -- 172.21.15.135:0/1020320055 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f167c004fa0 con 0x7f168c102170 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.556+0000 7f169998f740 1 Processor -- start 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.556+0000 7f169998f740 1 -- start start 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c4063022f0 0x55c4066ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c40662f340 con 0x55c40632b1b0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c4065d7290 con 0x55c4063022f0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f169998f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c40662b300 con 0x55c40630a4d0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57554/0 (socket says 172.21.15.135:57554) 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 -- 172.21.15.135:0/2432195405 learned_addr learned my addr 172.21.15.135:0/2432195405 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f16897fa640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 0x7f16740a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f168b7fe640 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f168bfff640 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c4063022f0 0x55c4066ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 -- 172.21.15.135:0/2432195405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 msgr2=0x55c4066ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 -- 172.21.15.135:0/2432195405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c4063022f0 msgr2=0x55c4066ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c4063022f0 0x55c4066ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 -- 172.21.15.135:0/2432195405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4065fb8e0 con 0x55c40632b1b0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f16897fa640 1 -- 172.21.15.135:0/1020320055 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f167c0cedc0 con 0x7f168c102170 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 0x7f16740a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.557+0000 7f1690faa640 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1684011590 tx=0x7f1684011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655fa5de3f883c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f16727fc640 1 -- 172.21.15.135:0/2432195405 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684017050 con 0x55c40632b1b0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f16727fc640 1 -- 172.21.15.135:0/2432195405 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168401bc50 con 0x55c40632b1b0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f16727fc640 1 -- 172.21.15.135:0/2432195405 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400e3b0 con 0x55c40632b1b0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f169998f740 1 -- 172.21.15.135:0/2432195405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 msgr2=0x55c4066c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f169998f740 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1684011590 tx=0x7f1684011a50 comp rx=0 tx=0).stop 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.558+0000 7f1690faa640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 0x7f16740a5200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1684022000 tx=0x7f1684023000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 -- 172.21.15.135:0/2432195405 shutdown_connections 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c4063022f0 0x55c4066ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 --2- 172.21.15.135:0/2432195405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066c9f70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 -- 172.21.15.135:0/2432195405 >> 172.21.15.135:0/2432195405 conn(0x55c40631f300 msgr2=0x55c4066c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 -- 172.21.15.135:0/2432195405 shutdown_connections 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 -- 172.21.15.135:0/2432195405 wait complete. 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 -- start start 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.559+0000 7f169998f740 1 Processor -- start 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40632b1b0 0x55c4066deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4066db5c0 con 0x55c4063022f0 2024-05-20T17:40:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c4065ea790 con 0x55c40630a4d0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c4066db740 con 0x55c40632b1b0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 10 client.0 _ll_register_callbacks cb 0x55c406625a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57556/0 (socket says 172.21.15.135:57556) 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 -- 172.21.15.135:0/2271672243 learned_addr learned my addr 172.21.15.135:0/2271672243 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168b7fe640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f1690faa640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40632b1b0 0x55c4066deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 -- 172.21.15.135:0/2271672243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40632b1b0 msgr2=0x55c4066deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40632b1b0 0x55c4066deb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 -- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 msgr2=0x55c4066d90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066d90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 -- 172.21.15.135:0/2271672243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c406343210 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f168bfff640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f167c0cc540 tx=0x7f167c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6983eeb8034cddaa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f166b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c020050 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f167c0995b0 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.560+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168401bc50 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f167c09f660 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 10 client.16554 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c40640f620 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168401bc50 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f167c097920 con 0x55c4063022f0 2024-05-20T17:40:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 10 client.16554 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 20 client.16554 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062e9d80 0x55c4066eae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 4 client.16554 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c40663ca70 con 0x55c4062e9d80 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.561+0000 7f168b7fe640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062e9d80 0x55c4066eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.562+0000 7f166b7fe640 10 client.16554 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.562+0000 7f168b7fe640 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062e9d80 0x55c4066eae00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24f2960ed1211aa server_cookie=df570642975f8df3 in_seq=0 out_seq=0 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.562+0000 7f166b7fe640 1 -- 172.21.15.135:0/2271672243 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c40663ca70 con 0x55c4062e9d80 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.562+0000 7f166b7fe640 10 client.16554 handle_command_reply: tid=0 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.562+0000 7f169998f740 1 client.16554 shutdown 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 msgr2=0x55c4066d8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f167c0cc540 tx=0x7f167c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 shutdown_connections 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062e9d80 0x55c4066eae00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40632b1b0 0x55c4066deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066d90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f166b7fe640 0 client.16554 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 --2- 172.21.15.135:0/2271672243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066d8b80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 >> 172.21.15.135:0/2271672243 conn(0x55c40631f300 msgr2=0x55c4066c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 shutdown_connections 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 1 -- 172.21.15.135:0/2271672243 wait complete. 2024-05-20T17:40:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.563+0000 7f169998f740 20 client.16554 trim_cache size 0 max 16384 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 Processor -- start 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 -- start start 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066d9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 0x55c4066de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1af330 con 0x55c4063022f0 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1acb40 con 0x55c40632b1b0 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f169998f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1aa9b0 con 0x55c40630a4d0 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f168bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57564/0 (socket says 172.21.15.135:57564) 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.578+0000 7f168bfff640 1 -- 172.21.15.135:0/3874686621 learned_addr learned my addr 172.21.15.135:0/3874686621 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168b7fe640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 -- 172.21.15.135:0/3874686621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 msgr2=0x55c4066d9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066d9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f1690faa640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 0x55c4066de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 -- 172.21.15.135:0/3874686621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 msgr2=0x55c4066de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 0x55c4066de9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 -- 172.21.15.135:0/3874686621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4066d7c70 con 0x55c4063022f0 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168b7fe640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066d9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:40:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f1690faa640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 0x55c4066de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f168bfff640 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f167c0ccae0 tx=0x7f167c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9003949b7616e6b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f1671ffb640 1 -- 172.21.15.135:0/3874686621 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c064020 con 0x55c4063022f0 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f1671ffb640 1 -- 172.21.15.135:0/3874686621 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c005290 con 0x55c4063022f0 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.579+0000 7f1671ffb640 1 -- 172.21.15.135:0/3874686621 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c014070 con 0x55c4063022f0 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- 172.21.15.135:0/3874686621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 msgr2=0x55c4066ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f167c0ccae0 tx=0x7f167c0048a0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- 172.21.15.135:0/3874686621 shutdown_connections 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40632b1b0 0x55c4066de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c40630a4d0 0x55c4066d9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 --2- 172.21.15.135:0/3874686621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4063022f0 0x55c4066ca480 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- 172.21.15.135:0/3874686621 >> 172.21.15.135:0/3874686621 conn(0x55c40631f300 msgr2=0x55c4066d8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- 172.21.15.135:0/3874686621 shutdown_connections 2024-05-20T17:40:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- 172.21.15.135:0/3874686621 wait complete. 2024-05-20T17:40:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 -- start start 2024-05-20T17:40:54.587 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.580+0000 7f169998f740 1 Processor -- start 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 0x55c4066e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1ab000 con 0x55c40632b1b0 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1ac470 con 0x55c40630a4d0 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1ab6d0 con 0x55c4063022f0 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f169998f740 10 client.0 _ll_register_callbacks cb 0x7f167c097640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57570/0 (socket says 172.21.15.135:57570) 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 -- 172.21.15.135:0/2812690407 learned_addr learned my addr 172.21.15.135:0/2812690407 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:40:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f168b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f168bfff640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 0x55c4066e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 -- 172.21.15.135:0/2812690407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 msgr2=0x55c4066e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 0x55c4066e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 -- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 msgr2=0x55c4066dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 -- 172.21.15.135:0/2812690407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4066e0a60 con 0x55c40632b1b0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f168bfff640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 0x55c4066e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f168b7fe640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f1690faa640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1684005c30 tx=0x7f1684005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed701e6701fb4476 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.581+0000 7f166b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168402a050 con 0x55c40632b1b0 2024-05-20T17:40:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f1684003d80 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f167c005290 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1684017020 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 10 client.16560 fetch_fsmap learned FSMap version 30 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c406752ea0 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c005290 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f168400ebf0 con 0x55c40632b1b0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 10 client.16560 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 20 client.16560 populate_metadata read hostname 'smithi135' 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062bf1c0 0x55c4067553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 4 client.16560 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c406636dc0 con 0x55c4062bf1c0 2024-05-20T17:40:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.582+0000 7f168bfff640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062bf1c0 0x55c4067553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:40:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.583+0000 7f166b7fe640 10 client.16560 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.583+0000 7f168bfff640 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062bf1c0 0x55c4067553c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=855e25d23a93b90c server_cookie=6f3673be82f9aae3 in_seq=0 out_seq=0 2024-05-20T17:40:54.643 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-20T17:40:54.643 INFO:tasks.workunit.client.0.smithi135.stdout:Final score for writes: 423 2024-05-20T17:40:54.644 INFO:tasks.workunit.client.0.smithi135.stdout:Final score for reads : 832694 2024-05-20T17:40:54.644 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-20T17:40:54.644 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-20T17:40:54.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.644+0000 7f166b7fe640 1 -- 172.21.15.135:0/2812690407 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c406636dc0 con 0x55c4062bf1c0 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.644+0000 7f166b7fe640 10 client.16560 handle_command_reply: tid=0 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.644+0000 7f169998f740 1 client.16560 shutdown 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 msgr2=0x55c4066e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1684005c30 tx=0x7f1684005f70 comp rx=0 tx=0).stop 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 shutdown_connections 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55c4062bf1c0 0x55c4067553c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c40632b1b0 0x55c4066e04a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c40630a4d0 0x55c4066dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f166b7fe640 0 client.16560 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 --2- 172.21.15.135:0/2812690407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4063022f0 0x55c4066e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 >> 172.21.15.135:0/2812690407 conn(0x55c40631f300 msgr2=0x55c4066cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 shutdown_connections 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 1 -- 172.21.15.135:0/2812690407 wait complete. 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f169998f740 20 client.16560 trim_cache size 0 max 16384 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:40:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.645+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 msgr2=0x7f16740a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 0x7f16740a5200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1684022000 tx=0x7f1684023000 comp rx=0 tx=0).stop 2024-05-20T17:40:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 msgr2=0x7f168c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d750 tx=0x7f167c00dc10 comp rx=0 tx=0).stop 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 shutdown_connections 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f16740a2cf0 0x7f16740a5200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f168c107eb0 0x7f168c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f168c107a10 0x7f168c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 --2- 172.21.15.135:0/1020320055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168c102170 0x7f168c19a700 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 >> 172.21.15.135:0/1020320055 conn(0x7f168c077160 msgr2=0x7f168c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 shutdown_connections 2024-05-20T17:40:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:40:54.646+0000 7f1692a0d640 1 -- 172.21.15.135:0/1020320055 wait complete. 2024-05-20T17:40:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:55 smithi160 ceph-mon[36261]: pgmap v232: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 251 KiB/s wr, 44 op/s 2024-05-20T17:40:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:55 smithi172 ceph-mon[36511]: pgmap v232: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 251 KiB/s wr, 44 op/s 2024-05-20T17:40:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:55 smithi135 ceph-mon[32027]: pgmap v232: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 251 KiB/s wr, 44 op/s 2024-05-20T17:40:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:57 smithi160 ceph-mon[36261]: pgmap v233: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 235 KiB/s wr, 36 op/s 2024-05-20T17:40:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:57 smithi172 ceph-mon[36511]: pgmap v233: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 235 KiB/s wr, 36 op/s 2024-05-20T17:40:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:57 smithi135 ceph-mon[32027]: pgmap v233: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 235 KiB/s wr, 36 op/s 2024-05-20T17:40:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:40:59 smithi160 ceph-mon[36261]: pgmap v234: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 519 KiB/s wr, 75 op/s 2024-05-20T17:40:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:40:59 smithi172 ceph-mon[36511]: pgmap v234: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 519 KiB/s wr, 75 op/s 2024-05-20T17:40:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:40:59 smithi135 ceph-mon[32027]: pgmap v234: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 519 KiB/s wr, 75 op/s 2024-05-20T17:41:01.755 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:01 smithi135 ceph-mon[32027]: pgmap v235: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 410 KiB/s wr, 57 op/s 2024-05-20T17:41:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:01 smithi160 ceph-mon[36261]: pgmap v235: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 410 KiB/s wr, 57 op/s 2024-05-20T17:41:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:01 smithi172 ceph-mon[36511]: pgmap v235: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 410 KiB/s wr, 57 op/s 2024-05-20T17:41:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:03 smithi160 ceph-mon[36261]: pgmap v236: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-20T17:41:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:03 smithi172 ceph-mon[36511]: pgmap v236: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-20T17:41:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:03 smithi135 ceph-mon[32027]: pgmap v236: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-20T17:41:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:05 smithi160 ceph-mon[36261]: pgmap v237: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 198 op/s 2024-05-20T17:41:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:05 smithi160 ceph-mon[36261]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:41:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:05 smithi172 ceph-mon[36511]: pgmap v237: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 198 op/s 2024-05-20T17:41:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:05 smithi172 ceph-mon[36511]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:41:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:05 smithi135 ceph-mon[32027]: pgmap v237: 97 pgs: 97 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 198 op/s 2024-05-20T17:41:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:05 smithi135 ceph-mon[32027]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:41:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:07 smithi160 ceph-mon[36261]: pgmap v239: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-20T17:41:07.797 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3218428262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107a10 msgr2=0x7fa9941015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.797 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3218428262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107a10 0x7fa9941015c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009ca0 tx=0x7fa98c02a8d0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3218428262 shutdown_connections 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3218428262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994102170 0x7fa99410e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3218428262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994107eb0 0x7fa994101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3218428262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107a10 0x7fa9941015c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3218428262 >> 172.21.15.135:0/3218428262 conn(0x7fa994077160 msgr2=0x7fa9940775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3218428262 shutdown_connections 2024-05-20T17:41:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.796+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3218428262 wait complete. 2024-05-20T17:41:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.798+0000 7fa99c4f7640 1 Processor -- start 2024-05-20T17:41:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.798+0000 7fa99c4f7640 1 -- start start 2024-05-20T17:41:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.798+0000 7fa99c4f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.798+0000 7fa99c4f7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994107a10 0x7fa99419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99c4f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107eb0 0x7fa9941996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99a293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99a293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:40384/0 (socket says 172.21.15.135:40384) 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99a293640 1 -- 172.21.15.135:0/3637786543 learned_addr learned my addr 172.21.15.135:0/3637786543 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa994112ec0 con 0x7fa994107eb0 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa994112d40 con 0x7fa994107a10 2024-05-20T17:41:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa994113040 con 0x7fa994102170 2024-05-20T17:41:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.799+0000 7fa999a92640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994107a10 0x7fa99419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 -- 172.21.15.135:0/3637786543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994107a10 msgr2=0x7fa99419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994107a10 0x7fa99419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 -- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107eb0 msgr2=0x7fa9941996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107eb0 0x7fa9941996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa994199dd0 con 0x7fa994102170 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.800+0000 7fa99a293640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009430 tx=0x7fa98c003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.801+0000 7fa98b7fe640 1 -- 172.21.15.135:0/3637786543 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c031660 con 0x7fa994102170 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.801+0000 7fa98b7fe640 1 -- 172.21.15.135:0/3637786543 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa98c031800 con 0x7fa994102170 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.801+0000 7fa98b7fe640 1 -- 172.21.15.135:0/3637786543 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c02faf0 con 0x7fa994102170 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.801+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99419a000 con 0x7fa994102170 2024-05-20T17:41:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.801+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99419a4c0 con 0x7fa994102170 2024-05-20T17:41:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.805+0000 7fa9a339d740 1 Processor -- start 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 -- start start 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563a96fde340 con 0x563a96cb12f0 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563a96f86290 con 0x563a96cb94d0 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.806+0000 7fa9a339d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563a96fda300 con 0x563a96cda1b0 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.807+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.807+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:40386/0 (socket says 172.21.15.135:40386) 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.807+0000 7fa99aa94640 1 -- 172.21.15.135:0/2061469379 learned_addr learned my addr 172.21.15.135:0/2061469379 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.808+0000 7fa999a92640 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa98b7fe640 1 -- 172.21.15.135:0/3637786543 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa98c02fcd0 con 0x7fa994102170 2024-05-20T17:41:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa99aa94640 1 -- 172.21.15.135:0/2061469379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 msgr2=0x563a9707f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa99aa94640 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa99aa94640 1 -- 172.21.15.135:0/2061469379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 msgr2=0x563a9707ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa99aa94640 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.809+0000 7fa99aa94640 1 -- 172.21.15.135:0/2061469379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a96faa8e0 con 0x563a96cda1b0 2024-05-20T17:41:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.810+0000 7fa99aa94640 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa990009c40 tx=0x7fa990030730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1fdeca323813801 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.810+0000 7fa988bfe640 1 -- 172.21.15.135:0/2061469379 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990005020 con 0x563a96cda1b0 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.810+0000 7fa98b7fe640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 0x7fa9800a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.810+0000 7fa988bfe640 1 -- 172.21.15.135:0/2061469379 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9900047a0 con 0x563a96cda1b0 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa98b7fe640 1 -- 172.21.15.135:0/3637786543 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa98c0f0620 con 0x7fa994102170 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa99a293640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 0x7fa9800a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa988bfe640 1 -- 172.21.15.135:0/2061469379 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990032680 con 0x563a96cda1b0 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa9a339d740 1 -- 172.21.15.135:0/2061469379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 msgr2=0x563a9707e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa9a339d740 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa990009c40 tx=0x7fa990030730 comp rx=0 tx=0).stop 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.811+0000 7fa99a293640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 0x7fa9800a5350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x563a97076860 tx=0x7fa98c0094a0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 -- 172.21.15.135:0/2061469379 shutdown_connections 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 --2- 172.21.15.135:0/2061469379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a9707e6a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 -- 172.21.15.135:0/2061469379 >> 172.21.15.135:0/2061469379 conn(0x563a96cce300 msgr2=0x563a970751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 -- 172.21.15.135:0/2061469379 shutdown_connections 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 -- 172.21.15.135:0/2061469379 wait complete. 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.812+0000 7fa9a339d740 1 -- start start 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 Processor -- start 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb12f0 0x563a97089930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a97089e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563a9707daa0 con 0x563a96cda1b0 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563a96f99790 con 0x563a96cb94d0 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563a9707dc20 con 0x563a96cb12f0 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa9a339d740 10 client.0 _ll_register_callbacks cb 0x563a96fd4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40094/0 (socket says 172.21.15.135:40094) 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa99aa94640 1 -- 172.21.15.135:0/4252898589 learned_addr learned my addr 172.21.15.135:0/4252898589 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.813+0000 7fa999a92640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a97089e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 -- 172.21.15.135:0/4252898589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb12f0 msgr2=0x563a97089930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb12f0 0x563a97089930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 -- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 msgr2=0x563a97089e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a97089e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 -- 172.21.15.135:0/4252898589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a96cf2210 con 0x563a96cda1b0 2024-05-20T17:41:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.814+0000 7fa99aa94640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa990009f60 tx=0x7fa990005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d2bdd7b210ced6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.816+0000 7fa97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:41:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.816+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990004950 con 0x563a96cda1b0 2024-05-20T17:41:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.816+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa990004af0 con 0x563a96cda1b0 2024-05-20T17:41:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.816+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9900047a0 con 0x563a96cda1b0 2024-05-20T17:41:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.816+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa990004030 con 0x563a96cda1b0 2024-05-20T17:41:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.817+0000 7fa9a339d740 10 client.16566 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.817+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563a96dbe620 con 0x563a96cda1b0 2024-05-20T17:41:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.817+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9900047a0 con 0x563a96cda1b0 2024-05-20T17:41:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.817+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa990005000 con 0x563a96cda1b0 2024-05-20T17:41:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 10 client.16566 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 20 client.16566 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c98d80 0x563a970958c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 4 client.16566 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:41:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.818+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a96feba70 con 0x563a96c98d80 2024-05-20T17:41:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.819+0000 7fa999a92640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c98d80 0x563a970958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.821+0000 7fa999a92640 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c98d80 0x563a970958c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65219253e996b69d server_cookie=cded376ae9f129a6 in_seq=0 out_seq=0 2024-05-20T17:41:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.821+0000 7fa97dffb640 10 client.16566 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.826+0000 7fa97dffb640 1 -- 172.21.15.135:0/4252898589 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563a96feba70 con 0x563a96c98d80 2024-05-20T17:41:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.826+0000 7fa97dffb640 10 client.16566 handle_command_reply: tid=0 2024-05-20T17:41:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 client.16566 shutdown 2024-05-20T17:41:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 msgr2=0x563a97083d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa990009f60 tx=0x7fa990005f90 comp rx=0 tx=0).stop 2024-05-20T17:41:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 shutdown_connections 2024-05-20T17:41:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c98d80 0x563a970958c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cda1b0 0x563a97083d20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a97089e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 --2- 172.21.15.135:0/4252898589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb12f0 0x563a97089930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.827+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 >> 172.21.15.135:0/4252898589 conn(0x563a96cce300 msgr2=0x563a970751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.828+0000 7fa97dffb640 0 client.16566 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.828+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 shutdown_connections 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.828+0000 7fa9a339d740 1 -- 172.21.15.135:0/4252898589 wait complete. 2024-05-20T17:41:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.828+0000 7fa9a339d740 20 client.16566 trim_cache size 0 max 16384 2024-05-20T17:41:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:07 smithi172 ceph-mon[36511]: pgmap v239: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-20T17:41:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 Processor -- start 2024-05-20T17:41:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 -- start start 2024-05-20T17:41:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a97073de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941af560 con 0x563a96cb12f0 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941acd70 con 0x563a96cb94d0 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.855+0000 7fa9a339d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941aabe0 con 0x563a96cda1b0 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40102/0 (socket says 172.21.15.135:40102) 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 -- 172.21.15.135:0/3716126182 learned_addr learned my addr 172.21.15.135:0/3716126182 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa999a92640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a97073de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 -- 172.21.15.135:0/3716126182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 msgr2=0x563a97073de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a97073de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 -- 172.21.15.135:0/3716126182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 msgr2=0x563a9707cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 -- 172.21.15.135:0/3716126182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a97076370 con 0x563a96cb12f0 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa9900092e0 tx=0x7fa990030730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3041ce739fd442d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa97ffff640 1 -- 172.21.15.135:0/3716126182 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990009800 con 0x563a96cb12f0 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa97ffff640 1 -- 172.21.15.135:0/3716126182 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9900035f0 con 0x563a96cb12f0 2024-05-20T17:41:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.856+0000 7fa97ffff640 1 -- 172.21.15.135:0/3716126182 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990004b10 con 0x563a96cb12f0 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.857+0000 7fa9a339d740 1 -- 172.21.15.135:0/3716126182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 msgr2=0x563a9707c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.857+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa9900092e0 tx=0x7fa990030730 comp rx=0 tx=0).stop 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 -- 172.21.15.135:0/3716126182 shutdown_connections 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cda1b0 0x563a97073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cb94d0 0x563a9707cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3716126182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a9707c820 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 -- 172.21.15.135:0/3716126182 >> 172.21.15.135:0/3716126182 conn(0x563a96cce300 msgr2=0x563a970825f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 -- 172.21.15.135:0/3716126182 shutdown_connections 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 -- 172.21.15.135:0/3716126182 wait complete. 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.858+0000 7fa9a339d740 1 -- start start 2024-05-20T17:41:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.859+0000 7fa9a339d740 1 Processor -- start 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.859+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.859+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb94d0 0x563a970f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa9a339d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cda1b0 0x563a9708f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa99aa94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40108/0 (socket says 172.21.15.135:40108) 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa99aa94640 1 -- 172.21.15.135:0/3342124602 learned_addr learned my addr 172.21.15.135:0/3342124602 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941ab230 con 0x563a96cb12f0 2024-05-20T17:41:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941ac6a0 con 0x563a96cda1b0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941ab900 con 0x563a96cb94d0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa9a339d740 10 client.0 _ll_register_callbacks cb 0x7fa990009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cda1b0 0x563a9708f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.860+0000 7fa999a92640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb94d0 0x563a970f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 -- 172.21.15.135:0/3342124602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb94d0 msgr2=0x563a970f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb94d0 0x563a970f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 -- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cda1b0 msgr2=0x563a9708f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cda1b0 0x563a9708f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a9708f7a0 con 0x563a96cb12f0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa99aa94640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa990030d90 tx=0x7fa990005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210a56bdd760b077 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.861+0000 7fa97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:41:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.862+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99003f040 con 0x563a96cb12f0 2024-05-20T17:41:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.862+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa9900043d0 con 0x563a96cb12f0 2024-05-20T17:41:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.863+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9900035f0 con 0x563a96cb12f0 2024-05-20T17:41:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9900047a0 con 0x563a96cb12f0 2024-05-20T17:41:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 10 client.16572 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563a970fd3c0 con 0x563a96cb12f0 2024-05-20T17:41:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9900035f0 con 0x563a96cb12f0 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa990065020 con 0x563a96cb12f0 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 10 client.16572 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 10 client.16572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 20 client.16572 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.865+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c6e1c0 0x563a970ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.866+0000 7fa9a339d740 4 client.16572 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.866+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a96fe5dc0 con 0x563a96c6e1c0 2024-05-20T17:41:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.866+0000 7fa999a92640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c6e1c0 0x563a970ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.867+0000 7fa97dffb640 10 client.16572 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:07.867+0000 7fa999a92640 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c6e1c0 0x563a970ffac0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fab1f3358701a2d server_cookie=6bfca6bb005b9a11 in_seq=0 out_seq=0 2024-05-20T17:41:07.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:07 smithi135 ceph-mon[32027]: pgmap v239: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-20T17:41:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:09 smithi172 ceph-mon[36511]: pgmap v240: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa97dffb640 1 -- 172.21.15.135:0/3342124602 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a96fe5dc0 con 0x563a96c6e1c0 2024-05-20T17:41:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa97dffb640 10 client.16572 handle_command_reply: tid=0 2024-05-20T17:41:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa9a339d740 1 client.16572 shutdown 2024-05-20T17:41:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 msgr2=0x563a970f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa990030d90 tx=0x7fa990005240 comp rx=0 tx=0).stop 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 shutdown_connections 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.897+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563a96c6e1c0 0x563a970ffac0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa97dffb640 0 client.16572 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563a96cda1b0 0x563a9708f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a96cb94d0 0x563a970f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 --2- 172.21.15.135:0/3342124602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563a96cb12f0 0x563a970f4ca0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 >> 172.21.15.135:0/3342124602 conn(0x563a96cce300 msgr2=0x563a97083260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 shutdown_connections 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 1 -- 172.21.15.135:0/3342124602 wait complete. 2024-05-20T17:41:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.898+0000 7fa9a339d740 20 client.16572 trim_cache size 0 max 16384 2024-05-20T17:41:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:41:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:41:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:41:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:41:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 msgr2=0x7fa9800a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 0x7fa9800a5350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x563a97076860 tx=0x7fa98c0094a0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 msgr2=0x7fa99419f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009430 tx=0x7fa98c003ce0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 shutdown_connections 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa9800a2e40 0x7fa9800a5350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa994107eb0 0x7fa9941996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa994107a10 0x7fa99419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 --2- 172.21.15.135:0/3637786543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa994102170 0x7fa99419f520 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 >> 172.21.15.135:0/3637786543 conn(0x7fa994077160 msgr2=0x7fa9941030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 shutdown_connections 2024-05-20T17:41:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:09.899+0000 7fa99c4f7640 1 -- 172.21.15.135:0/3637786543 wait complete. 2024-05-20T17:41:09.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:09 smithi135 ceph-mon[32027]: pgmap v240: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:10.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:09 smithi160 ceph-mon[36261]: pgmap v240: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:11 smithi172 ceph-mon[36511]: pgmap v241: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:11 smithi135 ceph-mon[32027]: pgmap v241: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:12.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:11 smithi160 ceph-mon[36261]: pgmap v241: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-20T17:41:13.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:13 smithi172 ceph-mon[36511]: pgmap v242: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2024-05-20T17:41:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:13 smithi135 ceph-mon[32027]: pgmap v242: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2024-05-20T17:41:14.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:13 smithi160 ceph-mon[36261]: pgmap v242: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2024-05-20T17:41:15.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:15 smithi172 ceph-mon[36511]: pgmap v243: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 330 op/s 2024-05-20T17:41:15.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:15 smithi135 ceph-mon[32027]: pgmap v243: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 330 op/s 2024-05-20T17:41:16.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:15 smithi160 ceph-mon[36261]: pgmap v243: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 330 op/s 2024-05-20T17:41:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:17 smithi172 ceph-mon[36511]: pgmap v244: 97 pgs: 19 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 46 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-05-20T17:41:17.957 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:17 smithi135 ceph-mon[32027]: pgmap v244: 97 pgs: 19 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 46 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-05-20T17:41:18.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:17 smithi160 ceph-mon[36261]: pgmap v244: 97 pgs: 19 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 46 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-05-20T17:41:19.807 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:19 smithi160 ceph-mon[36261]: pgmap v245: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-05-20T17:41:19.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:19 smithi172 ceph-mon[36511]: pgmap v245: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-05-20T17:41:19.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:19 smithi135 ceph-mon[32027]: pgmap v245: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-05-20T17:41:21.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:21 smithi172 ceph-mon[36511]: pgmap v246: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 245 op/s 2024-05-20T17:41:21.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:21 smithi135 ceph-mon[32027]: pgmap v246: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 245 op/s 2024-05-20T17:41:22.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:21 smithi160 ceph-mon[36261]: pgmap v246: 97 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 80 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 245 op/s 2024-05-20T17:41:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4217951013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 msgr2=0x7fa3dc10cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4217951013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc10cb00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009900 tx=0x7fa3d002a510 comp rx=0 tx=0).stop 2024-05-20T17:41:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4217951013 shutdown_connections 2024-05-20T17:41:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4217951013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 0x7fa3dc10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4217951013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc10cb00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4217951013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 0x7fa3dc104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4217951013 >> 172.21.15.135:0/4217951013 conn(0x7fa3dc077160 msgr2=0x7fa3dc0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4217951013 shutdown_connections 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4217951013 wait complete. 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.024+0000 7fa3e3d45640 1 Processor -- start 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 -- start start 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 0x7fa3dc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 0x7fa3dc19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc112e90 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc112d10 con 0x7fa3dc10d090 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e3d45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc113010 con 0x7fa3dc103c80 2024-05-20T17:41:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53248/0 (socket says 172.21.15.135:53248) 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 -- 172.21.15.135:0/4110102931 learned_addr learned my addr 172.21.15.135:0/4110102931 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 0x7fa3dc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 0x7fa3dc19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 -- 172.21.15.135:0/4110102931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 msgr2=0x7fa3dc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 0x7fa3dc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 -- 172.21.15.135:0/4110102931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 msgr2=0x7fa3dc19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 0x7fa3dc19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 -- 172.21.15.135:0/4110102931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc19e630 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004770 tx=0x7fa3d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.025+0000 7fa3daffd640 1 -- 172.21.15.135:0/4110102931 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d003f070 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.026+0000 7fa3daffd640 1 -- 172.21.15.135:0/4110102931 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d0031ca0 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.026+0000 7fa3daffd640 1 -- 172.21.15.135:0/4110102931 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0035030 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.026+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc19e8c0 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.026+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc19edb0 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.028+0000 7fa3daffd640 1 -- 172.21.15.135:0/4110102931 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa3d0042070 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.028+0000 7fa3eabf2740 1 Processor -- start 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 -- start start 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3daffd640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 0x7fa3c40a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64ccb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64ccbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae64c30340 con 0x55ae6492c1b0 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ae64bd8290 con 0x55ae6490b4d0 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae64c2c300 con 0x55ae649032f0 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 0x7fa3c40a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53256/0 (socket says 172.21.15.135:53256) 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 -- 172.21.15.135:0/718731479 learned_addr learned my addr 172.21.15.135:0/718731479 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64ccb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64ccbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3daffd640 1 -- 172.21.15.135:0/4110102931 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa3d00efab0 con 0x7fa3dc10a6e0 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 -- 172.21.15.135:0/718731479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 msgr2=0x55ae64ccb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64ccb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 -- 172.21.15.135:0/718731479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 msgr2=0x55ae64ccbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64ccbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e22e2640 1 -- 172.21.15.135:0/718731479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae64bfc8e0 con 0x55ae6492c1b0 2024-05-20T17:41:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64ccb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.029+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 0x7fa3c40a5200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005fd0 tx=0x7fa3cc009500 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.030+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4013780 tx=0x7fa3d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29019dc1ae324bcb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.030+0000 7fa3c3fff640 1 -- 172.21.15.135:0/718731479 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4013d00 con 0x55ae6492c1b0 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.030+0000 7fa3c3fff640 1 -- 172.21.15.135:0/718731479 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d4011cc0 con 0x55ae6492c1b0 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.030+0000 7fa3c3fff640 1 -- 172.21.15.135:0/718731479 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d401fba0 con 0x55ae6492c1b0 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- 172.21.15.135:0/718731479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 msgr2=0x55ae64ccb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4013780 tx=0x7fa3d4009780 comp rx=0 tx=0).stop 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- 172.21.15.135:0/718731479 shutdown_connections 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64ccbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64ccb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/718731479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae6492c1b0 0x55ae64ccb080 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- 172.21.15.135:0/718731479 >> 172.21.15.135:0/718731479 conn(0x55ae64920300 msgr2=0x55ae64cc7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- 172.21.15.135:0/718731479 shutdown_connections 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- 172.21.15.135:0/718731479 wait complete. 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 -- start start 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.031+0000 7fa3eabf2740 1 Processor -- start 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cd7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6492c1b0 0x55ae64cd5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae64cd81b0 con 0x55ae649032f0 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ae64beb790 con 0x55ae6492c1b0 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae64cd8330 con 0x55ae6490b4d0 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 10 client.0 _ll_register_callbacks cb 0x55ae64c26a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53262/0 (socket says 172.21.15.135:53262) 2024-05-20T17:41:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/393060914 learned_addr learned my addr 172.21.15.135:0/393060914 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cd7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6492c1b0 0x55ae64cd5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/393060914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 msgr2=0x55ae64cd7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cd7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6492c1b0 msgr2=0x55ae64cd5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6492c1b0 0x55ae64cd5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/393060914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae64944210 con 0x55ae649032f0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00ec00 tx=0x7fa3cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cde6f74eb56df26 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc01dc50 con 0x55ae649032f0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa3cc01ddf0 con 0x55ae649032f0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.032+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d4011cc0 con 0x55ae649032f0 2024-05-20T17:41:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3cc003970 con 0x55ae649032f0 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 10 client.16584 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae64a10620 con 0x55ae649032f0 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d4011cc0 con 0x55ae649032f0 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa3cc01e4e0 con 0x55ae649032f0 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 10 client.16584 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 10 client.16584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 20 client.16584 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae648ead80 0x55ae64ce7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 4 client.16584 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae64c3da70 con 0x55ae648ead80 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.033+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae648ead80 0x55ae64ce7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.034+0000 7fa3c17fa640 10 client.16584 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.034+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae648ead80 0x55ae64ce7b30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e982deb579af94 server_cookie=dc3f9ab2368f8182 in_seq=0 out_seq=0 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3c17fa640 1 -- 172.21.15.135:0/393060914 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ae64c3da70 con 0x55ae648ead80 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3c17fa640 10 client.16584 handle_command_reply: tid=0 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 client.16584 shutdown 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 msgr2=0x55ae64cd7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00ec00 tx=0x7fa3cc004ab0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 shutdown_connections 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae648ead80 0x55ae64ce7b30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6492c1b0 0x55ae64cd5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3c17fa640 0 client.16584 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cd7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.036+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/393060914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae649032f0 0x55ae64cd7210 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.037+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 >> 172.21.15.135:0/393060914 conn(0x55ae64920300 msgr2=0x55ae64ccaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.037+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 shutdown_connections 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.037+0000 7fa3eabf2740 1 -- 172.21.15.135:0/393060914 wait complete. 2024-05-20T17:41:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.037+0000 7fa3eabf2740 20 client.16584 trim_cache size 0 max 16384 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 Processor -- start 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 -- start start 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64cdd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64cddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1b1580 con 0x55ae648ead80 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1aed90 con 0x55ae6490b4d0 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1acc00 con 0x55ae649032f0 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53270/0 (socket says 172.21.15.135:53270) 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/3789871311 learned_addr learned my addr 172.21.15.135:0/3789871311 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64cdd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64cddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/3789871311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 msgr2=0x55ae64cdd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64cdd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/3789871311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 msgr2=0x55ae64cddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64cddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/3789871311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae64cc8420 con 0x55ae648ead80 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.052+0000 7fa3e22e2640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64cddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc011d40 tx=0x7fa3cc01d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7309970129bca server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3c37fe640 1 -- 172.21.15.135:0/3789871311 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc01dc50 con 0x55ae648ead80 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3c37fe640 1 -- 172.21.15.135:0/3789871311 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc01ddf0 con 0x55ae648ead80 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3c37fe640 1 -- 172.21.15.135:0/3789871311 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc005280 con 0x55ae648ead80 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3eabf2740 1 -- 172.21.15.135:0/3789871311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 msgr2=0x55ae64ccf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.053+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc011d40 tx=0x7fa3cc01d8d0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- 172.21.15.135:0/3789871311 shutdown_connections 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae6490b4d0 0x55ae64cddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae649032f0 0x55ae64cdd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/3789871311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64ccf450 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- 172.21.15.135:0/3789871311 >> 172.21.15.135:0/3789871311 conn(0x55ae64920300 msgr2=0x55ae64cced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- 172.21.15.135:0/3789871311 shutdown_connections 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- 172.21.15.135:0/3789871311 wait complete. 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- start start 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 Processor -- start 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae649032f0 0x55ae64d48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cdce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1ad250 con 0x55ae648ead80 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1ae6c0 con 0x55ae649032f0 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1ad920 con 0x55ae6490b4d0 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.054+0000 7fa3eabf2740 10 client.0 _ll_register_callbacks cb 0x7fa3cc00e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53286/0 (socket says 172.21.15.135:53286) 2024-05-20T17:41:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e22e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cdce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/4262390440 learned_addr learned my addr 172.21.15.135:0/4262390440 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae649032f0 0x55ae64d48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/4262390440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 msgr2=0x55ae64cdce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cdce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae649032f0 msgr2=0x55ae64d48e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae649032f0 0x55ae64d48e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 -- 172.21.15.135:0/4262390440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae64cdd490 con 0x55ae648ead80 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3e1ae1640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc016040 tx=0x7fa3cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b8e879866c16cd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc003de0 con 0x55ae648ead80 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8615+0+0 (secure 0 0 0) 0x7fa3cc0050b0 con 0x55ae648ead80 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3cc01ddf0 con 0x55ae648ead80 2024-05-20T17:41:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3cc046050 con 0x55ae648ead80 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3eabf2740 10 client.16590 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.055+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae64d4ff80 con 0x55ae648ead80 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc01ddf0 con 0x55ae648ead80 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa3cc02e860 con 0x55ae648ead80 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 10 client.16590 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 10 client.16590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 20 client.16590 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae6492c1b0 0x55ae64d52660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 4 client.16590 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae64c37dc0 con 0x55ae6492c1b0 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae6492c1b0 0x55ae64d52660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3c17fa640 10 client.16590 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:23.056+0000 7fa3e12e0640 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae6492c1b0 0x55ae64d52660 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=354e471d77056101 server_cookie=fd75afe8fd0cea79 in_seq=0 out_seq=0 2024-05-20T17:41:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:23 smithi172 ceph-mon[36511]: pgmap v247: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 443 op/s 2024-05-20T17:41:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:23 smithi172 ceph-mon[36511]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:41:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:23 smithi135 ceph-mon[32027]: pgmap v247: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 443 op/s 2024-05-20T17:41:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:23 smithi135 ceph-mon[32027]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:41:24.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:23 smithi160 ceph-mon[36261]: pgmap v247: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 443 op/s 2024-05-20T17:41:24.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:23 smithi160 ceph-mon[36261]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:41:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.322+0000 7fa3c17fa640 1 -- 172.21.15.135:0/4262390440 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae64c37dc0 con 0x55ae6492c1b0 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.322+0000 7fa3c17fa640 10 client.16590 handle_command_reply: tid=0 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.322+0000 7fa3eabf2740 1 client.16590 shutdown 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 msgr2=0x55ae64d488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc016040 tx=0x7fa3cc014000 comp rx=0 tx=0).stop 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 shutdown_connections 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ae6492c1b0 0x55ae64d52660 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3c17fa640 0 client.16590 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae6490b4d0 0x55ae64cdce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ae649032f0 0x55ae64d48e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 --2- 172.21.15.135:0/4262390440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae648ead80 0x55ae64d488d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 >> 172.21.15.135:0/4262390440 conn(0x55ae64920300 msgr2=0x55ae64ccae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 shutdown_connections 2024-05-20T17:41:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.323+0000 7fa3eabf2740 1 -- 172.21.15.135:0/4262390440 wait complete. 2024-05-20T17:41:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.324+0000 7fa3eabf2740 20 client.16590 trim_cache size 0 max 16384 2024-05-20T17:41:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:41:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:41:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:41:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.324+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 msgr2=0x7fa3c40a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.324+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 0x7fa3c40a5200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005fd0 tx=0x7fa3cc009500 comp rx=0 tx=0).stop 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.324+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 msgr2=0x7fa3dc199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.324+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004770 tx=0x7fa3d0003c10 comp rx=0 tx=0).stop 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 shutdown_connections 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa3c40a2cf0 0x7fa3c40a5200 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3dc10d090 0x7fa3dc19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc10a6e0 0x7fa3dc199d30 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 --2- 172.21.15.135:0/4110102931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3dc103c80 0x7fa3dc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 >> 172.21.15.135:0/4110102931 conn(0x7fa3dc077160 msgr2=0x7fa3dc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 shutdown_connections 2024-05-20T17:41:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:25.325+0000 7fa3e3d45640 1 -- 172.21.15.135:0/4110102931 wait complete. 2024-05-20T17:41:25.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:25 smithi172 ceph-mon[36511]: pgmap v249: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.0 MiB/s wr, 458 op/s 2024-05-20T17:41:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:25 smithi135 ceph-mon[32027]: pgmap v249: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.0 MiB/s wr, 458 op/s 2024-05-20T17:41:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:25 smithi160 ceph-mon[36261]: pgmap v249: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.0 MiB/s wr, 458 op/s 2024-05-20T17:41:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:27 smithi172 ceph-mon[36511]: pgmap v250: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 560 op/s 2024-05-20T17:41:27.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:27 smithi135 ceph-mon[32027]: pgmap v250: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 560 op/s 2024-05-20T17:41:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:27 smithi160 ceph-mon[36261]: pgmap v250: 97 pgs: 97 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 560 op/s 2024-05-20T17:41:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:29 smithi172 ceph-mon[36511]: pgmap v251: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 839 op/s 2024-05-20T17:41:29.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:29 smithi135 ceph-mon[32027]: pgmap v251: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 839 op/s 2024-05-20T17:41:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:29 smithi160 ceph-mon[36261]: pgmap v251: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 12 MiB/s wr, 839 op/s 2024-05-20T17:41:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:31 smithi172 ceph-mon[36511]: pgmap v252: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 856 op/s 2024-05-20T17:41:31.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:31 smithi135 ceph-mon[32027]: pgmap v252: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 856 op/s 2024-05-20T17:41:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:31 smithi160 ceph-mon[36261]: pgmap v252: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 856 op/s 2024-05-20T17:41:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:33 smithi172 ceph-mon[36511]: pgmap v253: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 692 op/s 2024-05-20T17:41:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:33 smithi135 ceph-mon[32027]: pgmap v253: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 692 op/s 2024-05-20T17:41:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:33 smithi160 ceph-mon[36261]: pgmap v253: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 692 op/s 2024-05-20T17:41:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:35 smithi172 ceph-mon[36511]: pgmap v254: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2024-05-20T17:41:35.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:35 smithi135 ceph-mon[32027]: pgmap v254: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2024-05-20T17:41:36.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:35 smithi160 ceph-mon[36261]: pgmap v254: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 8.4 MiB/s wr, 548 op/s 2024-05-20T17:41:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:37 smithi172 ceph-mon[36511]: pgmap v255: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-05-20T17:41:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:37 smithi135 ceph-mon[32027]: pgmap v255: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-05-20T17:41:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:37 smithi160 ceph-mon[36261]: pgmap v255: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-05-20T17:41:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 -- 172.21.15.135:0/439654827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010b1d0 msgr2=0x7ffb90104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/439654827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010b1d0 0x7ffb90104e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009860 tx=0x7ffb8002a340 comp rx=0 tx=0).stop 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 -- 172.21.15.135:0/439654827 shutdown_connections 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/439654827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 0x7ffb90111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/439654827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010b1d0 0x7ffb90104e10 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009860 tx=0x7ffb8002a340 comp rx=0 tx=0).stop 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/439654827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb9010ad30 0x7ffb901048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.470+0000 7ffb95a1b640 1 -- 172.21.15.135:0/439654827 >> 172.21.15.135:0/439654827 conn(0x7ffb901003b0 msgr2=0x7ffb90102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.473+0000 7ffb95a1b640 1 -- 172.21.15.135:0/439654827 shutdown_connections 2024-05-20T17:41:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.473+0000 7ffb95a1b640 1 -- 172.21.15.135:0/439654827 wait complete. 2024-05-20T17:41:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.474+0000 7ffb95a1b640 1 Processor -- start 2024-05-20T17:41:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.474+0000 7ffb95a1b640 1 -- start start 2024-05-20T17:41:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 0x7ffb90077340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90077dc0 0x7ffb901a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90115120 con 0x7ffb90077dc0 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90114fa0 con 0x7ffb90105480 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb95a1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901152a0 con 0x7ffb9010ad30 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90077dc0 0x7ffb901a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 0x7ffb90077340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:44936/0 (socket says 172.21.15.135:44936) 2024-05-20T17:41:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/3647986205 learned_addr learned my addr 172.21.15.135:0/3647986205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/3647986205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 msgr2=0x7ffb90077340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 0x7ffb90077340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90077dc0 msgr2=0x7ffb901a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90077dc0 0x7ffb901a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.475+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/3647986205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb901a1d70 con 0x7ffb9010ad30 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb8002a8b0 tx=0x7ffb80033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb94a19640 1 -- 172.21.15.135:0/3647986205 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80037040 con 0x7ffb9010ad30 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb94a19640 1 -- 172.21.15.135:0/3647986205 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb80004220 con 0x7ffb9010ad30 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb94a19640 1 -- 172.21.15.135:0/3647986205 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80003bc0 con 0x7ffb9010ad30 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb901a2000 con 0x7ffb9010ad30 2024-05-20T17:41:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.476+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb901a2440 con 0x7ffb9010ad30 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 Processor -- start 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb94a19640 1 -- 172.21.15.135:0/3647986205 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ffb80042060 con 0x7ffb9010ad30 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 -- start start 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da51027340 con 0x55da50d231b0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55da50fcf290 con 0x55da50d024d0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.481+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da51023300 con 0x55da50cfa2f0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:44944/0 (socket says 172.21.15.135:44944) 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 -- 172.21.15.135:0/3963728219 learned_addr learned my addr 172.21.15.135:0/3963728219 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb94a19640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 0x7ffb780a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 -- 172.21.15.135:0/3963728219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 msgr2=0x55da510c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 -- 172.21.15.135:0/3963728219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 msgr2=0x55da510c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb94a19640 1 -- 172.21.15.135:0/3647986205 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ffb800ee080 con 0x7ffb9010ad30 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 -- 172.21.15.135:0/3963728219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da50ff38e0 con 0x55da50cfa2f0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 0x7ffb780a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb8effd640 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009f40 tx=0x7ffb8800f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cdfbed0d7538147 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.482+0000 7ffb75ffb640 1 -- 172.21.15.135:0/3963728219 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88004b20 con 0x55da50cfa2f0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.483+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 0x7ffb780a52d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55da510bf1f0 tx=0x7ffb84008040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.483+0000 7ffb75ffb640 1 -- 172.21.15.135:0/3963728219 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb88004cc0 con 0x55da50cfa2f0 2024-05-20T17:41:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.483+0000 7ffb75ffb640 1 -- 172.21.15.135:0/3963728219 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880054e0 con 0x55da50cfa2f0 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.483+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3963728219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 msgr2=0x55da510c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.483+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009f40 tx=0x7ffb8800f890 comp rx=0 tx=0).stop 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3963728219 shutdown_connections 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510c25c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3963728219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3963728219 >> 172.21.15.135:0/3963728219 conn(0x55da50d17300 msgr2=0x55da510be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3963728219 shutdown_connections 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3963728219 wait complete. 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 -- start start 2024-05-20T17:41:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.484+0000 7ffb9c9a7740 1 Processor -- start 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da510cf1b0 con 0x55da50d231b0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55da50fe2790 con 0x55da50d024d0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da510cf330 con 0x55da50cfa2f0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 10 client.0 _ll_register_callbacks cb 0x55da5101da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:44468/0 (socket says 172.21.15.135:44468) 2024-05-20T17:41:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/928927805 learned_addr learned my addr 172.21.15.135:0/928927805 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60934/0 (socket says 172.21.15.135:60934) 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:44950/0 (socket says 172.21.15.135:44950) 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/928927805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 msgr2=0x55da510ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/928927805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 msgr2=0x55da510cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/928927805 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da50d3b210 con 0x55da50d024d0 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb800ba380 tx=0x7ffb8002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b82a8db1036dc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb6effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb800b6920 con 0x55da50d024d0 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb88004cc0 con 0x55da50d024d0 2024-05-20T17:41:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.485+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ffb80003d60 con 0x55da50d024d0 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffb800b9fe0 con 0x55da50d024d0 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 10 client.26201 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da50e07620 con 0x55da50d024d0 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb88004cc0 con 0x55da50d024d0 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ffb8003a070 con 0x55da50d024d0 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 10 client.26201 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 10 client.26201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 20 client.26201 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50ce1d80 0x55da510de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 4 client.26201 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da51034a70 con 0x55da50ce1d80 2024-05-20T17:41:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.486+0000 7ffb8effd640 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50ce1d80 0x55da510de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.487+0000 7ffb8effd640 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50ce1d80 0x55da510de700 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b894adcbefec6b7e server_cookie=9df7d79f7cfd602f in_seq=0 out_seq=0 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.487+0000 7ffb6effd640 10 client.26201 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.489+0000 7ffb6effd640 1 -- 172.21.15.135:0/928927805 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da51034a70 con 0x55da50ce1d80 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.489+0000 7ffb6effd640 10 client.26201 handle_command_reply: tid=0 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.489+0000 7ffb9c9a7740 1 client.26201 shutdown 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 msgr2=0x55da510ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb800ba380 tx=0x7ffb8002a340 comp rx=0 tx=0).stop 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 shutdown_connections 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50ce1d80 0x55da510de700 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb6effd640 0 client.26201 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d024d0 0x55da510ce600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/928927805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 >> 172.21.15.135:0/928927805 conn(0x55da50d17300 msgr2=0x55da510c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 shutdown_connections 2024-05-20T17:41:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/928927805 wait complete. 2024-05-20T17:41:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.490+0000 7ffb9c9a7740 20 client.26201 trim_cache size 0 max 16384 2024-05-20T17:41:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.505+0000 7ffb9c9a7740 1 Processor -- start 2024-05-20T17:41:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.505+0000 7ffb9c9a7740 1 -- start start 2024-05-20T17:41:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50d024d0 0x55da510e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901c0900 con 0x55da50d231b0 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901be110 con 0x55da50cfa2f0 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901bbf80 con 0x55da50d024d0 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60936/0 (socket says 172.21.15.135:60936) 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/3419872215 learned_addr learned my addr 172.21.15.135:0/3419872215 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8effd640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:44470/0 (socket says 172.21.15.135:44470) 2024-05-20T17:41:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50d024d0 0x55da510e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/3419872215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50d024d0 msgr2=0x55da510e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50d024d0 0x55da510e4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/3419872215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 msgr2=0x55da510e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/3419872215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da510cf090 con 0x55da50d231b0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8effd640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009e50 tx=0x7ffb84015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df2a78a53e2bb18 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb757fa640 1 -- 172.21.15.135:0/3419872215 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84015e00 con 0x55da50d231b0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb757fa640 1 -- 172.21.15.135:0/3419872215 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb84027030 con 0x55da50d231b0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.506+0000 7ffb757fa640 1 -- 172.21.15.135:0/3419872215 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84022ae0 con 0x55da50d231b0 2024-05-20T17:41:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3419872215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 msgr2=0x55da510d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009e50 tx=0x7ffb84015000 comp rx=0 tx=0).stop 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3419872215 shutdown_connections 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d231b0 0x55da510d45b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50d024d0 0x55da510e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/3419872215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50cfa2f0 0x55da510e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3419872215 >> 172.21.15.135:0/3419872215 conn(0x55da50d17300 msgr2=0x55da510cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3419872215 shutdown_connections 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.507+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/3419872215 wait complete. 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 -- start start 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 Processor -- start 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 0x55da510d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901bc5d0 con 0x55da50d024d0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901bda40 con 0x55da50d231b0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901bcca0 con 0x55da50cfa2f0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb9c9a7740 10 client.0 _ll_register_callbacks cb 0x7ffb80005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 0x55da510d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb8e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60942/0 (socket says 172.21.15.135:60942) 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb8e7fc640 1 -- 172.21.15.135:0/793938244 learned_addr learned my addr 172.21.15.135:0/793938244 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.508+0000 7ffb8effd640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/793938244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 msgr2=0x55da510d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510d4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/793938244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 msgr2=0x55da510cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 -- 172.21.15.135:0/793938244 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da510d0bc0 con 0x55da50d231b0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8e7fc640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb8f7fe640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 0x55da510d0450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb840094f0 tx=0x7ffb84009fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202b5cee7d174b17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8403a060 con 0x55da50d231b0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb84027030 con 0x55da50d231b0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ffb84015e00 con 0x55da50d231b0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffb840229f0 con 0x55da50d231b0 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb9c9a7740 10 client.26207 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da511469e0 con 0x55da50d231b0 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb84027030 con 0x55da50d231b0 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.509+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ffb8403e440 con 0x55da50d231b0 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 10 client.26207 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 10 client.26207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 20 client.26207 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50cb71c0 0x55da51149120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 4 client.26207 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da5102edc0 con 0x55da50cb71c0 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb8effd640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50cb71c0 0x55da51149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb6effd640 10 client.26207 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:38.510+0000 7ffb8effd640 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50cb71c0 0x55da51149120 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb7552f4d960bb02 server_cookie=a8d8dc88478c11b2 in_seq=0 out_seq=0 2024-05-20T17:41:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:39 smithi172 ceph-mon[36511]: pgmap v256: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 513 op/s 2024-05-20T17:41:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:39 smithi135 ceph-mon[32027]: pgmap v256: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 513 op/s 2024-05-20T17:41:40.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:39 smithi160 ceph-mon[36261]: pgmap v256: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.3 MiB/s wr, 513 op/s 2024-05-20T17:41:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb6effd640 1 -- 172.21.15.135:0/793938244 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da5102edc0 con 0x55da50cb71c0 2024-05-20T17:41:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb6effd640 10 client.26207 handle_command_reply: tid=0 2024-05-20T17:41:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 client.26207 shutdown 2024-05-20T17:41:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 msgr2=0x55da510d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 0x55da510d0450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb840094f0 tx=0x7ffb84009fc0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 shutdown_connections 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55da50cb71c0 0x55da51149120 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb6effd640 0 client.26207 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55da50d231b0 0x55da510d0450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da50d024d0 0x55da510cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 --2- 172.21.15.135:0/793938244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da50cfa2f0 0x55da510d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 >> 172.21.15.135:0/793938244 conn(0x55da50d17300 msgr2=0x55da510c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 shutdown_connections 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.332+0000 7ffb9c9a7740 1 -- 172.21.15.135:0/793938244 wait complete. 2024-05-20T17:41:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.333+0000 7ffb9c9a7740 20 client.26207 trim_cache size 0 max 16384 2024-05-20T17:41:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:41:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:41:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:41:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.333+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 msgr2=0x7ffb780a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.333+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 0x7ffb780a52d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55da510bf1f0 tx=0x7ffb84008040 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.333+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 msgr2=0x7ffb90077880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.333+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb8002a8b0 tx=0x7ffb80033d10 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 shutdown_connections 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffb780a2dc0 0x7ffb780a52d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb90077dc0 0x7ffb901a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9010ad30 0x7ffb90077880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 --2- 172.21.15.135:0/3647986205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb90105480 0x7ffb90077340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 >> 172.21.15.135:0/3647986205 conn(0x7ffb901003b0 msgr2=0x7ffb9010f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 shutdown_connections 2024-05-20T17:41:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:41.334+0000 7ffb95a1b640 1 -- 172.21.15.135:0/3647986205 wait complete. 2024-05-20T17:41:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:41 smithi172 ceph-mon[36511]: pgmap v257: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-20T17:41:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:41 smithi135 ceph-mon[32027]: pgmap v257: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-20T17:41:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:41 smithi160 ceph-mon[36261]: pgmap v257: 97 pgs: 97 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-20T17:41:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:43 smithi172 ceph-mon[36511]: pgmap v258: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 920 op/s 2024-05-20T17:41:43.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:43 smithi135 ceph-mon[32027]: pgmap v258: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 920 op/s 2024-05-20T17:41:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:43 smithi160 ceph-mon[36261]: pgmap v258: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 920 op/s 2024-05-20T17:41:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:45 smithi172 ceph-mon[36511]: pgmap v259: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 1.13k op/s 2024-05-20T17:41:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:45 smithi135 ceph-mon[32027]: pgmap v259: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 1.13k op/s 2024-05-20T17:41:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:45 smithi160 ceph-mon[36261]: pgmap v259: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 1.13k op/s 2024-05-20T17:41:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:47 smithi172 ceph-mon[36511]: pgmap v260: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 1.19k op/s 2024-05-20T17:41:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:47 smithi135 ceph-mon[32027]: pgmap v260: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 1.19k op/s 2024-05-20T17:41:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:47 smithi160 ceph-mon[36261]: pgmap v260: 97 pgs: 97 active+clean; 2.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 1.19k op/s 2024-05-20T17:41:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:49 smithi172 ceph-mon[36511]: pgmap v261: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 1.25k op/s 2024-05-20T17:41:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:49 smithi135 ceph-mon[32027]: pgmap v261: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 1.25k op/s 2024-05-20T17:41:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:49 smithi160 ceph-mon[36261]: pgmap v261: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 1.25k op/s 2024-05-20T17:41:50.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:50 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:41:50.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:50 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:41:51.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:50 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:41:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:51 smithi172 ceph-mon[36511]: pgmap v262: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.17k op/s 2024-05-20T17:41:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:51 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:41:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:51 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:41:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:51 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:41:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:51 smithi135 ceph-mon[32027]: pgmap v262: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.17k op/s 2024-05-20T17:41:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:51 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:41:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:51 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:41:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:51 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:41:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:51 smithi160 ceph-mon[36261]: pgmap v262: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 1.17k op/s 2024-05-20T17:41:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:51 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:41:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:51 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:41:52.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:51 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:41:53.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:53 smithi172 ceph-mon[36511]: pgmap v263: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 1.25k op/s 2024-05-20T17:41:53.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:53 smithi135 ceph-mon[32027]: pgmap v263: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 1.25k op/s 2024-05-20T17:41:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:53 smithi160 ceph-mon[36261]: pgmap v263: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 1.25k op/s 2024-05-20T17:41:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 -- 172.21.15.135:0/2040517385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810a680 msgr2=0x7f9c2810caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 --2- 172.21.15.135:0/2040517385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810a680 0x7f9c2810caa0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c1802a410 comp rx=0 tx=0).stop 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 -- 172.21.15.135:0/2040517385 shutdown_connections 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 --2- 172.21.15.135:0/2040517385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810d070 0x7f9c2810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 --2- 172.21.15.135:0/2040517385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810a680 0x7f9c2810caa0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 --2- 172.21.15.135:0/2040517385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c28104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.456+0000 7f9c2deca640 1 -- 172.21.15.135:0/2040517385 >> 172.21.15.135:0/2040517385 conn(0x7f9c28077160 msgr2=0x7f9c280775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.457+0000 7f9c2deca640 1 -- 172.21.15.135:0/2040517385 shutdown_connections 2024-05-20T17:41:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.457+0000 7f9c2deca640 1 -- 172.21.15.135:0/2040517385 wait complete. 2024-05-20T17:41:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.458+0000 7f9c2deca640 1 Processor -- start 2024-05-20T17:41:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.458+0000 7f9c2deca640 1 -- start start 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c2819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810a680 0x7f9c2819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112eb0 con 0x7f9c2810d070 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112d30 con 0x7f9c2810a680 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.459+0000 7f9c2deca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28113030 con 0x7f9c28103c20 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c2819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37208/0 (socket says 172.21.15.135:37208) 2024-05-20T17:41:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 -- 172.21.15.135:0/1773463128 learned_addr learned my addr 172.21.15.135:0/1773463128 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810a680 0x7f9c2819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 -- 172.21.15.135:0/1773463128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 msgr2=0x7f9c2819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c2819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 -- 172.21.15.135:0/1773463128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810a680 msgr2=0x7f9c2819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810a680 0x7f9c2819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.460+0000 7f9c27fff640 1 -- 172.21.15.135:0/1773463128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c28199e20 con 0x7f9c2810d070 2024-05-20T17:41:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.461+0000 7f9c277fe640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c2819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:41:54.464 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.461+0000 7f9c27fff640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b970 tx=0x7f9c2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.462+0000 7f9c24ff9640 1 -- 172.21.15.135:0/1773463128 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20019070 con 0x7f9c2810d070 2024-05-20T17:41:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.462+0000 7f9c24ff9640 1 -- 172.21.15.135:0/1773463128 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2000cb40 con 0x7f9c2810d070 2024-05-20T17:41:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.462+0000 7f9c24ff9640 1 -- 172.21.15.135:0/1773463128 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20007650 con 0x7f9c2810d070 2024-05-20T17:41:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.462+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2819a0b0 con 0x7f9c2810d070 2024-05-20T17:41:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.462+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2819a520 con 0x7f9c2810d070 2024-05-20T17:41:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.468+0000 7f9c34d73740 1 Processor -- start 2024-05-20T17:41:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.468+0000 7f9c24ff9640 1 -- 172.21.15.135:0/1773463128 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9c2001c070 con 0x7f9c2810d070 2024-05-20T17:41:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.468+0000 7f9c34d73740 1 -- start start 2024-05-20T17:41:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8681b0 0x55f65ac07080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f65ab6c340 con 0x55f65a83f2f0 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f65ab14290 con 0x55f65a8474d0 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c34d73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f65ab68300 con 0x55f65a8681b0 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:58432/0 (socket says 172.21.15.135:58432) 2024-05-20T17:41:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2049897952 learned_addr learned my addr 172.21.15.135:0/2049897952 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c277fe640 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.469+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8681b0 0x55f65ac07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c24ff9640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 0x7f9c100a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2049897952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8681b0 msgr2=0x55f65ac07080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8681b0 0x55f65ac07080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2049897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 msgr2=0x55f65ac075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2049897952 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65ab388e0 con 0x55f65a8474d0 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.470+0000 7f9c24ff9640 1 -- 172.21.15.135:0/1773463128 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f9c200ce950 con 0x7f9c2810d070 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.471+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005ab0 tx=0x7f9c18005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8196856bfbcb25b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.471+0000 7f9c27fff640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 0x7f9c100a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.471+0000 7f9c0dffb640 1 -- 172.21.15.135:0/2049897952 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035040 con 0x55f65a8474d0 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.471+0000 7f9c0dffb640 1 -- 172.21.15.135:0/2049897952 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c18031d50 con 0x55f65a8474d0 2024-05-20T17:41:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.471+0000 7f9c0dffb640 1 -- 172.21.15.135:0/2049897952 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003e30 con 0x55f65a8474d0 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 -- 172.21.15.135:0/2049897952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 msgr2=0x55f65ac07b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005ab0 tx=0x7f9c18005a20 comp rx=0 tx=0).stop 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c27fff640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 0x7f9c100a5410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c200cc180 tx=0x7f9c2000e040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 -- 172.21.15.135:0/2049897952 shutdown_connections 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac07b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2049897952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8681b0 0x55f65ac07080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 -- 172.21.15.135:0/2049897952 >> 172.21.15.135:0/2049897952 conn(0x55f65a85c300 msgr2=0x55f65ac03830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 -- 172.21.15.135:0/2049897952 shutdown_connections 2024-05-20T17:41:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.472+0000 7f9c34d73740 1 -- 172.21.15.135:0/2049897952 wait complete. 2024-05-20T17:41:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.473+0000 7f9c34d73740 1 -- start start 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.473+0000 7f9c34d73740 1 Processor -- start 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac115f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f65ac14150 con 0x55f65a8681b0 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f65ab27790 con 0x55f65a8474d0 2024-05-20T17:41:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f65ac142d0 con 0x55f65a83f2f0 2024-05-20T17:41:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c34d73740 10 client.0 _ll_register_callbacks cb 0x55f65ab62a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:58864/0 (socket says 172.21.15.135:58864) 2024-05-20T17:41:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c26ffd640 1 -- 172.21.15.135:0/330323637 learned_addr learned my addr 172.21.15.135:0/330323637 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.474+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.475+0000 7f9c277fe640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.475+0000 7f9c26ffd640 1 -- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 msgr2=0x55f65ac136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c26ffd640 1 -- 172.21.15.135:0/330323637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 msgr2=0x55f65ac115f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac115f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c26ffd640 1 -- 172.21.15.135:0/330323637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65a880210 con 0x55f65a83f2f0 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009850 tx=0x7f9c18005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c239f02fcad3db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.476+0000 7f9c06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.477+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035030 con 0x55f65a83f2f0 2024-05-20T17:41:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.477+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18031d50 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.477+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f9c18003850 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.477+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c1805b050 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.478+0000 7f9c34d73740 10 client.26122 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.478+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f65a94c620 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.478+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c18031d50 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9c1803a040 con 0x55f65a83f2f0 2024-05-20T17:41:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 10 client.26122 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 10 client.26122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 20 client.26122 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a826d80 0x55f65ac34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 4 client.26122 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.479+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f65ab79a70 con 0x55f65a826d80 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.480+0000 7f9c277fe640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a826d80 0x55f65ac34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.480+0000 7f9c277fe640 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a826d80 0x55f65ac34a80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4b7299897781cc server_cookie=3ba9f2213607e2af in_seq=0 out_seq=0 2024-05-20T17:41:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.480+0000 7f9c06ffd640 10 client.26122 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.484+0000 7f9c06ffd640 1 -- 172.21.15.135:0/330323637 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f65ab79a70 con 0x55f65a826d80 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.484+0000 7f9c06ffd640 10 client.26122 handle_command_reply: tid=0 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.485+0000 7f9c34d73740 1 client.26122 shutdown 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 msgr2=0x55f65ac13170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009850 tx=0x7f9c18005d50 comp rx=0 tx=0).stop 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 shutdown_connections 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a826d80 0x55f65ac34a80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 --2- 172.21.15.135:0/330323637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac13170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 >> 172.21.15.135:0/330323637 conn(0x55f65a85c300 msgr2=0x55f65ac08da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c06ffd640 0 client.26122 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 shutdown_connections 2024-05-20T17:41:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.486+0000 7f9c34d73740 1 -- 172.21.15.135:0/330323637 wait complete. 2024-05-20T17:41:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.487+0000 7f9c34d73740 20 client.26122 trim_cache size 0 max 16384 2024-05-20T17:41:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 Processor -- start 2024-05-20T17:41:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 -- start start 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac13420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac0ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281af3c0 con 0x55f65a8681b0 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28071e30 con 0x55f65a8474d0 2024-05-20T17:41:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.513+0000 7f9c34d73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2806fca0 con 0x55f65a83f2f0 2024-05-20T17:41:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:58870/0 (socket says 172.21.15.135:58870) 2024-05-20T17:41:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2880099877 learned_addr learned my addr 172.21.15.135:0/2880099877 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac0ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c277fe640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac13420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2880099877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 msgr2=0x55f65ac13420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac13420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2880099877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 msgr2=0x55f65ac0ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac0ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c26ffd640 1 -- 172.21.15.135:0/2880099877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65ac0ceb0 con 0x55f65a83f2f0 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.515+0000 7f9c277fe640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.516+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55f65ab278e0 tx=0x7f9c1804c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f309a41e30b5cb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.516+0000 7f9c0d7fa640 1 -- 172.21.15.135:0/2880099877 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035070 con 0x55f65a83f2f0 2024-05-20T17:41:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.516+0000 7f9c0d7fa640 1 -- 172.21.15.135:0/2880099877 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c1804e030 con 0x55f65a83f2f0 2024-05-20T17:41:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.516+0000 7f9c0d7fa640 1 -- 172.21.15.135:0/2880099877 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18049ac0 con 0x55f65a83f2f0 2024-05-20T17:41:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.517+0000 7f9c34d73740 1 -- 172.21.15.135:0/2880099877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 msgr2=0x55f65ac07ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.517+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55f65ab278e0 tx=0x7f9c1804c040 comp rx=0 tx=0).stop 2024-05-20T17:41:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.519+0000 7f9c34d73740 1 -- 172.21.15.135:0/2880099877 shutdown_connections 2024-05-20T17:41:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.520+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a8681b0 0x55f65ac0ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.520+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8474d0 0x55f65ac13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.520+0000 7f9c34d73740 1 --2- 172.21.15.135:0/2880099877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a83f2f0 0x55f65ac07ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.520+0000 7f9c34d73740 1 -- 172.21.15.135:0/2880099877 >> 172.21.15.135:0/2880099877 conn(0x55f65a85c300 msgr2=0x55f65ac12d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.521+0000 7f9c34d73740 1 -- 172.21.15.135:0/2880099877 shutdown_connections 2024-05-20T17:41:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.521+0000 7f9c34d73740 1 -- 172.21.15.135:0/2880099877 wait complete. 2024-05-20T17:41:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.522+0000 7f9c34d73740 1 -- start start 2024-05-20T17:41:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.522+0000 7f9c34d73740 1 Processor -- start 2024-05-20T17:41:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 0x55f65ac168f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8681b0 0x55f65ac16e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280702f0 con 0x55f65a83f2f0 2024-05-20T17:41:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28071760 con 0x55f65a8681b0 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280709c0 con 0x55f65a8474d0 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c34d73740 10 client.0 _ll_register_callbacks cb 0x7f9c1c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37244/0 (socket says 172.21.15.135:37244) 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 -- 172.21.15.135:0/3181877243 learned_addr learned my addr 172.21.15.135:0/3181877243 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:41:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c277fe640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 0x55f65ac168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8681b0 0x55f65ac16e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 -- 172.21.15.135:0/3181877243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 msgr2=0x55f65ac168f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 0x55f65ac168f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 -- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8681b0 msgr2=0x55f65ac16e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8681b0 0x55f65ac16e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.523+0000 7f9c26ffd640 1 -- 172.21.15.135:0/3181877243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65ac9afe0 con 0x55f65a83f2f0 2024-05-20T17:41:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c277fe640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 0x55f65ac168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c26ffd640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9c18031ed0 tx=0x7f9c18003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca7bcd61e1fbf25 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035070 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f9c18049420 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c1804e030 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c18009520 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c34d73740 10 client.16626 fetch_fsmap learned FSMap version 30 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f65ac9c1e0 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.524+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c1804e030 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9c1805e040 con 0x55f65a83f2f0 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 10 client.16626 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:41:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 10 client.16626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 20 client.16626 populate_metadata read hostname 'smithi135' 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a7fc1c0 0x55f65ac9e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 4 client.16626 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f65ab73dc0 con 0x55f65a7fc1c0 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.525+0000 7f9c277fe640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a7fc1c0 0x55f65ac9e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.526+0000 7f9c06ffd640 10 client.16626 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:54.526+0000 7f9c277fe640 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a7fc1c0 0x55f65ac9e920 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13296388b7e635e9 server_cookie=357c0060ea0a7933 in_seq=0 out_seq=0 2024-05-20T17:41:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c06ffd640 1 -- 172.21.15.135:0/3181877243 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f65ab73dc0 con 0x55f65a7fc1c0 2024-05-20T17:41:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c06ffd640 10 client.16626 handle_command_reply: tid=0 2024-05-20T17:41:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 client.16626 shutdown 2024-05-20T17:41:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 msgr2=0x55f65ac163b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9c18031ed0 tx=0x7f9c18003a60 comp rx=0 tx=0).stop 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 shutdown_connections 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f65a7fc1c0 0x55f65ac9e920 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f65a8681b0 0x55f65ac16e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c06ffd640 0 client.16626 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f65a8474d0 0x55f65ac168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 --2- 172.21.15.135:0/3181877243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f65a83f2f0 0x55f65ac163b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 >> 172.21.15.135:0/3181877243 conn(0x55f65a85c300 msgr2=0x55f65ac06e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 shutdown_connections 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 1 -- 172.21.15.135:0/3181877243 wait complete. 2024-05-20T17:41:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.093+0000 7f9c34d73740 20 client.16626 trim_cache size 0 max 16384 2024-05-20T17:41:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:41:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:41:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:41:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 msgr2=0x7f9c100a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 0x7f9c100a5410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c200cc180 tx=0x7f9c2000e040 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 msgr2=0x7f9c281996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000b970 tx=0x7f9c2000be30 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 shutdown_connections 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f9c100a2f00 0x7f9c100a5410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c2810d070 0x7f9c281996f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c2810a680 0x7f9c2819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 --2- 172.21.15.135:0/1773463128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28103c20 0x7f9c2819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:41:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 >> 172.21.15.135:0/1773463128 conn(0x7f9c28077160 msgr2=0x7f9c28100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:41:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 shutdown_connections 2024-05-20T17:41:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:41:55.094+0000 7f9c2deca640 1 -- 172.21.15.135:0/1773463128 wait complete. 2024-05-20T17:41:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:55 smithi172 ceph-mon[36511]: pgmap v264: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 581 op/s 2024-05-20T17:41:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:55 smithi135 ceph-mon[32027]: pgmap v264: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 581 op/s 2024-05-20T17:41:56.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:55 smithi160 ceph-mon[36261]: pgmap v264: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 581 op/s 2024-05-20T17:41:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:57 smithi135 ceph-mon[32027]: pgmap v265: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 348 op/s 2024-05-20T17:41:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:57 smithi160 ceph-mon[36261]: pgmap v265: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 348 op/s 2024-05-20T17:41:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:57 smithi172 ceph-mon[36511]: pgmap v265: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 348 op/s 2024-05-20T17:41:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:41:59 smithi135 ceph-mon[32027]: pgmap v266: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-05-20T17:42:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:41:59 smithi160 ceph-mon[36261]: pgmap v266: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-05-20T17:42:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:41:59 smithi172 ceph-mon[36511]: pgmap v266: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-05-20T17:42:01.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:01 smithi135 ceph-mon[32027]: pgmap v267: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-05-20T17:42:02.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:01 smithi160 ceph-mon[36261]: pgmap v267: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-05-20T17:42:02.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:01 smithi172 ceph-mon[36511]: pgmap v267: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-05-20T17:42:03.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:03 smithi135 ceph-mon[32027]: pgmap v268: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 448 op/s 2024-05-20T17:42:04.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:03 smithi160 ceph-mon[36261]: pgmap v268: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 448 op/s 2024-05-20T17:42:04.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:03 smithi172 ceph-mon[36511]: pgmap v268: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 448 op/s 2024-05-20T17:42:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:05 smithi135 ceph-mon[32027]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 391 op/s 2024-05-20T17:42:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:05 smithi135 ceph-mon[32027]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:42:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:05 smithi160 ceph-mon[36261]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 391 op/s 2024-05-20T17:42:06.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:05 smithi160 ceph-mon[36261]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:42:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:05 smithi172 ceph-mon[36511]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 391 op/s 2024-05-20T17:42:06.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:05 smithi172 ceph-mon[36511]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:42:06.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:06 smithi135 ceph-mon[32027]: pgmap v271: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2024-05-20T17:42:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:06 smithi160 ceph-mon[36261]: pgmap v271: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2024-05-20T17:42:07.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:06 smithi172 ceph-mon[36511]: pgmap v271: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2024-05-20T17:42:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 -- 172.21.15.135:0/992932315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 msgr2=0x7f48740a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 --2- 172.21.15.135:0/992932315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f48740a5640 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f487c067640 tx=0x7f487c096b30 comp rx=0 tx=0).stop 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 -- 172.21.15.135:0/992932315 shutdown_connections 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 --2- 172.21.15.135:0/992932315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f48740a5640 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 --2- 172.21.15.135:0/992932315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 0x7f48740a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 --2- 172.21.15.135:0/992932315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 -- 172.21.15.135:0/992932315 >> 172.21.15.135:0/992932315 conn(0x7f487400c000 msgr2=0x7f487400c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 -- 172.21.15.135:0/992932315 shutdown_connections 2024-05-20T17:42:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.244+0000 7f48808ca640 1 -- 172.21.15.135:0/992932315 wait complete. 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.245+0000 7f48808ca640 1 Processor -- start 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 -- start start 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 0x7f48740af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f4874148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4874097780 con 0x7f48740a31e0 2024-05-20T17:42:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4874097600 con 0x7f48740083d0 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f48808ca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4874097900 con 0x7f48740a0880 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41620/0 (socket says 172.21.15.135:41620) 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f487b7fe640 1 -- 172.21.15.135:0/33089757 learned_addr learned my addr 172.21.15.135:0/33089757 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.246+0000 7f487bfff640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f4874148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487affd640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 0x7f48740af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487bfff640 1 -- 172.21.15.135:0/33089757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 msgr2=0x7f48740af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487bfff640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 0x7f48740af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487bfff640 1 -- 172.21.15.135:0/33089757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 msgr2=0x7f48740af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487bfff640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487bfff640 1 -- 172.21.15.135:0/33089757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48741485d0 con 0x7f48740a31e0 2024-05-20T17:42:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.247+0000 7f487b7fe640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f487bfff640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f4874148090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f487c0676b0 tx=0x7f487c098a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f4878ff9640 1 -- 172.21.15.135:0/33089757 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0b2070 con 0x7f48740a31e0 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f4878ff9640 1 -- 172.21.15.135:0/33089757 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487c098e40 con 0x7f48740a31e0 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4874148860 con 0x7f48740a31e0 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4874148d20 con 0x7f48740a31e0 2024-05-20T17:42:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.248+0000 7f4878ff9640 1 -- 172.21.15.135:0/33089757 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c09d070 con 0x7f48740a31e0 2024-05-20T17:42:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.255+0000 7f4878ff9640 1 -- 172.21.15.135:0/33089757 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f487c0a0070 con 0x7f48740a31e0 2024-05-20T17:42:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.256+0000 7f4878ff9640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 0x7f48640a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.257+0000 7f4878ff9640 1 -- 172.21.15.135:0/33089757 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f487c15b1b0 con 0x7f48740a31e0 2024-05-20T17:42:08.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.257+0000 7f487b7fe640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 0x7f48640a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.259 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.258+0000 7f48889cd740 1 Processor -- start 2024-05-20T17:42:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.259+0000 7f487b7fe640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 0x7f48640a53e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48740b0130 tx=0x7f4870009190 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.259+0000 7f48889cd740 1 -- start start 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f5547f2f0 0x560f558477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55847d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560f557ac340 con 0x560f5547f2f0 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560f55754290 con 0x560f554a81b0 2024-05-20T17:42:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f48889cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560f557a8300 con 0x560f554874d0 2024-05-20T17:42:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41634/0 (socket says 172.21.15.135:41634) 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 -- 172.21.15.135:0/275453744 learned_addr learned my addr 172.21.15.135:0/275453744 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487bfff640 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55847d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487affd640 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f5547f2f0 0x560f558477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 -- 172.21.15.135:0/275453744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 msgr2=0x560f55847d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55847d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 -- 172.21.15.135:0/275453744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f5547f2f0 msgr2=0x560f558477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.260+0000 7f487b7fe640 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f5547f2f0 0x560f558477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.261+0000 7f487b7fe640 1 -- 172.21.15.135:0/275453744 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f557788e0 con 0x560f554a81b0 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.261+0000 7f487b7fe640 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4870006e80 tx=0x7f4870011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf111d9dfd1d3ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.261+0000 7f4861ffb640 1 -- 172.21.15.135:0/275453744 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487001b040 con 0x560f554a81b0 2024-05-20T17:42:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.262+0000 7f4861ffb640 1 -- 172.21.15.135:0/275453744 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870024070 con 0x560f554a81b0 2024-05-20T17:42:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.263+0000 7f48889cd740 1 -- 172.21.15.135:0/275453744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 msgr2=0x560f55847280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.263+0000 7f48889cd740 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4870006e80 tx=0x7f4870011000 comp rx=0 tx=0).stop 2024-05-20T17:42:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.264+0000 7f48889cd740 1 -- 172.21.15.135:0/275453744 shutdown_connections 2024-05-20T17:42:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.264+0000 7f48889cd740 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55847d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.264+0000 7f48889cd740 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f5547f2f0 0x560f558477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.264+0000 7f48889cd740 1 --2- 172.21.15.135:0/275453744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554a81b0 0x560f55847280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.264+0000 7f48889cd740 1 -- 172.21.15.135:0/275453744 >> 172.21.15.135:0/275453744 conn(0x560f5549c300 msgr2=0x560f55843a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.265+0000 7f48889cd740 1 -- 172.21.15.135:0/275453744 shutdown_connections 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.267+0000 7f48889cd740 1 -- 172.21.15.135:0/275453744 wait complete. 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.267+0000 7f48889cd740 1 -- start start 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 Processor -- start 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55851840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55851d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5586e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560f55854450 con 0x560f554a81b0 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560f55767790 con 0x560f554874d0 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560f558545d0 con 0x560f5547f2f0 2024-05-20T17:42:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.268+0000 7f48889cd740 10 client.0 _ll_register_callbacks cb 0x560f557a2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.269+0000 7f487affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55851d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.269+0000 7f487affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55851d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41640/0 (socket says 172.21.15.135:41640) 2024-05-20T17:42:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.269+0000 7f487affd640 1 -- 172.21.15.135:0/3164827314 learned_addr learned my addr 172.21.15.135:0/3164827314 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.269+0000 7f487b7fe640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55851840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.269+0000 7f487bfff640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5586e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.272+0000 7f487b7fe640 1 -- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 msgr2=0x560f55851d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.272+0000 7f487b7fe640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55851d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.272+0000 7f487b7fe640 1 -- 172.21.15.135:0/3164827314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 msgr2=0x560f5586e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.273+0000 7f487b7fe640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5586e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.273+0000 7f487b7fe640 1 -- 172.21.15.135:0/3164827314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f554c0210 con 0x560f5547f2f0 2024-05-20T17:42:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.274+0000 7f487b7fe640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55851840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4870009c00 tx=0x7f4870020ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca57c2a76621002 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.274+0000 7f485affd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:42:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.274+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487002d070 con 0x560f5547f2f0 2024-05-20T17:42:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.274+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f4870004460 con 0x560f5547f2f0 2024-05-20T17:42:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.277+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4870024070 con 0x560f5547f2f0 2024-05-20T17:42:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.283+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f487000ec80 con 0x560f5547f2f0 2024-05-20T17:42:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.284+0000 7f48889cd740 10 client.26140 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.284+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f5558c620 con 0x560f5547f2f0 2024-05-20T17:42:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.285+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870024070 con 0x560f5547f2f0 2024-05-20T17:42:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f487001e030 con 0x560f5547f2f0 2024-05-20T17:42:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 10 client.26140 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 10 client.26140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 20 client.26140 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f55466d80 0x560f55859440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 4 client.26140 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:42:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.286+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f557b9a70 con 0x560f55466d80 2024-05-20T17:42:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.287+0000 7f487affd640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f55466d80 0x560f55859440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.291+0000 7f487affd640 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f55466d80 0x560f55859440 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e379b9a30f303a server_cookie=d4d5ead6fd0551f4 in_seq=0 out_seq=0 2024-05-20T17:42:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.291+0000 7f485affd640 10 client.26140 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.293+0000 7f485affd640 1 -- 172.21.15.135:0/3164827314 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560f557b9a70 con 0x560f55466d80 2024-05-20T17:42:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.293+0000 7f485affd640 10 client.26140 handle_command_reply: tid=0 2024-05-20T17:42:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.293+0000 7f48889cd740 1 client.26140 shutdown 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 msgr2=0x560f55851840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55851840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4870009c00 tx=0x7f4870020ea0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 shutdown_connections 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f55466d80 0x560f55859440 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5586e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55851d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 --2- 172.21.15.135:0/3164827314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55851840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 >> 172.21.15.135:0/3164827314 conn(0x560f5549c300 msgr2=0x560f55847010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f485affd640 0 client.26140 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 shutdown_connections 2024-05-20T17:42:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 1 -- 172.21.15.135:0/3164827314 wait complete. 2024-05-20T17:42:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.294+0000 7f48889cd740 20 client.26140 trim_cache size 0 max 16384 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.323+0000 7f48889cd740 1 Processor -- start 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.323+0000 7f48889cd740 1 -- start start 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f5547f2f0 0x560f55842df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5585e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f487affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f487affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46184/0 (socket says 172.21.15.135:46184) 2024-05-20T17:42:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f487affd640 1 -- 172.21.15.135:0/2618529312 learned_addr learned my addr 172.21.15.135:0/2618529312 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f487b7fe640 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f5547f2f0 0x560f55842df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4868011270 con 0x560f554a81b0 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f486800ea80 con 0x560f5547f2f0 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.324+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f486800c8f0 con 0x560f554874d0 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.327+0000 7f487affd640 1 -- 172.21.15.135:0/2618529312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f5547f2f0 msgr2=0x560f55842df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.327+0000 7f487affd640 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f5547f2f0 0x560f55842df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.327+0000 7f487affd640 1 -- 172.21.15.135:0/2618529312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 msgr2=0x560f5585e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.327+0000 7f487affd640 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5585e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.327+0000 7f487affd640 1 -- 172.21.15.135:0/2618529312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f55848380 con 0x560f554874d0 2024-05-20T17:42:08.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.330+0000 7f487affd640 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b00 tx=0x7f486c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f29854fe938a980b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.330+0000 7f48617fa640 1 -- 172.21.15.135:0/2618529312 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c004220 con 0x560f554874d0 2024-05-20T17:42:08.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.330+0000 7f48617fa640 1 -- 172.21.15.135:0/2618529312 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486c025030 con 0x560f554874d0 2024-05-20T17:42:08.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.330+0000 7f48617fa640 1 -- 172.21.15.135:0/2618529312 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c004e20 con 0x560f554874d0 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 msgr2=0x560f55843b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b00 tx=0x7f486c005f90 comp rx=0 tx=0).stop 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 shutdown_connections 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f5585e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f554874d0 0x560f55843b00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 --2- 172.21.15.135:0/2618529312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f5547f2f0 0x560f55842df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 >> 172.21.15.135:0/2618529312 conn(0x560f5549c300 msgr2=0x560f558433f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:08.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.332+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 shutdown_connections 2024-05-20T17:42:08.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.333+0000 7f48889cd740 1 -- 172.21.15.135:0/2618529312 wait complete. 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.333+0000 7f48889cd740 1 -- start start 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.334+0000 7f48889cd740 1 Processor -- start 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.334+0000 7f48889cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55866e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.334+0000 7f48889cd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55867350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f48889cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f55867890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55866e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f48889cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f486800cf40 con 0x560f554a81b0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f48889cd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f486800e3b0 con 0x560f554874d0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f48889cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f486800d610 con 0x560f5547f2f0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f487affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55867350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f487bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f55867890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f487affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55867350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41654/0 (socket says 172.21.15.135:41654) 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f487affd640 1 -- 172.21.15.135:0/4112099325 learned_addr learned my addr 172.21.15.135:0/4112099325 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.335+0000 7f48889cd740 10 client.0 _ll_register_callbacks cb 0x7f4870015f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.336+0000 7f487b7fe640 1 -- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 msgr2=0x560f55867350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.336+0000 7f487b7fe640 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55867350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.336+0000 7f487b7fe640 1 -- 172.21.15.135:0/4112099325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 msgr2=0x560f55867890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.336+0000 7f487b7fe640 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f55867890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.336+0000 7f487b7fe640 1 -- 172.21.15.135:0/4112099325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f558ec2c0 con 0x560f5547f2f0 2024-05-20T17:42:08.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.338+0000 7f487b7fe640 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55866e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f487000ea30 tx=0x7f4870009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81c16e897da62bf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:08.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.338+0000 7f485affd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:42:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.338+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487002d070 con 0x560f5547f2f0 2024-05-20T17:42:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.338+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f4870004460 con 0x560f5547f2f0 2024-05-20T17:42:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.338+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486c025030 con 0x560f5547f2f0 2024-05-20T17:42:08.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.339+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f487001f980 con 0x560f5547f2f0 2024-05-20T17:42:08.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.339+0000 7f48889cd740 10 client.26146 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:08.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.339+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f558ed3f0 con 0x560f5547f2f0 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.339+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4870024040 con 0x560f5547f2f0 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f487001e040 con 0x560f5547f2f0 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 10 client.26146 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 10 client.26146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 20 client.26146 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f5543c1c0 0x560f558efac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 4 client.26146 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:42:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.340+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f486c025030 con 0x560f5543c1c0 2024-05-20T17:42:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.343+0000 7f487affd640 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f5543c1c0 0x560f558efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:08.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.349+0000 7f487affd640 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f5543c1c0 0x560f558efac0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29e237cede2b213 server_cookie=2735bddf55b2aafa in_seq=0 out_seq=0 2024-05-20T17:42:08.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:08.349+0000 7f485affd640 10 client.26146 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:09 smithi172 ceph-mon[36511]: pgmap v272: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-05-20T17:42:09.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:09 smithi135 ceph-mon[32027]: pgmap v272: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-05-20T17:42:09.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:09 smithi160 ceph-mon[36261]: pgmap v272: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.497+0000 7f485affd640 1 -- 172.21.15.135:0/4112099325 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f486c025030 con 0x560f5543c1c0 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.497+0000 7f485affd640 10 client.26146 handle_command_reply: tid=0 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.497+0000 7f48889cd740 1 client.26146 shutdown 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 msgr2=0x560f55866e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55866e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f487000ea30 tx=0x7f4870009850 comp rx=0 tx=0).stop 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 shutdown_connections 2024-05-20T17:42:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x560f5543c1c0 0x560f558efac0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f485affd640 0 client.26146 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560f554a81b0 0x560f55867890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f554874d0 0x560f55867350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 --2- 172.21.15.135:0/4112099325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f5547f2f0 0x560f55866e10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 >> 172.21.15.135:0/4112099325 conn(0x560f5549c300 msgr2=0x560f55847010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 shutdown_connections 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.498+0000 7f48889cd740 1 -- 172.21.15.135:0/4112099325 wait complete. 2024-05-20T17:42:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.499+0000 7f48889cd740 20 client.26146 trim_cache size 0 max 16384 2024-05-20T17:42:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:42:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:42:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:42:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:42:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.499+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 msgr2=0x7f48640a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 0x7f48640a53e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48740b0130 tx=0x7f4870009190 comp rx=0 tx=0).stop 2024-05-20T17:42:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 msgr2=0x7f4874148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f4874148090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f487c0676b0 tx=0x7f487c098a40 comp rx=0 tx=0).stop 2024-05-20T17:42:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 shutdown_connections 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f48640a2ed0 0x7f48640a53e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48740a31e0 0x7f4874148090 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48740a0880 0x7f48740af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 --2- 172.21.15.135:0/33089757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48740083d0 0x7f48740af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 >> 172.21.15.135:0/33089757 conn(0x7f487400c000 msgr2=0x7f48740951d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 shutdown_connections 2024-05-20T17:42:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:09.500+0000 7f48808ca640 1 -- 172.21.15.135:0/33089757 wait complete. 2024-05-20T17:42:11.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:11 smithi172 ceph-mon[36511]: pgmap v273: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-05-20T17:42:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:11 smithi135 ceph-mon[32027]: pgmap v273: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-05-20T17:42:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:11 smithi160 ceph-mon[36261]: pgmap v273: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-05-20T17:42:13.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:13 smithi172 ceph-mon[36511]: pgmap v274: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 264 op/s 2024-05-20T17:42:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:13 smithi135 ceph-mon[32027]: pgmap v274: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 264 op/s 2024-05-20T17:42:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:13 smithi160 ceph-mon[36261]: pgmap v274: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 264 op/s 2024-05-20T17:42:15.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:15 smithi172 ceph-mon[36511]: pgmap v275: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-20T17:42:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:15 smithi135 ceph-mon[32027]: pgmap v275: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-20T17:42:15.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:15 smithi160 ceph-mon[36261]: pgmap v275: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 262 op/s 2024-05-20T17:42:17.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:17 smithi172 ceph-mon[36511]: pgmap v276: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 241 op/s 2024-05-20T17:42:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:17 smithi135 ceph-mon[32027]: pgmap v276: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 241 op/s 2024-05-20T17:42:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:17 smithi160 ceph-mon[36261]: pgmap v276: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 2.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 241 op/s 2024-05-20T17:42:19.308 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:19 smithi160 ceph-mon[36261]: pgmap v277: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 252 op/s 2024-05-20T17:42:19.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:19 smithi172 ceph-mon[36511]: pgmap v277: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 252 op/s 2024-05-20T17:42:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:19 smithi135 ceph-mon[32027]: pgmap v277: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 252 op/s 2024-05-20T17:42:21.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:21 smithi172 ceph-mon[36511]: pgmap v278: 97 pgs: 6 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2024-05-20T17:42:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:21 smithi135 ceph-mon[32027]: pgmap v278: 97 pgs: 6 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2024-05-20T17:42:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:21 smithi160 ceph-mon[36261]: pgmap v278: 97 pgs: 6 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2024-05-20T17:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 -- 172.21.15.135:0/4260665901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4108b20 msgr2=0x7f22a41026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/4260665901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4108b20 0x7f22a41026c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2294009900 tx=0x7f229402a410 comp rx=0 tx=0).stop 2024-05-20T17:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 -- 172.21.15.135:0/4260665901 shutdown_connections 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/4260665901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4103270 0x7f22a410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/4260665901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 0x7f22a4102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/4260665901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4108b20 0x7f22a41026c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 -- 172.21.15.135:0/4260665901 >> 172.21.15.135:0/4260665901 conn(0x7f22a40fe1c0 msgr2=0x7f22a4100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 -- 172.21.15.135:0/4260665901 shutdown_connections 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.606+0000 7f22a9f4c640 1 -- 172.21.15.135:0/4260665901 wait complete. 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 Processor -- start 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 -- start start 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4108b20 0x7f22a40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 0x7f22a40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4112e60 con 0x7f22a4103270 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4112ce0 con 0x7f22a4108fc0 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a9f4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4112fe0 con 0x7f22a4108b20 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.607+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60272/0 (socket says 172.21.15.135:60272) 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 -- 172.21.15.135:0/1816028066 learned_addr learned my addr 172.21.15.135:0/1816028066 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4108b20 0x7f22a40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a3fff640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 0x7f22a40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 -- 172.21.15.135:0/1816028066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4108b20 msgr2=0x7f22a40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4108b20 0x7f22a40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 -- 172.21.15.135:0/1816028066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 msgr2=0x7f22a40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 0x7f22a40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 -- 172.21.15.135:0/1816028066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a41a7ba0 con 0x7f22a4103270 2024-05-20T17:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2294005940 tx=0x7f2294004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a0ff9640 1 -- 172.21.15.135:0/1816028066 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229403f030 con 0x7f22a4103270 2024-05-20T17:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a0ff9640 1 -- 172.21.15.135:0/1816028066 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2294003ad0 con 0x7f22a4103270 2024-05-20T17:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a41a7e30 con 0x7f22a4103270 2024-05-20T17:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a0ff9640 1 -- 172.21.15.135:0/1816028066 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294035070 con 0x7f22a4103270 2024-05-20T17:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.608+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41a8290 con 0x7f22a4103270 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22a0ff9640 1 -- 172.21.15.135:0/1816028066 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2294042030 con 0x7f22a4103270 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 Processor -- start 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 -- start start 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 0x5634984ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22a0ff9640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 0x7f228c0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563498413340 con 0x56349810f1b0 2024-05-20T17:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5634983bb290 con 0x5634980e62f0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22b0df6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56349840f300 con 0x5634980ee4d0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.611+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60286/0 (socket says 172.21.15.135:60286) 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a3fff640 1 -- 172.21.15.135:0/565891809 learned_addr learned my addr 172.21.15.135:0/565891809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 0x5634984ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 0x7f228c0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a3fff640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a0ff9640 1 -- 172.21.15.135:0/1816028066 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f22940efbe0 con 0x7f22a4103270 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 -- 172.21.15.135:0/565891809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 msgr2=0x5634984aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 -- 172.21.15.135:0/565891809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 msgr2=0x5634984ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 -- 172.21.15.135:0/565891809 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634983df8e0 con 0x5634980e62f0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a3fff640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 0x7f228c0a5200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22a4101000 tx=0x7f2298005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f22a37fe640 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 0x5634984ae5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f22940ed270 tx=0x7f229404b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f997c770d113e3d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f2289ffb640 1 -- 172.21.15.135:0/565891809 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294049070 con 0x5634980e62f0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f2289ffb640 1 -- 172.21.15.135:0/565891809 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22940c03f0 con 0x5634980e62f0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.612+0000 7f2289ffb640 1 -- 172.21.15.135:0/565891809 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22940ba480 con 0x5634980e62f0 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 -- 172.21.15.135:0/565891809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 msgr2=0x5634984ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 0x5634984ae5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f22940ed270 tx=0x7f229404b000 comp rx=0 tx=0).stop 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 -- 172.21.15.135:0/565891809 shutdown_connections 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980e62f0 0x5634984ae5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 --2- 172.21.15.135:0/565891809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 -- 172.21.15.135:0/565891809 >> 172.21.15.135:0/565891809 conn(0x563498103300 msgr2=0x5634984aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 -- 172.21.15.135:0/565891809 shutdown_connections 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.613+0000 7f22b0df6740 1 -- 172.21.15.135:0/565891809 wait complete. 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 -- start start 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 Processor -- start 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5634984baf70 con 0x5634980e62f0 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5634983ce790 con 0x56349810f1b0 2024-05-20T17:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5634984bb0f0 con 0x5634980ee4d0 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22b0df6740 10 client.0 _ll_register_callbacks cb 0x563498409a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60298/0 (socket says 172.21.15.135:60298) 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35152/0 (socket says 172.21.15.135:35152) 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a37fe640 1 -- 172.21.15.135:0/4056486224 learned_addr learned my addr 172.21.15.135:0/4056486224 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 -- 172.21.15.135:0/4056486224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 msgr2=0x5634984ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 -- 172.21.15.135:0/4056486224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 msgr2=0x5634984ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.614+0000 7f22a3fff640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22a3fff640 1 -- 172.21.15.135:0/4056486224 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563498127210 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22a37fe640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22a3fff640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f229c009840 tx=0x7f229c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522fb7a72cc6e62c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c004d20 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f229c00f570 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22940c03f0 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f229c028050 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 10 client.26246 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5634981f3620 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22940c03f0 con 0x56349810f1b0 2024-05-20T17:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f229c00f040 con 0x56349810f1b0 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 10 client.26246 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 10 client.26246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 20 client.26246 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980cdd80 0x5634984ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 4 client.26246 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.615+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563498420a70 con 0x5634980cdd80 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.616+0000 7f22a37fe640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980cdd80 0x5634984ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.616+0000 7f2282ffd640 10 client.26246 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.616+0000 7f22a37fe640 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980cdd80 0x5634984ca690 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ba637860c9794c server_cookie=70e1050cc6a2d8ca in_seq=0 out_seq=0 2024-05-20T17:42:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f2282ffd640 1 -- 172.21.15.135:0/4056486224 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563498420a70 con 0x5634980cdd80 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f2282ffd640 10 client.26246 handle_command_reply: tid=0 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 client.26246 shutdown 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 msgr2=0x5634984b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f229c009840 tx=0x7f229c0107a0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 shutdown_connections 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980cdd80 0x5634984ca690 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984b85a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 --2- 172.21.15.135:0/4056486224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f2282ffd640 0 client.26246 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 >> 172.21.15.135:0/4056486224 conn(0x563498103300 msgr2=0x5634984afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 shutdown_connections 2024-05-20T17:42:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.618+0000 7f22b0df6740 1 -- 172.21.15.135:0/4056486224 wait complete. 2024-05-20T17:42:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.619+0000 7f22b0df6740 20 client.26246 trim_cache size 0 max 16384 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.633+0000 7f22b0df6740 1 Processor -- start 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.633+0000 7f22b0df6740 1 -- start start 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980e62f0 0x5634984b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980ee4d0 0x5634984b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41b3870 con 0x56349810f1b0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41b1080 con 0x5634980ee4d0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22b0df6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41aeef0 con 0x5634980e62f0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60306/0 (socket says 172.21.15.135:60306) 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 -- 172.21.15.135:0/2792936150 learned_addr learned my addr 172.21.15.135:0/2792936150 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980ee4d0 0x5634984b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a37fe640 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980e62f0 0x5634984b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 -- 172.21.15.135:0/2792936150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980e62f0 msgr2=0x5634984b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980e62f0 0x5634984b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 -- 172.21.15.135:0/2792936150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980ee4d0 msgr2=0x5634984b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980ee4d0 0x5634984b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 -- 172.21.15.135:0/2792936150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634984ab980 con 0x56349810f1b0 2024-05-20T17:42:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22a3fff640 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f229c006010 tx=0x7f229c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a23ce7f21211eb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22897fa640 1 -- 172.21.15.135:0/2792936150 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c031070 con 0x56349810f1b0 2024-05-20T17:42:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22897fa640 1 -- 172.21.15.135:0/2792936150 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c016040 con 0x56349810f1b0 2024-05-20T17:42:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.634+0000 7f22897fa640 1 -- 172.21.15.135:0/2792936150 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c00f990 con 0x56349810f1b0 2024-05-20T17:42:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 -- 172.21.15.135:0/2792936150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 msgr2=0x5634984b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f229c006010 tx=0x7f229c005720 comp rx=0 tx=0).stop 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 -- 172.21.15.135:0/2792936150 shutdown_connections 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56349810f1b0 0x5634984b2340 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5634980ee4d0 0x5634984b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 --2- 172.21.15.135:0/2792936150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980e62f0 0x5634984b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 -- 172.21.15.135:0/2792936150 >> 172.21.15.135:0/2792936150 conn(0x563498103300 msgr2=0x5634984afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 -- 172.21.15.135:0/2792936150 shutdown_connections 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.635+0000 7f22b0df6740 1 -- 172.21.15.135:0/2792936150 wait complete. 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 -- start start 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 Processor -- start 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984c0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41af540 con 0x5634980e62f0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41b09b0 con 0x56349810f1b0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41afc10 con 0x5634980ee4d0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22b0df6740 10 client.0 _ll_register_callbacks cb 0x7f229c012cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60316/0 (socket says 172.21.15.135:60316) 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22a37fe640 1 -- 172.21.15.135:0/1006062520 learned_addr learned my addr 172.21.15.135:0/1006062520 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.636+0000 7f22a3fff640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 -- 172.21.15.135:0/1006062520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 msgr2=0x5634984c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 -- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 msgr2=0x5634984bd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984bd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 -- 172.21.15.135:0/1006062520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634984b0910 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22a37fe640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f22940b8ac0 tx=0x7f22940efe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7d5dc7f93dd508 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294049040 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f22940ba3f0 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229c016040 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f22940c03f0 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 10 client.16659 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563498532160 con 0x5634980e62f0 2024-05-20T17:42:22.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c016040 con 0x5634980e62f0 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f22940ed4f0 con 0x5634980e62f0 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 10 client.16659 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 10 client.16659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 20 client.16659 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.637+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980a31c0 0x5634985347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.638+0000 7f22b0df6740 4 client.16659 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.638+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56349841adc0 con 0x5634980a31c0 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.638+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980a31c0 0x5634985347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.638+0000 7f2282ffd640 10 client.16659 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:22.638+0000 7f22a2ffd640 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980a31c0 0x5634985347b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919d18c97b1aa7a7 server_cookie=2182f211b1b9933b in_seq=0 out_seq=0 2024-05-20T17:42:23.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:23 smithi172 ceph-mon[36511]: pgmap v279: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.357+0000 7f2282ffd640 1 -- 172.21.15.135:0/1006062520 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56349841adc0 con 0x5634980a31c0 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.357+0000 7f2282ffd640 10 client.16659 handle_command_reply: tid=0 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.357+0000 7f22b0df6740 1 client.16659 shutdown 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 msgr2=0x5634984c0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f22940b8ac0 tx=0x7f22940efe60 comp rx=0 tx=0).stop 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 shutdown_connections 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5634980a31c0 0x5634985347b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56349810f1b0 0x5634984bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634980ee4d0 0x5634984c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 --2- 172.21.15.135:0/1006062520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634980e62f0 0x5634984c0010 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 >> 172.21.15.135:0/1006062520 conn(0x563498103300 msgr2=0x5634984adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f2282ffd640 0 client.16659 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 shutdown_connections 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 1 -- 172.21.15.135:0/1006062520 wait complete. 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.358+0000 7f22b0df6740 20 client.16659 trim_cache size 0 max 16384 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:42:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:42:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:42:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:42:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 msgr2=0x7f228c0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 0x7f228c0a5200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22a4101000 tx=0x7f2298005f90 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 msgr2=0x7f22a4074f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2294005940 tx=0x7f2294004270 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 shutdown_connections 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f228c0a2cf0 0x7f228c0a5200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22a4108fc0 0x7f22a40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a4108b20 0x7f22a40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 --2- 172.21.15.135:0/1816028066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a4103270 0x7f22a4074f60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 >> 172.21.15.135:0/1816028066 conn(0x7f22a40fe1c0 msgr2=0x7f22a40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 shutdown_connections 2024-05-20T17:42:23.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:23.359+0000 7f22a9f4c640 1 -- 172.21.15.135:0/1816028066 wait complete. 2024-05-20T17:42:23.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:23 smithi135 ceph-mon[32027]: pgmap v279: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-05-20T17:42:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:23 smithi160 ceph-mon[36261]: pgmap v279: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-05-20T17:42:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:24 smithi135 ceph-mon[32027]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:42:24.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:24 smithi160 ceph-mon[36261]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:42:24.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:24 smithi172 ceph-mon[36511]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:42:25.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:25 smithi135 ceph-mon[32027]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:42:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:25 smithi160 ceph-mon[36261]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:42:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:25 smithi172 ceph-mon[36511]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:42:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:27 smithi135 ceph-mon[32027]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-05-20T17:42:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:27 smithi160 ceph-mon[36261]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-05-20T17:42:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:27 smithi172 ceph-mon[36511]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-05-20T17:42:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:29 smithi135 ceph-mon[32027]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-05-20T17:42:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:29 smithi160 ceph-mon[36261]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-05-20T17:42:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:29 smithi172 ceph-mon[36511]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-05-20T17:42:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:31 smithi135 ceph-mon[32027]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 383 op/s 2024-05-20T17:42:31.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:31 smithi160 ceph-mon[36261]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 383 op/s 2024-05-20T17:42:31.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:31 smithi172 ceph-mon[36511]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 383 op/s 2024-05-20T17:42:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:33 smithi135 ceph-mon[32027]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 413 op/s 2024-05-20T17:42:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:33 smithi160 ceph-mon[36261]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 413 op/s 2024-05-20T17:42:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:33 smithi172 ceph-mon[36511]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 413 op/s 2024-05-20T17:42:35.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:35 smithi135 ceph-mon[32027]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 384 op/s 2024-05-20T17:42:35.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:35 smithi160 ceph-mon[36261]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 384 op/s 2024-05-20T17:42:35.579 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:35 smithi172 ceph-mon[36511]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 384 op/s 2024-05-20T17:42:36.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 -- 172.21.15.135:0/3051698108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0075420 msgr2=0x7fdbc0075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 --2- 172.21.15.135:0/3051698108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0075420 0x7fdbc0075830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009860 tx=0x7fdbbc02a3d0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 -- 172.21.15.135:0/3051698108 shutdown_connections 2024-05-20T17:42:36.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 --2- 172.21.15.135:0/3051698108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0113ab0 0x7fdbc0115ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 --2- 172.21.15.135:0/3051698108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 0x7fdbc0113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 --2- 172.21.15.135:0/3051698108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0075420 0x7fdbc0075830 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.481+0000 7fdbc8673640 1 -- 172.21.15.135:0/3051698108 >> 172.21.15.135:0/3051698108 conn(0x7fdbc00fe1b0 msgr2=0x7fdbc0100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.482+0000 7fdbc8673640 1 -- 172.21.15.135:0/3051698108 shutdown_connections 2024-05-20T17:42:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.482+0000 7fdbc8673640 1 -- 172.21.15.135:0/3051698108 wait complete. 2024-05-20T17:42:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.483+0000 7fdbc8673640 1 Processor -- start 2024-05-20T17:42:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.484+0000 7fdbc8673640 1 -- start start 2024-05-20T17:42:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.484+0000 7fdbc8673640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.484+0000 7fdbc8673640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 0x7fdbc01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc640f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc640f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:54490/0 (socket says 172.21.15.135:54490) 2024-05-20T17:42:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc8673640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 0x7fdbc01a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc640f640 1 -- 172.21.15.135:0/4060521844 learned_addr learned my addr 172.21.15.135:0/4060521844 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01193d0 con 0x7fdbc0113ab0 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0119250 con 0x7fdbc0075420 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0119550 con 0x7fdbc0111150 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.485+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 0x7fdbc01a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 0x7fdbc01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 -- 172.21.15.135:0/4060521844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 msgr2=0x7fdbc01a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 0x7fdbc01a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 -- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 msgr2=0x7fdbc01a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 0x7fdbc01a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc01a4b90 con 0x7fdbc0075420 2024-05-20T17:42:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 0x7fdbc01a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:36.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc640f640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009980 tx=0x7fdbbc030710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbb77fe640 1 -- 172.21.15.135:0/4060521844 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc005460 con 0x7fdbc0075420 2024-05-20T17:42:36.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc01a4e20 con 0x7fdbc0075420 2024-05-20T17:42:36.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.486+0000 7fdbb77fe640 1 -- 172.21.15.135:0/4060521844 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc005600 con 0x7fdbc0075420 2024-05-20T17:42:36.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.487+0000 7fdbb77fe640 1 -- 172.21.15.135:0/4060521844 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004d20 con 0x7fdbc0075420 2024-05-20T17:42:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.487+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01a5360 con 0x7fdbc0075420 2024-05-20T17:42:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.491+0000 7fdbcf5fb740 1 Processor -- start 2024-05-20T17:42:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.491+0000 7fdbb77fe640 1 -- 172.21.15.135:0/4060521844 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fdbbc039040 con 0x7fdbc0075420 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 -- start start 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f99250f1b0 0x55f9928ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f992813340 con 0x55f9924ee4d0 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f9927bb290 con 0x55f9924e62f0 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f99280f300 con 0x55f99250f1b0 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbc640f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34412/0 (socket says 172.21.15.135:34412) 2024-05-20T17:42:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.492+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/1489780242 learned_addr learned my addr 172.21.15.135:0/1489780242 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc640f640 1 -- 172.21.15.135:0/1489780242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f99250f1b0 msgr2=0x55f9928ae080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc640f640 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f99250f1b0 0x55f9928ae080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc640f640 1 -- 172.21.15.135:0/1489780242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 msgr2=0x55f9928aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc640f640 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc640f640 1 -- 172.21.15.135:0/1489780242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9927df8e0 con 0x55f9924e62f0 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.493+0000 7fdbb77fe640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 0x7fdbac0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbc640f640 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928ae5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0ed770 tx=0x7fdbbc0f3f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff63c6ffe1ea110 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 0x7fdbac0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbb77fe640 1 -- 172.21.15.135:0/4060521844 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fdbbc0f00b0 con 0x7fdbc0075420 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbb4bfe640 1 -- 172.21.15.135:0/1489780242 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0b8ce0 con 0x55f9924e62f0 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbb4bfe640 1 -- 172.21.15.135:0/1489780242 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc0dc070 con 0x55f9924e62f0 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.494+0000 7fdbb4bfe640 1 -- 172.21.15.135:0/1489780242 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0f3bd0 con 0x55f9924e62f0 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.495+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1489780242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 msgr2=0x55f9928ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.495+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 0x7fdbac0a5300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55f9928ab1f0 tx=0x7fdbb8010040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.495+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928ae5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0ed770 tx=0x7fdbbc0f3f90 comp rx=0 tx=0).stop 2024-05-20T17:42:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.496+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1489780242 shutdown_connections 2024-05-20T17:42:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.496+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.496+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928ae5c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.496+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1489780242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f99250f1b0 0x55f9928ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.496+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1489780242 >> 172.21.15.135:0/1489780242 conn(0x55f992503300 msgr2=0x55f9928aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.497+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1489780242 shutdown_connections 2024-05-20T17:42:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.497+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1489780242 wait complete. 2024-05-20T17:42:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 -- start start 2024-05-20T17:42:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 Processor -- start 2024-05-20T17:42:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9928cbf80 con 0x55f9924ee4d0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f9927ce790 con 0x55f99250f1b0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9928cc100 con 0x55f9924e62f0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.498+0000 7fdbcf5fb740 10 client.0 _ll_register_callbacks cb 0x55f992809a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc6c10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:60868/0 (socket says 172.21.15.135:60868) 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 -- 172.21.15.135:0/45383437 learned_addr learned my addr 172.21.15.135:0/45383437 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:54506/0 (socket says 172.21.15.135:54506) 2024-05-20T17:42:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 -- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 msgr2=0x55f9928b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 -- 172.21.15.135:0/45383437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 msgr2=0x55f9928ba6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928ba6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 -- 172.21.15.135:0/45383437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f992527210 con 0x55f9924e62f0 2024-05-20T17:42:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.499+0000 7fdbc640f640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0c5180 tx=0x7fdbbc005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64a7dd0cfea53c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.500+0000 7fdba9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.500+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc049070 con 0x55f9924e62f0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.500+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbbc0dc070 con 0x55f9924e62f0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.500+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fdbbc0ed9f0 con 0x55f9924e62f0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.502+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdbbc0bc3a0 con 0x55f9924e62f0 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.502+0000 7fdbcf5fb740 10 client.26164 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.502+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f9925f3620 con 0x55f9924e62f0 2024-05-20T17:42:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.502+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc0dc070 con 0x55f9924e62f0 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdbbc0bcca0 con 0x55f9924e62f0 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 10 client.26164 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 20 client.26164 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924cdd80 0x55f9928db5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 4 client.26164 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.503+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f992820a70 con 0x55f9924cdd80 2024-05-20T17:42:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.504+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924cdd80 0x55f9928db5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.505+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924cdd80 0x55f9928db5b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3e049c704d40a3 server_cookie=30ef3ba990afb0fd in_seq=0 out_seq=0 2024-05-20T17:42:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.505+0000 7fdba9ffb640 10 client.26164 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdba9ffb640 1 -- 172.21.15.135:0/45383437 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f992820a70 con 0x55f9924cdd80 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdba9ffb640 10 client.26164 handle_command_reply: tid=0 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 client.26164 shutdown 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 msgr2=0x55f9928ba170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0c5180 tx=0x7fdbbc005d40 comp rx=0 tx=0).stop 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 shutdown_connections 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924cdd80 0x55f9928db5b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924ee4d0 0x55f9928ba6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/45383437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924e62f0 0x55f9928ba170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 >> 172.21.15.135:0/45383437 conn(0x55f992503300 msgr2=0x55f9928adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdba9ffb640 0 client.26164 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 shutdown_connections 2024-05-20T17:42:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/45383437 wait complete. 2024-05-20T17:42:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.506+0000 7fdbcf5fb740 20 client.26164 trim_cache size 0 max 16384 2024-05-20T17:42:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.533+0000 7fdbcf5fb740 1 Processor -- start 2024-05-20T17:42:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.533+0000 7fdbcf5fb740 1 -- start start 2024-05-20T17:42:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.533+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.533+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.533+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99250f1b0 0x55f9928e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01af2f0 con 0x55f99250f1b0 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01acb00 con 0x55f9924e62f0 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0071db0 con 0x55f9924ee4d0 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:60880/0 (socket says 172.21.15.135:60880) 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/1532946427 learned_addr learned my addr 172.21.15.135:0/1532946427 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99250f1b0 0x55f9928e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.534+0000 7fdbc640f640 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/1532946427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 msgr2=0x55f9928b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/1532946427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99250f1b0 msgr2=0x55f9928e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99250f1b0 0x55f9928e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/1532946427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9928ab980 con 0x55f9924ee4d0 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00058c0 tx=0x7fdbb000a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a4b34fb5608a96 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbabfff640 1 -- 172.21.15.135:0/1532946427 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0005220 con 0x55f9924ee4d0 2024-05-20T17:42:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.535+0000 7fdbabfff640 1 -- 172.21.15.135:0/1532946427 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb0024070 con 0x55f9924ee4d0 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.536+0000 7fdbabfff640 1 -- 172.21.15.135:0/1532946427 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00205c0 con 0x55f9924ee4d0 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1532946427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 msgr2=0x55f9928e0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00058c0 tx=0x7fdbb000a2d0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1532946427 shutdown_connections 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99250f1b0 0x55f9928e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928e0b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/1532946427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9924e62f0 0x55f9928b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1532946427 >> 172.21.15.135:0/1532946427 conn(0x55f992503300 msgr2=0x55f9928b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1532946427 shutdown_connections 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/1532946427 wait complete. 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 -- start start 2024-05-20T17:42:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.537+0000 7fdbcf5fb740 1 Processor -- start 2024-05-20T17:42:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924e62f0 0x55f9928cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0072400 con 0x55f9924e62f0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0073870 con 0x55f99250f1b0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0072ad0 con 0x55f9924ee4d0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbcf5fb740 10 client.0 _ll_register_callbacks cb 0x7fdbbc0c0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbc5c0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:60882/0 (socket says 172.21.15.135:60882) 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/3418413292 learned_addr learned my addr 172.21.15.135:0/3418413292 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbc6c10640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.538+0000 7fdbc640f640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924e62f0 0x55f9928cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 msgr2=0x55f9928d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/3418413292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924e62f0 msgr2=0x55f9928cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924e62f0 0x55f9928cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 -- 172.21.15.135:0/3418413292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f992941740 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbc5c0e640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005f10 tx=0x7fdbb00201c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3cffc7d4856aef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdba9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00048d0 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb0024070 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fdbb0004a70 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdbb0004c70 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbcf5fb740 10 client.26170 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.539+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f992942970 con 0x55f9924ee4d0 2024-05-20T17:42:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb0024070 con 0x55f9924ee4d0 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdbb00398a0 con 0x55f9924ee4d0 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 10 client.26170 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 10 client.26170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 20 client.26170 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924a31c0 0x55f992945110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 4 client.26170 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f99281adc0 con 0x55f9924a31c0 2024-05-20T17:42:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.540+0000 7fdbc640f640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924a31c0 0x55f992945110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.541+0000 7fdbc640f640 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924a31c0 0x55f992945110 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf3a1d44a3f53ef server_cookie=72bb465eff26b264 in_seq=0 out_seq=0 2024-05-20T17:42:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.541+0000 7fdba9ffb640 10 client.26170 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdba9ffb640 1 -- 172.21.15.135:0/3418413292 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f99281adc0 con 0x55f9924a31c0 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdba9ffb640 10 client.26170 handle_command_reply: tid=0 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 client.26170 shutdown 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 msgr2=0x55f9928d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005f10 tx=0x7fdbb00201c0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 shutdown_connections 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9924a31c0 0x55f992945110 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f99250f1b0 0x55f9928d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9924ee4d0 0x55f9928d0520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 --2- 172.21.15.135:0/3418413292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9924e62f0 0x55f9928cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 >> 172.21.15.135:0/3418413292 conn(0x55f992503300 msgr2=0x55f9928ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdba9ffb640 0 client.26170 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 shutdown_connections 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.747+0000 7fdbcf5fb740 1 -- 172.21.15.135:0/3418413292 wait complete. 2024-05-20T17:42:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.748+0000 7fdbcf5fb740 20 client.26170 trim_cache size 0 max 16384 2024-05-20T17:42:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:42:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:42:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:42:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.748+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 msgr2=0x7fdbac0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.748+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 0x7fdbac0a5300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55f9928ab1f0 tx=0x7fdbb8010040 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.748+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 msgr2=0x7fdbc019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.748+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009980 tx=0x7fdbbc030710 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 shutdown_connections 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fdbac0a2df0 0x7fdbac0a5300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc0113ab0 0x7fdbc01a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0111150 0x7fdbc01a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 --2- 172.21.15.135:0/4060521844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbc0075420 0x7fdbc019fdb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 >> 172.21.15.135:0/4060521844 conn(0x7fdbc00fe1b0 msgr2=0x7fdbc00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 shutdown_connections 2024-05-20T17:42:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:36.749+0000 7fdbc8673640 1 -- 172.21.15.135:0/4060521844 wait complete. 2024-05-20T17:42:37.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:37 smithi160 ceph-mon[36261]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 373 op/s 2024-05-20T17:42:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:37 smithi172 ceph-mon[36511]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 373 op/s 2024-05-20T17:42:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:37 smithi135 ceph-mon[32027]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 373 op/s 2024-05-20T17:42:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:39 smithi160 ceph-mon[36261]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 453 op/s 2024-05-20T17:42:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:39 smithi172 ceph-mon[36511]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 453 op/s 2024-05-20T17:42:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:39 smithi135 ceph-mon[32027]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 453 op/s 2024-05-20T17:42:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:41 smithi160 ceph-mon[36261]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 314 op/s 2024-05-20T17:42:41.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:41 smithi172 ceph-mon[36511]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 314 op/s 2024-05-20T17:42:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:41 smithi135 ceph-mon[32027]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 314 op/s 2024-05-20T17:42:43.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:43 smithi160 ceph-mon[36261]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 465 op/s 2024-05-20T17:42:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:43 smithi172 ceph-mon[36511]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 465 op/s 2024-05-20T17:42:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:43 smithi135 ceph-mon[32027]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 465 op/s 2024-05-20T17:42:45.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:45 smithi160 ceph-mon[36261]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 412 op/s 2024-05-20T17:42:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:45 smithi172 ceph-mon[36511]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 412 op/s 2024-05-20T17:42:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:45 smithi135 ceph-mon[32027]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 412 op/s 2024-05-20T17:42:47.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:47 smithi160 ceph-mon[36261]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 405 op/s 2024-05-20T17:42:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:47 smithi172 ceph-mon[36511]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 405 op/s 2024-05-20T17:42:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:47 smithi135 ceph-mon[32027]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 405 op/s 2024-05-20T17:42:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:49 smithi160 ceph-mon[36261]: pgmap v293: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 488 op/s 2024-05-20T17:42:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:49 smithi172 ceph-mon[36511]: pgmap v293: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 488 op/s 2024-05-20T17:42:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:49 smithi135 ceph-mon[32027]: pgmap v293: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 488 op/s 2024-05-20T17:42:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.856+0000 7f730eba3640 1 -- 172.21.15.135:0/2092568583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308107a30 msgr2=0x7f73081015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.856+0000 7f730eba3640 1 --2- 172.21.15.135:0/2092568583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308107a30 0x7f73081015e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7304009ca0 tx=0x7f730402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.856+0000 7f730eba3640 1 -- 172.21.15.135:0/2092568583 shutdown_connections 2024-05-20T17:42:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.856+0000 7f730eba3640 1 --2- 172.21.15.135:0/2092568583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308102190 0x7f730810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 --2- 172.21.15.135:0/2092568583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f7308101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 --2- 172.21.15.135:0/2092568583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308107a30 0x7f73081015e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 -- 172.21.15.135:0/2092568583 >> 172.21.15.135:0/2092568583 conn(0x7f73080fd210 msgr2=0x7f73080ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 -- 172.21.15.135:0/2092568583 shutdown_connections 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 -- 172.21.15.135:0/2092568583 wait complete. 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 Processor -- start 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.857+0000 7f730eba3640 1 -- start start 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 0x7f730819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f730819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111d80 con 0x7f7308102190 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111c00 con 0x7f7308107ed0 2024-05-20T17:42:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730eba3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111f00 con 0x7f7308107a30 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60606/0 (socket says 172.21.15.135:60606) 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 -- 172.21.15.135:0/1706056830 learned_addr learned my addr 172.21.15.135:0/1706056830 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f72fffff640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 0x7f730819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730d140640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f730819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 -- 172.21.15.135:0/1706056830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 msgr2=0x7f730819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 0x7f730819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 -- 172.21.15.135:0/1706056830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 msgr2=0x7f730819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f730819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 -- 172.21.15.135:0/1706056830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73081a5930 con 0x7f7308102190 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f72fffff640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 0x7f730819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:49.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730d140640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f730819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.858+0000 7f730c93f640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7304000f80 tx=0x7f73040319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.859+0000 7f72fdffb640 1 -- 172.21.15.135:0/1706056830 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730402fa20 con 0x7f7308102190 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.859+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73081a5bc0 con 0x7f7308102190 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.859+0000 7f72fdffb640 1 -- 172.21.15.135:0/1706056830 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730402fbc0 con 0x7f7308102190 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.859+0000 7f72fdffb640 1 -- 172.21.15.135:0/1706056830 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730403a660 con 0x7f7308102190 2024-05-20T17:42:49.864 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.859+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73081a6110 con 0x7f7308102190 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.861+0000 7f72fdffb640 1 -- 172.21.15.135:0/1706056830 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f73040305c0 con 0x7f7308102190 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.861+0000 7f7315a45740 1 Processor -- start 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 -- start start 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb93095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb9309b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fb926e340 con 0x564fb8f412f0 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564fb9216290 con 0x564fb8f6a1b0 2024-05-20T17:42:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f7315a45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fb926a300 con 0x564fb8f494d0 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730c93f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb93095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51214/0 (socket says 172.21.15.135:51214) 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 -- 172.21.15.135:0/1809038737 learned_addr learned my addr 172.21.15.135:0/1809038737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f72fdffb640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 0x7f72f00a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f72fffff640 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb9309b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 -- 172.21.15.135:0/1809038737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 msgr2=0x564fb9309b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb9309b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 -- 172.21.15.135:0/1809038737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 msgr2=0x564fb93095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb93095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 -- 172.21.15.135:0/1809038737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb923a8e0 con 0x564fb8f6a1b0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f72fdffb640 1 -- 172.21.15.135:0/1706056830 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f73040f06c0 con 0x7f7308102190 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.862+0000 7f730d140640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 0x7f72f00a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.863+0000 7f730d140640 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73000105a0 tx=0x7f7300010a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d601fc8c60d2521f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.863+0000 7f72eeffd640 1 -- 172.21.15.135:0/1809038737 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300023070 con 0x564fb8f6a1b0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.863+0000 7f730d140640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 0x7f72f00a5200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7300020000 tx=0x7f730001b000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.863+0000 7f72eeffd640 1 -- 172.21.15.135:0/1809038737 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730000e5f0 con 0x564fb8f6a1b0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.863+0000 7f72eeffd640 1 -- 172.21.15.135:0/1809038737 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730001d7a0 con 0x564fb8f6a1b0 2024-05-20T17:42:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- 172.21.15.135:0/1809038737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 msgr2=0x564fb9309080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73000105a0 tx=0x7f7300010a60 comp rx=0 tx=0).stop 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- 172.21.15.135:0/1809038737 shutdown_connections 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb9309b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb93095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 --2- 172.21.15.135:0/1809038737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f6a1b0 0x564fb9309080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- 172.21.15.135:0/1809038737 >> 172.21.15.135:0/1809038737 conn(0x564fb8f5e300 msgr2=0x564fb9305830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- 172.21.15.135:0/1809038737 shutdown_connections 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- 172.21.15.135:0/1809038737 wait complete. 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 -- start start 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.864+0000 7f7315a45740 1 Processor -- start 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f494d0 0x564fb93156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f6a1b0 0x564fb93135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fb93161b0 con 0x564fb8f412f0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564fb9229790 con 0x564fb8f494d0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fb9316330 con 0x564fb8f6a1b0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 10 client.0 _ll_register_callbacks cb 0x564fb9264a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60618/0 (socket says 172.21.15.135:60618) 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f72fffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f494d0 0x564fb93156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 -- 172.21.15.135:0/1189102700 learned_addr learned my addr 172.21.15.135:0/1189102700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730d140640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f6a1b0 0x564fb93135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 -- 172.21.15.135:0/1189102700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f6a1b0 msgr2=0x564fb93135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f6a1b0 0x564fb93135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 -- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f494d0 msgr2=0x564fb93156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f494d0 0x564fb93156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 -- 172.21.15.135:0/1189102700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb8f82210 con 0x564fb8f412f0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f730c93f640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f73040bc9c0 tx=0x7f73040bcb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ff15528fa72093 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f72e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040bc620 con 0x564fb8f412f0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f73040bcf20 con 0x564fb8f412f0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.865+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f730000e5f0 con 0x564fb8f412f0 2024-05-20T17:42:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73040db900 con 0x564fb8f412f0 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 10 client.16689 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fb904e620 con 0x564fb8f412f0 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730000e5f0 con 0x564fb8f412f0 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f73040c54a0 con 0x564fb8f412f0 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 10 client.16689 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 20 client.16689 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f28d80 0x564fb9325a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 4 client.16689 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fb927ba70 con 0x564fb8f28d80 2024-05-20T17:42:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.866+0000 7f72fffff640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f28d80 0x564fb9325a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.867+0000 7f72e7fff640 10 client.16689 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.867+0000 7f72fffff640 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f28d80 0x564fb9325a20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7cd7bd7c7ec46a server_cookie=ca6bc215a77a7ad6 in_seq=0 out_seq=0 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.867+0000 7f72e7fff640 1 -- 172.21.15.135:0/1189102700 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564fb927ba70 con 0x564fb8f28d80 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.867+0000 7f72e7fff640 10 client.16689 handle_command_reply: tid=0 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.867+0000 7f7315a45740 1 client.16689 shutdown 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 msgr2=0x564fb9315170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f73040bc9c0 tx=0x7f73040bcb20 comp rx=0 tx=0).stop 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 shutdown_connections 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f28d80 0x564fb9325a20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f6a1b0 0x564fb93135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f494d0 0x564fb93156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f72e7fff640 0 client.16689 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 --2- 172.21.15.135:0/1189102700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9315170 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 >> 172.21.15.135:0/1189102700 conn(0x564fb8f5e300 msgr2=0x564fb9308e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 shutdown_connections 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 1 -- 172.21.15.135:0/1189102700 wait complete. 2024-05-20T17:42:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.868+0000 7f7315a45740 20 client.16689 trim_cache size 0 max 16384 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.883+0000 7f7315a45740 1 Processor -- start 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 -- start start 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f28d80 0x564fb9312530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb931b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73081b14d0 con 0x564fb8f412f0 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f73081aece0 con 0x564fb8f28d80 2024-05-20T17:42:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f7315a45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73081acb50 con 0x564fb8f494d0 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f730c93f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f28d80 0x564fb9312530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60632/0 (socket says 172.21.15.135:60632) 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 -- 172.21.15.135:0/2674204039 learned_addr learned my addr 172.21.15.135:0/2674204039 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f730d140640 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb931b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 -- 172.21.15.135:0/2674204039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 msgr2=0x564fb931b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb931b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 -- 172.21.15.135:0/2674204039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f28d80 msgr2=0x564fb9312530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f28d80 0x564fb9312530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 -- 172.21.15.135:0/2674204039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb930d770 con 0x564fb8f412f0 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f730d140640 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb931b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:42:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.884+0000 7f72fffff640 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005e00 tx=0x7f72f8012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b4c268cfbeb5f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f72ee7fc640 1 -- 172.21.15.135:0/2674204039 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004310 con 0x564fb8f412f0 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f72ee7fc640 1 -- 172.21.15.135:0/2674204039 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f80044b0 con 0x564fb8f412f0 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f72ee7fc640 1 -- 172.21.15.135:0/2674204039 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80035f0 con 0x564fb8f412f0 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 -- 172.21.15.135:0/2674204039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 msgr2=0x564fb9313590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005e00 tx=0x7f72f8012b00 comp rx=0 tx=0).stop 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 -- 172.21.15.135:0/2674204039 shutdown_connections 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f494d0 0x564fb931b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f412f0 0x564fb9313590 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 --2- 172.21.15.135:0/2674204039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f28d80 0x564fb9312530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 -- 172.21.15.135:0/2674204039 >> 172.21.15.135:0/2674204039 conn(0x564fb8f5e300 msgr2=0x564fb9312e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 -- 172.21.15.135:0/2674204039 shutdown_connections 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.885+0000 7f7315a45740 1 -- 172.21.15.135:0/2674204039 wait complete. 2024-05-20T17:42:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 -- start start 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 Processor -- start 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 0x564fb938a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 0x564fb938a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 0x564fb9384800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73081ad1a0 con 0x564fb8f494d0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f73081ae610 con 0x564fb8f412f0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.886+0000 7f7315a45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73081ad870 con 0x564fb8f28d80 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f7315a45740 10 client.0 _ll_register_callbacks cb 0x7f73040de040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 0x564fb9384800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730c93f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 0x564fb938a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72fffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 0x564fb938a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72fffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 0x564fb938a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51234/0 (socket says 172.21.15.135:51234) 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730c93f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 0x564fb938a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:42130/0 (socket says 172.21.15.135:42130) 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72fffff640 1 -- 172.21.15.135:0/460886393 learned_addr learned my addr 172.21.15.135:0/460886393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 -- 172.21.15.135:0/460886393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 msgr2=0x564fb938a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 0x564fb938a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 -- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 msgr2=0x564fb938a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 0x564fb938a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 -- 172.21.15.135:0/460886393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb9384e10 con 0x564fb8f494d0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f730d140640 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 0x564fb9384800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f730000e7e0 tx=0x7f730000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10603d10fb11ac5d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300035060 con 0x564fb8f494d0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f7300011640 con 0x564fb8f494d0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f80044b0 con 0x564fb8f494d0 2024-05-20T17:42:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7300023040 con 0x564fb8f494d0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.887+0000 7f7315a45740 10 client.16695 fetch_fsmap learned FSMap version 30 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fb9391ac0 con 0x564fb8f494d0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f80044b0 con 0x564fb8f494d0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7300013620 con 0x564fb8f494d0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 10 client.16695 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 20 client.16695 populate_metadata read hostname 'smithi135' 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f6a1b0 0x564fb9394190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 4 client.16695 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fb9275dc0 con 0x564fb8f6a1b0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f730c93f640 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f6a1b0 0x564fb9394190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.888+0000 7f72e7fff640 10 client.16695 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.889+0000 7f730c93f640 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f6a1b0 0x564fb9394190 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d27f3ab3f3d3f93 server_cookie=af63e1824f47b852 in_seq=0 out_seq=0 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.907+0000 7f72e7fff640 1 -- 172.21.15.135:0/460886393 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564fb9275dc0 con 0x564fb8f6a1b0 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.907+0000 7f72e7fff640 10 client.16695 handle_command_reply: tid=0 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.907+0000 7f7315a45740 1 client.16695 shutdown 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 msgr2=0x564fb9384800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 0x564fb9384800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f730000e7e0 tx=0x7f730000bd30 comp rx=0 tx=0).stop 2024-05-20T17:42:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 shutdown_connections 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x564fb8f6a1b0 0x564fb9394190 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fb8f494d0 0x564fb9384800 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564fb8f412f0 0x564fb938a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f72e7fff640 0 client.16695 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 --2- 172.21.15.135:0/460886393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fb8f28d80 0x564fb938a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 >> 172.21.15.135:0/460886393 conn(0x564fb8f5e300 msgr2=0x564fb9312e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 shutdown_connections 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 1 -- 172.21.15.135:0/460886393 wait complete. 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.908+0000 7f7315a45740 20 client.16695 trim_cache size 0 max 16384 2024-05-20T17:42:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:42:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:42:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:42:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 msgr2=0x7f72f00a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 0x7f72f00a5200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7300020000 tx=0x7f730001b000 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 msgr2=0x7f730819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7304000f80 tx=0x7f73040319f0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 shutdown_connections 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f72f00a2cf0 0x7f72f00a5200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7308107ed0 0x7f730819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7308107a30 0x7f730819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 --2- 172.21.15.135:0/1706056830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7308102190 0x7f730819a620 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 >> 172.21.15.135:0/1706056830 conn(0x7f73080fd210 msgr2=0x7f73080fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 shutdown_connections 2024-05-20T17:42:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:42:49.909+0000 7f730eba3640 1 -- 172.21.15.135:0/1706056830 wait complete. 2024-05-20T17:42:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:51 smithi160 ceph-mon[36261]: pgmap v294: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-05-20T17:42:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:51 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:42:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:51 smithi172 ceph-mon[36511]: pgmap v294: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-05-20T17:42:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:51 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:42:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:51 smithi135 ceph-mon[32027]: pgmap v294: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-05-20T17:42:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:51 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:42:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:53 smithi160 ceph-mon[36261]: pgmap v295: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 497 op/s 2024-05-20T17:42:53.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:53 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:42:53.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:53 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:42:53.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:53 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:42:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:53 smithi172 ceph-mon[36511]: pgmap v295: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 497 op/s 2024-05-20T17:42:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:53 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:42:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:53 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:42:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:53 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:42:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:53 smithi135 ceph-mon[32027]: pgmap v295: 97 pgs: 97 active+clean; 2.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 497 op/s 2024-05-20T17:42:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:53 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:42:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:53 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:42:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:53 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:42:55.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:55 smithi160 ceph-mon[36261]: pgmap v296: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-05-20T17:42:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:55 smithi172 ceph-mon[36511]: pgmap v296: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-05-20T17:42:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:55 smithi135 ceph-mon[32027]: pgmap v296: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-05-20T17:42:57.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:57 smithi160 ceph-mon[36261]: pgmap v297: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-05-20T17:42:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:57 smithi172 ceph-mon[36511]: pgmap v297: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-05-20T17:42:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:57 smithi135 ceph-mon[32027]: pgmap v297: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-05-20T17:42:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:42:59 smithi160 ceph-mon[36261]: pgmap v298: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 423 op/s 2024-05-20T17:42:59.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:42:59 smithi172 ceph-mon[36511]: pgmap v298: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 423 op/s 2024-05-20T17:42:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:42:59 smithi135 ceph-mon[32027]: pgmap v298: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 423 op/s 2024-05-20T17:43:01.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:01 smithi135 ceph-mon[32027]: pgmap v299: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-05-20T17:43:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:01 smithi160 ceph-mon[36261]: pgmap v299: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-05-20T17:43:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:01 smithi172 ceph-mon[36511]: pgmap v299: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-05-20T17:43:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3206815203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107a30 msgr2=0x7fda881015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3206815203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107a30 0x7fda881015e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fda78009900 tx=0x7fda7802a410 comp rx=0 tx=0).stop 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3206815203 shutdown_connections 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3206815203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88102190 0x7fda8810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3206815203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88107ed0 0x7fda88101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3206815203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107a30 0x7fda881015e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3206815203 >> 172.21.15.135:0/3206815203 conn(0x7fda880fd210 msgr2=0x7fda880ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3206815203 shutdown_connections 2024-05-20T17:43:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.018+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3206815203 wait complete. 2024-05-20T17:43:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 Processor -- start 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 -- start start 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88102190 0x7fda8819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88107a30 0x7fda8819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda88111d80 con 0x7fda88107ed0 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda88111c00 con 0x7fda88102190 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8cb0f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda88111f00 con 0x7fda88107a30 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47726/0 (socket says 172.21.15.135:47726) 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 -- 172.21.15.135:0/3469221230 learned_addr learned my addr 172.21.15.135:0/3469221230 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda8659c640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88102190 0x7fda8819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda85d9b640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88107a30 0x7fda8819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 -- 172.21.15.135:0/3469221230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88107a30 msgr2=0x7fda8819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88107a30 0x7fda8819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 -- 172.21.15.135:0/3469221230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88102190 msgr2=0x7fda8819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88102190 0x7fda8819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.019+0000 7fda86d9d640 1 -- 172.21.15.135:0/3469221230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda881a59a0 con 0x7fda88107ed0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda86d9d640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fda8000d950 tx=0x7fda8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda777fe640 1 -- 172.21.15.135:0/3469221230 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80017030 con 0x7fda88107ed0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda881a5c90 con 0x7fda88107ed0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda777fe640 1 -- 172.21.15.135:0/3469221230 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda80004020 con 0x7fda88107ed0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda777fe640 1 -- 172.21.15.135:0/3469221230 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80003c00 con 0x7fda88107ed0 2024-05-20T17:43:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.020+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda881a6190 con 0x7fda88107ed0 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda777fe640 1 -- 172.21.15.135:0/3469221230 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fda8001a070 con 0x7fda88107ed0 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 Processor -- start 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 -- start start 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aabc1b0 0x55650ae5aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa932f0 0x55650ae5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55650adc0340 con 0x55650aa9b4d0 2024-05-20T17:43:03.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55650ad68290 con 0x55650aabc1b0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda939b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55650adbc300 con 0x55650aa932f0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47742/0 (socket says 172.21.15.135:47742) 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.023+0000 7fda85d9b640 1 -- 172.21.15.135:0/2526794216 learned_addr learned my addr 172.21.15.135:0/2526794216 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda8659c640 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa932f0 0x55650ae5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda777fe640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 0x7fda700a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aabc1b0 0x55650ae5aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 -- 172.21.15.135:0/2526794216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa932f0 msgr2=0x55650ae5b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa932f0 0x55650ae5b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 -- 172.21.15.135:0/2526794216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aabc1b0 msgr2=0x55650ae5aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda86d9d640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 0x7fda700a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aabc1b0 0x55650ae5aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 -- 172.21.15.135:0/2526794216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650ad8c8e0 con 0x55650aa9b4d0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda777fe640 1 -- 172.21.15.135:0/3469221230 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fda800ced70 con 0x7fda88107ed0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda85d9b640 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0092f0 tx=0x7fda7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66388209f6e265fd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda74ff9640 1 -- 172.21.15.135:0/2526794216 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c019030 con 0x55650aa9b4d0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda86d9d640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 0x7fda700a5200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda800976c0 tx=0x7fda8006e2d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda74ff9640 1 -- 172.21.15.135:0/2526794216 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda7c011d60 con 0x55650aa9b4d0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.024+0000 7fda74ff9640 1 -- 172.21.15.135:0/2526794216 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00fac0 con 0x55650aa9b4d0 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 -- 172.21.15.135:0/2526794216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 msgr2=0x55650ae5b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0092f0 tx=0x7fda7c009780 comp rx=0 tx=0).stop 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 -- 172.21.15.135:0/2526794216 shutdown_connections 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae5b970 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa932f0 0x55650ae5b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 --2- 172.21.15.135:0/2526794216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aabc1b0 0x55650ae5aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 -- 172.21.15.135:0/2526794216 >> 172.21.15.135:0/2526794216 conn(0x55650aab0300 msgr2=0x55650ae57830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 -- 172.21.15.135:0/2526794216 shutdown_connections 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.025+0000 7fda939b0740 1 -- 172.21.15.135:0/2526794216 wait complete. 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 -- start start 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 Processor -- start 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55650ae6c5c0 con 0x55650aabc1b0 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55650ad7b790 con 0x55650aa932f0 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55650ae6c740 con 0x55650aa9b4d0 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda939b0740 10 client.0 _ll_register_callbacks cb 0x55650adb6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47748/0 (socket says 172.21.15.135:47748) 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda85d9b640 1 -- 172.21.15.135:0/3032223571 learned_addr learned my addr 172.21.15.135:0/3032223571 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda85d9b640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.026+0000 7fda8659c640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 -- 172.21.15.135:0/3032223571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 msgr2=0x55650ae6a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 -- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 msgr2=0x55650ae69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 -- 172.21.15.135:0/3032223571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650aad4210 con 0x55650aabc1b0 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda85d9b640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fda7c012010 tx=0x7fda7c00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78b50c2589ba92f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c019070 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fda7c00f840 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda7c011d60 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fda7c00fa80 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda939b0740 10 client.16707 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55650aba0620 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.027+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda7c011d60 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fda7c032020 con 0x55650aabc1b0 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 10 client.16707 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 20 client.16707 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa7ad80 0x55650ae7bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 4 client.16707 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:43:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55650adcda70 con 0x55650aa7ad80 2024-05-20T17:43:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda8659c640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa7ad80 0x55650ae7bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda6dffb640 10 client.16707 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.028+0000 7fda8659c640 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa7ad80 0x55650ae7bc80 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3f31b554b70f4d server_cookie=32dc9fcb198bc926 in_seq=0 out_seq=0 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda6dffb640 1 -- 172.21.15.135:0/3032223571 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55650adcda70 con 0x55650aa7ad80 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda6dffb640 10 client.16707 handle_command_reply: tid=0 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 client.16707 shutdown 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 msgr2=0x55650ae6fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fda7c012010 tx=0x7fda7c00f6a0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 shutdown_connections 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa7ad80 0x55650ae7bc80 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6fa70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda6dffb640 0 client.16707 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 --2- 172.21.15.135:0/3032223571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 >> 172.21.15.135:0/3032223571 conn(0x55650aab0300 msgr2=0x55650ae5cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 shutdown_connections 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.029+0000 7fda939b0740 1 -- 172.21.15.135:0/3032223571 wait complete. 2024-05-20T17:43:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.030+0000 7fda939b0740 20 client.16707 trim_cache size 0 max 16384 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.044+0000 7fda939b0740 1 Processor -- start 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 -- start start 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae5d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda881af3d0 con 0x55650aabc1b0 2024-05-20T17:43:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda881acbe0 con 0x55650aa932f0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda939b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda881aaa50 con 0x55650aa9b4d0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47762/0 (socket says 172.21.15.135:47762) 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 -- 172.21.15.135:0/45463662 learned_addr learned my addr 172.21.15.135:0/45463662 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda8659c640 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 -- 172.21.15.135:0/45463662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 msgr2=0x55650ae6f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 -- 172.21.15.135:0/45463662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 msgr2=0x55650ae5d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae5d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 -- 172.21.15.135:0/45463662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650ae67e60 con 0x55650aabc1b0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda8659c640 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda85d9b640 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fda7c013d90 tx=0x7fda7c00f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7771fb25dcbd21 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.045+0000 7fda6ffff640 1 -- 172.21.15.135:0/45463662 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c019040 con 0x55650aabc1b0 2024-05-20T17:43:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda6ffff640 1 -- 172.21.15.135:0/45463662 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda7c013e30 con 0x55650aabc1b0 2024-05-20T17:43:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda6ffff640 1 -- 172.21.15.135:0/45463662 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00f710 con 0x55650aabc1b0 2024-05-20T17:43:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 -- 172.21.15.135:0/45463662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 msgr2=0x55650ae6ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fda7c013d90 tx=0x7fda7c00f530 comp rx=0 tx=0).stop 2024-05-20T17:43:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 -- 172.21.15.135:0/45463662 shutdown_connections 2024-05-20T17:43:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aabc1b0 0x55650ae6ff20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aa9b4d0 0x55650ae6f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 --2- 172.21.15.135:0/45463662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae5d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 -- 172.21.15.135:0/45463662 >> 172.21.15.135:0/45463662 conn(0x55650aab0300 msgr2=0x55650ae5cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 -- 172.21.15.135:0/45463662 shutdown_connections 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.046+0000 7fda939b0740 1 -- 172.21.15.135:0/45463662 wait complete. 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 -- start start 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 Processor -- start 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae70480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 0x55650ae70f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ab0a0 con 0x55650aa9b4d0 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ac510 con 0x55650aa932f0 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ab770 con 0x55650aabc1b0 2024-05-20T17:43:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda939b0740 10 client.0 _ll_register_callbacks cb 0x7fda7c013620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47776/0 (socket says 172.21.15.135:47776) 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 -- 172.21.15.135:0/1161458257 learned_addr learned my addr 172.21.15.135:0/1161458257 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda85d9b640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae70480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda85d9b640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 0x55650ae70f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 -- 172.21.15.135:0/1161458257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 msgr2=0x55650ae70f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 0x55650ae70f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 -- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 msgr2=0x55650ae70480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae70480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda8659c640 1 -- 172.21.15.135:0/1161458257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650aee2020 con 0x55650aa9b4d0 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.047+0000 7fda85d9b640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 0x55650ae70f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:43:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda8659c640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fda78005940 tx=0x7fda780041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8893cd931d1ffea server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78035040 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fda78005240 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda7c013e30 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fda78051050 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 10 client.16713 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55650aee3260 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda7c013e30 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fda7804c030 con 0x55650aa9b4d0 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 10 client.16713 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 20 client.16713 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa501c0 0x55650aee5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 4 client.16713 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.048+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55650adc7dc0 con 0x55650aa501c0 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.049+0000 7fda85d9b640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa501c0 0x55650aee5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.049+0000 7fda85d9b640 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa501c0 0x55650aee5b00 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56465f2cf349f17 server_cookie=6a45235d19168522 in_seq=0 out_seq=0 2024-05-20T17:43:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:03.049+0000 7fda6dffb640 10 client.16713 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:03 smithi160 ceph-mon[36261]: pgmap v300: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 386 op/s 2024-05-20T17:43:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:03 smithi172 ceph-mon[36511]: pgmap v300: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 386 op/s 2024-05-20T17:43:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:03 smithi135 ceph-mon[32027]: pgmap v300: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 386 op/s 2024-05-20T17:43:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda6dffb640 1 -- 172.21.15.135:0/1161458257 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55650adc7dc0 con 0x55650aa501c0 2024-05-20T17:43:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda6dffb640 10 client.16713 handle_command_reply: tid=0 2024-05-20T17:43:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 client.16713 shutdown 2024-05-20T17:43:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 msgr2=0x55650ae709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fda78005940 tx=0x7fda780041a0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 shutdown_connections 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55650aa501c0 0x55650aee5b00 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55650aabc1b0 0x55650ae70f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55650aa9b4d0 0x55650ae709c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda6dffb640 0 client.16713 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 --2- 172.21.15.135:0/1161458257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55650aa932f0 0x55650ae70480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 >> 172.21.15.135:0/1161458257 conn(0x55650aab0300 msgr2=0x55650ae6afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 shutdown_connections 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 1 -- 172.21.15.135:0/1161458257 wait complete. 2024-05-20T17:43:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.394+0000 7fda939b0740 20 client.16713 trim_cache size 0 max 16384 2024-05-20T17:43:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:43:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:43:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:43:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 msgr2=0x7fda700a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 0x7fda700a5200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda800976c0 tx=0x7fda8006e2d0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 msgr2=0x7fda8819b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fda8000d950 tx=0x7fda8000de10 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 shutdown_connections 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fda700a2cf0 0x7fda700a5200 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda88107ed0 0x7fda8819b100 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda88107a30 0x7fda8819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 --2- 172.21.15.135:0/3469221230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88102190 0x7fda8819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 >> 172.21.15.135:0/3469221230 conn(0x7fda880fd210 msgr2=0x7fda880fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 shutdown_connections 2024-05-20T17:43:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:05.395+0000 7fda8cb0f640 1 -- 172.21.15.135:0/3469221230 wait complete. 2024-05-20T17:43:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:05 smithi160 ceph-mon[36261]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-05-20T17:43:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:05 smithi172 ceph-mon[36511]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-05-20T17:43:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:05 smithi135 ceph-mon[32027]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-05-20T17:43:07.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:07 smithi160 ceph-mon[36261]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-05-20T17:43:07.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:07 smithi172 ceph-mon[36511]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-05-20T17:43:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:07 smithi135 ceph-mon[32027]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-05-20T17:43:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:09 smithi160 ceph-mon[36261]: pgmap v303: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 856 op/s 2024-05-20T17:43:09.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:09 smithi172 ceph-mon[36511]: pgmap v303: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 856 op/s 2024-05-20T17:43:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:09 smithi135 ceph-mon[32027]: pgmap v303: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 856 op/s 2024-05-20T17:43:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:11 smithi160 ceph-mon[36261]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 810 op/s 2024-05-20T17:43:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:11 smithi172 ceph-mon[36511]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 810 op/s 2024-05-20T17:43:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:11 smithi135 ceph-mon[32027]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 810 op/s 2024-05-20T17:43:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:13 smithi160 ceph-mon[36261]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 930 op/s 2024-05-20T17:43:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:13 smithi172 ceph-mon[36511]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 930 op/s 2024-05-20T17:43:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:13 smithi135 ceph-mon[32027]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 930 op/s 2024-05-20T17:43:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:15 smithi172 ceph-mon[36511]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 915 op/s 2024-05-20T17:43:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:15 smithi172 ceph-mon[36511]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:43:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:15 smithi135 ceph-mon[32027]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 915 op/s 2024-05-20T17:43:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:15 smithi135 ceph-mon[32027]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:43:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:15 smithi160 ceph-mon[36261]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 915 op/s 2024-05-20T17:43:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:15 smithi160 ceph-mon[36261]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:43:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:17 smithi172 ceph-mon[36511]: pgmap v308: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 974 op/s 2024-05-20T17:43:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:17 smithi135 ceph-mon[32027]: pgmap v308: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 974 op/s 2024-05-20T17:43:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:17 smithi160 ceph-mon[36261]: pgmap v308: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 2.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 974 op/s 2024-05-20T17:43:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.548+0000 7f551e826640 1 -- 172.21.15.135:0/1237858903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 msgr2=0x7f551810e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.548+0000 7f551e826640 1 --2- 172.21.15.135:0/1237858903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 0x7f551810e140 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f550c009860 tx=0x7f550c02b490 comp rx=0 tx=0).stop 2024-05-20T17:43:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.551+0000 7f551e826640 1 -- 172.21.15.135:0/1237858903 shutdown_connections 2024-05-20T17:43:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.551+0000 7f551e826640 1 --2- 172.21.15.135:0/1237858903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f551810e7d0 0x7f5518115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.551+0000 7f551e826640 1 --2- 172.21.15.135:0/1237858903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 0x7f551810e140 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.551+0000 7f551e826640 1 --2- 172.21.15.135:0/1237858903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5518109780 0x7f5518109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.551+0000 7f551e826640 1 -- 172.21.15.135:0/1237858903 >> 172.21.15.135:0/1237858903 conn(0x7f551806dc30 msgr2=0x7f551806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.554+0000 7f551e826640 1 -- 172.21.15.135:0/1237858903 shutdown_connections 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.555+0000 7f551e826640 1 -- 172.21.15.135:0/1237858903 wait complete. 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 Processor -- start 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 -- start start 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5518109780 0x7f55181a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 0x7f55181a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55181193b0 con 0x7f551810dd10 2024-05-20T17:43:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5518119230 con 0x7f5518109780 2024-05-20T17:43:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.556+0000 7f551e826640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5518119530 con 0x7f551810e7d0 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.557+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.557+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:55716/0 (socket says 172.21.15.135:55716) 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.557+0000 7f551cdc3640 1 -- 172.21.15.135:0/3077038027 learned_addr learned my addr 172.21.15.135:0/3077038027 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 -- 172.21.15.135:0/3077038027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5518109780 msgr2=0x7f55181a4a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5518109780 0x7f55181a4a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 -- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 msgr2=0x7f55181a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 0x7f55181a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 -- 172.21.15.135:0/3077038027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55181a0410 con 0x7f551810e7d0 2024-05-20T17:43:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.558+0000 7f551cdc3640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f550800e940 tx=0x7f550800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.560+0000 7f55157fa640 1 -- 172.21.15.135:0/3077038027 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550800cd80 con 0x7f551810e7d0 2024-05-20T17:43:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.560+0000 7f55157fa640 1 -- 172.21.15.135:0/3077038027 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55080035f0 con 0x7f551810e7d0 2024-05-20T17:43:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.560+0000 7f55157fa640 1 -- 172.21.15.135:0/3077038027 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508010690 con 0x7f551810e7d0 2024-05-20T17:43:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.561+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55181a0700 con 0x7f551810e7d0 2024-05-20T17:43:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.561+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55181ac780 con 0x7f551810e7d0 2024-05-20T17:43:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.568+0000 7f55257a9740 1 Processor -- start 2024-05-20T17:43:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.572+0000 7f55157fa640 1 -- 172.21.15.135:0/3077038027 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f55080037a0 con 0x7f551810e7d0 2024-05-20T17:43:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.573+0000 7f55157fa640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 0x7f55000a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.573+0000 7f55157fa640 1 -- 172.21.15.135:0/3077038027 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f55080cf910 con 0x7f551810e7d0 2024-05-20T17:43:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.573+0000 7f55257a9740 1 -- start start 2024-05-20T17:43:18.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.578+0000 7f55177fe640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 0x7f55000a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.578+0000 7f55257a9740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.578+0000 7f55257a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.580+0000 7f55257a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.580+0000 7f55257a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d334a65340 con 0x55d3347404d0 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.580+0000 7f55257a9740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d334a0d290 con 0x55d3347611b0 2024-05-20T17:43:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.580+0000 7f55257a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d334a61300 con 0x55d3347382f0 2024-05-20T17:43:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.581+0000 7f5517fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.581+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.581+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45126/0 (socket says 172.21.15.135:45126) 2024-05-20T17:43:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.581+0000 7f551cdc3640 1 -- 172.21.15.135:0/3643789905 learned_addr learned my addr 172.21.15.135:0/3643789905 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.582+0000 7f5517fff640 1 -- 172.21.15.135:0/3643789905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 msgr2=0x55d334b005c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.582+0000 7f5517fff640 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b005c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.582+0000 7f5517fff640 1 -- 172.21.15.135:0/3643789905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 msgr2=0x55d334b00b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.586+0000 7f5517fff640 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.586+0000 7f5517fff640 1 -- 172.21.15.135:0/3643789905 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d334a318e0 con 0x55d3347611b0 2024-05-20T17:43:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.586+0000 7f551cdc3640 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.590+0000 7f55177fe640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 0x7f55000a53d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f550c0057c0 tx=0x7f550c005d30 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.597+0000 7f5517fff640 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b00080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d70 tx=0x7f551000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b787382f3edba49 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.599+0000 7f54fe7fc640 1 -- 172.21.15.135:0/3643789905 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510004b20 con 0x55d3347611b0 2024-05-20T17:43:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.599+0000 7f54fe7fc640 1 -- 172.21.15.135:0/3643789905 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5510003e50 con 0x55d3347611b0 2024-05-20T17:43:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.599+0000 7f54fe7fc640 1 -- 172.21.15.135:0/3643789905 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510005020 con 0x55d3347611b0 2024-05-20T17:43:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.601+0000 7f55257a9740 1 -- 172.21.15.135:0/3643789905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 msgr2=0x55d334b00080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.601+0000 7f55257a9740 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b00080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d70 tx=0x7f551000e720 comp rx=0 tx=0).stop 2024-05-20T17:43:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.605+0000 7f55257a9740 1 -- 172.21.15.135:0/3643789905 shutdown_connections 2024-05-20T17:43:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.605+0000 7f55257a9740 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b00b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.605+0000 7f55257a9740 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.605+0000 7f55257a9740 1 --2- 172.21.15.135:0/3643789905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b00080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.605+0000 7f55257a9740 1 -- 172.21.15.135:0/3643789905 >> 172.21.15.135:0/3643789905 conn(0x55d334755300 msgr2=0x55d334afc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.607+0000 7f55257a9740 1 -- 172.21.15.135:0/3643789905 shutdown_connections 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.610+0000 7f55257a9740 1 -- 172.21.15.135:0/3643789905 wait complete. 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.610+0000 7f55257a9740 1 -- start start 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 Processor -- start 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b0c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b0a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d334b0d1b0 con 0x55d3347404d0 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d334a20790 con 0x55d3347611b0 2024-05-20T17:43:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d334b0d330 con 0x55d3347382f0 2024-05-20T17:43:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.611+0000 7f55257a9740 10 client.0 _ll_register_callbacks cb 0x55d334a5ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.614+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b0a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.614+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b0a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:49294/0 (socket says 172.21.15.135:49294) 2024-05-20T17:43:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.614+0000 7f551cdc3640 1 -- 172.21.15.135:0/1288619051 learned_addr learned my addr 172.21.15.135:0/1288619051 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.616+0000 7f55177fe640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b0c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.616+0000 7f5517fff640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 -- 172.21.15.135:0/1288619051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 msgr2=0x55d334b0c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b0c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 -- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 msgr2=0x55d334b0a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b0a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 -- 172.21.15.135:0/1288619051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d334779210 con 0x55d3347404d0 2024-05-20T17:43:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.623+0000 7f55177fe640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b0c6b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5518115430 tx=0x7f550c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5e67bf60636adf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.624+0000 7f54f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:43:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.625+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c04d070 con 0x55d3347404d0 2024-05-20T17:43:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.625+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5510003e50 con 0x55d3347404d0 2024-05-20T17:43:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.625+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f550c049650 con 0x55d3347404d0 2024-05-20T17:43:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.628+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f550c049850 con 0x55d3347404d0 2024-05-20T17:43:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.631+0000 7f55257a9740 10 client.16722 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.631+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d334845620 con 0x55d3347404d0 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5510003e50 con 0x55d3347404d0 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f550c03cbc0 con 0x55d3347404d0 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 10 client.16722 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 10 client.16722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 20 client.16722 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d33471fd80 0x55d334b1c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 4 client.16722 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:43:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.637+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d334a72a70 con 0x55d33471fd80 2024-05-20T17:43:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.638+0000 7f5517fff640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d33471fd80 0x55d334b1c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.644+0000 7f5517fff640 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d33471fd80 0x55d334b1c9a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=926190c7bd4c9382 server_cookie=71effed1bec6dbd2 in_seq=0 out_seq=0 2024-05-20T17:43:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.646+0000 7f54f77fe640 10 client.16722 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.646+0000 7f54f77fe640 1 -- 172.21.15.135:0/1288619051 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d334a72a70 con 0x55d33471fd80 2024-05-20T17:43:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.646+0000 7f54f77fe640 10 client.16722 handle_command_reply: tid=0 2024-05-20T17:43:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.646+0000 7f55257a9740 1 client.16722 shutdown 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.650+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 msgr2=0x55d334b0c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.650+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b0c6b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5518115430 tx=0x7f550c005f90 comp rx=0 tx=0).stop 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 shutdown_connections 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d33471fd80 0x55d334b1c9a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b0a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3347404d0 0x55d334b0c6b0 secure :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5518115430 tx=0x7f550c005f90 comp rx=0 tx=0).stop 2024-05-20T17:43:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 --2- 172.21.15.135:0/1288619051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b0c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 >> 172.21.15.135:0/1288619051 conn(0x55d334755300 msgr2=0x55d334affeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.651+0000 7f54f77fe640 0 client.16722 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.652+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 shutdown_connections 2024-05-20T17:43:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.654+0000 7f55257a9740 1 -- 172.21.15.135:0/1288619051 wait complete. 2024-05-20T17:43:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.655+0000 7f55257a9740 20 client.16722 trim_cache size 0 max 16384 2024-05-20T17:43:18.689 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.687+0000 7f55257a9740 1 Processor -- start 2024-05-20T17:43:18.689 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.687+0000 7f55257a9740 1 -- start start 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347382f0 0x55d334b00520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347611b0 0x55d334b125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b7630 con 0x55d3346f51c0 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b7d60 con 0x55d3347382f0 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.689+0000 7f55257a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b5570 con 0x55d3347611b0 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45142/0 (socket says 172.21.15.135:45142) 2024-05-20T17:43:18.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 -- 172.21.15.135:0/1468623311 learned_addr learned my addr 172.21.15.135:0/1468623311 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 -- 172.21.15.135:0/1468623311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347611b0 msgr2=0x55d334b125c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:43:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347611b0 0x55d334b125c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 -- 172.21.15.135:0/1468623311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347382f0 msgr2=0x55d334b00520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:43:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347382f0 0x55d334b00520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.690+0000 7f551cdc3640 1 -- 172.21.15.135:0/1468623311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d334b13040 con 0x55d3346f51c0 2024-05-20T17:43:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.694+0000 7f551cdc3640 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5508009470 tx=0x7f5508097970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2e8f46eec8861f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.695+0000 7f54fdffb640 1 -- 172.21.15.135:0/1468623311 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55080b8070 con 0x55d3346f51c0 2024-05-20T17:43:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.695+0000 7f54fdffb640 1 -- 172.21.15.135:0/1468623311 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55080a0120 con 0x55d3346f51c0 2024-05-20T17:43:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.695+0000 7f54fdffb640 1 -- 172.21.15.135:0/1468623311 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55080a4550 con 0x55d3346f51c0 2024-05-20T17:43:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.696+0000 7f55257a9740 1 -- 172.21.15.135:0/1468623311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 msgr2=0x55d334b12b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.696+0000 7f55257a9740 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5508009470 tx=0x7f5508097970 comp rx=0 tx=0).stop 2024-05-20T17:43:18.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.697+0000 7f55257a9740 1 -- 172.21.15.135:0/1468623311 shutdown_connections 2024-05-20T17:43:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.697+0000 7f55257a9740 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b12b00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.697+0000 7f55257a9740 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347611b0 0x55d334b125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.697+0000 7f55257a9740 1 --2- 172.21.15.135:0/1468623311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347382f0 0x55d334b00520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.697+0000 7f55257a9740 1 -- 172.21.15.135:0/1468623311 >> 172.21.15.135:0/1468623311 conn(0x55d334755300 msgr2=0x55d334affe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.701+0000 7f55257a9740 1 -- 172.21.15.135:0/1468623311 shutdown_connections 2024-05-20T17:43:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.701+0000 7f55257a9740 1 -- 172.21.15.135:0/1468623311 wait complete. 2024-05-20T17:43:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.702+0000 7f55257a9740 1 -- start start 2024-05-20T17:43:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.702+0000 7f55257a9740 1 Processor -- start 2024-05-20T17:43:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.702+0000 7f55257a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.702+0000 7f55257a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b7d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.702+0000 7f55257a9740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b11a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f55257a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b3a50 con 0x55d3346f51c0 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f55257a9740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b4ea0 con 0x55d3347611b0 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f55257a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55181b4100 con 0x55d3347382f0 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f55257a9740 10 client.0 _ll_register_callbacks cb 0x7f550c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f5517fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f5517fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45156/0 (socket says 172.21.15.135:45156) 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f5517fff640 1 -- 172.21.15.135:0/1245714123 learned_addr learned my addr 172.21.15.135:0/1245714123 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f5517fff640 1 -- 172.21.15.135:0/1245714123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 msgr2=0x55d334b7d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.703+0000 7f5517fff640 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b7d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.704+0000 7f5517fff640 1 -- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 msgr2=0x55d334b11a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.704+0000 7f5517fff640 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b11a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.704+0000 7f5517fff640 1 -- 172.21.15.135:0/1245714123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d334b12090 con 0x55d3346f51c0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.704+0000 7f5517fff640 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d70 tx=0x7f5510009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314dccab9039a1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.704+0000 7f54f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510004600 con 0x55d3346f51c0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55080a0120 con 0x55d3346f51c0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f55100047a0 con 0x55d3346f51c0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f55100049a0 con 0x55d3346f51c0 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f55257a9740 10 client.16728 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.705+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d334b84a70 con 0x55d3346f51c0 2024-05-20T17:43:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55080a0120 con 0x55d3346f51c0 2024-05-20T17:43:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5510005040 con 0x55d3346f51c0 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 10 client.16728 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 10 client.16728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 20 client.16728 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d334b85160 0x55d334b87610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 4 client.16728 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:43:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.709+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d334a6cdc0 con 0x55d334b85160 2024-05-20T17:43:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.717+0000 7f55177fe640 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d334b85160 0x55d334b87610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.721+0000 7f55177fe640 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d334b85160 0x55d334b87610 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c98d7645266cde2d server_cookie=fc5b94bccf998aa0 in_seq=0 out_seq=0 2024-05-20T17:43:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:18.721+0000 7f54f77fe640 10 client.16728 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:19.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:19 smithi160 ceph-mon[36261]: pgmap v309: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-05-20T17:43:19.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:19 smithi172 ceph-mon[36511]: pgmap v309: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-05-20T17:43:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:19 smithi135 ceph-mon[32027]: pgmap v309: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-05-20T17:43:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.237+0000 7f54f77fe640 1 -- 172.21.15.135:0/1245714123 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d334a6cdc0 con 0x55d334b85160 2024-05-20T17:43:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.237+0000 7f54f77fe640 10 client.16728 handle_command_reply: tid=0 2024-05-20T17:43:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.237+0000 7f55257a9740 1 client.16728 shutdown 2024-05-20T17:43:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 msgr2=0x55d334b7d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d70 tx=0x7f5510009500 comp rx=0 tx=0).stop 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 shutdown_connections 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d334b85160 0x55d334b87610 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d3347611b0 0x55d334b11a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3347382f0 0x55d334b7d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 --2- 172.21.15.135:0/1245714123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3346f51c0 0x55d334b7d340 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 >> 172.21.15.135:0/1245714123 conn(0x55d334755300 msgr2=0x55d334b09ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f54f77fe640 0 client.16728 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 shutdown_connections 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 1 -- 172.21.15.135:0/1245714123 wait complete. 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.238+0000 7f55257a9740 20 client.16728 trim_cache size 0 max 16384 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:43:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 msgr2=0x7f55000a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 0x7f55000a53d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f550c0057c0 tx=0x7f550c005d30 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 msgr2=0x7f551819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f550800e940 tx=0x7f550800ee00 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 shutdown_connections 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f55000a2ec0 0x7f55000a53d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f551810e7d0 0x7f551819fc10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f551810dd10 0x7f55181a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 --2- 172.21.15.135:0/3077038027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5518109780 0x7f55181a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.239+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 >> 172.21.15.135:0/3077038027 conn(0x7f551806dc30 msgr2=0x7f551810cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.240+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 shutdown_connections 2024-05-20T17:43:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:20.240+0000 7f551e826640 1 -- 172.21.15.135:0/3077038027 wait complete. 2024-05-20T17:43:20.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:43:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:43:20.032+0000 7f26a818c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-20T17:43:21.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:21 smithi172 ceph-mon[36511]: pgmap v310: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 500 op/s 2024-05-20T17:43:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:21 smithi135 ceph-mon[32027]: pgmap v310: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 500 op/s 2024-05-20T17:43:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:21 smithi160 ceph-mon[36261]: pgmap v310: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 500 op/s 2024-05-20T17:43:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:23 smithi172 ceph-mon[36511]: pgmap v311: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 374 op/s 2024-05-20T17:43:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:23 smithi135 ceph-mon[32027]: pgmap v311: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 374 op/s 2024-05-20T17:43:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:23 smithi160 ceph-mon[36261]: pgmap v311: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 374 op/s 2024-05-20T17:43:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:25 smithi172 ceph-mon[36511]: pgmap v312: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 321 op/s 2024-05-20T17:43:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:25 smithi135 ceph-mon[32027]: pgmap v312: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 321 op/s 2024-05-20T17:43:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:25 smithi160 ceph-mon[36261]: pgmap v312: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 321 op/s 2024-05-20T17:43:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:27 smithi172 ceph-mon[36511]: pgmap v313: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-20T17:43:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:27 smithi135 ceph-mon[32027]: pgmap v313: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-20T17:43:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:27 smithi160 ceph-mon[36261]: pgmap v313: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-20T17:43:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:29 smithi172 ceph-mon[36511]: pgmap v314: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 301 op/s 2024-05-20T17:43:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:29 smithi135 ceph-mon[32027]: pgmap v314: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 301 op/s 2024-05-20T17:43:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:29 smithi160 ceph-mon[36261]: pgmap v314: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 301 op/s 2024-05-20T17:43:31.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:31 smithi172 ceph-mon[36511]: pgmap v315: 97 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 63 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 818 KiB/s wr, 168 op/s 2024-05-20T17:43:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:31 smithi135 ceph-mon[32027]: pgmap v315: 97 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 63 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 818 KiB/s wr, 168 op/s 2024-05-20T17:43:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:31 smithi160 ceph-mon[36261]: pgmap v315: 97 pgs: 11 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 63 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 818 KiB/s wr, 168 op/s 2024-05-20T17:43:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- 172.21.15.135:0/767879388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107ed0 msgr2=0x7fb178101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 --2- 172.21.15.135:0/767879388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107ed0 0x7fb178101b20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb168009900 tx=0x7fb16802a410 comp rx=0 tx=0).stop 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- 172.21.15.135:0/767879388 shutdown_connections 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 --2- 172.21.15.135:0/767879388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 0x7fb17810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 --2- 172.21.15.135:0/767879388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107ed0 0x7fb178101b20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 --2- 172.21.15.135:0/767879388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107a30 0x7fb1781015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- 172.21.15.135:0/767879388 >> 172.21.15.135:0/767879388 conn(0x7fb1780fd210 msgr2=0x7fb1780ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- 172.21.15.135:0/767879388 shutdown_connections 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- 172.21.15.135:0/767879388 wait complete. 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 Processor -- start 2024-05-20T17:43:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.346+0000 7fb17fde3640 1 -- start start 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 0x7fb1780fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107ed0 0x7fb1780fe170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb178111df0 con 0x7fb178107a30 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb178111c70 con 0x7fb178102190 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17fde3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb178111f70 con 0x7fb178107ed0 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40270/0 (socket says 172.21.15.135:40270) 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 -- 172.21.15.135:0/2287083802 learned_addr learned my addr 172.21.15.135:0/2287083802 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17db7f640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 0x7fb1780fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17e380640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107ed0 0x7fb1780fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 -- 172.21.15.135:0/2287083802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107ed0 msgr2=0x7fb1780fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107ed0 0x7fb1780fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 -- 172.21.15.135:0/2287083802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 msgr2=0x7fb1780fd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 0x7fb1780fd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 -- 172.21.15.135:0/2287083802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1781a7c80 con 0x7fb178107a30 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb16802a930 tx=0x7fb168003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb16effd640 1 -- 172.21.15.135:0/2287083802 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16803f070 con 0x7fb178107a30 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.347+0000 7fb16effd640 1 -- 172.21.15.135:0/2287083802 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb168031c90 con 0x7fb178107a30 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.348+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781a7f10 con 0x7fb178107a30 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.348+0000 7fb16effd640 1 -- 172.21.15.135:0/2287083802 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168035030 con 0x7fb178107a30 2024-05-20T17:43:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.348+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781a8310 con 0x7fb178107a30 2024-05-20T17:43:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.350+0000 7fb16effd640 1 -- 172.21.15.135:0/2287083802 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb168042070 con 0x7fb178107a30 2024-05-20T17:43:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.350+0000 7fb186d63740 1 Processor -- start 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.350+0000 7fb186d63740 1 -- start start 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 0x55d857979080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 0x55d8579795c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857979b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8578de340 con 0x55d8575b12f0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d857886290 con 0x55d8575b94d0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb186d63740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8578da300 con 0x55d8575da1b0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17db7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 0x55d8579795c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857979b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17e380640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 0x55d857979080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17db7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 0x55d8579795c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40280/0 (socket says 172.21.15.135:40280) 2024-05-20T17:43:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb16effd640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 0x7fb1640a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17db7f640 1 -- 172.21.15.135:0/3810467168 learned_addr learned my addr 172.21.15.135:0/3810467168 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17e380640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 0x7fb1640a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb16effd640 1 -- 172.21.15.135:0/2287083802 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fb1680efbc0 con 0x7fb178107a30 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 -- 172.21.15.135:0/3810467168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 msgr2=0x55d857979080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 0x55d857979080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 -- 172.21.15.135:0/3810467168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 msgr2=0x55d8579795c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 0x55d8579795c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17d37e640 1 -- 172.21.15.135:0/3810467168 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8578aa8e0 con 0x55d8575b94d0 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.351+0000 7fb17e380640 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 0x55d857979080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.352+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857979b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1680ed2b0 tx=0x7fb1680bbfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfbab72f97b9a7cc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.352+0000 7fb17e380640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 0x7fb1640a5200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55d8579761f0 tx=0x7fb170004ab0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.352+0000 7fb163fff640 1 -- 172.21.15.135:0/3810467168 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168049030 con 0x55d8575b94d0 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.352+0000 7fb163fff640 1 -- 172.21.15.135:0/3810467168 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1680c0430 con 0x55d8575b94d0 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.352+0000 7fb163fff640 1 -- 172.21.15.135:0/3810467168 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680c00b0 con 0x55d8575b94d0 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- 172.21.15.135:0/3810467168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 msgr2=0x55d857979b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857979b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1680ed2b0 tx=0x7fb1680bbfb0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- 172.21.15.135:0/3810467168 shutdown_connections 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857979b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b12f0 0x55d8579795c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 --2- 172.21.15.135:0/3810467168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575da1b0 0x55d857979080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- 172.21.15.135:0/3810467168 >> 172.21.15.135:0/3810467168 conn(0x55d8575ce300 msgr2=0x55d857975830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- 172.21.15.135:0/3810467168 shutdown_connections 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- 172.21.15.135:0/3810467168 wait complete. 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 -- start start 2024-05-20T17:43:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.353+0000 7fb186d63740 1 Processor -- start 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d8579851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857985720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d857983660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d857985f70 con 0x55d8575da1b0 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d857899790 con 0x55d8575b94d0 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8579860f0 con 0x55d8575b12f0 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 10 client.0 _ll_register_callbacks cb 0x55d8578d4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17e380640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d857983660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17e380640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d857983660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40290/0 (socket says 172.21.15.135:40290) 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17e380640 1 -- 172.21.15.135:0/3986064607 learned_addr learned my addr 172.21.15.135:0/3986064607 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857985720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17db7f640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d8579851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 -- 172.21.15.135:0/3986064607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 msgr2=0x55d8579851e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d8579851e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 -- 172.21.15.135:0/3986064607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 msgr2=0x55d857983660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d857983660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 -- 172.21.15.135:0/3986064607 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8575f2210 con 0x55d8575b94d0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb17d37e640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857985720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b8b00 tx=0x7fb168031f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c098cde0dd88ba70 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168049070 con 0x55d8575b94d0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1680c0430 con 0x55d8575b94d0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.354+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fb1680ed530 con 0x55d8575b94d0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb1680ba430 con 0x55d8575b94d0 2024-05-20T17:43:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 10 client.26321 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d8576be620 con 0x55d8575b94d0 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1680c0430 con 0x55d8575b94d0 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb1680bc490 con 0x55d8575b94d0 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 10 client.26321 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 10 client.26321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 20 client.26321 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d857598d80 0x55d8579955b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 4 client.26321 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8578eba70 con 0x55d857598d80 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb17db7f640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d857598d80 0x55d8579955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.355+0000 7fb1617fa640 10 client.26321 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb17db7f640 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d857598d80 0x55d8579955b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb2394274f1e1 server_cookie=8785c0231dfdc9ac in_seq=0 out_seq=0 2024-05-20T17:43:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb1617fa640 1 -- 172.21.15.135:0/3986064607 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d8578eba70 con 0x55d857598d80 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb1617fa640 10 client.26321 handle_command_reply: tid=0 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 client.26321 shutdown 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 msgr2=0x55d857985720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857985720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b8b00 tx=0x7fb168031f60 comp rx=0 tx=0).stop 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 shutdown_connections 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d857598d80 0x55d8579955b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d857983660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b94d0 0x55d857985720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 --2- 172.21.15.135:0/3986064607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d8579851e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb1617fa640 0 client.26321 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.356+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 >> 172.21.15.135:0/3986064607 conn(0x55d8575ce300 msgr2=0x55d85797ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.357+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 shutdown_connections 2024-05-20T17:43:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.357+0000 7fb186d63740 1 -- 172.21.15.135:0/3986064607 wait complete. 2024-05-20T17:43:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.357+0000 7fb186d63740 20 client.26321 trim_cache size 0 max 16384 2024-05-20T17:43:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 Processor -- start 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 -- start start 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d85797b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 0x55d85799b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781b3870 con 0x55d8575b94d0 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781b1080 con 0x55d8575da1b0 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb186d63740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781aeef0 con 0x55d8575b12f0 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40292/0 (socket says 172.21.15.135:40292) 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb17d37e640 1 -- 172.21.15.135:0/2900810082 learned_addr learned my addr 172.21.15.135:0/2900810082 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb17db7f640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d85797b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.372+0000 7fb17e380640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 0x55d85799b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 -- 172.21.15.135:0/2900810082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 msgr2=0x55d85797b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d85797b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 -- 172.21.15.135:0/2900810082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 msgr2=0x55d85799b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 0x55d85799b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 -- 172.21.15.135:0/2900810082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d857976400 con 0x55d8575b94d0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17db7f640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d85797b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17e380640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 0x55d85799b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb17d37e640 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb1680bc2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e425ef015f9a6f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb1637fe640 1 -- 172.21.15.135:0/2900810082 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168049070 con 0x55d8575b94d0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb1637fe640 1 -- 172.21.15.135:0/2900810082 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1680c4cf0 con 0x55d8575b94d0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.373+0000 7fb1637fe640 1 -- 172.21.15.135:0/2900810082 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680b87a0 con 0x55d8575b94d0 2024-05-20T17:43:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- 172.21.15.135:0/2900810082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 msgr2=0x55d85799abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb1680bc2b0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- 172.21.15.135:0/2900810082 shutdown_connections 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575da1b0 0x55d85799b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575b94d0 0x55d85799abe0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 --2- 172.21.15.135:0/2900810082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b12f0 0x55d85797b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- 172.21.15.135:0/2900810082 >> 172.21.15.135:0/2900810082 conn(0x55d8575ce300 msgr2=0x55d85797ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- 172.21.15.135:0/2900810082 shutdown_connections 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- 172.21.15.135:0/2900810082 wait complete. 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 -- start start 2024-05-20T17:43:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.374+0000 7fb186d63740 1 Processor -- start 2024-05-20T17:43:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 0x55d857986cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d8579f5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781af540 con 0x55d8575da1b0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781b09b0 con 0x55d8575b12f0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781afc10 con 0x55d8575b94d0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb186d63740 10 client.0 _ll_register_callbacks cb 0x7fb174009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17e380640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d8579f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:55094/0 (socket says 172.21.15.135:55094) 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17e380640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d8579f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40298/0 (socket says 172.21.15.135:40298) 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17d37e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 0x55d857986cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 -- 172.21.15.135:0/1269953493 learned_addr learned my addr 172.21.15.135:0/1269953493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 -- 172.21.15.135:0/1269953493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 msgr2=0x55d857986cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 0x55d857986cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 -- 172.21.15.135:0/1269953493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 msgr2=0x55d8579f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d8579f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 -- 172.21.15.135:0/1269953493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8579f5cc0 con 0x55d8575b12f0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17d37e640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 0x55d857986cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb17db7f640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55d85797a430 tx=0x7fb174010c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ec33e18ad51373 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.375+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17401fc60 con 0x55d8575b12f0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1680c4cf0 con 0x55d8575b12f0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fb17401fe00 con 0x55d8575b12f0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb17402f050 con 0x55d8575b12f0 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 10 client.26327 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d8579fcff0 con 0x55d8575b12f0 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1680c4cf0 con 0x55d8575b12f0 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb1740048c0 con 0x55d8575b12f0 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 10 client.26327 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 10 client.26327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 20 client.26327 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d85756e1c0 0x55d8579ff860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 4 client.26327 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8578e5dc0 con 0x55d85756e1c0 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.376+0000 7fb17d37e640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d85756e1c0 0x55d8579ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.377+0000 7fb1617fa640 10 client.26327 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.377+0000 7fb17d37e640 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d85756e1c0 0x55d8579ff860 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3883ab4fb6ba3265 server_cookie=77d94a9cd5ffab90 in_seq=0 out_seq=0 2024-05-20T17:43:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.393+0000 7fb1617fa640 1 -- 172.21.15.135:0/1269953493 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8578e5dc0 con 0x55d85756e1c0 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.393+0000 7fb1617fa640 10 client.26327 handle_command_reply: tid=0 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.393+0000 7fb186d63740 1 client.26327 shutdown 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.393+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 msgr2=0x55d857986790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.393+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55d85797a430 tx=0x7fb174010c50 comp rx=0 tx=0).stop 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 shutdown_connections 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d85756e1c0 0x55d8579ff860 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8575da1b0 0x55d8579f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8575b94d0 0x55d857986cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 --2- 172.21.15.135:0/1269953493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8575b12f0 0x55d857986790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb1617fa640 0 client.26327 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 >> 172.21.15.135:0/1269953493 conn(0x55d8575ce300 msgr2=0x55d85797b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 shutdown_connections 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 1 -- 172.21.15.135:0/1269953493 wait complete. 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb186d63740 20 client.26327 trim_cache size 0 max 16384 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:43:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:43:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:43:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:43:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 msgr2=0x7fb1640a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 0x7fb1640a5200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55d8579761f0 tx=0x7fb170004ab0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 msgr2=0x7fb1780fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb16802a930 tx=0x7fb168003b90 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 shutdown_connections 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb1640a2cf0 0x7fb1640a5200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178107ed0 0x7fb1780fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178107a30 0x7fb1780fdc30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 --2- 172.21.15.135:0/2287083802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb178102190 0x7fb1780fd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.394+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 >> 172.21.15.135:0/2287083802 conn(0x7fb1780fd210 msgr2=0x7fb1780ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.395+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 shutdown_connections 2024-05-20T17:43:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:33.395+0000 7fb17fde3640 1 -- 172.21.15.135:0/2287083802 wait complete. 2024-05-20T17:43:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:33 smithi172 ceph-mon[36511]: pgmap v316: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 962 KiB/s wr, 259 op/s 2024-05-20T17:43:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:33 smithi135 ceph-mon[32027]: pgmap v316: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 962 KiB/s wr, 259 op/s 2024-05-20T17:43:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:33 smithi160 ceph-mon[36261]: pgmap v316: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 962 KiB/s wr, 259 op/s 2024-05-20T17:43:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:35 smithi172 ceph-mon[36511]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-20T17:43:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:35 smithi135 ceph-mon[32027]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-20T17:43:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:35 smithi160 ceph-mon[36261]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-05-20T17:43:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:37 smithi172 ceph-mon[36511]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 285 op/s 2024-05-20T17:43:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:37 smithi135 ceph-mon[32027]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 285 op/s 2024-05-20T17:43:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:37 smithi160 ceph-mon[36261]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 285 op/s 2024-05-20T17:43:39.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:39 smithi135 ceph-mon[32027]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-20T17:43:39.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:39 smithi135 ceph-mon[32027]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:43:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:39 smithi160 ceph-mon[36261]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-20T17:43:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:39 smithi160 ceph-mon[36261]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:43:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:39 smithi172 ceph-mon[36511]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 397 op/s 2024-05-20T17:43:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:39 smithi172 ceph-mon[36511]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:43:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:41 smithi135 ceph-mon[32027]: pgmap v321: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 389 op/s 2024-05-20T17:43:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:41 smithi160 ceph-mon[36261]: pgmap v321: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 389 op/s 2024-05-20T17:43:41.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:41 smithi172 ceph-mon[36511]: pgmap v321: 97 pgs: 97 active+clean; 2.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 389 op/s 2024-05-20T17:43:43.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:43 smithi135 ceph-mon[32027]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 438 op/s 2024-05-20T17:43:43.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:43 smithi160 ceph-mon[36261]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 438 op/s 2024-05-20T17:43:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:43 smithi172 ceph-mon[36511]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 438 op/s 2024-05-20T17:43:45.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:45 smithi160 ceph-mon[36261]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 434 op/s 2024-05-20T17:43:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:45 smithi172 ceph-mon[36511]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 434 op/s 2024-05-20T17:43:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:45 smithi135 ceph-mon[32027]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 434 op/s 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 -- 172.21.15.135:0/162526365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60102170 msgr2=0x7fad6010e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 --2- 172.21.15.135:0/162526365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60102170 0x7fad6010e4a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad58009ca0 tx=0x7fad5802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 -- 172.21.15.135:0/162526365 shutdown_connections 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 --2- 172.21.15.135:0/162526365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60102170 0x7fad6010e4a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 --2- 172.21.15.135:0/162526365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107eb0 0x7fad60101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 --2- 172.21.15.135:0/162526365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60107a10 0x7fad601015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 -- 172.21.15.135:0/162526365 >> 172.21.15.135:0/162526365 conn(0x7fad60077160 msgr2=0x7fad600775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 -- 172.21.15.135:0/162526365 shutdown_connections 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.494+0000 7fad65ad7640 1 -- 172.21.15.135:0/162526365 wait complete. 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 Processor -- start 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 -- start start 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 0x7fad60198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107a10 0x7fad60198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad60111d80 con 0x7fad60107eb0 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad60111c00 con 0x7fad60102170 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad65ad7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad60111f00 con 0x7fad60107a10 2024-05-20T17:43:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 0x7fad60198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36058/0 (socket says 172.21.15.135:36058) 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.495+0000 7fad5ffff640 1 -- 172.21.15.135:0/3512010331 learned_addr learned my addr 172.21.15.135:0/3512010331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad57fff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107a10 0x7fad60198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 -- 172.21.15.135:0/3512010331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107a10 msgr2=0x7fad60198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107a10 0x7fad60198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 -- 172.21.15.135:0/3512010331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 msgr2=0x7fad60198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 0x7fad60198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 -- 172.21.15.135:0/3512010331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6019d560 con 0x7fad60107eb0 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 0x7fad60198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5ffff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad58031a20 tx=0x7fad58031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5d7fa640 1 -- 172.21.15.135:0/3512010331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58003c30 con 0x7fad60107eb0 2024-05-20T17:43:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5d7fa640 1 -- 172.21.15.135:0/3512010331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad58003dd0 con 0x7fad60107eb0 2024-05-20T17:43:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6019d7f0 con 0x7fad60107eb0 2024-05-20T17:43:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad5d7fa640 1 -- 172.21.15.135:0/3512010331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5802fc40 con 0x7fad60107eb0 2024-05-20T17:43:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.496+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601a51d0 con 0x7fad60107eb0 2024-05-20T17:43:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad5d7fa640 1 -- 172.21.15.135:0/3512010331 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fad58004050 con 0x7fad60107eb0 2024-05-20T17:43:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 Processor -- start 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 -- start start 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 0x55bbad25f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bbad1c4340 con 0x55bbace9f4d0 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bbad16c290 con 0x55bbacec01b0 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad6c976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bbad1c0300 con 0x55bbace972f0 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36074/0 (socket says 172.21.15.135:36074) 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad57fff640 1 -- 172.21.15.135:0/3837413641 learned_addr learned my addr 172.21.15.135:0/3837413641 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad5d7fa640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 0x7fad4c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad57fff640 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 0x55bbad25f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.499+0000 7fad5ffff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 0x7fad4c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 -- 172.21.15.135:0/3837413641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 msgr2=0x55bbad25f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 -- 172.21.15.135:0/3837413641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 msgr2=0x55bbad25fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 -- 172.21.15.135:0/3837413641 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbad1908e0 con 0x55bbacec01b0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad5d7fa640 1 -- 172.21.15.135:0/3512010331 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fad580f0550 con 0x7fad60107eb0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad57fff640 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 0x55bbad25f080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad48005d80 tx=0x7fad48005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5590adbdc4e2cbe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad5ffff640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 0x7fad4c0a5280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad580bca00 tx=0x7fad5802a8c0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad55ffb640 1 -- 172.21.15.135:0/3837413641 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48005220 con 0x55bbacec01b0 2024-05-20T17:43:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad55ffb640 1 -- 172.21.15.135:0/3837413641 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad48004c80 con 0x55bbacec01b0 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.500+0000 7fad55ffb640 1 -- 172.21.15.135:0/3837413641 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48010b50 con 0x55bbacec01b0 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- 172.21.15.135:0/3837413641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 msgr2=0x55bbad25f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 0x55bbad25f080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad48005d80 tx=0x7fad48005850 comp rx=0 tx=0).stop 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- 172.21.15.135:0/3837413641 shutdown_connections 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 --2- 172.21.15.135:0/3837413641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbacec01b0 0x55bbad25f080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- 172.21.15.135:0/3837413641 >> 172.21.15.135:0/3837413641 conn(0x55bbaceb4300 msgr2=0x55bbad25b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- 172.21.15.135:0/3837413641 shutdown_connections 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- 172.21.15.135:0/3837413641 wait complete. 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 -- start start 2024-05-20T17:43:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.501+0000 7fad6c976740 1 Processor -- start 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 0x55bbad26b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad2695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bbad26c1b0 con 0x55bbacec01b0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bbad17f790 con 0x55bbace972f0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bbad26c330 con 0x55bbace9f4d0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad6c976740 10 client.0 _ll_register_callbacks cb 0x55bbad1baa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:46712/0 (socket says 172.21.15.135:46712) 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 -- 172.21.15.135:0/3347020756 learned_addr learned my addr 172.21.15.135:0/3347020756 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad2695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 0x55bbad26b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 -- 172.21.15.135:0/3347020756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 msgr2=0x55bbad26b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 0x55bbad26b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 -- 172.21.15.135:0/3347020756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 msgr2=0x55bbad2695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad2695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 -- 172.21.15.135:0/3347020756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbaced8210 con 0x55bbace972f0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 0x55bbad26b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad57fff640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55bbad222bf0 tx=0x7fad48010810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41716f47f6bd0ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.502+0000 7fad3effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48013030 con 0x55bbace972f0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fad480131d0 con 0x55bbace972f0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad48004c80 con 0x55bbace972f0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad48032050 con 0x55bbace972f0 2024-05-20T17:43:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 10 client.26339 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bbacfa4620 con 0x55bbace972f0 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad48004c80 con 0x55bbace972f0 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fad4800f040 con 0x55bbace972f0 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 10 client.26339 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 10 client.26339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 20 client.26339 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace7ed80 0x55bbad27b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 4 client.26339 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:43:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbad1d1a70 con 0x55bbace7ed80 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.503+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace7ed80 0x55bbad27b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.504+0000 7fad3effd640 10 client.26339 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.504+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace7ed80 0x55bbad27b8c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288a595403b47b2a server_cookie=4c7e597c4451a6e7 in_seq=0 out_seq=0 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad3effd640 1 -- 172.21.15.135:0/3347020756 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bbad1d1a70 con 0x55bbace7ed80 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad3effd640 10 client.26339 handle_command_reply: tid=0 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 client.26339 shutdown 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 msgr2=0x55bbad26b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55bbad222bf0 tx=0x7fad48010810 comp rx=0 tx=0).stop 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 shutdown_connections 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace7ed80 0x55bbad27b8c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad2695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace9f4d0 0x55bbad26b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad3effd640 0 client.26339 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 --2- 172.21.15.135:0/3347020756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad26b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.505+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 >> 172.21.15.135:0/3347020756 conn(0x55bbaceb4300 msgr2=0x55bbad25eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.506+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 shutdown_connections 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.506+0000 7fad6c976740 1 -- 172.21.15.135:0/3347020756 wait complete. 2024-05-20T17:43:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.506+0000 7fad6c976740 20 client.26339 trim_cache size 0 max 16384 2024-05-20T17:43:46.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 Processor -- start 2024-05-20T17:43:46.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 -- start start 2024-05-20T17:43:46.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace9f4d0 0x55bbad2717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad601b03d0 con 0x55bbacec01b0 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad601adbe0 con 0x55bbace9f4d0 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad6c976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad601aba50 con 0x55bbace972f0 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36092/0 (socket says 172.21.15.135:36092) 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 -- 172.21.15.135:0/3620659836 learned_addr learned my addr 172.21.15.135:0/3620659836 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace9f4d0 0x55bbad2717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 -- 172.21.15.135:0/3620659836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 msgr2=0x55bbad25b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 -- 172.21.15.135:0/3620659836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace9f4d0 msgr2=0x55bbad2717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace9f4d0 0x55bbad2717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 -- 172.21.15.135:0/3620659836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbad256ba0 con 0x55bbacec01b0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.521+0000 7fad57fff640 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fad480107e0 tx=0x7fad48010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a2d13f1224110e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad557fa640 1 -- 172.21.15.135:0/3620659836 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48004c80 con 0x55bbacec01b0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad557fa640 1 -- 172.21.15.135:0/3620659836 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad480057f0 con 0x55bbacec01b0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad557fa640 1 -- 172.21.15.135:0/3620659836 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad480048c0 con 0x55bbacec01b0 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 -- 172.21.15.135:0/3620659836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 msgr2=0x55bbad280fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fad480107e0 tx=0x7fad48010880 comp rx=0 tx=0).stop 2024-05-20T17:43:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 -- 172.21.15.135:0/3620659836 shutdown_connections 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbacec01b0 0x55bbad280fc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace9f4d0 0x55bbad2717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 --2- 172.21.15.135:0/3620659836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbace972f0 0x55bbad25b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 -- 172.21.15.135:0/3620659836 >> 172.21.15.135:0/3620659836 conn(0x55bbaceb4300 msgr2=0x55bbad25b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 -- 172.21.15.135:0/3620659836 shutdown_connections 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.522+0000 7fad6c976740 1 -- 172.21.15.135:0/3620659836 wait complete. 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 -- start start 2024-05-20T17:43:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 Processor -- start 2024-05-20T17:43:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad25a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbacec01b0 0x55bbad2e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ac0a0 con 0x55bbace9f4d0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ad510 con 0x55bbace972f0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ac770 con 0x55bbacec01b0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad6c976740 10 client.0 _ll_register_callbacks cb 0x7fad4800e8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36106/0 (socket says 172.21.15.135:36106) 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad5f7fe640 1 -- 172.21.15.135:0/3447390573 learned_addr learned my addr 172.21.15.135:0/3447390573 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.523+0000 7fad57fff640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad25a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad57fff640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbacec01b0 0x55bbad2e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 -- 172.21.15.135:0/3447390573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbacec01b0 msgr2=0x55bbad2e3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbacec01b0 0x55bbad2e3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 -- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 msgr2=0x55bbad25a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad25a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 -- 172.21.15.135:0/3447390573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbad25b1f0 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad5f7fe640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fad50009fd0 tx=0x7fad500207d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed81e0d41d9b3f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad3effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50004050 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fad500041f0 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad480057f0 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad50032050 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad6c976740 10 client.16764 fetch_fsmap learned FSMap version 30 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bbad2e51c0 con 0x55bbace9f4d0 2024-05-20T17:43:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.524+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad480057f0 con 0x55bbace9f4d0 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fad50022120 con 0x55bbace9f4d0 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 10 client.16764 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 10 client.16764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 20 client.16764 populate_metadata read hostname 'smithi135' 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace541c0 0x55bbad2e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 4 client.16764 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bbad1cbdc0 con 0x55bbace541c0 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad57fff640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace541c0 0x55bbad2e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad3effd640 10 client.16764 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:46.525+0000 7fad57fff640 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace541c0 0x55bbad2e79e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9d52fb9cf265d4 server_cookie=ae190ad723cbe6eb in_seq=0 out_seq=0 2024-05-20T17:43:47.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:47 smithi160 ceph-mon[36261]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 406 op/s 2024-05-20T17:43:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:47 smithi172 ceph-mon[36511]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 406 op/s 2024-05-20T17:43:47.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:47 smithi135 ceph-mon[32027]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 406 op/s 2024-05-20T17:43:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:49 smithi160 ceph-mon[36261]: pgmap v325: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 327 op/s 2024-05-20T17:43:49.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:49 smithi172 ceph-mon[36511]: pgmap v325: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 327 op/s 2024-05-20T17:43:49.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:49 smithi135 ceph-mon[32027]: pgmap v325: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 327 op/s 2024-05-20T17:43:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:51 smithi160 ceph-mon[36261]: pgmap v326: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-05-20T17:43:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:51 smithi172 ceph-mon[36511]: pgmap v326: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-05-20T17:43:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:51 smithi135 ceph-mon[32027]: pgmap v326: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-05-20T17:43:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad3effd640 1 -- 172.21.15.135:0/3447390573 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bbad1cbdc0 con 0x55bbace541c0 2024-05-20T17:43:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad3effd640 10 client.16764 handle_command_reply: tid=0 2024-05-20T17:43:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 client.16764 shutdown 2024-05-20T17:43:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 msgr2=0x55bbad25a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fad50009fd0 tx=0x7fad500207d0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 shutdown_connections 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55bbace541c0 0x55bbad2e79e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbacec01b0 0x55bbad2e3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbace9f4d0 0x55bbad25a920 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad3effd640 0 client.16764 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 --2- 172.21.15.135:0/3447390573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbace972f0 0x55bbad25a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 >> 172.21.15.135:0/3447390573 conn(0x55bbaceb4300 msgr2=0x55bbad26ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 shutdown_connections 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 1 -- 172.21.15.135:0/3447390573 wait complete. 2024-05-20T17:43:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.107+0000 7fad6c976740 20 client.16764 trim_cache size 0 max 16384 2024-05-20T17:43:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:43:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:43:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:43:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.108+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 msgr2=0x7fad4c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.108+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 0x7fad4c0a5280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad580bca00 tx=0x7fad5802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.108+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 msgr2=0x7fad6019cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.108+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad58031a20 tx=0x7fad58031a50 comp rx=0 tx=0).stop 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 shutdown_connections 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad4c0a2d70 0x7fad4c0a5280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad60107eb0 0x7fad6019cf20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad60107a10 0x7fad60198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 --2- 172.21.15.135:0/3512010331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad60102170 0x7fad60198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:43:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.109+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 >> 172.21.15.135:0/3512010331 conn(0x7fad60077160 msgr2=0x7fad600ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:43:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.110+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 shutdown_connections 2024-05-20T17:43:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:43:53.110+0000 7fad65ad7640 1 -- 172.21.15.135:0/3512010331 wait complete. 2024-05-20T17:43:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:53 smithi160 ceph-mon[36261]: pgmap v327: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 1.08k op/s 2024-05-20T17:43:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:53 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:43:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:53 smithi172 ceph-mon[36511]: pgmap v327: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 1.08k op/s 2024-05-20T17:43:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:53 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:43:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:53 smithi135 ceph-mon[32027]: pgmap v327: 97 pgs: 97 active+clean; 2.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 1.08k op/s 2024-05-20T17:43:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:53 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: pgmap v328: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 1.44k op/s 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:55 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: pgmap v328: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 1.44k op/s 2024-05-20T17:43:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:55.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:55 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:56.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: pgmap v328: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 1.44k op/s 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:56.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:55 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:43:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:43:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:56.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:56 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:43:57.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:56 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi135 to 176.1M 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi135 to 184753766: error parsing value: Value '184753766' is below minimum 939524096 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:56 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:57 smithi135 ceph-mon[32027]: pgmap v329: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 1.49k op/s 2024-05-20T17:43:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:57 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:43:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:57 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:43:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:57 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:57 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:58.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:57 smithi160 ceph-mon[36261]: pgmap v329: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 1.49k op/s 2024-05-20T17:43:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:57 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:43:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:57 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:43:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:57 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:58.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:57 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:57 smithi172 ceph-mon[36511]: pgmap v329: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 1.49k op/s 2024-05-20T17:43:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:57 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi160 to 176.2M 2024-05-20T17:43:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:57 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi160 to 184786739: error parsing value: Value '184786739' is below minimum 939524096 2024-05-20T17:43:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:57 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:58.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:57 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:58.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:58.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:43:58.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:43:58.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:58 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:59.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:43:59.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:43:59.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:58 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:43:59.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:58 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:43:59.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:59 smithi135 ceph-mon[32027]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:43:59.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:59 smithi135 ceph-mon[32027]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:43:59.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:43:59 smithi135 ceph-mon[32027]: pgmap v330: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 1.75k op/s 2024-05-20T17:44:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:59 smithi160 ceph-mon[36261]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:44:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:59 smithi160 ceph-mon[36261]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:44:00.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:43:59 smithi160 ceph-mon[36261]: pgmap v330: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 1.75k op/s 2024-05-20T17:44:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:59 smithi172 ceph-mon[36511]: Adjusting osd_memory_target on smithi172 to 176.2M 2024-05-20T17:44:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:59 smithi172 ceph-mon[36511]: Unable to set osd_memory_target on smithi172 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-20T17:44:00.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:43:59 smithi172 ceph-mon[36511]: pgmap v330: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 1.75k op/s 2024-05-20T17:44:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:00 smithi135 ceph-mon[32027]: pgmap v331: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.8 MiB/s wr, 1.69k op/s 2024-05-20T17:44:01.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:00 smithi160 ceph-mon[36261]: pgmap v331: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.8 MiB/s wr, 1.69k op/s 2024-05-20T17:44:01.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:00 smithi172 ceph-mon[36511]: pgmap v331: 97 pgs: 97 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.8 MiB/s wr, 1.69k op/s 2024-05-20T17:44:03.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:03 smithi172 ceph-mon[36511]: pgmap v332: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-05-20T17:44:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:03 smithi135 ceph-mon[32027]: pgmap v332: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-05-20T17:44:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:03 smithi160 ceph-mon[36261]: pgmap v332: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-05-20T17:44:05.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:05 smithi172 ceph-mon[36511]: pgmap v333: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 964 op/s 2024-05-20T17:44:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:05 smithi135 ceph-mon[32027]: pgmap v333: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 964 op/s 2024-05-20T17:44:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:05 smithi160 ceph-mon[36261]: pgmap v333: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 964 op/s 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 -- 172.21.15.135:0/515163713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc110100 msgr2=0x7f43dc110510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 --2- 172.21.15.135:0/515163713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc110100 0x7f43dc110510 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009860 tx=0x7f43d802a360 comp rx=0 tx=0).stop 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 -- 172.21.15.135:0/515163713 shutdown_connections 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 --2- 172.21.15.135:0/515163713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc10f4d0 0x7f43dc116cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 --2- 172.21.15.135:0/515163713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43dc10ea10 0x7f43dc10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 --2- 172.21.15.135:0/515163713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc110100 0x7f43dc110510 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 -- 172.21.15.135:0/515163713 >> 172.21.15.135:0/515163713 conn(0x7f43dc06d780 msgr2=0x7f43dc06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 -- 172.21.15.135:0/515163713 shutdown_connections 2024-05-20T17:44:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.237+0000 7f43e3f79640 1 -- 172.21.15.135:0/515163713 wait complete. 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.238+0000 7f43e3f79640 1 Processor -- start 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.238+0000 7f43e3f79640 1 -- start start 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.238+0000 7f43e3f79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43dc10ea10 0x7f43dc1a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.238+0000 7f43e3f79640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc10f4d0 0x7f43dc1a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e3f79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e3f79640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc11a5e0 con 0x7f43dc110100 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e3f79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc11a460 con 0x7f43dc10ea10 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e3f79640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc11a760 con 0x7f43dc10f4d0 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47670/0 (socket says 172.21.15.135:47670) 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 -- 172.21.15.135:0/1120310952 learned_addr learned my addr 172.21.15.135:0/1120310952 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e1514640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc10f4d0 0x7f43dc1a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 -- 172.21.15.135:0/1120310952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc10f4d0 msgr2=0x7f43dc1a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc10f4d0 0x7f43dc1a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 -- 172.21.15.135:0/1120310952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43dc10ea10 msgr2=0x7f43dc1a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43dc10ea10 0x7f43dc1a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 -- 172.21.15.135:0/1120310952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1ae2b0 con 0x7f43dc110100 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.239+0000 7f43e2516640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f43d400efc0 tx=0x7f43d400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.240+0000 7f43ceffd640 1 -- 172.21.15.135:0/1120310952 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4003970 con 0x7f43dc110100 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.240+0000 7f43ceffd640 1 -- 172.21.15.135:0/1120310952 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d4004020 con 0x7f43dc110100 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.240+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1ae5a0 con 0x7f43dc110100 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.240+0000 7f43ceffd640 1 -- 172.21.15.135:0/1120310952 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d400b9f0 con 0x7f43dc110100 2024-05-20T17:44:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.240+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1aeaf0 con 0x7f43dc110100 2024-05-20T17:44:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.242+0000 7f43ceffd640 1 -- 172.21.15.135:0/1120310952 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f43d401d020 con 0x7f43dc110100 2024-05-20T17:44:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.243+0000 7f43ceffd640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 0x7f43c80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.243+0000 7f43ceffd640 1 -- 172.21.15.135:0/1120310952 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f43d40cf360 con 0x7f43dc110100 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.243+0000 7f43e1d15640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 0x7f43c80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.243+0000 7f43eae1c740 1 Processor -- start 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 -- start start 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 0x55ded21ea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1d15640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 0x7f43c80a5280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43d80095f0 tx=0x7f43d80303d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded21eab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ded214f340 con 0x55ded1e222f0 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ded20f7290 con 0x55ded1e4b1b0 2024-05-20T17:44:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43eae1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ded214b300 con 0x55ded1e2a4d0 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1514640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1d15640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 0x55ded21ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1514640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47674/0 (socket says 172.21.15.135:47674) 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1514640 1 -- 172.21.15.135:0/2130751923 learned_addr learned my addr 172.21.15.135:0/2130751923 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e2516640 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded21eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1514640 1 -- 172.21.15.135:0/2130751923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 msgr2=0x55ded21eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.244+0000 7f43e1514640 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded21eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43e1514640 1 -- 172.21.15.135:0/2130751923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 msgr2=0x55ded21ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43e1514640 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 0x55ded21ea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43e1514640 1 -- 172.21.15.135:0/2130751923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded211b8e0 con 0x55ded1e222f0 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43e1d15640 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 0x55ded21ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43e1514640 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43d00099f0 tx=0x7f43d0009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab476f171094989 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43c7fff640 1 -- 172.21.15.135:0/2130751923 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017070 con 0x55ded1e222f0 2024-05-20T17:44:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43c7fff640 1 -- 172.21.15.135:0/2130751923 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0013470 con 0x55ded1e222f0 2024-05-20T17:44:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.245+0000 7f43c7fff640 1 -- 172.21.15.135:0/2130751923 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0012610 con 0x55ded1e222f0 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 -- 172.21.15.135:0/2130751923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 msgr2=0x55ded21ea5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43d00099f0 tx=0x7f43d0009eb0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 -- 172.21.15.135:0/2130751923 shutdown_connections 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded21eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e222f0 0x55ded21ea5c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2130751923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e4b1b0 0x55ded21ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.246+0000 7f43eae1c740 1 -- 172.21.15.135:0/2130751923 >> 172.21.15.135:0/2130751923 conn(0x55ded1e3f300 msgr2=0x55ded21e6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.247+0000 7f43eae1c740 1 -- 172.21.15.135:0/2130751923 shutdown_connections 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.247+0000 7f43eae1c740 1 -- 172.21.15.135:0/2130751923 wait complete. 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.247+0000 7f43eae1c740 1 -- start start 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.247+0000 7f43eae1c740 1 Processor -- start 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e2a4d0 0x55ded21f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e09d80 0x55ded21f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ded21f71b0 con 0x55ded1e4b1b0 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47680/0 (socket says 172.21.15.135:47680) 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 -- 172.21.15.135:0/62890485 learned_addr learned my addr 172.21.15.135:0/62890485 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ded210a790 con 0x55ded1e2a4d0 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ded21f7330 con 0x55ded1e09d80 2024-05-20T17:44:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43eae1c740 10 client.0 _ll_register_callbacks cb 0x55ded2145a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1d15640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e2a4d0 0x55ded21f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e2516640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e09d80 0x55ded21f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 -- 172.21.15.135:0/62890485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e09d80 msgr2=0x55ded21f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e09d80 0x55ded21f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 -- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e2a4d0 msgr2=0x55ded21f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e2a4d0 0x55ded21f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.248+0000 7f43e1514640 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded1e63210 con 0x55ded1e4b1b0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43e1514640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55ded21e7b70 tx=0x7f43d0013b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658c366c1a6374a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017050 con 0x55ded1e4b1b0 2024-05-20T17:44:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f43d001c450 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d0013470 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f43d001c650 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43eae1c740 10 client.16776 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.249+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ded1f2f620 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0013470 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f43d00307d0 con 0x55ded1e4b1b0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 10 client.16776 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 10 client.16776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 20 client.16776 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1ddf1c0 0x55ded22069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 4 client.16776 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded215ca70 con 0x55ded1ddf1c0 2024-05-20T17:44:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.250+0000 7f43e1d15640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1ddf1c0 0x55ded22069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.251+0000 7f43c57fa640 10 client.16776 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.251+0000 7f43e1d15640 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1ddf1c0 0x55ded22069a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16cd179b8a920ed server_cookie=cc9ef2a7fc217ef1 in_seq=0 out_seq=0 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43c57fa640 1 -- 172.21.15.135:0/62890485 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ded215ca70 con 0x55ded1ddf1c0 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43c57fa640 10 client.16776 handle_command_reply: tid=0 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 client.16776 shutdown 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 msgr2=0x55ded21f6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55ded21e7b70 tx=0x7f43d0013b20 comp rx=0 tx=0).stop 2024-05-20T17:44:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 shutdown_connections 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1ddf1c0 0x55ded22069a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e09d80 0x55ded21f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e4b1b0 0x55ded21f6720 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 --2- 172.21.15.135:0/62890485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e2a4d0 0x55ded21f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43c57fa640 0 client.16776 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 >> 172.21.15.135:0/62890485 conn(0x55ded1e3f300 msgr2=0x55ded21ebda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 shutdown_connections 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.253+0000 7f43eae1c740 1 -- 172.21.15.135:0/62890485 wait complete. 2024-05-20T17:44:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.254+0000 7f43eae1c740 20 client.16776 trim_cache size 0 max 16384 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 Processor -- start 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 -- start start 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1ddf1c0 0x55ded21eae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded21edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b9d60 con 0x55ded1e2a4d0 2024-05-20T17:44:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b7570 con 0x55ded1e09d80 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43eae1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b53e0 con 0x55ded1ddf1c0 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.279+0000 7f43e2516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47694/0 (socket says 172.21.15.135:47694) 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 -- 172.21.15.135:0/3586762116 learned_addr learned my addr 172.21.15.135:0/3586762116 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e1d15640 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1ddf1c0 0x55ded21eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 -- 172.21.15.135:0/3586762116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1ddf1c0 msgr2=0x55ded21eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1ddf1c0 0x55ded21eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 -- 172.21.15.135:0/3586762116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 msgr2=0x55ded21edd30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded21edd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 -- 172.21.15.135:0/3586762116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded21eb8d0 con 0x55ded1e2a4d0 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.280+0000 7f43e2516640 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f43d4098220 tx=0x7f43d409b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799b2f7e902b3b0c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.281+0000 7f43c77fe640 1 -- 172.21.15.135:0/3586762116 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40b9070 con 0x55ded1e2a4d0 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.281+0000 7f43c77fe640 1 -- 172.21.15.135:0/3586762116 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d40a44c0 con 0x55ded1e2a4d0 2024-05-20T17:44:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.281+0000 7f43c77fe640 1 -- 172.21.15.135:0/3586762116 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40b3030 con 0x55ded1e2a4d0 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 -- 172.21.15.135:0/3586762116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 msgr2=0x55ded21ee270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f43d4098220 tx=0x7f43d409b750 comp rx=0 tx=0).stop 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 -- 172.21.15.135:0/3586762116 shutdown_connections 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1e2a4d0 0x55ded21ee270 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded21edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 --2- 172.21.15.135:0/3586762116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1ddf1c0 0x55ded21eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.282+0000 7f43eae1c740 1 -- 172.21.15.135:0/3586762116 >> 172.21.15.135:0/3586762116 conn(0x55ded1e3f300 msgr2=0x55ded21e5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.283+0000 7f43eae1c740 1 -- 172.21.15.135:0/3586762116 shutdown_connections 2024-05-20T17:44:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.283+0000 7f43eae1c740 1 -- 172.21.15.135:0/3586762116 wait complete. 2024-05-20T17:44:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.283+0000 7f43eae1c740 1 -- start start 2024-05-20T17:44:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.284+0000 7f43eae1c740 1 Processor -- start 2024-05-20T17:44:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.284+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1ddf1c0 0x55ded226b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.284+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded226bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43eae1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded2265b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43eae1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b5a30 con 0x55ded1ddf1c0 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43eae1c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b6ea0 con 0x55ded1e09d80 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43eae1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b6100 con 0x55ded1e2a4d0 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43eae1c740 10 client.0 _ll_register_callbacks cb 0x7f43d8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e1514640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded226bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e1514640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded226bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:37374/0 (socket says 172.21.15.135:37374) 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e1514640 1 -- 172.21.15.135:0/2116260531 learned_addr learned my addr 172.21.15.135:0/2116260531 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded2265b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e1d15640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1ddf1c0 0x55ded226b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 -- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 msgr2=0x55ded226bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded226bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 -- 172.21.15.135:0/2116260531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1ddf1c0 msgr2=0x55ded226b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1ddf1c0 0x55ded226b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.285+0000 7f43e2516640 1 -- 172.21.15.135:0/2116260531 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded2266140 con 0x55ded1e2a4d0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43e2516640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded2265b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55ded21ebbb0 tx=0x7f43d40ccd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3978804146ab646 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40b3030 con 0x55ded1e2a4d0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d40a44c0 con 0x55ded1e2a4d0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f43d40ce070 con 0x55ded1e2a4d0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f43d40b9070 con 0x55ded1e2a4d0 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43eae1c740 10 client.26257 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.286+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ded2272df0 con 0x55ded1e2a4d0 2024-05-20T17:44:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.287+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d40a44c0 con 0x55ded1e2a4d0 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f43d4081070 con 0x55ded1e2a4d0 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 10 client.26257 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 10 client.26257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 20 client.26257 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1e4b1b0 0x55ded2275460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 4 client.26257 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ded2156dc0 con 0x55ded1e4b1b0 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.288+0000 7f43e1d15640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1e4b1b0 0x55ded2275460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.289+0000 7f43e1d15640 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1e4b1b0 0x55ded2275460 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343b68b4ffc19c32 server_cookie=f20fc6300afda44e in_seq=0 out_seq=0 2024-05-20T17:44:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.289+0000 7f43c57fa640 10 client.26257 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.424+0000 7f43c57fa640 1 -- 172.21.15.135:0/2116260531 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ded2156dc0 con 0x55ded1e4b1b0 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.424+0000 7f43c57fa640 10 client.26257 handle_command_reply: tid=0 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.424+0000 7f43eae1c740 1 client.26257 shutdown 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 msgr2=0x55ded2265b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded2265b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55ded21ebbb0 tx=0x7f43d40ccd00 comp rx=0 tx=0).stop 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 shutdown_connections 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55ded1e4b1b0 0x55ded2275460 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ded1e2a4d0 0x55ded2265b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ded1e09d80 0x55ded226bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43c57fa640 0 client.26257 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 --2- 172.21.15.135:0/2116260531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ded1ddf1c0 0x55ded226b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 >> 172.21.15.135:0/2116260531 conn(0x55ded1e3f300 msgr2=0x55ded21e9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 shutdown_connections 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 1 -- 172.21.15.135:0/2116260531 wait complete. 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.425+0000 7f43eae1c740 20 client.26257 trim_cache size 0 max 16384 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:44:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 msgr2=0x7f43c80a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 0x7f43c80a5280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43d80095f0 tx=0x7f43d80303d0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 msgr2=0x7f43dc1a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f43d400efc0 tx=0x7f43d400c800 comp rx=0 tx=0).stop 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 shutdown_connections 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f43c80a2d70 0x7f43c80a5280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43dc110100 0x7f43dc1a3a20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc10f4d0 0x7f43dc1a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 --2- 172.21.15.135:0/1120310952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43dc10ea10 0x7f43dc1a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 >> 172.21.15.135:0/1120310952 conn(0x7f43dc06d780 msgr2=0x7f43dc10a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 shutdown_connections 2024-05-20T17:44:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:06.426+0000 7f43e3f79640 1 -- 172.21.15.135:0/1120310952 wait complete. 2024-05-20T17:44:07.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:07 smithi172 ceph-mon[36511]: pgmap v334: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 459 op/s 2024-05-20T17:44:07.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:07 smithi135 ceph-mon[32027]: pgmap v334: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 459 op/s 2024-05-20T17:44:07.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:07 smithi160 ceph-mon[36261]: pgmap v334: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 459 op/s 2024-05-20T17:44:09.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:09 smithi172 ceph-mon[36511]: pgmap v335: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2024-05-20T17:44:09.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:09 smithi135 ceph-mon[32027]: pgmap v335: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2024-05-20T17:44:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:09 smithi160 ceph-mon[36261]: pgmap v335: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 454 op/s 2024-05-20T17:44:11.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:11 smithi172 ceph-mon[36511]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-05-20T17:44:11.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:11 smithi172 ceph-mon[36511]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:44:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:11 smithi135 ceph-mon[32027]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-05-20T17:44:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:11 smithi135 ceph-mon[32027]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:44:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:11 smithi160 ceph-mon[36261]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-05-20T17:44:11.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:11 smithi160 ceph-mon[36261]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:44:13.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:13 smithi172 ceph-mon[36511]: pgmap v338: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2024-05-20T17:44:13.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:13 smithi135 ceph-mon[32027]: pgmap v338: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2024-05-20T17:44:13.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:13 smithi160 ceph-mon[36261]: pgmap v338: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 256 op/s 2024-05-20T17:44:15.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:15 smithi135 ceph-mon[32027]: pgmap v339: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 259 op/s 2024-05-20T17:44:15.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:15 smithi160 ceph-mon[36261]: pgmap v339: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 259 op/s 2024-05-20T17:44:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:15 smithi172 ceph-mon[36511]: pgmap v339: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 259 op/s 2024-05-20T17:44:17.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:17 smithi135 ceph-mon[32027]: pgmap v340: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-05-20T17:44:17.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:17 smithi160 ceph-mon[36261]: pgmap v340: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-05-20T17:44:17.584 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:17 smithi172 ceph-mon[36511]: pgmap v340: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 267 op/s 2024-05-20T17:44:19.381 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:19 smithi172 ceph-mon[36511]: pgmap v341: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 250 op/s 2024-05-20T17:44:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:19 smithi135 ceph-mon[32027]: pgmap v341: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 250 op/s 2024-05-20T17:44:19.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:19 smithi160 ceph-mon[36261]: pgmap v341: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 250 op/s 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.555+0000 7f0abae61640 1 -- 172.21.15.135:0/1375334488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab410d550 msgr2=0x7f0ab410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.555+0000 7f0abae61640 1 --2- 172.21.15.135:0/1375334488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab410d550 0x7f0ab410f970 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ca0 tx=0x7f0aac02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 -- 172.21.15.135:0/1375334488 shutdown_connections 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 --2- 172.21.15.135:0/1375334488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab410d550 0x7f0ab410f970 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 --2- 172.21.15.135:0/1375334488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab4101050 0x7f0ab4101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 --2- 172.21.15.135:0/1375334488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4108ba0 0x7f0ab4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 -- 172.21.15.135:0/1375334488 >> 172.21.15.135:0/1375334488 conn(0x7f0ab4076860 msgr2=0x7f0ab4076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 -- 172.21.15.135:0/1375334488 shutdown_connections 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.556+0000 7f0abae61640 1 -- 172.21.15.135:0/1375334488 wait complete. 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 Processor -- start 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 -- start start 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab4108ba0 0x7f0ab406d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab410d550 0x7f0ab406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab406bbf0 con 0x7f0ab4108ba0 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab406ba70 con 0x7f0ab4101050 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.557+0000 7f0abae61640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab406bd70 con 0x7f0ab410d550 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:54334/0 (socket says 172.21.15.135:54334) 2024-05-20T17:44:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 -- 172.21.15.135:0/2953064547 learned_addr learned my addr 172.21.15.135:0/2953064547 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab410d550 0x7f0ab406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab4108ba0 0x7f0ab406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 -- 172.21.15.135:0/2953064547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab410d550 msgr2=0x7f0ab406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab410d550 0x7f0ab406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 -- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab4108ba0 msgr2=0x7f0ab406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab4108ba0 0x7f0ab406d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.558+0000 7f0ab8bfd640 1 -- 172.21.15.135:0/2953064547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab406e390 con 0x7f0ab4101050 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800e980 tx=0x7f0aa800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0ab1ffb640 1 -- 172.21.15.135:0/2953064547 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800cd80 con 0x7f0ab4101050 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab41ae530 con 0x7f0ab4101050 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0ab1ffb640 1 -- 172.21.15.135:0/2953064547 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa8010910 con 0x7f0ab4101050 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab41aea20 con 0x7f0ab4101050 2024-05-20T17:44:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.559+0000 7f0ab1ffb640 1 -- 172.21.15.135:0/2953064547 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8017930 con 0x7f0ab4101050 2024-05-20T17:44:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 Processor -- start 2024-05-20T17:44:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ab1ffb640 1 -- 172.21.15.135:0/2953064547 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0aa8010430 con 0x7f0ab4101050 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 -- start start 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11982f0 0x5564f1560490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f15609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564f14c5340 con 0x5564f11c11b0 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5564f146d290 con 0x5564f11a04d0 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5564f14c1300 con 0x5564f11982f0 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51408/0 (socket says 172.21.15.135:51408) 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ab93fe640 1 -- 172.21.15.135:0/3665611528 learned_addr learned my addr 172.21.15.135:0/3665611528 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.563+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f15609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab1ffb640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 0x7f0aa40a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 -- 172.21.15.135:0/3665611528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11982f0 msgr2=0x5564f1560490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11982f0 0x5564f1560490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 -- 172.21.15.135:0/3665611528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 msgr2=0x5564f15609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f15609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 -- 172.21.15.135:0/3665611528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f14918e0 con 0x5564f11c11b0 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab1ffb640 1 -- 172.21.15.135:0/2953064547 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7f0aa80176d0 con 0x7f0ab4101050 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 0x7f0aa40a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.564+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ca0 tx=0x7f0aac0305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6ec520e4e69916 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.565+0000 7f0a9effd640 1 -- 172.21.15.135:0/3665611528 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac04c070 con 0x5564f11c11b0 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.565+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 0x7f0aa40a5440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009a60 tx=0x7f0aac04a000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.565+0000 7f0a9effd640 1 -- 172.21.15.135:0/3665611528 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aac036070 con 0x5564f11c11b0 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.565+0000 7f0a9effd640 1 -- 172.21.15.135:0/3665611528 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac004280 con 0x5564f11c11b0 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- 172.21.15.135:0/3665611528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 msgr2=0x5564f155ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ca0 tx=0x7f0aac0305c0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- 172.21.15.135:0/3665611528 shutdown_connections 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f15609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11982f0 0x5564f1560490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/3665611528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f155ff50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- 172.21.15.135:0/3665611528 >> 172.21.15.135:0/3665611528 conn(0x5564f11b5300 msgr2=0x5564f155c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- 172.21.15.135:0/3665611528 shutdown_connections 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- 172.21.15.135:0/3665611528 wait complete. 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 -- start start 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.566+0000 7f0ac1de1740 1 Processor -- start 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 0x5564f15706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 0x5564f1570bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564f15714f0 con 0x5564f11c11b0 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5564f1480790 con 0x5564f11982f0 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5564f1571670 con 0x5564f11a04d0 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51414/0 (socket says 172.21.15.135:51414) 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ab93fe640 1 -- 172.21.15.135:0/2983825663 learned_addr learned my addr 172.21.15.135:0/2983825663 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 0x5564f15706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 0x5564f1570bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.567+0000 7f0ac1de1740 10 client.0 _ll_register_callbacks cb 0x5564f14bba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 -- 172.21.15.135:0/2983825663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 msgr2=0x5564f1570bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 0x5564f1570bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 -- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 msgr2=0x5564f15706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 0x5564f15706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 -- 172.21.15.135:0/2983825663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f11d9210 con 0x5564f11c11b0 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 0x5564f15706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 0x5564f1570bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ab93fe640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0aac004df0 tx=0x7f0aac003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba5717c66e957c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac04c070 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac036070 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7f0aac031860 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0aac030ed0 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ac1de1740 10 client.16794 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.568+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564f12a5620 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aac036070 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0aac045030 con 0x5564f11c11b0 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 10 client.16794 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 20 client.16794 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f117fd80 0x5564f1580b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 4 client.16794 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:44:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564f14d2a70 con 0x5564f117fd80 2024-05-20T17:44:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.569+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f117fd80 0x5564f1580b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.570+0000 7f0a93fff640 10 client.16794 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.570+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f117fd80 0x5564f1580b90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0cf7f554a3a10c server_cookie=bfb0a36a4cb18e1a in_seq=0 out_seq=0 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0a93fff640 1 -- 172.21.15.135:0/2983825663 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5564f14d2a70 con 0x5564f117fd80 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0a93fff640 10 client.16794 handle_command_reply: tid=0 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 client.16794 shutdown 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 msgr2=0x5564f156eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0aac004df0 tx=0x7f0aac003da0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 shutdown_connections 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f117fd80 0x5564f1580b90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0a93fff640 0 client.16794 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11c11b0 0x5564f156eaa0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f11a04d0 0x5564f1570bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2983825663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11982f0 0x5564f15706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 >> 172.21.15.135:0/2983825663 conn(0x5564f11b5300 msgr2=0x5564f155fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.571+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 shutdown_connections 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.572+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2983825663 wait complete. 2024-05-20T17:44:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.572+0000 7f0ac1de1740 20 client.16794 trim_cache size 0 max 16384 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.595+0000 7f0ac1de1740 1 Processor -- start 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.595+0000 7f0ac1de1740 1 -- start start 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.595+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f15682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.595+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.595+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f155fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b7c40 con 0x5564f11982f0 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b5450 con 0x5564f11a04d0 2024-05-20T17:44:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab8bfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f15682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f155fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51430/0 (socket says 172.21.15.135:51430) 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 -- 172.21.15.135:0/4099268007 learned_addr learned my addr 172.21.15.135:0/4099268007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b32c0 con 0x5564f117fd80 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 -- 172.21.15.135:0/4099268007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 msgr2=0x5564f15682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f15682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 -- 172.21.15.135:0/4099268007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 msgr2=0x5564f155fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f155fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 -- 172.21.15.135:0/4099268007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f1571660 con 0x5564f11982f0 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f15682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.596+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4074680 tx=0x7f0aa0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56e5e548c56129 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.597+0000 7f0a9e7fc640 1 -- 172.21.15.135:0/4099268007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0022070 con 0x5564f11982f0 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.597+0000 7f0a9e7fc640 1 -- 172.21.15.135:0/4099268007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa0004250 con 0x5564f11982f0 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.597+0000 7f0a9e7fc640 1 -- 172.21.15.135:0/4099268007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa001d920 con 0x5564f11982f0 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 msgr2=0x5564f1568800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4074680 tx=0x7f0aa0005f90 comp rx=0 tx=0).stop 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 shutdown_connections 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f155fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1568800 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/4099268007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f15682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 >> 172.21.15.135:0/4099268007 conn(0x5564f11b5300 msgr2=0x5564f156d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 shutdown_connections 2024-05-20T17:44:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- 172.21.15.135:0/4099268007 wait complete. 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 -- start start 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.598+0000 7f0ac1de1740 1 Processor -- start 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f1576a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f1573f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b3910 con 0x5564f11982f0 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b4d80 con 0x5564f11a04d0 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b3fe0 con 0x5564f117fd80 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ac1de1740 10 client.0 _ll_register_callbacks cb 0x7f0aac04a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f1573f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab93fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f1573f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:54366/0 (socket says 172.21.15.135:54366) 2024-05-20T17:44:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab93fe640 1 -- 172.21.15.135:0/2379995816 learned_addr learned my addr 172.21.15.135:0/2379995816 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51438/0 (socket says 172.21.15.135:51438) 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f1576a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 -- 172.21.15.135:0/2379995816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 msgr2=0x5564f1576a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f1576a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 -- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 msgr2=0x5564f1573f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f1573f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.599+0000 7f0ab3fff640 1 -- 172.21.15.135:0/2379995816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f1560d90 con 0x5564f11982f0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ab3fff640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009690 tx=0x7f0aa0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8de44f20d8a7e5c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa002d020 con 0x5564f11982f0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7f0aa0004400 con 0x5564f11982f0 2024-05-20T17:44:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa0004250 con 0x5564f11982f0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0aa0038050 con 0x5564f11982f0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 10 client.16800 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564f15e86b0 con 0x5564f11982f0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa0004250 con 0x5564f11982f0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0aa0028040 con 0x5564f11982f0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 10 client.16800 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 10 client.16800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.600+0000 7f0ac1de1740 20 client.16800 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.601+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f11c11b0 0x5564f15ead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.601+0000 7f0ac1de1740 4 client.16800 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.601+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564f14ccdc0 con 0x5564f11c11b0 2024-05-20T17:44:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.601+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f11c11b0 0x5564f15ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.601+0000 7f0a93fff640 10 client.16800 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.602+0000 7f0ab8bfd640 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f11c11b0 0x5564f15ead90 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdd1ff21f4753d server_cookie=bf5dd29cd3e809de in_seq=0 out_seq=0 2024-05-20T17:44:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.719+0000 7f0a93fff640 1 -- 172.21.15.135:0/2379995816 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564f14ccdc0 con 0x5564f11c11b0 2024-05-20T17:44:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.719+0000 7f0a93fff640 10 client.16800 handle_command_reply: tid=0 2024-05-20T17:44:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 client.16800 shutdown 2024-05-20T17:44:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 msgr2=0x5564f1576fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009690 tx=0x7f0aa0005850 comp rx=0 tx=0).stop 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 shutdown_connections 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5564f11c11b0 0x5564f15ead90 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5564f11a04d0 0x5564f1573f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0a93fff640 0 client.16800 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564f11982f0 0x5564f1576fc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 --2- 172.21.15.135:0/2379995816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564f117fd80 0x5564f1576a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 >> 172.21.15.135:0/2379995816 conn(0x5564f11b5300 msgr2=0x5564f1561d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 shutdown_connections 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 1 -- 172.21.15.135:0/2379995816 wait complete. 2024-05-20T17:44:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.720+0000 7f0ac1de1740 20 client.16800 trim_cache size 0 max 16384 2024-05-20T17:44:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:44:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:44:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:44:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 msgr2=0x7f0aa40a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 0x7f0aa40a5440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009a60 tx=0x7f0aac04a000 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 msgr2=0x7f0ab40735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800e980 tx=0x7f0aa800ee40 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 shutdown_connections 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0aa40a2f30 0x7f0aa40a5440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ab410d550 0x7f0ab406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab4108ba0 0x7f0ab406d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 --2- 172.21.15.135:0/2953064547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4101050 0x7f0ab40735c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.721+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 >> 172.21.15.135:0/2953064547 conn(0x7f0ab4076860 msgr2=0x7f0ab4109510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.722+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 shutdown_connections 2024-05-20T17:44:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:19.722+0000 7f0abae61640 1 -- 172.21.15.135:0/2953064547 wait complete. 2024-05-20T17:44:20.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:44:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:44:20.065+0000 7f26a818c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-20T17:44:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:21 smithi135 ceph-mon[32027]: pgmap v342: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 243 op/s 2024-05-20T17:44:21.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:21 smithi160 ceph-mon[36261]: pgmap v342: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 243 op/s 2024-05-20T17:44:21.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:21 smithi172 ceph-mon[36511]: pgmap v342: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 243 op/s 2024-05-20T17:44:23.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:23 smithi135 ceph-mon[32027]: pgmap v343: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 247 op/s 2024-05-20T17:44:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:23 smithi160 ceph-mon[36261]: pgmap v343: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 247 op/s 2024-05-20T17:44:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:23 smithi172 ceph-mon[36511]: pgmap v343: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 247 op/s 2024-05-20T17:44:25.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:25 smithi135 ceph-mon[32027]: pgmap v344: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 184 op/s 2024-05-20T17:44:25.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:25 smithi160 ceph-mon[36261]: pgmap v344: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 184 op/s 2024-05-20T17:44:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:25 smithi172 ceph-mon[36511]: pgmap v344: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 184 op/s 2024-05-20T17:44:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:27 smithi135 ceph-mon[32027]: pgmap v345: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-05-20T17:44:27.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:27 smithi160 ceph-mon[36261]: pgmap v345: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-05-20T17:44:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:27 smithi172 ceph-mon[36511]: pgmap v345: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-05-20T17:44:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:29 smithi135 ceph-mon[32027]: pgmap v346: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-05-20T17:44:29.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:29 smithi160 ceph-mon[36261]: pgmap v346: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-05-20T17:44:29.583 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:29 smithi172 ceph-mon[36511]: pgmap v346: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-05-20T17:44:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:31 smithi135 ceph-mon[32027]: pgmap v347: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 98 op/s 2024-05-20T17:44:31.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:31 smithi160 ceph-mon[36261]: pgmap v347: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 98 op/s 2024-05-20T17:44:31.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:31 smithi172 ceph-mon[36511]: pgmap v347: 97 pgs: 17 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 44 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 98 op/s 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.876+0000 7fd511d79640 1 -- 172.21.15.135:0/3230844456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c101850 msgr2=0x7fd50c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.876+0000 7fd511d79640 1 --2- 172.21.15.135:0/3230844456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c101850 0x7fd50c101c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd500009900 tx=0x7fd50002a3f0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.877+0000 7fd511d79640 1 -- 172.21.15.135:0/3230844456 shutdown_connections 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.877+0000 7fd511d79640 1 --2- 172.21.15.135:0/3230844456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.877+0000 7fd511d79640 1 --2- 172.21.15.135:0/3230844456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10ca90 0x7fd50c10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.877+0000 7fd511d79640 1 --2- 172.21.15.135:0/3230844456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c101850 0x7fd50c101c60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.877+0000 7fd511d79640 1 -- 172.21.15.135:0/3230844456 >> 172.21.15.135:0/3230844456 conn(0x7fd50c0fd210 msgr2=0x7fd50c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.878+0000 7fd511d79640 1 -- 172.21.15.135:0/3230844456 shutdown_connections 2024-05-20T17:44:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.878+0000 7fd511d79640 1 -- 172.21.15.135:0/3230844456 wait complete. 2024-05-20T17:44:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.879+0000 7fd511d79640 1 Processor -- start 2024-05-20T17:44:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.879+0000 7fd511d79640 1 -- start start 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c101850 0x7fd50c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c10ca90 0x7fd50c1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c115090 con 0x7fd50c101850 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c114f10 con 0x7fd50c10f3f0 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd511d79640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c115210 con 0x7fd50c10ca90 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35354/0 (socket says 172.21.15.135:35354) 2024-05-20T17:44:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.880+0000 7fd50bfff640 1 -- 172.21.15.135:0/3445175644 learned_addr learned my addr 172.21.15.135:0/3445175644 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.881+0000 7fd50affd640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c10ca90 0x7fd50c1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.883+0000 7fd50b7fe640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c101850 0x7fd50c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.883+0000 7fd50bfff640 1 -- 172.21.15.135:0/3445175644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c10ca90 msgr2=0x7fd50c1a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.883+0000 7fd50bfff640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c10ca90 0x7fd50c1a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.883+0000 7fd50bfff640 1 -- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c101850 msgr2=0x7fd50c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.883+0000 7fd50bfff640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c101850 0x7fd50c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.884+0000 7fd50bfff640 1 -- 172.21.15.135:0/3445175644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c19bf50 con 0x7fd50c10f3f0 2024-05-20T17:44:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.884+0000 7fd50bfff640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd50400b970 tx=0x7fd50400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.884+0000 7fd508ff9640 1 -- 172.21.15.135:0/3445175644 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504019070 con 0x7fd50c10f3f0 2024-05-20T17:44:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.885+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c19c240 con 0x7fd50c10f3f0 2024-05-20T17:44:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.885+0000 7fd508ff9640 1 -- 172.21.15.135:0/3445175644 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd50400cb40 con 0x7fd50c10f3f0 2024-05-20T17:44:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.885+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c1a8490 con 0x7fd50c10f3f0 2024-05-20T17:44:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.885+0000 7fd508ff9640 1 -- 172.21.15.135:0/3445175644 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504007610 con 0x7fd50c10f3f0 2024-05-20T17:44:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.889+0000 7fd518c1b740 1 Processor -- start 2024-05-20T17:44:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 -- start start 2024-05-20T17:44:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3a87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a88310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5568d39e4340 con 0x5568d36e01b0 2024-05-20T17:44:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5568d398c290 con 0x5568d36b72f0 2024-05-20T17:44:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.890+0000 7fd518c1b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568d39e0300 con 0x5568d36bf4d0 2024-05-20T17:44:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.892+0000 7fd508ff9640 1 -- 172.21.15.135:0/3445175644 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fd50401c070 con 0x7fd50c10f3f0 2024-05-20T17:44:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.893+0000 7fd508ff9640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 0x7fd4f40a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.893+0000 7fd508ff9640 1 -- 172.21.15.135:0/3445175644 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7fd5040ce8a0 con 0x7fd50c10f3f0 2024-05-20T17:44:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.894+0000 7fd50bfff640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 0x7fd4f40a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.894+0000 7fd50bfff640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 0x7fd4f40a5280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bfd0 tx=0x7fd50400bf60 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.896+0000 7fd50affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3a87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.896+0000 7fd50affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3a87890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56824/0 (socket says 172.21.15.135:56824) 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.896+0000 7fd50affd640 1 -- 172.21.15.135:0/4243952198 learned_addr learned my addr 172.21.15.135:0/4243952198 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.896+0000 7fd50affd640 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a88310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.897+0000 7fd50affd640 1 -- 172.21.15.135:0/4243952198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 msgr2=0x5568d3a87dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.897+0000 7fd50affd640 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a87dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.897+0000 7fd50affd640 1 -- 172.21.15.135:0/4243952198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 msgr2=0x5568d3a87890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.897+0000 7fd50affd640 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3a87890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.897+0000 7fd50affd640 1 -- 172.21.15.135:0/4243952198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d39b08e0 con 0x5568d36bf4d0 2024-05-20T17:44:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.898+0000 7fd50affd640 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a88310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004650 tx=0x7fd4fc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f3ca5b79069f4d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.899+0000 7fd4f1ffb640 1 -- 172.21.15.135:0/4243952198 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00d740 con 0x5568d36bf4d0 2024-05-20T17:44:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.899+0000 7fd4f1ffb640 1 -- 172.21.15.135:0/4243952198 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4fc00ddc0 con 0x5568d36bf4d0 2024-05-20T17:44:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.899+0000 7fd4f1ffb640 1 -- 172.21.15.135:0/4243952198 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00fde0 con 0x5568d36bf4d0 2024-05-20T17:44:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 -- 172.21.15.135:0/4243952198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 msgr2=0x5568d3a88310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a88310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc004650 tx=0x7fd4fc005f90 comp rx=0 tx=0).stop 2024-05-20T17:44:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 -- 172.21.15.135:0/4243952198 shutdown_connections 2024-05-20T17:44:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a88310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 --2- 172.21.15.135:0/4243952198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3a87890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.902+0000 7fd518c1b740 1 -- 172.21.15.135:0/4243952198 >> 172.21.15.135:0/4243952198 conn(0x5568d36d4300 msgr2=0x5568d3a84040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.907+0000 7fd518c1b740 1 -- 172.21.15.135:0/4243952198 shutdown_connections 2024-05-20T17:44:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.909+0000 7fd518c1b740 1 -- 172.21.15.135:0/4243952198 wait complete. 2024-05-20T17:44:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.909+0000 7fd518c1b740 1 -- start start 2024-05-20T17:44:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.910+0000 7fd518c1b740 1 Processor -- start 2024-05-20T17:44:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36bf4d0 0x5568d3a93e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a91df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5568d3aa59d0 con 0x5568d36bf4d0 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5568d399f790 con 0x5568d36e01b0 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568d3aa5b50 con 0x5568d36b72f0 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd518c1b740 10 client.0 _ll_register_callbacks cb 0x5568d39daa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.914+0000 7fd50affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:51092/0 (socket says 172.21.15.135:51092) 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 -- 172.21.15.135:0/3470397176 learned_addr learned my addr 172.21.15.135:0/3470397176 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a91df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 -- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 msgr2=0x5568d3a91df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a91df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 -- 172.21.15.135:0/3470397176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36bf4d0 msgr2=0x5568d3a93e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36bf4d0 0x5568d3a93e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 -- 172.21.15.135:0/3470397176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d36f8210 con 0x5568d36b72f0 2024-05-20T17:44:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.915+0000 7fd50affd640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00fac0 tx=0x7fd4fc00f9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=403a5393e9a1eb9d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.916+0000 7fd4eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:44:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.916+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00fb60 con 0x5568d36b72f0 2024-05-20T17:44:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.916+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7fd4fc00fd00 con 0x5568d36b72f0 2024-05-20T17:44:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.918+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc00ddc0 con 0x5568d36b72f0 2024-05-20T17:44:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.920+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc00d920 con 0x5568d36b72f0 2024-05-20T17:44:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.920+0000 7fd518c1b740 10 client.26284 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.920+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568d37c4620 con 0x5568d36b72f0 2024-05-20T17:44:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4fc00ddc0 con 0x5568d36b72f0 2024-05-20T17:44:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd4fc0047e0 con 0x5568d36b72f0 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 10 client.26284 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 20 client.26284 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d369ed80 0x5568d3a80230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 4 client.26284 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:44:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.923+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568d39f1a70 con 0x5568d369ed80 2024-05-20T17:44:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.924+0000 7fd50b7fe640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d369ed80 0x5568d3a80230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.928+0000 7fd50b7fe640 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d369ed80 0x5568d3a80230 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cda225c96a4fc23 server_cookie=81bbaefc0acdd976 in_seq=0 out_seq=0 2024-05-20T17:44:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.928+0000 7fd4eaffd640 10 client.26284 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.929+0000 7fd4eaffd640 1 -- 172.21.15.135:0/3470397176 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5568d39f1a70 con 0x5568d369ed80 2024-05-20T17:44:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.929+0000 7fd4eaffd640 10 client.26284 handle_command_reply: tid=0 2024-05-20T17:44:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.929+0000 7fd518c1b740 1 client.26284 shutdown 2024-05-20T17:44:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.932+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 msgr2=0x5568d3a938e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.932+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00fac0 tx=0x7fd4fc00f9c0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 shutdown_connections 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d369ed80 0x5568d3a80230 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a91df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36bf4d0 0x5568d3a93e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3470397176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36b72f0 0x5568d3a938e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 >> 172.21.15.135:0/3470397176 conn(0x5568d36d4300 msgr2=0x5568d3a895b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:32.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.934+0000 7fd4eaffd640 0 client.26284 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:32.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.936+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 shutdown_connections 2024-05-20T17:44:32.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.938+0000 7fd518c1b740 1 -- 172.21.15.135:0/3470397176 wait complete. 2024-05-20T17:44:32.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.938+0000 7fd518c1b740 20 client.26284 trim_cache size 0 max 16384 2024-05-20T17:44:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.967+0000 7fd518c1b740 1 Processor -- start 2024-05-20T17:44:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.967+0000 7fd518c1b740 1 -- start start 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.967+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.967+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.967+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3ac5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd518c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f8011330 con 0x5568d36e01b0 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd518c1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800eb40 con 0x5568d36b72f0 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:35388/0 (socket says 172.21.15.135:35388) 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 -- 172.21.15.135:0/3876213982 learned_addr learned my addr 172.21.15.135:0/3876213982 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800c9b0 con 0x5568d36bf4d0 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3ac5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 -- 172.21.15.135:0/3876213982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 msgr2=0x5568d3a89be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 -- 172.21.15.135:0/3876213982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 msgr2=0x5568d3ac5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3ac5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 -- 172.21.15.135:0/3876213982 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d3a75a80 con 0x5568d36b72f0 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.968+0000 7fd50affd640 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00a010 tx=0x7fd4fc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c026093481b7dc43 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.969+0000 7fd4f17fa640 1 -- 172.21.15.135:0/3876213982 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc037040 con 0x5568d36b72f0 2024-05-20T17:44:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.969+0000 7fd4f17fa640 1 -- 172.21.15.135:0/3876213982 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4fc009a10 con 0x5568d36b72f0 2024-05-20T17:44:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.969+0000 7fd4f17fa640 1 -- 172.21.15.135:0/3876213982 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005300 con 0x5568d36b72f0 2024-05-20T17:44:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 msgr2=0x5568d3a7adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00a010 tx=0x7fd4fc005f90 comp rx=0 tx=0).stop 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 shutdown_connections 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36e01b0 0x5568d3ac5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a89be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 --2- 172.21.15.135:0/3876213982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36b72f0 0x5568d3a7adf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 >> 172.21.15.135:0/3876213982 conn(0x5568d36d4300 msgr2=0x5568d3a894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 shutdown_connections 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- 172.21.15.135:0/3876213982 wait complete. 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 -- start start 2024-05-20T17:44:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.970+0000 7fd518c1b740 1 Processor -- start 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 0x5568d3a8adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a8b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a8b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800d000 con 0x5568d36b72f0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800e470 con 0x5568d36e01b0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800d6d0 con 0x5568d36bf4d0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd518c1b740 10 client.0 _ll_register_callbacks cb 0x7fd4fc009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd50affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 0x5568d3a8adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd50affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a8b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd50affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 0x5568d3a8adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56846/0 (socket says 172.21.15.135:56846) 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.971+0000 7fd50affd640 1 -- 172.21.15.135:0/2036081264 learned_addr learned my addr 172.21.15.135:0/2036081264 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.972+0000 7fd50affd640 1 -- 172.21.15.135:0/2036081264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 msgr2=0x5568d3a8b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.972+0000 7fd50affd640 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a8b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.972+0000 7fd50affd640 1 -- 172.21.15.135:0/2036081264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 msgr2=0x5568d3a8adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.972+0000 7fd50affd640 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 0x5568d3a8adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.972+0000 7fd50affd640 1 -- 172.21.15.135:0/2036081264 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d3a8a120 con 0x5568d36e01b0 2024-05-20T17:44:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.974+0000 7fd50affd640 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a8b870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5568d37e1bf0 tx=0x7fd4fc009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a01cd8cd0b6a937 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.974+0000 7fd4eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:44:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.979+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc037070 con 0x5568d36e01b0 2024-05-20T17:44:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.979+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8615+0+0 (secure 0 0 0) 0x7fd4fc0053e0 con 0x5568d36e01b0 2024-05-20T17:44:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.979+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc009a10 con 0x5568d36e01b0 2024-05-20T17:44:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.982+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc009c40 con 0x5568d36e01b0 2024-05-20T17:44:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.982+0000 7fd518c1b740 10 client.26384 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.982+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568d3a944c0 con 0x5568d36e01b0 2024-05-20T17:44:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4fc009a10 con 0x5568d36e01b0 2024-05-20T17:44:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd4fc042440 con 0x5568d36e01b0 2024-05-20T17:44:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 10 client.26384 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 20 client.26384 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d36741c0 0x5568d3b26e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 4 client.26384 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:44:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.987+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568d39ebdc0 con 0x5568d36741c0 2024-05-20T17:44:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.988+0000 7fd50b7fe640 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d36741c0 0x5568d3b26e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.989+0000 7fd50b7fe640 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d36741c0 0x5568d3b26e10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9827c324d45cbf50 server_cookie=ed6d1b06f6622ab3 in_seq=0 out_seq=0 2024-05-20T17:44:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:32.989+0000 7fd4eaffd640 10 client.26384 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.054+0000 7fd4eaffd640 1 -- 172.21.15.135:0/2036081264 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568d39ebdc0 con 0x5568d36741c0 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.054+0000 7fd4eaffd640 10 client.26384 handle_command_reply: tid=0 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.054+0000 7fd518c1b740 1 client.26384 shutdown 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 msgr2=0x5568d3a8b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a8b870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5568d37e1bf0 tx=0x7fd4fc009ea0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 shutdown_connections 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x5568d36741c0 0x5568d3b26e10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568d36e01b0 0x5568d3a8b870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568d36bf4d0 0x5568d3a8b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd4eaffd640 0 client.26384 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 --2- 172.21.15.135:0/2036081264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568d36b72f0 0x5568d3a8adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 >> 172.21.15.135:0/2036081264 conn(0x5568d36d4300 msgr2=0x5568d3a934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 shutdown_connections 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 1 -- 172.21.15.135:0/2036081264 wait complete. 2024-05-20T17:44:33.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.055+0000 7fd518c1b740 20 client.26384 trim_cache size 0 max 16384 2024-05-20T17:44:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:44:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:44:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:44:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:44:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 msgr2=0x7fd4f40a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 0x7fd4f40a5280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bfd0 tx=0x7fd50400bf60 comp rx=0 tx=0).stop 2024-05-20T17:44:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 msgr2=0x7fd50c19b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd50400b970 tx=0x7fd50400be30 comp rx=0 tx=0).stop 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 shutdown_connections 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fd4f40a2d70 0x7fd4f40a5280 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c10f3f0 0x7fd50c19b870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd50c10ca90 0x7fd50c1a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 --2- 172.21.15.135:0/3445175644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c101850 0x7fd50c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 >> 172.21.15.135:0/3445175644 conn(0x7fd50c0fd210 msgr2=0x7fd50c10e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 shutdown_connections 2024-05-20T17:44:33.061 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:33.056+0000 7fd511d79640 1 -- 172.21.15.135:0/3445175644 wait complete. 2024-05-20T17:44:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:33 smithi135 ceph-mon[32027]: pgmap v348: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-20T17:44:33.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:33 smithi160 ceph-mon[36261]: pgmap v348: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-20T17:44:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:33 smithi172 ceph-mon[36511]: pgmap v348: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-20T17:44:35.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:35 smithi135 ceph-mon[32027]: pgmap v349: 97 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 64 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-20T17:44:35.471 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:35 smithi172 ceph-mon[36511]: pgmap v349: 97 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 64 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-20T17:44:35.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:35 smithi160 ceph-mon[36261]: pgmap v349: 97 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 64 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-20T17:44:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:37 smithi135 ceph-mon[32027]: pgmap v350: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-20T17:44:37.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:37 smithi160 ceph-mon[36261]: pgmap v350: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-20T17:44:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:37 smithi172 ceph-mon[36511]: pgmap v350: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-20T17:44:39.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:39 smithi135 ceph-mon[32027]: pgmap v351: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 163 op/s 2024-05-20T17:44:39.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:39 smithi160 ceph-mon[36261]: pgmap v351: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 163 op/s 2024-05-20T17:44:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:39 smithi172 ceph-mon[36511]: pgmap v351: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 163 op/s 2024-05-20T17:44:41.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:41 smithi135 ceph-mon[32027]: pgmap v352: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-05-20T17:44:41.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:41 smithi160 ceph-mon[36261]: pgmap v352: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-05-20T17:44:41.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:41 smithi172 ceph-mon[36511]: pgmap v352: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-05-20T17:44:43.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:43 smithi135 ceph-mon[32027]: pgmap v353: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 234 op/s 2024-05-20T17:44:43.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:43 smithi160 ceph-mon[36261]: pgmap v353: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 234 op/s 2024-05-20T17:44:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:43 smithi172 ceph-mon[36511]: pgmap v353: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 234 op/s 2024-05-20T17:44:44.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:44 smithi160 ceph-mon[36261]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:44:44.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:44 smithi172 ceph-mon[36511]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:44:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:44 smithi135 ceph-mon[32027]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:44:45.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:45 smithi160 ceph-mon[36261]: pgmap v355: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-05-20T17:44:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:45 smithi172 ceph-mon[36511]: pgmap v355: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-05-20T17:44:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:45 smithi135 ceph-mon[32027]: pgmap v355: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-05-20T17:44:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 -- 172.21.15.135:0/320511256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 msgr2=0x7f622c109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 --2- 172.21.15.135:0/320511256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c109730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6218009900 tx=0x7f621802a4a0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 -- 172.21.15.135:0/320511256 shutdown_connections 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 --2- 172.21.15.135:0/320511256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c117d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 --2- 172.21.15.135:0/320511256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 0x7f622c111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 --2- 172.21.15.135:0/320511256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c109730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 -- 172.21.15.135:0/320511256 >> 172.21.15.135:0/320511256 conn(0x7f622c06d780 msgr2=0x7f622c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 -- 172.21.15.135:0/320511256 shutdown_connections 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.196+0000 7f6232b2a640 1 -- 172.21.15.135:0/320511256 wait complete. 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 Processor -- start 2024-05-20T17:44:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 -- start start 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 0x7f622c1a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f622c11b660 con 0x7f622c111790 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f622c11b4e0 con 0x7f622c110c70 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.197+0000 7f6232b2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f622c11b7e0 con 0x7f622c109320 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62308c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49336/0 (socket says 172.21.15.135:49336) 2024-05-20T17:44:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62308c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46486/0 (socket says 172.21.15.135:46486) 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 -- 172.21.15.135:0/1620895669 learned_addr learned my addr 172.21.15.135:0/1620895669 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f622bfff640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 0x7f622c1a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 -- 172.21.15.135:0/1620895669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 msgr2=0x7f622c1a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 -- 172.21.15.135:0/1620895669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 msgr2=0x7f622c1a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 0x7f622c1a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 -- 172.21.15.135:0/1620895669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c1a90c0 con 0x7f622c111790 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62308c6640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.198+0000 7f62310c7640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f622400eb40 tx=0x7f622400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.199+0000 7f6229ffb640 1 -- 172.21.15.135:0/1620895669 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622400ce40 con 0x7f622c111790 2024-05-20T17:44:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.199+0000 7f6229ffb640 1 -- 172.21.15.135:0/1620895669 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6224005020 con 0x7f622c111790 2024-05-20T17:44:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.199+0000 7f6229ffb640 1 -- 172.21.15.135:0/1620895669 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224010690 con 0x7f622c111790 2024-05-20T17:44:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.199+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622c1a93b0 con 0x7f622c111790 2024-05-20T17:44:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.199+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622c1a98b0 con 0x7f622c111790 2024-05-20T17:44:46.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.202+0000 7f62399cc740 1 Processor -- start 2024-05-20T17:44:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.203+0000 7f6229ffb640 1 -- 172.21.15.135:0/1620895669 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f62240051d0 con 0x7f622c111790 2024-05-20T17:44:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 -- start start 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425af61b0 0x559425e9d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425e9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559425dfa340 con 0x559425acd2f0 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559425da2290 con 0x559425ad54d0 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62399cc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559425df6300 con 0x559425af61b0 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62308c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62308c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49344/0 (socket says 172.21.15.135:49344) 2024-05-20T17:44:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f62308c6640 1 -- 172.21.15.135:0/713439587 learned_addr learned my addr 172.21.15.135:0/713439587 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f622bfff640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425af61b0 0x559425e9d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f6229ffb640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 0x7f621c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.204+0000 7f622bfff640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425e9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62310c7640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 0x7f621c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 -- 172.21.15.135:0/713439587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425af61b0 msgr2=0x559425e9d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425af61b0 0x559425e9d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 -- 172.21.15.135:0/713439587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 msgr2=0x559425e9e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425e9e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 -- 172.21.15.135:0/713439587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559425dc68e0 con 0x559425acd2f0 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f6229ffb640 1 -- 172.21.15.135:0/1620895669 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7f62240cfb60 con 0x7f622c111790 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f622bfff640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425e9e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62308c6640 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f62180314e0 tx=0x7f6218009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389e76b0748b5de5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f62310c7640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 0x7f621c0a5280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62240cd880 tx=0x7f62240bc040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f6216ffd640 1 -- 172.21.15.135:0/713439587 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218035040 con 0x559425acd2f0 2024-05-20T17:44:46.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f6216ffd640 1 -- 172.21.15.135:0/713439587 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6218031940 con 0x559425acd2f0 2024-05-20T17:44:46.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.205+0000 7f6216ffd640 1 -- 172.21.15.135:0/713439587 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218004a00 con 0x559425acd2f0 2024-05-20T17:44:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.206+0000 7f62399cc740 1 -- 172.21.15.135:0/713439587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 msgr2=0x559425e9ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.206+0000 7f62399cc740 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f62180314e0 tx=0x7f6218009680 comp rx=0 tx=0).stop 2024-05-20T17:44:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.206+0000 7f62399cc740 1 -- 172.21.15.135:0/713439587 shutdown_connections 2024-05-20T17:44:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.206+0000 7f62399cc740 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425e9e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425e9ddd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 --2- 172.21.15.135:0/713439587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425af61b0 0x559425e9d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 -- 172.21.15.135:0/713439587 >> 172.21.15.135:0/713439587 conn(0x559425aea300 msgr2=0x559425e9a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 -- 172.21.15.135:0/713439587 shutdown_connections 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 -- 172.21.15.135:0/713439587 wait complete. 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 -- start start 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.207+0000 7f62399cc740 1 Processor -- start 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ea9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425af61b0 0x559425ea7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559425eaa960 con 0x559425ad54d0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559425db5790 con 0x559425af61b0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559425eaaae0 con 0x559425acd2f0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62399cc740 10 client.0 _ll_register_callbacks cb 0x559425df0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f622bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f622bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:46490/0 (socket says 172.21.15.135:46490) 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f622bfff640 1 -- 172.21.15.135:0/1053589402 learned_addr learned my addr 172.21.15.135:0/1053589402 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f62308c6640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ea9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.208+0000 7f622bfff640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425af61b0 0x559425ea7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 -- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425af61b0 msgr2=0x559425ea7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425af61b0 0x559425ea7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 -- 172.21.15.135:0/1053589402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 msgr2=0x559425ea9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ea9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 -- 172.21.15.135:0/1053589402 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559425b0e210 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f622bfff640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6220009650 tx=0x7f62200047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7358a82435ad069d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f620bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622001a110 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7f6220018450 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6218031940 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.209+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f622002a050 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 10 client.26296 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559425bda620 con 0x559425acd2f0 2024-05-20T17:44:46.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6218031940 con 0x559425acd2f0 2024-05-20T17:44:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6220025440 con 0x559425acd2f0 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 10 client.26296 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 20 client.26296 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425ab4d80 0x559425eb9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 4 client.26296 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.210+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559425e07a70 con 0x559425ab4d80 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.211+0000 7f62308c6640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425ab4d80 0x559425eb9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.211+0000 7f62308c6640 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425ab4d80 0x559425eb9fe0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6e93d5a39dac10 server_cookie=cda05a597e994dc8 in_seq=0 out_seq=0 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.212+0000 7f620bfff640 10 client.26296 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f620bfff640 1 -- 172.21.15.135:0/1053589402 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559425e07a70 con 0x559425ab4d80 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f620bfff640 10 client.26296 handle_command_reply: tid=0 2024-05-20T17:44:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 client.26296 shutdown 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 msgr2=0x559425ea9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6220009650 tx=0x7f62200047d0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 shutdown_connections 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425ab4d80 0x559425eb9fe0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425af61b0 0x559425ea7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.213+0000 7f620bfff640 0 client.26296 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ea9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 1 --2- 172.21.15.135:0/1053589402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425acd2f0 0x559425ea9980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 >> 172.21.15.135:0/1053589402 conn(0x559425aea300 msgr2=0x559425e9d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 shutdown_connections 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 1 -- 172.21.15.135:0/1053589402 wait complete. 2024-05-20T17:44:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.214+0000 7f62399cc740 20 client.26296 trim_cache size 0 max 16384 2024-05-20T17:44:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.241+0000 7f62399cc740 1 Processor -- start 2024-05-20T17:44:46.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.241+0000 7f62399cc740 1 -- start start 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425ea1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425acd2f0 0x559425ebf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b7bd0 con 0x559425ad54d0 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b53e0 con 0x559425acd2f0 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62399cc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b3270 con 0x559425ab4d80 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425ea1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49358/0 (socket says 172.21.15.135:49358) 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 -- 172.21.15.135:0/2202997081 learned_addr learned my addr 172.21.15.135:0/2202997081 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f62308c6640 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425acd2f0 0x559425ebf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 -- 172.21.15.135:0/2202997081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 msgr2=0x559425ea1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425ea1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 -- 172.21.15.135:0/2202997081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425acd2f0 msgr2=0x559425ebf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.242+0000 7f622bfff640 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425acd2f0 0x559425ebf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.243+0000 7f622bfff640 1 -- 172.21.15.135:0/2202997081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559425eb6af0 con 0x559425ad54d0 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.243+0000 7f622bfff640 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6220015c20 tx=0x7f622001ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be29ee48ed110c5a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.243+0000 7f62167fc640 1 -- 172.21.15.135:0/2202997081 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220025640 con 0x559425ad54d0 2024-05-20T17:44:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.243+0000 7f62167fc640 1 -- 172.21.15.135:0/2202997081 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6220009d00 con 0x559425ad54d0 2024-05-20T17:44:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.243+0000 7f62167fc640 1 -- 172.21.15.135:0/2202997081 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220018980 con 0x559425ad54d0 2024-05-20T17:44:46.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 -- 172.21.15.135:0/2202997081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 msgr2=0x559425ebfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6220015c20 tx=0x7f622001ae30 comp rx=0 tx=0).stop 2024-05-20T17:44:46.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 -- 172.21.15.135:0/2202997081 shutdown_connections 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425ad54d0 0x559425ebfd20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425acd2f0 0x559425ebf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 --2- 172.21.15.135:0/2202997081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425ea1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.244+0000 7f62399cc740 1 -- 172.21.15.135:0/2202997081 >> 172.21.15.135:0/2202997081 conn(0x559425aea300 msgr2=0x559425ea1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.245+0000 7f62399cc740 1 -- 172.21.15.135:0/2202997081 shutdown_connections 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.245+0000 7f62399cc740 1 -- 172.21.15.135:0/2202997081 wait complete. 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.245+0000 7f62399cc740 1 -- start start 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.245+0000 7f62399cc740 1 Processor -- start 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425eaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425ead870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b38c0 con 0x559425acd2f0 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b4d10 con 0x559425ad54d0 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b3f70 con 0x559425ab4d80 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62399cc740 10 client.0 _ll_register_callbacks cb 0x7f6220009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49362/0 (socket says 172.21.15.135:49362) 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 -- 172.21.15.135:0/4020227199 learned_addr learned my addr 172.21.15.135:0/4020227199 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f622bfff640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425eaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 -- 172.21.15.135:0/4020227199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 msgr2=0x559425eaffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425eaffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 -- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 msgr2=0x559425ead870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425ead870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.246+0000 7f62308c6640 1 -- 172.21.15.135:0/4020227199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559425eaddb0 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f62308c6640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6218005600 tx=0x7f6218005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850622b8178c852e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f620bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218056070 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7f6218031d60 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559425e01dc0 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6218035040 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f62399cc740 10 client.16833 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559425f21fd0 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.247+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559425e01dc0 con 0x559425acd2f0 2024-05-20T17:44:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6218061070 con 0x559425acd2f0 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 10 client.16833 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 20 client.16833 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425af61b0 0x559425f243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 4 client.16833 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559425d7f8e0 con 0x559425af61b0 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f622bfff640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425af61b0 0x559425f243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f622bfff640 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425af61b0 0x559425f243e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31211947a3819adc server_cookie=dfaaffa7a844547b in_seq=0 out_seq=0 2024-05-20T17:44:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.248+0000 7f620bfff640 10 client.16833 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.483+0000 7f620bfff640 1 -- 172.21.15.135:0/4020227199 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559425d7f8e0 con 0x559425af61b0 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.483+0000 7f620bfff640 10 client.16833 handle_command_reply: tid=0 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.483+0000 7f62399cc740 1 client.16833 shutdown 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 msgr2=0x559425ead330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6218005600 tx=0x7f6218005590 comp rx=0 tx=0).stop 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 shutdown_connections 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x559425af61b0 0x559425f243e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559425ad54d0 0x559425ead870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f620bfff640 0 client.16833 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559425acd2f0 0x559425ead330 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 --2- 172.21.15.135:0/4020227199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559425ab4d80 0x559425eaffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 >> 172.21.15.135:0/4020227199 conn(0x559425aea300 msgr2=0x559425e99930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 shutdown_connections 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 1 -- 172.21.15.135:0/4020227199 wait complete. 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f62399cc740 20 client.16833 trim_cache size 0 max 16384 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:44:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:44:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:44:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 msgr2=0x7f621c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 0x7f621c0a5280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62240cd880 tx=0x7f62240bc040 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 msgr2=0x7f622c1a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.484+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f622400eb40 tx=0x7f622400ef40 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 shutdown_connections 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f621c0a2d70 0x7f621c0a5280 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f622c111790 0x7f622c1a8a80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c110c70 0x7f622c1a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 --2- 172.21.15.135:0/1620895669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c109320 0x7f622c1a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 >> 172.21.15.135:0/1620895669 conn(0x7f622c06d780 msgr2=0x7f622c0726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 shutdown_connections 2024-05-20T17:44:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:46.485+0000 7f6232b2a640 1 -- 172.21.15.135:0/1620895669 wait complete. 2024-05-20T17:44:47.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:47 smithi160 ceph-mon[36261]: pgmap v356: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-05-20T17:44:47.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:47 smithi172 ceph-mon[36511]: pgmap v356: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-05-20T17:44:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:47 smithi135 ceph-mon[32027]: pgmap v356: 97 pgs: 97 active+clean; 2.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-05-20T17:44:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:49 smithi160 ceph-mon[36261]: pgmap v357: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 306 op/s 2024-05-20T17:44:49.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:49 smithi172 ceph-mon[36511]: pgmap v357: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 306 op/s 2024-05-20T17:44:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:49 smithi135 ceph-mon[32027]: pgmap v357: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 306 op/s 2024-05-20T17:44:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:51 smithi160 ceph-mon[36261]: pgmap v358: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-05-20T17:44:51.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:51 smithi172 ceph-mon[36511]: pgmap v358: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-05-20T17:44:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:51 smithi135 ceph-mon[32027]: pgmap v358: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-05-20T17:44:53.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:53 smithi160 ceph-mon[36261]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-05-20T17:44:53.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:53 smithi172 ceph-mon[36511]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-05-20T17:44:53.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:53 smithi135 ceph-mon[32027]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-05-20T17:44:55.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:55 smithi160 ceph-mon[36261]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-05-20T17:44:55.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:55 smithi172 ceph-mon[36511]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-05-20T17:44:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:55 smithi135 ceph-mon[32027]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-05-20T17:44:57.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:57 smithi160 ceph-mon[36261]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 270 op/s 2024-05-20T17:44:57.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:57 smithi172 ceph-mon[36511]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 270 op/s 2024-05-20T17:44:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:57 smithi135 ceph-mon[32027]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 270 op/s 2024-05-20T17:44:58.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:58 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:44:58.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:58 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:44:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:58 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:44:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 -- 172.21.15.135:0/1159714470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 msgr2=0x7fca7010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 --2- 172.21.15.135:0/1159714470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7010f650 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fca68009ca0 tx=0x7fca6802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 -- 172.21.15.135:0/1159714470 shutdown_connections 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 --2- 172.21.15.135:0/1159714470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7010f650 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 --2- 172.21.15.135:0/1159714470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 0x7fca70102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 --2- 172.21.15.135:0/1159714470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca701026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 -- 172.21.15.135:0/1159714470 >> 172.21.15.135:0/1159714470 conn(0x7fca70078220 msgr2=0x7fca70078660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 -- 172.21.15.135:0/1159714470 shutdown_connections 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.602+0000 7fca759f5640 1 -- 172.21.15.135:0/1159714470 wait complete. 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 Processor -- start 2024-05-20T17:44:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 -- start start 2024-05-20T17:44:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca7019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 0x7fca70199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca70112e90 con 0x7fca70103280 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca70112d10 con 0x7fca70108b30 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca759f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca70113010 con 0x7fca70108fd0 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32788/0 (socket says 172.21.15.135:32788) 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca6effd640 1 -- 172.21.15.135:0/386799788 learned_addr learned my addr 172.21.15.135:0/386799788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.603+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca7019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 0x7fca70199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 -- 172.21.15.135:0/386799788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 msgr2=0x7fca70199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 0x7fca70199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 -- 172.21.15.135:0/386799788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 msgr2=0x7fca7019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca7019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 -- 172.21.15.135:0/386799788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca70199d80 con 0x7fca70103280 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca7019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca6effd640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d770 tx=0x7fca6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca749f3640 1 -- 172.21.15.135:0/386799788 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60017070 con 0x7fca70103280 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca749f3640 1 -- 172.21.15.135:0/386799788 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca60009c30 con 0x7fca70103280 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7019a010 con 0x7fca70103280 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca749f3640 1 -- 172.21.15.135:0/386799788 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6000f620 con 0x7fca70103280 2024-05-20T17:44:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.604+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a6270 con 0x7fca70103280 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca749f3640 1 -- 172.21.15.135:0/386799788 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fca6001a070 con 0x7fca70103280 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 Processor -- start 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 -- start start 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f516445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51644b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555f515a9340 con 0x555f512a51b0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555f51551290 con 0x555f512844d0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca7c973740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f515a5300 con 0x555f5127c2f0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca749f3640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 0x7fca5c0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32798/0 (socket says 172.21.15.135:32798) 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.607+0000 7fca6f7fe640 1 -- 172.21.15.135:0/469723088 learned_addr learned my addr 172.21.15.135:0/469723088 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51644b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 0x7fca5c0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca749f3640 1 -- 172.21.15.135:0/386799788 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7fca600ceee0 con 0x7fca70103280 2024-05-20T17:44:59.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6effd640 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f516445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 -- 172.21.15.135:0/469723088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 msgr2=0x555f516445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f516445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 -- 172.21.15.135:0/469723088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 msgr2=0x555f51644b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51644b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 -- 172.21.15.135:0/469723088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f515758e0 con 0x555f512a51b0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fca68004af0 tx=0x7fca680039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dacda7707c26b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca65ffb640 1 -- 172.21.15.135:0/469723088 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca680319a0 con 0x555f512a51b0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca65ffb640 1 -- 172.21.15.135:0/469723088 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca6804f070 con 0x555f512a51b0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca65ffb640 1 -- 172.21.15.135:0/469723088 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6802fcf0 con 0x555f512a51b0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.608+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 0x7fca5c0a5200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fca6804e000 tx=0x7fca6804c000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 -- 172.21.15.135:0/469723088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 msgr2=0x555f51644080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fca68004af0 tx=0x7fca680039f0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 -- 172.21.15.135:0/469723088 shutdown_connections 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51644b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f516445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 --2- 172.21.15.135:0/469723088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51644080 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 -- 172.21.15.135:0/469723088 >> 172.21.15.135:0/469723088 conn(0x555f51299300 msgr2=0x555f51640830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 -- 172.21.15.135:0/469723088 shutdown_connections 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.609+0000 7fca7c973740 1 -- 172.21.15.135:0/469723088 wait complete. 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.610+0000 7fca7c973740 1 -- start start 2024-05-20T17:44:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.610+0000 7fca7c973740 1 Processor -- start 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51658bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51659130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51652fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555f51651030 con 0x555f512a51b0 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555f51564790 con 0x555f512844d0 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f516511b0 con 0x555f5127c2f0 2024-05-20T17:44:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.614+0000 7fca7c973740 10 client.0 _ll_register_callbacks cb 0x555f5159fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51658bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51659130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51659130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41874/0 (socket says 172.21.15.135:41874) 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6e7fc640 1 -- 172.21.15.135:0/1539861773 learned_addr learned my addr 172.21.15.135:0/1539861773 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51652fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1539861773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 msgr2=0x555f51658bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51658bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 msgr2=0x555f51659130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51659130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1539861773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f512bd210 con 0x555f512a51b0 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51652fa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fca68004af0 tx=0x7fca68004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d324d806e34f14f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.615+0000 7fca4effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6805c060 con 0x555f512a51b0 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7fca68004410 con 0x555f512a51b0 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca6804f070 con 0x555f512a51b0 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca680319a0 con 0x555f512a51b0 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca7c973740 10 client.16845 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f51389620 con 0x555f512a51b0 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.616+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca6804f070 con 0x555f512a51b0 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fca68030c40 con 0x555f512a51b0 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 10 client.16845 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 20 client.16845 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f51263d80 0x555f51664b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 4 client.16845 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f515b6a70 con 0x555f51263d80 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca6effd640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f51263d80 0x555f51664b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca6effd640 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f51263d80 0x555f51664b80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73479f48f96cb69 server_cookie=6ce138cb392c039b in_seq=0 out_seq=0 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.617+0000 7fca4effd640 10 client.16845 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.618+0000 7fca4effd640 1 -- 172.21.15.135:0/1539861773 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555f515b6a70 con 0x555f51263d80 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.618+0000 7fca4effd640 10 client.16845 handle_command_reply: tid=0 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.618+0000 7fca7c973740 1 client.16845 shutdown 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 msgr2=0x555f51652fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51652fa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fca68004af0 tx=0x7fca68004a80 comp rx=0 tx=0).stop 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 shutdown_connections 2024-05-20T17:44:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f51263d80 0x555f51664b80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f51652fa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f51659130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 --2- 172.21.15.135:0/1539861773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51658bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 >> 172.21.15.135:0/1539861773 conn(0x555f51299300 msgr2=0x555f51643e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca4effd640 0 client.16845 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 shutdown_connections 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 1 -- 172.21.15.135:0/1539861773 wait complete. 2024-05-20T17:44:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.619+0000 7fca7c973740 20 client.16845 trim_cache size 0 max 16384 2024-05-20T17:44:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 Processor -- start 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 -- start start 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51644520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f5164c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca701af410 con 0x555f512a51b0 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca701acc20 con 0x555f512844d0 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca7c973740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca701aaa90 con 0x555f5127c2f0 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32824/0 (socket says 172.21.15.135:32824) 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1791522914 learned_addr learned my addr 172.21.15.135:0/1791522914 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f5164c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6effd640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51644520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1791522914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 msgr2=0x555f51644520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51644520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1791522914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 msgr2=0x555f5164c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f5164c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6f7fe640 1 -- 172.21.15.135:0/1791522914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f51651520 con 0x555f512a51b0 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.635+0000 7fca6effd640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51644520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.636+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fca68009bf0 tx=0x7fca68005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c9d19eb29e7128 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.636+0000 7fca657fa640 1 -- 172.21.15.135:0/1791522914 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6805c040 con 0x555f512a51b0 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.636+0000 7fca657fa640 1 -- 172.21.15.135:0/1791522914 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca68040070 con 0x555f512a51b0 2024-05-20T17:44:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.636+0000 7fca657fa640 1 -- 172.21.15.135:0/1791522914 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6804adb0 con 0x555f512a51b0 2024-05-20T17:44:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- 172.21.15.135:0/1791522914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 msgr2=0x555f5164c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fca68009bf0 tx=0x7fca68005fd0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- 172.21.15.135:0/1791522914 shutdown_connections 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5164c7c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f512844d0 0x555f5164c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 --2- 172.21.15.135:0/1791522914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f5127c2f0 0x555f51644520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- 172.21.15.135:0/1791522914 >> 172.21.15.135:0/1791522914 conn(0x555f51299300 msgr2=0x555f51643e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- 172.21.15.135:0/1791522914 shutdown_connections 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- 172.21.15.135:0/1791522914 wait complete. 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 -- start start 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.637+0000 7fca7c973740 1 Processor -- start 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 0x555f5165baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f512844d0 0x555f5165c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ab0e0 con 0x555f512a51b0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ac550 con 0x555f5127c2f0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ab7b0 con 0x555f512844d0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca7c973740 10 client.0 _ll_register_callbacks cb 0x7fca5800ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32826/0 (socket says 172.21.15.135:32826) 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6f7fe640 1 -- 172.21.15.135:0/2879982293 learned_addr learned my addr 172.21.15.135:0/2879982293 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 0x555f5165baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f512844d0 0x555f5165c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 -- 172.21.15.135:0/2879982293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f512844d0 msgr2=0x555f5165c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f512844d0 0x555f5165c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 -- 172.21.15.135:0/2879982293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 msgr2=0x555f5165c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 -- 172.21.15.135:0/2879982293 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f516caf30 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6f7fe640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca6effd640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 0x555f5165baf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca600cc600 tx=0x7fca60097760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d5c2e152862f55 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.638+0000 7fca4effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600b9060 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca68040070 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8571+0+0 (secure 0 0 0) 0x7fca60097af0 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca600b4070 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 10 client.26414 fetch_fsmap learned FSMap version 30 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f516cc180 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca68040070 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fca6007c030 con 0x555f5127c2f0 2024-05-20T17:44:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 10 client.26414 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 10 client.26414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 20 client.26414 populate_metadata read hostname 'smithi135' 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f512391c0 0x555f516ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 4 client.26414 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f515b0dc0 con 0x555f512391c0 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.639+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f512391c0 0x555f516ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.640+0000 7fca4effd640 10 client.26414 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.640+0000 7fca6e7fc640 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f512391c0 0x555f516ce950 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0e18689c9128cf server_cookie=da3edfcbc2b58553 in_seq=0 out_seq=0 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca4effd640 1 -- 172.21.15.135:0/2879982293 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f515b0dc0 con 0x555f512391c0 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca4effd640 10 client.26414 handle_command_reply: tid=0 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 client.26414 shutdown 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 msgr2=0x555f5165baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 0x555f5165baf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca600cc600 tx=0x7fca60097760 comp rx=0 tx=0).stop 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 shutdown_connections 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x555f512391c0 0x555f516ce950 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555f512a51b0 0x555f5165c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca4effd640 0 client.26414 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f512844d0 0x555f5165c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 --2- 172.21.15.135:0/2879982293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555f5127c2f0 0x555f5165baf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 >> 172.21.15.135:0/2879982293 conn(0x555f51299300 msgr2=0x555f51645cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 shutdown_connections 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 1 -- 172.21.15.135:0/2879982293 wait complete. 2024-05-20T17:44:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca7c973740 20 client.26414 trim_cache size 0 max 16384 2024-05-20T17:44:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:44:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:44:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:44:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 msgr2=0x7fca5c0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 0x7fca5c0a5200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fca6804e000 tx=0x7fca6804c000 comp rx=0 tx=0).stop 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 msgr2=0x7fca7019f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d770 tx=0x7fca6000dc30 comp rx=0 tx=0).stop 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 shutdown_connections 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fca5c0a2cf0 0x7fca5c0a5200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca70108fd0 0x7fca70199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca70108b30 0x7fca7019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 --2- 172.21.15.135:0/386799788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca70103280 0x7fca7019f4d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:44:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 >> 172.21.15.135:0/386799788 conn(0x7fca70078220 msgr2=0x7fca70100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:44:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 shutdown_connections 2024-05-20T17:44:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:44:59.655+0000 7fca759f5640 1 -- 172.21.15.135:0/386799788 wait complete. 2024-05-20T17:44:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: pgmap v362: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 369 op/s 2024-05-20T17:44:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:44:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:44:59.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:44:59 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: pgmap v362: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 369 op/s 2024-05-20T17:44:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:44:59.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:44:59.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:44:59 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: pgmap v362: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 369 op/s 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:44:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:44:59 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:45:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:01 smithi135 ceph-mon[32027]: pgmap v363: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-05-20T17:45:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:01 smithi160 ceph-mon[36261]: pgmap v363: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-05-20T17:45:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:01 smithi172 ceph-mon[36511]: pgmap v363: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-05-20T17:45:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:03 smithi135 ceph-mon[32027]: pgmap v364: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 363 op/s 2024-05-20T17:45:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:03 smithi160 ceph-mon[36261]: pgmap v364: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 363 op/s 2024-05-20T17:45:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:03 smithi172 ceph-mon[36511]: pgmap v364: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 363 op/s 2024-05-20T17:45:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:05 smithi135 ceph-mon[32027]: pgmap v365: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-20T17:45:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:05 smithi135 ceph-mon[32027]: osdmap e99: 12 total, 12 up, 12 in 2024-05-20T17:45:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:05 smithi160 ceph-mon[36261]: pgmap v365: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-20T17:45:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:05 smithi160 ceph-mon[36261]: osdmap e99: 12 total, 12 up, 12 in 2024-05-20T17:45:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:05 smithi172 ceph-mon[36511]: pgmap v365: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-20T17:45:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:05 smithi172 ceph-mon[36511]: osdmap e99: 12 total, 12 up, 12 in 2024-05-20T17:45:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:07 smithi135 ceph-mon[32027]: pgmap v367: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-05-20T17:45:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:07 smithi160 ceph-mon[36261]: pgmap v367: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-05-20T17:45:07.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:07 smithi172 ceph-mon[36511]: pgmap v367: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-05-20T17:45:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:09 smithi135 ceph-mon[32027]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2024-05-20T17:45:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:09 smithi160 ceph-mon[36261]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2024-05-20T17:45:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:09 smithi172 ceph-mon[36511]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 39 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2024-05-20T17:45:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:11 smithi135 ceph-mon[32027]: pgmap v369: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-05-20T17:45:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:11 smithi160 ceph-mon[36261]: pgmap v369: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-05-20T17:45:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:11 smithi172 ceph-mon[36511]: pgmap v369: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-05-20T17:45:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.816+0000 7f64adffb640 1 -- 172.21.15.135:0/1484403577 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a802f340 con 0x7f64b0102170 2024-05-20T17:45:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.816+0000 7f64b5a5a640 1 -- 172.21.15.135:0/1484403577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0102170 msgr2=0x7f64b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.816+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/1484403577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0102170 0x7f64b0069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009ca0 tx=0x7f64a802a8f0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.817+0000 7f64b5a5a640 1 -- 172.21.15.135:0/1484403577 shutdown_connections 2024-05-20T17:45:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.817+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/1484403577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0102170 0x7f64b0069420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.817+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/1484403577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 0x7f64b0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.817+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/1484403577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0107a10 0x7f64b01015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.817+0000 7f64b5a5a640 1 -- 172.21.15.135:0/1484403577 >> 172.21.15.135:0/1484403577 conn(0x7f64b0077160 msgr2=0x7f64b00775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.824+0000 7f64b5a5a640 1 -- 172.21.15.135:0/1484403577 shutdown_connections 2024-05-20T17:45:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.826+0000 7f64b5a5a640 1 -- 172.21.15.135:0/1484403577 wait complete. 2024-05-20T17:45:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.827+0000 7f64b5a5a640 1 Processor -- start 2024-05-20T17:45:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 -- start start 2024-05-20T17:45:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0107a10 0x7f64b01a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 0x7f64b01abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0112fb0 con 0x7f64b0102170 2024-05-20T17:45:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0112e30 con 0x7f64b0107a10 2024-05-20T17:45:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.828+0000 7f64b5a5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0113130 con 0x7f64b0107eb0 2024-05-20T17:45:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.829+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.829+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59496/0 (socket says 172.21.15.135:59496) 2024-05-20T17:45:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.829+0000 7f64aeffd640 1 -- 172.21.15.135:0/2670773074 learned_addr learned my addr 172.21.15.135:0/2670773074 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.829+0000 7f64af7fe640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 0x7f64b01abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 -- 172.21.15.135:0/2670773074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 msgr2=0x7f64b01abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 0x7f64b01abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 -- 172.21.15.135:0/2670773074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0107a10 msgr2=0x7f64b01a11d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:45:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0107a10 0x7f64b01a11d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 -- 172.21.15.135:0/2670773074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b01a1ab0 con 0x7f64b0102170 2024-05-20T17:45:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.830+0000 7f64aeffd640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f64a000b450 tx=0x7f64a000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.831+0000 7f64b4a58640 1 -- 172.21.15.135:0/2670773074 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0015020 con 0x7f64b0102170 2024-05-20T17:45:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.831+0000 7f64b4a58640 1 -- 172.21.15.135:0/2670773074 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a0011d70 con 0x7f64b0102170 2024-05-20T17:45:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.831+0000 7f64b4a58640 1 -- 172.21.15.135:0/2670773074 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f340 con 0x7f64b0102170 2024-05-20T17:45:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.834+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b01ac370 con 0x7f64b0102170 2024-05-20T17:45:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.834+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01ac870 con 0x7f64b0102170 2024-05-20T17:45:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.839+0000 7f64bc9db740 1 Processor -- start 2024-05-20T17:45:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 -- start start 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b75f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64b4a58640 1 -- 172.21.15.135:0/2670773074 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f64a0018020 con 0x7f64b0102170 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b75fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d63b6c4340 con 0x55d63b3972f0 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d63b66c290 con 0x55d63b3c01b0 2024-05-20T17:45:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.842+0000 7f64bc9db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d63b6c0300 con 0x55d63b39f4d0 2024-05-20T17:45:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.843+0000 7f64b4a58640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 0x7f64940a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.844+0000 7f64b4a58640 1 -- 172.21.15.135:0/2670773074 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f64a00ced00 con 0x7f64b0102170 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.844+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.844+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59500/0 (socket says 172.21.15.135:59500) 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.844+0000 7f64aeffd640 1 -- 172.21.15.135:0/1915308277 learned_addr learned my addr 172.21.15.135:0/1915308277 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.844+0000 7f64af7fe640 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b75f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64af7fe640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 0x7f64940a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 -- 172.21.15.135:0/1915308277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 msgr2=0x55d63b75fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b75fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 -- 172.21.15.135:0/1915308277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 msgr2=0x55d63b75f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b75f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 -- 172.21.15.135:0/1915308277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63b6908e0 con 0x55d63b3972f0 2024-05-20T17:45:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.845+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f64a0097c40 tx=0x7f64a009ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b661881aa0effee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.846+0000 7f64a5ffb640 1 -- 172.21.15.135:0/1915308277 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00b4070 con 0x55d63b3972f0 2024-05-20T17:45:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.846+0000 7f64a5ffb640 1 -- 172.21.15.135:0/1915308277 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a00a3ee0 con 0x55d63b3972f0 2024-05-20T17:45:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.846+0000 7f64a5ffb640 1 -- 172.21.15.135:0/1915308277 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00cc610 con 0x55d63b3972f0 2024-05-20T17:45:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.848+0000 7f64bc9db740 1 -- 172.21.15.135:0/1915308277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 msgr2=0x55d63b75f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.848+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f64a0097c40 tx=0x7f64a009ba30 comp rx=0 tx=0).stop 2024-05-20T17:45:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.848+0000 7f64af7fe640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 0x7f64940a53d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006010 tx=0x7f64a802a8f0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.849+0000 7f64bc9db740 1 -- 172.21.15.135:0/1915308277 shutdown_connections 2024-05-20T17:45:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.849+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b75fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.849+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b75f5c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.849+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1915308277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b75f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.849+0000 7f64bc9db740 1 -- 172.21.15.135:0/1915308277 >> 172.21.15.135:0/1915308277 conn(0x55d63b3b4300 msgr2=0x55d63b75b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.853+0000 7f64bc9db740 1 -- 172.21.15.135:0/1915308277 shutdown_connections 2024-05-20T17:45:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.855+0000 7f64bc9db740 1 -- 172.21.15.135:0/1915308277 wait complete. 2024-05-20T17:45:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.855+0000 7f64bc9db740 1 -- start start 2024-05-20T17:45:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 Processor -- start 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b3972f0 0x55d63b76b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b769580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d63b77d210 con 0x55d63b39f4d0 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d63b67f790 con 0x55d63b3c01b0 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d63b77d390 con 0x55d63b3972f0 2024-05-20T17:45:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64bc9db740 10 client.0 _ll_register_callbacks cb 0x55d63b6baa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64ae7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64ae7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59510/0 (socket says 172.21.15.135:59510) 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.856+0000 7f64ae7fc640 1 -- 172.21.15.135:0/883301076 learned_addr learned my addr 172.21.15.135:0/883301076 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64af7fe640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b769580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64ae7fc640 1 -- 172.21.15.135:0/883301076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b3972f0 msgr2=0x55d63b76b090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:45:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b3972f0 0x55d63b76b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64ae7fc640 1 -- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 msgr2=0x55d63b769580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b769580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.857+0000 7f64ae7fc640 1 -- 172.21.15.135:0/883301076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63b3d8210 con 0x55d63b39f4d0 2024-05-20T17:45:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.858+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f649c009d80 tx=0x7f649c00b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d37cce960325e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.858+0000 7f6492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.859+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c011420 con 0x55d63b39f4d0 2024-05-20T17:45:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.859+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a00a3ee0 con 0x55d63b39f4d0 2024-05-20T17:45:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.859+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f649c0115c0 con 0x55d63b39f4d0 2024-05-20T17:45:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.862+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f649c01f050 con 0x55d63b39f4d0 2024-05-20T17:45:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.865+0000 7f64bc9db740 10 client.16860 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.865+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d63b4a4620 con 0x55d63b39f4d0 2024-05-20T17:45:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a00a3ee0 con 0x55d63b39f4d0 2024-05-20T17:45:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f649c010ab0 con 0x55d63b39f4d0 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 10 client.16860 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 20 client.16860 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b37ed80 0x55d63b78cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 4 client.16860 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:45:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.870+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63b6d1a70 con 0x55d63b37ed80 2024-05-20T17:45:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.874+0000 7f64aeffd640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b37ed80 0x55d63b78cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.877+0000 7f64aeffd640 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b37ed80 0x55d63b78cd80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7548c26022b6259 server_cookie=548c32d5ae8b912f in_seq=0 out_seq=0 2024-05-20T17:45:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.877+0000 7f6492ffd640 10 client.16860 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.880+0000 7f6492ffd640 1 -- 172.21.15.135:0/883301076 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d63b6d1a70 con 0x55d63b37ed80 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.880+0000 7f6492ffd640 10 client.16860 handle_command_reply: tid=0 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.881+0000 7f64bc9db740 1 client.16860 shutdown 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 msgr2=0x55d63b76b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f649c009d80 tx=0x7f649c00b4b0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 shutdown_connections 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b37ed80 0x55d63b78cd80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b769580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b39f4d0 0x55d63b76b5d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 --2- 172.21.15.135:0/883301076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b3972f0 0x55d63b76b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.883+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 >> 172.21.15.135:0/883301076 conn(0x55d63b3b4300 msgr2=0x55d63b75f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.884+0000 7f6492ffd640 0 client.16860 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.887+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 shutdown_connections 2024-05-20T17:45:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.888+0000 7f64bc9db740 1 -- 172.21.15.135:0/883301076 wait complete. 2024-05-20T17:45:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.892+0000 7f64bc9db740 20 client.16860 trim_cache size 0 max 16384 2024-05-20T17:45:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.921+0000 7f64bc9db740 1 Processor -- start 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 -- start start 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b792ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3c01b0 0x55d63b762d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01af660 con 0x55d63b3c01b0 2024-05-20T17:45:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01ace70 con 0x55d63b3972f0 2024-05-20T17:45:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.922+0000 7f64bc9db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64b00690c0 con 0x55d63b39f4d0 2024-05-20T17:45:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.923+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.923+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51500/0 (socket says 172.21.15.135:51500) 2024-05-20T17:45:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.923+0000 7f64aeffd640 1 -- 172.21.15.135:0/1320678584 learned_addr learned my addr 172.21.15.135:0/1320678584 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.925+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b792ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.927+0000 7f64aeffd640 1 -- 172.21.15.135:0/1320678584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 msgr2=0x55d63b792ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.927+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b792ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.927+0000 7f64aeffd640 1 -- 172.21.15.135:0/1320678584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3c01b0 msgr2=0x55d63b762d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.927+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3c01b0 0x55d63b762d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.927+0000 7f64aeffd640 1 -- 172.21.15.135:0/1320678584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63b37efb0 con 0x55d63b3972f0 2024-05-20T17:45:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.930+0000 7f64aeffd640 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f64a00976d0 tx=0x7f64a009ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8575b1e5ce103147 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.933+0000 7f64a57fa640 1 -- 172.21.15.135:0/1320678584 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00b9070 con 0x55d63b3972f0 2024-05-20T17:45:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.933+0000 7f64a57fa640 1 -- 172.21.15.135:0/1320678584 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a00a3ee0 con 0x55d63b3972f0 2024-05-20T17:45:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.934+0000 7f64bc9db740 1 -- 172.21.15.135:0/1320678584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 msgr2=0x55d63b792580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.934+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f64a00976d0 tx=0x7f64a009ba30 comp rx=0 tx=0).stop 2024-05-20T17:45:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.940+0000 7f64bc9db740 1 -- 172.21.15.135:0/1320678584 shutdown_connections 2024-05-20T17:45:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.940+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3c01b0 0x55d63b762d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.940+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b792ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.940+0000 7f64bc9db740 1 --2- 172.21.15.135:0/1320678584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3972f0 0x55d63b792580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.940+0000 7f64bc9db740 1 -- 172.21.15.135:0/1320678584 >> 172.21.15.135:0/1320678584 conn(0x55d63b3b4300 msgr2=0x55d63b767e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.948+0000 7f64bc9db740 1 -- 172.21.15.135:0/1320678584 shutdown_connections 2024-05-20T17:45:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.948+0000 7f64bc9db740 1 -- 172.21.15.135:0/1320678584 wait complete. 2024-05-20T17:45:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.949+0000 7f64bc9db740 1 -- start start 2024-05-20T17:45:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.949+0000 7f64bc9db740 1 Processor -- start 2024-05-20T17:45:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b77ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b77f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0072590 con 0x55d63b3972f0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0073a00 con 0x55d63b3c01b0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0072c60 con 0x55d63b39f4d0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.953+0000 7f64bc9db740 10 client.0 _ll_register_callbacks cb 0x7f649c006e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.954+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.954+0000 7f64aeffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59534/0 (socket says 172.21.15.135:59534) 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.954+0000 7f64aeffd640 1 -- 172.21.15.135:0/3104763834 learned_addr learned my addr 172.21.15.135:0/3104763834 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64af7fe640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b77f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64aeffd640 1 -- 172.21.15.135:0/3104763834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 msgr2=0x55d63b77ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64aeffd640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b77ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64aeffd640 1 -- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 msgr2=0x55d63b77f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64aeffd640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b77f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.955+0000 7f64aeffd640 1 -- 172.21.15.135:0/3104763834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63b77f660 con 0x55d63b3972f0 2024-05-20T17:45:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.956+0000 7f64aeffd640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f64a009aca0 tx=0x7f64a0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82224c902b1a22a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.957+0000 7f6492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.957+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00b9070 con 0x55d63b3972f0 2024-05-20T17:45:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.957+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f64a00a3c50 con 0x55d63b3972f0 2024-05-20T17:45:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.959+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a00a3ee0 con 0x55d63b3972f0 2024-05-20T17:45:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.963+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f64a00b4040 con 0x55d63b3972f0 2024-05-20T17:45:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.964+0000 7f64bc9db740 10 client.16863 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.964+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d63b7efc90 con 0x55d63b3972f0 2024-05-20T17:45:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.974+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a00a3ee0 con 0x55d63b3972f0 2024-05-20T17:45:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.974+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f64a0022060 con 0x55d63b3972f0 2024-05-20T17:45:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 10 client.16863 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 20 client.16863 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b3541c0 0x55d63b7f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 4 client.16863 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:45:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.975+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d63b6cbdc0 con 0x55d63b3541c0 2024-05-20T17:45:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.977+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b3541c0 0x55d63b7f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.982+0000 7f64ae7fc640 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b3541c0 0x55d63b7f0310 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41daf3be143735a server_cookie=f54ab1cfa0986239 in_seq=0 out_seq=0 2024-05-20T17:45:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:12.982+0000 7f6492ffd640 10 client.16863 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.127+0000 7f6492ffd640 1 -- 172.21.15.135:0/3104763834 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d63b6cbdc0 con 0x55d63b3541c0 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.127+0000 7f6492ffd640 10 client.16863 handle_command_reply: tid=0 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.127+0000 7f64bc9db740 1 client.16863 shutdown 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 msgr2=0x55d63b782880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f64a009aca0 tx=0x7f64a0010830 comp rx=0 tx=0).stop 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 shutdown_connections 2024-05-20T17:45:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55d63b3541c0 0x55d63b7f0310 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d63b3c01b0 0x55d63b77f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d63b39f4d0 0x55d63b77ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 --2- 172.21.15.135:0/3104763834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d63b3972f0 0x55d63b782880 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 >> 172.21.15.135:0/3104763834 conn(0x55d63b3b4300 msgr2=0x55d63b762d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f6492ffd640 0 client.16863 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 shutdown_connections 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 1 -- 172.21.15.135:0/3104763834 wait complete. 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.128+0000 7f64bc9db740 20 client.16863 trim_cache size 0 max 16384 2024-05-20T17:45:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:45:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:45:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:45:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 msgr2=0x7f64940a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 0x7f64940a53d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006010 tx=0x7f64a802a8f0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 msgr2=0x7f64b01a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f64a000b450 tx=0x7f64a000b910 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 shutdown_connections 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f64940a2ec0 0x7f64940a53d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0107eb0 0x7f64b01abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b0107a10 0x7f64b01a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 --2- 172.21.15.135:0/2670773074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b0102170 0x7f64b01a0c90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 >> 172.21.15.135:0/2670773074 conn(0x7f64b0077160 msgr2=0x7f64b0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.129+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 shutdown_connections 2024-05-20T17:45:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:13.130+0000 7f64b5a5a640 1 -- 172.21.15.135:0/2670773074 wait complete. 2024-05-20T17:45:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:13 smithi135 ceph-mon[32027]: pgmap v370: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 205 op/s 2024-05-20T17:45:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:13 smithi160 ceph-mon[36261]: pgmap v370: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 205 op/s 2024-05-20T17:45:13.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:13 smithi172 ceph-mon[36511]: pgmap v370: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 205 op/s 2024-05-20T17:45:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:15 smithi135 ceph-mon[32027]: pgmap v371: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-05-20T17:45:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:15 smithi160 ceph-mon[36261]: pgmap v371: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-05-20T17:45:15.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:15 smithi172 ceph-mon[36511]: pgmap v371: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-05-20T17:45:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:17 smithi135 ceph-mon[32027]: pgmap v372: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-05-20T17:45:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:17 smithi160 ceph-mon[36261]: pgmap v372: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-05-20T17:45:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:17 smithi172 ceph-mon[36511]: pgmap v372: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-05-20T17:45:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:19 smithi135 ceph-mon[32027]: pgmap v373: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2024-05-20T17:45:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:19 smithi160 ceph-mon[36261]: pgmap v373: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2024-05-20T17:45:19.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:19 smithi172 ceph-mon[36511]: pgmap v373: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2024-05-20T17:45:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:21 smithi135 ceph-mon[32027]: pgmap v374: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 956 KiB/s wr, 114 op/s 2024-05-20T17:45:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:21 smithi160 ceph-mon[36261]: pgmap v374: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 956 KiB/s wr, 114 op/s 2024-05-20T17:45:21.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:21 smithi172 ceph-mon[36511]: pgmap v374: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 956 KiB/s wr, 114 op/s 2024-05-20T17:45:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:23 smithi135 ceph-mon[32027]: pgmap v375: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-05-20T17:45:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:23 smithi160 ceph-mon[36261]: pgmap v375: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-05-20T17:45:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:23 smithi172 ceph-mon[36511]: pgmap v375: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-05-20T17:45:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:25 smithi135 ceph-mon[32027]: pgmap v376: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 139 op/s 2024-05-20T17:45:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:25 smithi160 ceph-mon[36261]: pgmap v376: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 139 op/s 2024-05-20T17:45:25.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:25 smithi172 ceph-mon[36511]: pgmap v376: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 139 op/s 2024-05-20T17:45:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 -- 172.21.15.135:0/2739044435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8101a10 msgr2=0x7f3ce8101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/2739044435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8101a10 0x7f3ce8101e20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009900 tx=0x7f3ce002a3f0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 -- 172.21.15.135:0/2739044435 shutdown_connections 2024-05-20T17:45:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/2739044435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce8106e90 0x7f3ce8107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/2739044435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce8106870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/2739044435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8101a10 0x7f3ce8101e20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 -- 172.21.15.135:0/2739044435 >> 172.21.15.135:0/2739044435 conn(0x7f3ce8077160 msgr2=0x7f3ce80775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 -- 172.21.15.135:0/2739044435 shutdown_connections 2024-05-20T17:45:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.284+0000 7f3cee1d5640 1 -- 172.21.15.135:0/2739044435 wait complete. 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.285+0000 7f3cee1d5640 1 Processor -- start 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 -- start start 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce8101a10 0x7f3ce819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8106e90 0x7f3ce81a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce8119430 con 0x7f3ce8106e90 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce81192b0 con 0x7f3ce8106460 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.286+0000 7f3cee1d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce81195b0 con 0x7f3ce8101a10 2024-05-20T17:45:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:50800/0 (socket says 172.21.15.135:50800) 2024-05-20T17:45:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3324029341 learned_addr learned my addr 172.21.15.135:0/3324029341 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3324029341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce8101a10 msgr2=0x7f3ce819fe10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce8101a10 0x7f3ce819fe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8106e90 msgr2=0x7f3ce81a4630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8106e90 0x7f3ce81a4630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3324029341 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce81a4c70 con 0x7f3ce8106460 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.287+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800ebc0 tx=0x7f3cd800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.288+0000 7f3ce4ff9640 1 -- 172.21.15.135:0/3324029341 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8010630 con 0x7f3ce8106460 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.288+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce81a4f60 con 0x7f3ce8106460 2024-05-20T17:45:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.288+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce81ac8e0 con 0x7f3ce8106460 2024-05-20T17:45:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.288+0000 7f3ce4ff9640 1 -- 172.21.15.135:0/3324029341 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd8010cb0 con 0x7f3ce8106460 2024-05-20T17:45:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.290+0000 7f3ce4ff9640 1 -- 172.21.15.135:0/3324029341 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8018c70 con 0x7f3ce8106460 2024-05-20T17:45:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.292+0000 7f3cf5082740 1 Processor -- start 2024-05-20T17:45:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.293+0000 7f3cf5082740 1 -- start start 2024-05-20T17:45:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.293+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x55648419e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x55648419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3cf5082740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556484103340 con 0x556483dde4d0 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3cf5082740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5564840ab290 con 0x556483dff1b0 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3cf5082740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5564840ff300 con 0x556483dd62f0 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:50804/0 (socket says 172.21.15.135:50804) 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 -- 172.21.15.135:0/183917554 learned_addr learned my addr 172.21.15.135:0/183917554 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x55648419e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce4ff9640 1 -- 172.21.15.135:0/3324029341 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f3cd80107d0 con 0x7f3ce8106460 2024-05-20T17:45:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 -- 172.21.15.135:0/183917554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 msgr2=0x55648419e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x55648419e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 -- 172.21.15.135:0/183917554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 msgr2=0x55648419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x55648419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.294+0000 7f3ce7fff640 1 -- 172.21.15.135:0/183917554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564840cf8e0 con 0x556483dff1b0 2024-05-20T17:45:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b980 tx=0x7f3cdc00be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd2a5429578e2d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ccdffb640 1 -- 172.21.15.135:0/183917554 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc016070 con 0x556483dff1b0 2024-05-20T17:45:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ce4ff9640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 0x7f3cd00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ccdffb640 1 -- 172.21.15.135:0/183917554 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cdc005500 con 0x556483dff1b0 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ccdffb640 1 -- 172.21.15.135:0/183917554 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc004d70 con 0x556483dff1b0 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.295+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 0x7f3cd00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3ce4ff9640 1 -- 172.21.15.135:0/3324029341 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f3cd80cfcb0 con 0x7f3ce8106460 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 -- 172.21.15.135:0/183917554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 msgr2=0x55648419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b980 tx=0x7f3cdc00be40 comp rx=0 tx=0).stop 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 0x7f3cd00a50e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55648419bb70 tx=0x7f3ce0000bc0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 -- 172.21.15.135:0/183917554 shutdown_connections 2024-05-20T17:45:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x55648419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x55648419e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 --2- 172.21.15.135:0/183917554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x55648419e080 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 -- 172.21.15.135:0/183917554 >> 172.21.15.135:0/183917554 conn(0x556483df3300 msgr2=0x55648419a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 -- 172.21.15.135:0/183917554 shutdown_connections 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.296+0000 7f3cf5082740 1 -- 172.21.15.135:0/183917554 wait complete. 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 -- start start 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 Processor -- start 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x5564841ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.297+0000 7f3cf5082740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564841ab200 con 0x556483dde4d0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cf5082740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5564840be790 con 0x556483dff1b0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cf5082740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5564841ab380 con 0x556483dd62f0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cf5082740 10 client.0 _ll_register_callbacks cb 0x5564840f9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47264/0 (socket says 172.21.15.135:47264) 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3918348568 learned_addr learned my addr 172.21.15.135:0/3918348568 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x5564841ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3918348568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 msgr2=0x5564841a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 msgr2=0x5564841ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x5564841ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/3918348568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556483e17210 con 0x556483dde4d0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8098570 tx=0x7f3cd809ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dc839417151481 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8010e60 con 0x556483dde4d0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cdc005500 con 0x556483dde4d0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.298+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f3cd8098780 con 0x556483dde4d0 2024-05-20T17:45:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3cd80a04c0 con 0x556483dde4d0 2024-05-20T17:45:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cf5082740 10 client.16869 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556483ee3620 con 0x556483dde4d0 2024-05-20T17:45:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cdc005500 con 0x556483dde4d0 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3cd809b560 con 0x556483dde4d0 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cf5082740 10 client.16869 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cf5082740 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.299+0000 7f3cf5082740 20 client.16869 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.300+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483dbdd80 0x5564841baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.300+0000 7f3cf5082740 4 client.16869 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.300+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556484110a70 con 0x556483dbdd80 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.300+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483dbdd80 0x5564841baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.301+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483dbdd80 0x5564841baef0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f6ca8b56fbe6952 server_cookie=d466daee07c67d28 in_seq=0 out_seq=0 2024-05-20T17:45:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.301+0000 7f3cc6ffd640 10 client.16869 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.302+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/3918348568 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556484110a70 con 0x556483dbdd80 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.302+0000 7f3cc6ffd640 10 client.16869 handle_command_reply: tid=0 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.302+0000 7f3cf5082740 1 client.16869 shutdown 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.303+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 msgr2=0x5564841a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.303+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8098570 tx=0x7f3cd809ba70 comp rx=0 tx=0).stop 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 shutdown_connections 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483dbdd80 0x5564841baef0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dff1b0 0x5564841ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dde4d0 0x5564841a8cb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 --2- 172.21.15.135:0/3918348568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 >> 172.21.15.135:0/3918348568 conn(0x556483df3300 msgr2=0x55648419fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cc6ffd640 0 client.16869 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 shutdown_connections 2024-05-20T17:45:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 1 -- 172.21.15.135:0/3918348568 wait complete. 2024-05-20T17:45:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.304+0000 7f3cf5082740 20 client.16869 trim_cache size 0 max 16384 2024-05-20T17:45:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.335+0000 7f3cf5082740 1 Processor -- start 2024-05-20T17:45:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.335+0000 7f3cf5082740 1 -- start start 2024-05-20T17:45:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.335+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.335+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.335+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:51504/0 (socket says 172.21.15.135:51504) 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:50828/0 (socket says 172.21.15.135:50828) 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce77fe640 1 -- 172.21.15.135:0/854875541 learned_addr learned my addr 172.21.15.135:0/854875541 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd40111d0 con 0x556483dff1b0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd400e9e0 con 0x556483dde4d0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd400c850 con 0x556483dd62f0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/854875541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 msgr2=0x5564841a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/854875541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 msgr2=0x5564841aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.336+0000 7f3ce6ffd640 1 -- 172.21.15.135:0/854875541 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564841a4100 con 0x556483dde4d0 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.337+0000 7f3ce6ffd640 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3cd809be10 tx=0x7f3cd809a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3819f4baffbd2be6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.337+0000 7f3ccd7fa640 1 -- 172.21.15.135:0/854875541 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8010e60 con 0x556483dde4d0 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.337+0000 7f3ccd7fa640 1 -- 172.21.15.135:0/854875541 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd809c810 con 0x556483dde4d0 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.337+0000 7f3ccd7fa640 1 -- 172.21.15.135:0/854875541 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8098780 con 0x556483dde4d0 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 msgr2=0x5564841ae620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3cd809be10 tx=0x7f3cd809a620 comp rx=0 tx=0).stop 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 shutdown_connections 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841ae620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 --2- 172.21.15.135:0/854875541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.339+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 >> 172.21.15.135:0/854875541 conn(0x556483df3300 msgr2=0x5564841a6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.340+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 shutdown_connections 2024-05-20T17:45:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.340+0000 7f3cf5082740 1 -- 172.21.15.135:0/854875541 wait complete. 2024-05-20T17:45:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.341+0000 7f3cf5082740 1 -- start start 2024-05-20T17:45:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.341+0000 7f3cf5082740 1 Processor -- start 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3cf5082740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:51518/0 (socket says 172.21.15.135:51518) 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3ce6ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:50830/0 (socket says 172.21.15.135:50830) 2024-05-20T17:45:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.342+0000 7f3ce77fe640 1 -- 172.21.15.135:0/2277033629 learned_addr learned my addr 172.21.15.135:0/2277033629 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd400cea0 con 0x556483dff1b0 2024-05-20T17:45:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd400e310 con 0x556483dde4d0 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd400d570 con 0x556483dd62f0 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3cf5082740 10 client.0 _ll_register_callbacks cb 0x7f3cd800eb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 -- 172.21.15.135:0/2277033629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 msgr2=0x5564841af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 -- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 msgr2=0x5564841af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.343+0000 7f3ce7fff640 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556484221490 con 0x556483dff1b0 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.344+0000 7f3ce7fff640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841afcb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b950 tx=0x7f3cdc00dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5b07629b1a9c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.344+0000 7f3cc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.344+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc029060 con 0x556483dff1b0 2024-05-20T17:45:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.345+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f3cdc004240 con 0x556483dff1b0 2024-05-20T17:45:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.345+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd809c810 con 0x556483dff1b0 2024-05-20T17:45:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.346+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3cdc016040 con 0x556483dff1b0 2024-05-20T17:45:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.346+0000 7f3cf5082740 10 client.16875 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.346+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564842226e0 con 0x556483dff1b0 2024-05-20T17:45:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.346+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd809c810 con 0x556483dff1b0 2024-05-20T17:45:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3cdc010460 con 0x556483dff1b0 2024-05-20T17:45:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 10 client.16875 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 20 client.16875 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483d931c0 0x556484224bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 4 client.16875 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55648410adc0 con 0x556483d931c0 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.347+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483d931c0 0x556484224bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.348+0000 7f3cc6ffd640 10 client.16875 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.348+0000 7f3ce77fe640 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483d931c0 0x556484224bb0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb961fb8aba53e7 server_cookie=6a7dca0ea6c3892b in_seq=0 out_seq=0 2024-05-20T17:45:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.448+0000 7f3cc6ffd640 1 -- 172.21.15.135:0/2277033629 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55648410adc0 con 0x556483d931c0 2024-05-20T17:45:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.448+0000 7f3cc6ffd640 10 client.16875 handle_command_reply: tid=0 2024-05-20T17:45:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.448+0000 7f3cf5082740 1 client.16875 shutdown 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 msgr2=0x5564841afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841afcb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b950 tx=0x7f3cdc00dc20 comp rx=0 tx=0).stop 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 shutdown_connections 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556483d931c0 0x556484224bb0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556483dff1b0 0x5564841afcb0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556483dde4d0 0x5564841af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 --2- 172.21.15.135:0/2277033629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556483dd62f0 0x5564841af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 >> 172.21.15.135:0/2277033629 conn(0x556483df3300 msgr2=0x5564841a9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cc6ffd640 0 client.16875 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 shutdown_connections 2024-05-20T17:45:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 1 -- 172.21.15.135:0/2277033629 wait complete. 2024-05-20T17:45:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.449+0000 7f3cf5082740 20 client.16875 trim_cache size 0 max 16384 2024-05-20T17:45:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:45:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:45:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:45:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:45:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 msgr2=0x7f3cd00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 0x7f3cd00a50e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55648419bb70 tx=0x7f3ce0000bc0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 msgr2=0x7f3ce81a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800ebc0 tx=0x7f3cd800c6a0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 shutdown_connections 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f3cd00a2bd0 0x7f3cd00a50e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce8106e90 0x7f3ce81a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce8106460 0x7f3ce81a0370 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 --2- 172.21.15.135:0/3324029341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce8101a10 0x7f3ce819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.450+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 >> 172.21.15.135:0/3324029341 conn(0x7f3ce8077160 msgr2=0x7f3ce81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.451+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 shutdown_connections 2024-05-20T17:45:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:26.451+0000 7f3cee1d5640 1 -- 172.21.15.135:0/3324029341 wait complete. 2024-05-20T17:45:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:27 smithi135 ceph-mon[32027]: pgmap v377: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-20T17:45:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:27 smithi160 ceph-mon[36261]: pgmap v377: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-20T17:45:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:27 smithi172 ceph-mon[36511]: pgmap v377: 97 pgs: 20 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 37 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-20T17:45:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:29 smithi135 ceph-mon[32027]: pgmap v378: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 178 op/s 2024-05-20T17:45:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:29 smithi160 ceph-mon[36261]: pgmap v378: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 178 op/s 2024-05-20T17:45:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:29 smithi172 ceph-mon[36511]: pgmap v378: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 178 op/s 2024-05-20T17:45:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:31 smithi135 ceph-mon[32027]: pgmap v379: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-20T17:45:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:31 smithi160 ceph-mon[36261]: pgmap v379: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-20T17:45:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:31 smithi172 ceph-mon[36511]: pgmap v379: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-20T17:45:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:33 smithi135 ceph-mon[32027]: pgmap v380: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-05-20T17:45:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:33 smithi160 ceph-mon[36261]: pgmap v380: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-05-20T17:45:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:33 smithi172 ceph-mon[36511]: pgmap v380: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-05-20T17:45:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:35 smithi135 ceph-mon[32027]: pgmap v381: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-05-20T17:45:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:35 smithi160 ceph-mon[36261]: pgmap v381: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-05-20T17:45:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:35 smithi172 ceph-mon[36511]: pgmap v381: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-05-20T17:45:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:37 smithi135 ceph-mon[32027]: pgmap v382: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-20T17:45:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:37 smithi160 ceph-mon[36261]: pgmap v382: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-20T17:45:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:37 smithi172 ceph-mon[36511]: pgmap v382: 97 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 45 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-20T17:45:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 -- 172.21.15.135:0/3413876177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010d090 msgr2=0x7f463010f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 --2- 172.21.15.135:0/3413876177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010d090 0x7f463010f580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4628009ca0 tx=0x7f462802a9e0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 -- 172.21.15.135:0/3413876177 shutdown_connections 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 --2- 172.21.15.135:0/3413876177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010d090 0x7f463010f580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 --2- 172.21.15.135:0/3413876177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463010a6e0 0x7f463010cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 --2- 172.21.15.135:0/3413876177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 0x7f4630104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 -- 172.21.15.135:0/3413876177 >> 172.21.15.135:0/3413876177 conn(0x7f4630077160 msgr2=0x7f46300775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 -- 172.21.15.135:0/3413876177 shutdown_connections 2024-05-20T17:45:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.586+0000 7f4636413640 1 -- 172.21.15.135:0/3413876177 wait complete. 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.587+0000 7f4636413640 1 Processor -- start 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.587+0000 7f4636413640 1 -- start start 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 0x7f46301030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463010d090 0x7f4630101b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4630112e90 con 0x7f463010d090 2024-05-20T17:45:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4630112d10 con 0x7f4630103c80 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f4636413640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4630113010 con 0x7f463010a6e0 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:56108/0 (socket says 172.21.15.135:56108) 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 -- 172.21.15.135:0/3411856346 learned_addr learned my addr 172.21.15.135:0/3411856346 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462ffff640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 0x7f46301030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 -- 172.21.15.135:0/3411856346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 msgr2=0x7f46301030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 0x7f46301030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 -- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463010d090 msgr2=0x7f4630101b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463010d090 0x7f4630101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.588+0000 7f462f7fe640 1 -- 172.21.15.135:0/3411856346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4630102330 con 0x7f463010a6e0 2024-05-20T17:45:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f462f7fe640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f462400ea60 tx=0x7f462400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f462d7fa640 1 -- 172.21.15.135:0/3411856346 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462400cde0 con 0x7f463010a6e0 2024-05-20T17:45:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f462d7fa640 1 -- 172.21.15.135:0/3411856346 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46240035f0 con 0x7f463010a6e0 2024-05-20T17:45:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f462d7fa640 1 -- 172.21.15.135:0/3411856346 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624010670 con 0x7f463010a6e0 2024-05-20T17:45:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46301ac2d0 con 0x7f463010a6e0 2024-05-20T17:45:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.589+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46301ac7a0 con 0x7f463010a6e0 2024-05-20T17:45:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.593+0000 7f462d7fa640 1 -- 172.21.15.135:0/3411856346 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f4624010810 con 0x7f463010a6e0 2024-05-20T17:45:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.593+0000 7f463d38a740 1 Processor -- start 2024-05-20T17:45:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.593+0000 7f463d38a740 1 -- start start 2024-05-20T17:45:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a79080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a795c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a79b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e6029de340 con 0x55e6026da1b0 2024-05-20T17:45:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e602986290 con 0x55e6026b94d0 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f463d38a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e6029da300 con 0x55e6026b12f0 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a79b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a79080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a79b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:59974/0 (socket says 172.21.15.135:59974) 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f462f7fe640 1 -- 172.21.15.135:0/2996555877 learned_addr learned my addr 172.21.15.135:0/2996555877 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f462ffff640 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a795c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f462d7fa640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 0x7f46180a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 -- 172.21.15.135:0/2996555877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 msgr2=0x55e602a795c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a795c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 -- 172.21.15.135:0/2996555877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 msgr2=0x55e602a79b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a79b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.594+0000 7f46349b0640 1 -- 172.21.15.135:0/2996555877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6029aa8e0 con 0x55e6026da1b0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.595+0000 7f462d7fa640 1 -- 172.21.15.135:0/3411856346 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f46240cf680 con 0x7f463010a6e0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.595+0000 7f46349b0640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 0x7f46180a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.595+0000 7f46349b0640 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a79080 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f462802afd0 tx=0x7f4628009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254e6504665ae8b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.595+0000 7f46167fc640 1 -- 172.21.15.135:0/2996555877 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628033070 con 0x55e6026da1b0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.595+0000 7f46349b0640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 0x7f46180a53d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4628048000 tx=0x7f4628049000 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.596+0000 7f46167fc640 1 -- 172.21.15.135:0/2996555877 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4628003e00 con 0x55e6026da1b0 2024-05-20T17:45:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.596+0000 7f46167fc640 1 -- 172.21.15.135:0/2996555877 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280042a0 con 0x55e6026da1b0 2024-05-20T17:45:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 -- 172.21.15.135:0/2996555877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 msgr2=0x55e602a79080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a79080 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f462802afd0 tx=0x7f4628009490 comp rx=0 tx=0).stop 2024-05-20T17:45:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 -- 172.21.15.135:0/2996555877 shutdown_connections 2024-05-20T17:45:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a79b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a795c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 --2- 172.21.15.135:0/2996555877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a79080 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.597+0000 7f463d38a740 1 -- 172.21.15.135:0/2996555877 >> 172.21.15.135:0/2996555877 conn(0x55e6026ce300 msgr2=0x55e602a75830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.600+0000 7f463d38a740 1 -- 172.21.15.135:0/2996555877 shutdown_connections 2024-05-20T17:45:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.601+0000 7f463d38a740 1 -- 172.21.15.135:0/2996555877 wait complete. 2024-05-20T17:45:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.601+0000 7f463d38a740 1 -- start start 2024-05-20T17:45:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.601+0000 7f463d38a740 1 Processor -- start 2024-05-20T17:45:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b12f0 0x55e602a83780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a83ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e602a86150 con 0x55e6026b12f0 2024-05-20T17:45:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e602999790 con 0x55e6026b94d0 2024-05-20T17:45:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e602a862d0 con 0x55e6026da1b0 2024-05-20T17:45:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f463d38a740 10 client.0 _ll_register_callbacks cb 0x55e6029d4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f46349b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f46349b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:56140/0 (socket says 172.21.15.135:56140) 2024-05-20T17:45:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.602+0000 7f46349b0640 1 -- 172.21.15.135:0/4018291485 learned_addr learned my addr 172.21.15.135:0/4018291485 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.604+0000 7f462f7fe640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a83ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.604+0000 7f462ffff640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b12f0 0x55e602a83780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 -- 172.21.15.135:0/4018291485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 msgr2=0x55e602a9a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 -- 172.21.15.135:0/4018291485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b12f0 msgr2=0x55e602a83780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b12f0 0x55e602a83780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 -- 172.21.15.135:0/4018291485 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6026f2210 con 0x55e6026b94d0 2024-05-20T17:45:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.605+0000 7f462f7fe640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a83ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46240984b0 tx=0x7f4624097660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1979166c53a2e12 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f460f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:45:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462409b620 con 0x55e6026b94d0 2024-05-20T17:45:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4628003e00 con 0x55e6026b94d0 2024-05-20T17:45:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f462409af30 con 0x55e6026b94d0 2024-05-20T17:45:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f462409b440 con 0x55e6026b94d0 2024-05-20T17:45:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f463d38a740 10 client.26453 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.606+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e6027be620 con 0x55e6026b94d0 2024-05-20T17:45:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4628003e00 con 0x55e6026b94d0 2024-05-20T17:45:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f46240b4ce0 con 0x55e6026b94d0 2024-05-20T17:45:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 10 client.26453 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 10 client.26453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 20 client.26453 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e602698d80 0x55e602a8b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 4 client.26453 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:45:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.607+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6029eba70 con 0x55e602698d80 2024-05-20T17:45:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.608+0000 7f462ffff640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e602698d80 0x55e602a8b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.608+0000 7f460f7fe640 10 client.26453 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.608+0000 7f462ffff640 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e602698d80 0x55e602a8b380 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f4a7273643471b server_cookie=2b01db9961e9b649 in_seq=0 out_seq=0 2024-05-20T17:45:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f460f7fe640 1 -- 172.21.15.135:0/4018291485 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e6029eba70 con 0x55e602698d80 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f460f7fe640 10 client.26453 handle_command_reply: tid=0 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 client.26453 shutdown 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 msgr2=0x55e602a83ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a83ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46240984b0 tx=0x7f4624097660 comp rx=0 tx=0).stop 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 shutdown_connections 2024-05-20T17:45:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e602698d80 0x55e602a8b380 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a83ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 --2- 172.21.15.135:0/4018291485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b12f0 0x55e602a83780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 >> 172.21.15.135:0/4018291485 conn(0x55e6026ce300 msgr2=0x55e602a78eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f460f7fe640 0 client.26453 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 shutdown_connections 2024-05-20T17:45:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 1 -- 172.21.15.135:0/4018291485 wait complete. 2024-05-20T17:45:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.610+0000 7f463d38a740 20 client.26453 trim_cache size 0 max 16384 2024-05-20T17:45:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.631+0000 7f463d38a740 1 Processor -- start 2024-05-20T17:45:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.631+0000 7f463d38a740 1 -- start start 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a75900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a9a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f461c011220 con 0x55e6026da1b0 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f461c00ea30 con 0x55e6026b94d0 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f463d38a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f461c00c8a0 con 0x55e6026b12f0 2024-05-20T17:45:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f46349b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a9a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:59986/0 (socket says 172.21.15.135:59986) 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.632+0000 7f462f7fe640 1 -- 172.21.15.135:0/2242173278 learned_addr learned my addr 172.21.15.135:0/2242173278 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462ffff640 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a75900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 -- 172.21.15.135:0/2242173278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 msgr2=0x55e602a75900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a75900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 -- 172.21.15.135:0/2242173278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 msgr2=0x55e602a9a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a9a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 -- 172.21.15.135:0/2242173278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e602a7a460 con 0x55e6026b94d0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f46349b0640 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a9a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f462f7fe640 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4624097f40 tx=0x7f462400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821f1b4c87f85aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.633+0000 7f4615ffb640 1 -- 172.21.15.135:0/2242173278 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624097d80 con 0x55e6026b94d0 2024-05-20T17:45:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.634+0000 7f4615ffb640 1 -- 172.21.15.135:0/2242173278 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462409b250 con 0x55e6026b94d0 2024-05-20T17:45:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.634+0000 7f4615ffb640 1 -- 172.21.15.135:0/2242173278 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624098150 con 0x55e6026b94d0 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 -- 172.21.15.135:0/2242173278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 msgr2=0x55e602a82e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4624097f40 tx=0x7f462400ef90 comp rx=0 tx=0).stop 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 -- 172.21.15.135:0/2242173278 shutdown_connections 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026da1b0 0x55e602a9a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b94d0 0x55e602a82e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 --2- 172.21.15.135:0/2242173278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026b12f0 0x55e602a75900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 -- 172.21.15.135:0/2242173278 >> 172.21.15.135:0/2242173278 conn(0x55e6026ce300 msgr2=0x55e602a751f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.635+0000 7f463d38a740 1 -- 172.21.15.135:0/2242173278 shutdown_connections 2024-05-20T17:45:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.636+0000 7f463d38a740 1 -- 172.21.15.135:0/2242173278 wait complete. 2024-05-20T17:45:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.636+0000 7f463d38a740 1 -- start start 2024-05-20T17:45:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.637+0000 7f463d38a740 1 Processor -- start 2024-05-20T17:45:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.637+0000 7f463d38a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.637+0000 7f463d38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b94d0 0x55e602a9bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.637+0000 7f463d38a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.637+0000 7f463d38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f461c00cef0 con 0x55e6026b94d0 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f463d38a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f461c00e360 con 0x55e6026b12f0 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f462ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f462ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:60000/0 (socket says 172.21.15.135:60000) 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f462ffff640 1 -- 172.21.15.135:0/1779459214 learned_addr learned my addr 172.21.15.135:0/1779459214 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f46349b0640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f462f7fe640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b94d0 0x55e602a9bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.638+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f461c00d5c0 con 0x55e6026da1b0 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f463d38a740 10 client.0 _ll_register_callbacks cb 0x7f4624009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 -- 172.21.15.135:0/1779459214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 msgr2=0x55e602a9c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 -- 172.21.15.135:0/1779459214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b94d0 msgr2=0x55e602a9bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b94d0 0x55e602a9bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 -- 172.21.15.135:0/1779459214 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e602a9c5d0 con 0x55e6026b12f0 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f462ffff640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4620005d00 tx=0x7f4620011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9dc170479695459 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f460f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:45:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620021030 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.639+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f462409b250 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.640+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f462001d630 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.640+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f462001d830 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.640+0000 7f463d38a740 10 client.26459 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.640+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e602b1fdf0 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.640+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462409b250 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f462001c430 con 0x55e6026b12f0 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 10 client.26459 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 10 client.26459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 20 client.26459 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e60266e1c0 0x55e602b22660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 4 client.26459 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:45:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.641+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6029e5dc0 con 0x55e60266e1c0 2024-05-20T17:45:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.642+0000 7f462f7fe640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e60266e1c0 0x55e602b22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.644+0000 7f462f7fe640 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e60266e1c0 0x55e602b22660 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ed3c545c741d13 server_cookie=c00f8f5ffae0a599 in_seq=0 out_seq=0 2024-05-20T17:45:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:39.644+0000 7f460f7fe640 10 client.26459 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:39 smithi135 ceph-mon[32027]: pgmap v383: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-05-20T17:45:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:39 smithi160 ceph-mon[36261]: pgmap v383: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-05-20T17:45:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:39 smithi172 ceph-mon[36511]: pgmap v383: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-05-20T17:45:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f460f7fe640 1 -- 172.21.15.135:0/1779459214 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6029e5dc0 con 0x55e60266e1c0 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f460f7fe640 10 client.26459 handle_command_reply: tid=0 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 client.26459 shutdown 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 msgr2=0x55e602aa07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4620005d00 tx=0x7f4620011810 comp rx=0 tx=0).stop 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 shutdown_connections 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55e60266e1c0 0x55e602b22660 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6026da1b0 0x55e602a9c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f460f7fe640 0 client.26459 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6026b94d0 0x55e602a9bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 --2- 172.21.15.135:0/1779459214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6026b12f0 0x55e602aa07b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 >> 172.21.15.135:0/1779459214 conn(0x55e6026ce300 msgr2=0x55e602a78e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.800+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 shutdown_connections 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.801+0000 7f463d38a740 1 -- 172.21.15.135:0/1779459214 wait complete. 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.801+0000 7f463d38a740 20 client.26459 trim_cache size 0 max 16384 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:45:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 msgr2=0x7f46180a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 0x7f46180a53d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4628048000 tx=0x7f4628049000 comp rx=0 tx=0).stop 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 msgr2=0x7f4630101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f462400ea60 tx=0x7f462400ef20 comp rx=0 tx=0).stop 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 shutdown_connections 2024-05-20T17:45:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f46180a2ec0 0x7f46180a53d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463010d090 0x7f4630101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f463010a6e0 0x7f4630101540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 --2- 172.21.15.135:0/3411856346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4630103c80 0x7f46301030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 >> 172.21.15.135:0/3411856346 conn(0x7f4630077160 msgr2=0x7f4630100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 shutdown_connections 2024-05-20T17:45:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:40.802+0000 7f4636413640 1 -- 172.21.15.135:0/3411856346 wait complete. 2024-05-20T17:45:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:41 smithi135 ceph-mon[32027]: pgmap v384: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 990 KiB/s wr, 109 op/s 2024-05-20T17:45:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:41 smithi160 ceph-mon[36261]: pgmap v384: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 990 KiB/s wr, 109 op/s 2024-05-20T17:45:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:41 smithi172 ceph-mon[36511]: pgmap v384: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 990 KiB/s wr, 109 op/s 2024-05-20T17:45:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:43 smithi135 ceph-mon[32027]: pgmap v385: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-20T17:45:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:43 smithi160 ceph-mon[36261]: pgmap v385: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-20T17:45:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:43 smithi172 ceph-mon[36511]: pgmap v385: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-05-20T17:45:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:45 smithi135 ceph-mon[32027]: pgmap v386: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-05-20T17:45:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:45 smithi160 ceph-mon[36261]: pgmap v386: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-05-20T17:45:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:45 smithi172 ceph-mon[36511]: pgmap v386: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-05-20T17:45:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:47 smithi135 ceph-mon[32027]: pgmap v387: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 156 op/s 2024-05-20T17:45:47.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:47 smithi160 ceph-mon[36261]: pgmap v387: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 156 op/s 2024-05-20T17:45:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:47 smithi172 ceph-mon[36511]: pgmap v387: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 156 op/s 2024-05-20T17:45:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:49 smithi135 ceph-mon[32027]: pgmap v388: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:45:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:49 smithi160 ceph-mon[36261]: pgmap v388: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:45:49.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:49 smithi172 ceph-mon[36511]: pgmap v388: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-05-20T17:45:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:51 smithi160 ceph-mon[36261]: pgmap v389: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 162 op/s 2024-05-20T17:45:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:51 smithi172 ceph-mon[36511]: pgmap v389: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 162 op/s 2024-05-20T17:45:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:51 smithi135 ceph-mon[32027]: pgmap v389: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 162 op/s 2024-05-20T17:45:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:53 smithi160 ceph-mon[36261]: pgmap v390: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-05-20T17:45:53.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:53 smithi172 ceph-mon[36511]: pgmap v390: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.905+0000 7f28e891a640 1 -- 172.21.15.135:0/2317466590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4108b10 msgr2=0x7f28e4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.905+0000 7f28e891a640 1 --2- 172.21.15.135:0/2317466590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4108b10 0x7f28e4100bc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009900 tx=0x7f28d402a410 comp rx=0 tx=0).stop 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 -- 172.21.15.135:0/2317466590 shutdown_connections 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 --2- 172.21.15.135:0/2317466590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e41017b0 0x7f28e410f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 --2- 172.21.15.135:0/2317466590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108fb0 0x7f28e4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 --2- 172.21.15.135:0/2317466590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4108b10 0x7f28e4100bc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 -- 172.21.15.135:0/2317466590 >> 172.21.15.135:0/2317466590 conn(0x7f28e40fc850 msgr2=0x7f28e40feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 -- 172.21.15.135:0/2317466590 shutdown_connections 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 -- 172.21.15.135:0/2317466590 wait complete. 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 Processor -- start 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.906+0000 7f28e891a640 1 -- start start 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108b10 0x7f28e4199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e419dd90 0x7f28e419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112e50 con 0x7f28e4199570 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112cd0 con 0x7f28e419dd90 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112fd0 con 0x7f28e4108b10 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37220/0 (socket says 172.21.15.135:37220) 2024-05-20T17:45:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 -- 172.21.15.135:0/4084437298 learned_addr learned my addr 172.21.15.135:0/4084437298 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e259c640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108b10 0x7f28e4199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e419dd90 0x7f28e419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 -- 172.21.15.135:0/4084437298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108b10 msgr2=0x7f28e4199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108b10 0x7f28e4199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 -- 172.21.15.135:0/4084437298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e419dd90 msgr2=0x7f28e419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e419dd90 0x7f28e419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 -- 172.21.15.135:0/4084437298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41a5b00 con 0x7f28e4199570 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28dbfff640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00e9f0 tx=0x7f28cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28db7fe640 1 -- 172.21.15.135:0/4084437298 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00ccc0 con 0x7f28e4199570 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e41a5cd0 con 0x7f28e4199570 2024-05-20T17:45:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.907+0000 7f28db7fe640 1 -- 172.21.15.135:0/4084437298 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28cc005500 con 0x7f28e4199570 2024-05-20T17:45:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.908+0000 7f28db7fe640 1 -- 172.21.15.135:0/4084437298 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc010690 con 0x7f28e4199570 2024-05-20T17:45:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.908+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a6140 con 0x7f28e4199570 2024-05-20T17:45:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.910+0000 7f28db7fe640 1 -- 172.21.15.135:0/4084437298 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f28cc0046c0 con 0x7f28e4199570 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.910+0000 7f28ef7c4740 1 Processor -- start 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.910+0000 7f28ef7c4740 1 -- start start 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb5404f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556cb536a340 con 0x556cb50454d0 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556cb5312290 con 0x556cb50661b0 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556cb5366300 con 0x556cb503d2f0 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:38650/0 (socket says 172.21.15.135:38650) 2024-05-20T17:45:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37224/0 (socket says 172.21.15.135:37224) 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 -- 172.21.15.135:0/3529315129 learned_addr learned my addr 172.21.15.135:0/3529315129 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb5404f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28db7fe640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 0x7f28d00a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 -- 172.21.15.135:0/3529315129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 msgr2=0x556cb5404f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb5404f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 -- 172.21.15.135:0/3529315129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 msgr2=0x556cb5405990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 -- 172.21.15.135:0/3529315129 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb53368e0 con 0x556cb503d2f0 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 0x7f28d00a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28db7fe640 1 -- 172.21.15.135:0/4084437298 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f28cc0cf850 con 0x7f28e4199570 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.911+0000 7f28e259c640 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28e406a390 tx=0x7f28d4005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=314ff3b82ad45111 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.912+0000 7f28d8ff9640 1 -- 172.21.15.135:0/3529315129 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4040070 con 0x556cb503d2f0 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.912+0000 7f28d8ff9640 1 -- 172.21.15.135:0/3529315129 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28d40318f0 con 0x556cb503d2f0 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.912+0000 7f28d8ff9640 1 -- 172.21.15.135:0/3529315129 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4035040 con 0x556cb503d2f0 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3529315129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 msgr2=0x556cb5405450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28e406a390 tx=0x7f28d4005dd0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 0x7f28d00a5200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x556cb5402220 tx=0x7f28dc004a40 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3529315129 shutdown_connections 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3529315129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb5404f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3529315129 >> 172.21.15.135:0/3529315129 conn(0x556cb505a300 msgr2=0x556cb5401830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3529315129 shutdown_connections 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3529315129 wait complete. 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- start start 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 Processor -- start 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb54154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb54159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556cb54165c0 con 0x556cb50661b0 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556cb5325790 con 0x556cb503d2f0 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.913+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556cb5416740 con 0x556cb50454d0 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28ef7c4740 10 client.0 _ll_register_callbacks cb 0x556cb5360a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb54159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37238/0 (socket says 172.21.15.135:37238) 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 -- 172.21.15.135:0/185038157 learned_addr learned my addr 172.21.15.135:0/185038157 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e259c640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb54154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 -- 172.21.15.135:0/185038157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 msgr2=0x556cb54159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb54159e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 -- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 msgr2=0x556cb54154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb54154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 -- 172.21.15.135:0/185038157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb507e210 con 0x556cb50661b0 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28dbfff640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb54159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009b60 tx=0x7f28dc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b4096ec6e09a21 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc010960 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f28dc010b00 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d40318f0 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f28dc010d00 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28ef7c4740 10 client.16902 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.914+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556cb514a620 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28d40318f0 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f28dc01e5a0 con 0x556cb50661b0 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 10 client.16902 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 10 client.16902 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 20 client.16902 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb5024d80 0x556cb5425e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 4 client.16902 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cb5377a70 con 0x556cb5024d80 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28e259c640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb5024d80 0x556cb5425e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28c9ffb640 10 client.16902 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.915+0000 7f28e259c640 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb5024d80 0x556cb5425e10 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=592413de3a99fbda server_cookie=437ed7546adb861c in_seq=0 out_seq=0 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28c9ffb640 1 -- 172.21.15.135:0/185038157 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556cb5377a70 con 0x556cb5024d80 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28c9ffb640 10 client.16902 handle_command_reply: tid=0 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 client.16902 shutdown 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 msgr2=0x556cb5413990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009b60 tx=0x7f28dc004ab0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 shutdown_connections 2024-05-20T17:45:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb5024d80 0x556cb5425e10 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5413990 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb54159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28c9ffb640 0 client.16902 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/185038157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb54154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 >> 172.21.15.135:0/185038157 conn(0x556cb505a300 msgr2=0x556cb5406da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 shutdown_connections 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 1 -- 172.21.15.135:0/185038157 wait complete. 2024-05-20T17:45:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.917+0000 7f28ef7c4740 20 client.16902 trim_cache size 0 max 16384 2024-05-20T17:45:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 Processor -- start 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 -- start start 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb542b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41af410 con 0x556cb50454d0 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41acc20 con 0x556cb50661b0 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41aaa90 con 0x556cb503d2f0 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37244/0 (socket says 172.21.15.135:37244) 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28dbfff640 1 -- 172.21.15.135:0/3087893032 learned_addr learned my addr 172.21.15.135:0/3087893032 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28e259c640 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb542b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28dbfff640 1 -- 172.21.15.135:0/3087893032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 msgr2=0x556cb5405520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.933+0000 7f28dbfff640 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28dbfff640 1 -- 172.21.15.135:0/3087893032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 msgr2=0x556cb542b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28dbfff640 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb542b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28dbfff640 1 -- 172.21.15.135:0/3087893032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb53fba80 con 0x556cb50454d0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28dbfff640 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0986e0 tx=0x7f28cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8b35c47ac1cc5e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28cbfff640 1 -- 172.21.15.135:0/3087893032 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc09bae0 con 0x556cb50454d0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28cbfff640 1 -- 172.21.15.135:0/3087893032 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28cc09c410 con 0x556cb50454d0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.934+0000 7f28cbfff640 1 -- 172.21.15.135:0/3087893032 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0056b0 con 0x556cb50454d0 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3087893032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 msgr2=0x556cb5405a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0986e0 tx=0x7f28cc00cf60 comp rx=0 tx=0).stop 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3087893032 shutdown_connections 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb50661b0 0x556cb542b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50454d0 0x556cb5405a60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/3087893032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb503d2f0 0x556cb5405520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3087893032 >> 172.21.15.135:0/3087893032 conn(0x556cb505a300 msgr2=0x556cb5404e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3087893032 shutdown_connections 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- 172.21.15.135:0/3087893032 wait complete. 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- start start 2024-05-20T17:45:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 Processor -- start 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb541be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb5419240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ab0e0 con 0x556cb50661b0 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ac550 con 0x556cb503d2f0 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ab7b0 con 0x556cb50454d0 2024-05-20T17:45:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.935+0000 7f28ef7c4740 10 client.0 _ll_register_callbacks cb 0x7f28dc009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37258/0 (socket says 172.21.15.135:37258) 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb541be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb5419240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 -- 172.21.15.135:0/2846998020 learned_addr learned my addr 172.21.15.135:0/2846998020 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 -- 172.21.15.135:0/2846998020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 msgr2=0x556cb5419240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb5419240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 -- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 msgr2=0x556cb541be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb541be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 -- 172.21.15.135:0/2846998020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb5419e20 con 0x556cb50661b0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28e2d9d640 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f28dc01ea10 tx=0x7f28dc003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d93d1a13101a3c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:45:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc034070 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8615+0+0 (secure 0 0 0) 0x7f28dc010760 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28cc09c410 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f28dc010960 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28ef7c4740 10 client.16908 fetch_fsmap learned FSMap version 30 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.936+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556cb548e030 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28cc09c410 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f28dc030440 con 0x556cb50661b0 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 10 client.16908 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 10 client.16908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 20 client.16908 populate_metadata read hostname 'smithi135' 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb4ffa1c0 0x556cb5490780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 4 client.16908 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:45:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556cb5371dc0 con 0x556cb4ffa1c0 2024-05-20T17:45:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28e259c640 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb4ffa1c0 0x556cb5490780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:45:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28c9ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:53.937+0000 7f28e259c640 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb4ffa1c0 0x556cb5490780 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9be83feaea0706e server_cookie=d0ac4bdcfca36b6b in_seq=0 out_seq=0 2024-05-20T17:45:53.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:53 smithi135 ceph-mon[32027]: pgmap v390: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-05-20T17:45:54.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28c9ffb640 1 -- 172.21.15.135:0/2846998020 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556cb5371dc0 con 0x556cb4ffa1c0 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28c9ffb640 10 client.16908 handle_command_reply: tid=0 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 client.16908 shutdown 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 msgr2=0x556cb5419780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f28dc01ea10 tx=0x7f28dc003e20 comp rx=0 tx=0).stop 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 shutdown_connections 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556cb4ffa1c0 0x556cb5490780 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556cb50661b0 0x556cb5419780 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556cb50454d0 0x556cb5419240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.375+0000 7f28ef7c4740 1 --2- 172.21.15.135:0/2846998020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cb503d2f0 0x556cb541be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.376+0000 7f28c9ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.376+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 >> 172.21.15.135:0/2846998020 conn(0x556cb505a300 msgr2=0x556cb5405840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.376+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 shutdown_connections 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.376+0000 7f28ef7c4740 1 -- 172.21.15.135:0/2846998020 wait complete. 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.376+0000 7f28ef7c4740 20 client.16908 trim_cache size 0 max 16384 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:45:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:45:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 msgr2=0x7f28d00a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 0x7f28d00a5200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x556cb5402220 tx=0x7f28dc004a40 comp rx=0 tx=0).stop 2024-05-20T17:45:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 msgr2=0x7f28e419d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:45:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00e9f0 tx=0x7f28cc00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 shutdown_connections 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f28d00a2cf0 0x7f28d00a5200 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e419dd90 0x7f28e419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e4199570 0x7f28e419d850 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 --2- 172.21.15.135:0/4084437298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e4108b10 0x7f28e4199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 >> 172.21.15.135:0/4084437298 conn(0x7f28e40fc850 msgr2=0x7f28e40ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 shutdown_connections 2024-05-20T17:45:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:45:54.377+0000 7f28e891a640 1 -- 172.21.15.135:0/4084437298 wait complete. 2024-05-20T17:45:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:55 smithi160 ceph-mon[36261]: pgmap v391: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-05-20T17:45:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:55 smithi172 ceph-mon[36511]: pgmap v391: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-05-20T17:45:55.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:55 smithi135 ceph-mon[32027]: pgmap v391: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-05-20T17:45:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:57 smithi160 ceph-mon[36261]: pgmap v392: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 196 op/s 2024-05-20T17:45:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:57 smithi172 ceph-mon[36511]: pgmap v392: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 196 op/s 2024-05-20T17:45:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:57 smithi135 ceph-mon[32027]: pgmap v392: 97 pgs: 97 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 196 op/s 2024-05-20T17:45:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:59 smithi160 ceph-mon[36261]: pgmap v393: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 369 op/s 2024-05-20T17:45:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:45:59 smithi160 ceph-mon[36261]: osdmap e100: 12 total, 12 up, 12 in 2024-05-20T17:45:59.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:59 smithi172 ceph-mon[36511]: pgmap v393: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 369 op/s 2024-05-20T17:45:59.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:45:59 smithi172 ceph-mon[36511]: osdmap e100: 12 total, 12 up, 12 in 2024-05-20T17:45:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:59 smithi135 ceph-mon[32027]: pgmap v393: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 369 op/s 2024-05-20T17:45:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:45:59 smithi135 ceph-mon[32027]: osdmap e100: 12 total, 12 up, 12 in 2024-05-20T17:46:00.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:00 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:46:00.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:00 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:00 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:00 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:00 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:00 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:46:00.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:00 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:00 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:00 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:00 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:00 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:46:00.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:00 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:00 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:00 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:00.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:00 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:01.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:01 smithi160 ceph-mon[36261]: pgmap v395: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-05-20T17:46:01.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:01 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:46:01.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:01 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:46:01.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:01 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:01 smithi172 ceph-mon[36511]: pgmap v395: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-05-20T17:46:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:01 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:46:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:01 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:46:01.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:01 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:01 smithi135 ceph-mon[32027]: pgmap v395: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-05-20T17:46:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:01 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:46:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:01 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:46:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:01 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:46:03.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:03 smithi135 ceph-mon[32027]: pgmap v396: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-05-20T17:46:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:03 smithi160 ceph-mon[36261]: pgmap v396: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-05-20T17:46:03.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:03 smithi172 ceph-mon[36511]: pgmap v396: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-05-20T17:46:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:05 smithi160 ceph-mon[36261]: pgmap v397: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2024-05-20T17:46:05.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:05 smithi172 ceph-mon[36511]: pgmap v397: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2024-05-20T17:46:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:05 smithi135 ceph-mon[32027]: pgmap v397: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2024-05-20T17:46:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 -- 172.21.15.135:0/4170494556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 msgr2=0x7fbb9c10e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 --2- 172.21.15.135:0/4170494556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c10e7c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009ca0 tx=0x7fbb9402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 -- 172.21.15.135:0/4170494556 shutdown_connections 2024-05-20T17:46:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 --2- 172.21.15.135:0/4170494556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c10e7c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 --2- 172.21.15.135:0/4170494556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 --2- 172.21.15.135:0/4170494556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 0x7fbb9c1015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 -- 172.21.15.135:0/4170494556 >> 172.21.15.135:0/4170494556 conn(0x7fbb9c0fd210 msgr2=0x7fbb9c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 -- 172.21.15.135:0/4170494556 shutdown_connections 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.493+0000 7fbba19fe640 1 -- 172.21.15.135:0/4170494556 wait complete. 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 Processor -- start 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 -- start start 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 0x7fbb9c198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c111d70 con 0x7fbb9c10c3a0 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c111bf0 con 0x7fbb9c101b10 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbba19fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c111ef0 con 0x7fbb9c107a40 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:45844/0 (socket says 172.21.15.135:45844) 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56402/0 (socket says 172.21.15.135:56402) 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.494+0000 7fbb9affd640 1 -- 172.21.15.135:0/928134018 learned_addr learned my addr 172.21.15.135:0/928134018 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb93fff640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 0x7fbb9c198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 -- 172.21.15.135:0/928134018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 msgr2=0x7fbb9c198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 0x7fbb9c198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 -- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 msgr2=0x7fbb9c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 -- 172.21.15.135:0/928134018 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c19d510 con 0x7fbb9c101b10 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbb9affd640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00d740 tx=0x7fbb8c00dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbba09fc640 1 -- 172.21.15.135:0/928134018 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c017070 con 0x7fbb9c101b10 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c19d800 con 0x7fbb9c101b10 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c1a5180 con 0x7fbb9c101b10 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbba09fc640 1 -- 172.21.15.135:0/928134018 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb8c00de50 con 0x7fbb9c101b10 2024-05-20T17:46:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.495+0000 7fbba09fc640 1 -- 172.21.15.135:0/928134018 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c020060 con 0x7fbb9c101b10 2024-05-20T17:46:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.498+0000 7fbba8977740 1 Processor -- start 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.498+0000 7fbba8977740 1 -- start start 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26f21b0 0x563ef2a90ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba09fc640 1 -- 172.21.15.135:0/928134018 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fbb8c009cc0 con 0x7fbb9c101b10 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ef29f6340 con 0x563ef26c92f0 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563ef299e290 con 0x563ef26d14d0 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba8977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ef29f2300 con 0x563ef26f21b0 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56414/0 (socket says 172.21.15.135:56414) 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 -- 172.21.15.135:0/2842736223 learned_addr learned my addr 172.21.15.135:0/2842736223 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb93fff640 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26f21b0 0x563ef2a90ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 -- 172.21.15.135:0/2842736223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26f21b0 msgr2=0x563ef2a90ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26f21b0 0x563ef2a90ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 -- 172.21.15.135:0/2842736223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 msgr2=0x563ef2a91950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 -- 172.21.15.135:0/2842736223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ef29c28e0 con 0x563ef26c92f0 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0cc500 tx=0x7fbb8c0d7570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2964473c47a8e08 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbba09fc640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 0x7fbb880a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.499+0000 7fbb91ffb640 1 -- 172.21.15.135:0/2842736223 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0e2070 con 0x563ef26c92f0 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 0x7fbb880a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbb91ffb640 1 -- 172.21.15.135:0/2842736223 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb8c01d000 con 0x563ef26c92f0 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbb91ffb640 1 -- 172.21.15.135:0/2842736223 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c09acc0 con 0x563ef26c92f0 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba09fc640 1 -- 172.21.15.135:0/928134018 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8571+0+0 (secure 0 0 0) 0x7fbb8c0cee70 con 0x7fbb9c101b10 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 -- 172.21.15.135:0/2842736223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 msgr2=0x563ef2a91410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 0x7fbb880a5200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb94004af0 tx=0x7fbb94004a80 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0cc500 tx=0x7fbb8c0d7570 comp rx=0 tx=0).stop 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 -- 172.21.15.135:0/2842736223 shutdown_connections 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26c92f0 0x563ef2a91410 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 --2- 172.21.15.135:0/2842736223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26f21b0 0x563ef2a90ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.500+0000 7fbba8977740 1 -- 172.21.15.135:0/2842736223 >> 172.21.15.135:0/2842736223 conn(0x563ef26e6300 msgr2=0x563ef2a8d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 -- 172.21.15.135:0/2842736223 shutdown_connections 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 -- 172.21.15.135:0/2842736223 wait complete. 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 -- start start 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 Processor -- start 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2a9d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2a9de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ef2aa0420 con 0x563ef26f21b0 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.501+0000 7fbba8977740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563ef29b1790 con 0x563ef26c92f0 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbba8977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ef2aa05a0 con 0x563ef26d14d0 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbba8977740 10 client.0 _ll_register_callbacks cb 0x563ef29eca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2a9d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56418/0 (socket says 172.21.15.135:56418) 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 -- 172.21.15.135:0/2336774185 learned_addr learned my addr 172.21.15.135:0/2336774185 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2a9d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:45858/0 (socket says 172.21.15.135:45858) 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb93fff640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2a9de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 -- 172.21.15.135:0/2336774185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 msgr2=0x563ef2a9de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2a9de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 -- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 msgr2=0x563ef2a9d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2a9d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 -- 172.21.15.135:0/2336774185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ef270a210 con 0x563ef26f21b0 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009ca0 tx=0x7fbb9402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1add0db8e221984 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb7affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:46:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94004250 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8571+0+0 (secure 0 0 0) 0x7fbb940043f0 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb8c01d000 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb940045f0 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbba8977740 10 client.16920 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.502+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563ef27d6620 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb8c01d000 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbb940306c0 con 0x563ef26f21b0 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 10 client.16920 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 10 client.16920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 20 client.16920 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26b0d80 0x563ef2aafb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 4 client.16920 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:46:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ef2a03a70 con 0x563ef26b0d80 2024-05-20T17:46:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26b0d80 0x563ef2aafb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbb7affd640 10 client.16920 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.503+0000 7fbb9affd640 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26b0d80 0x563ef2aafb50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d19e07a3759a4744 server_cookie=8142d3960f993b7e in_seq=0 out_seq=0 2024-05-20T17:46:07.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:07 smithi160 ceph-mon[36261]: pgmap v398: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2024-05-20T17:46:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbb7affd640 1 -- 172.21.15.135:0/2336774185 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fbb8c080c70 con 0x563ef26b0d80 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbb7affd640 10 client.16920 handle_command_reply: tid=0 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 client.16920 shutdown 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 msgr2=0x563ef2aa3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009ca0 tx=0x7fbb9402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 shutdown_connections 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26b0d80 0x563ef2aafb50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26f21b0 0x563ef2aa3890 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2a9de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbb7affd640 0 client.16920 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 --2- 172.21.15.135:0/2336774185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2a9d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 >> 172.21.15.135:0/2336774185 conn(0x563ef26e6300 msgr2=0x563ef2a91840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 shutdown_connections 2024-05-20T17:46:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 1 -- 172.21.15.135:0/2336774185 wait complete. 2024-05-20T17:46:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.505+0000 7fbba8977740 20 client.16920 trim_cache size 0 max 16384 2024-05-20T17:46:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.520+0000 7fbba8977740 1 Processor -- start 2024-05-20T17:46:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.520+0000 7fbba8977740 1 -- start start 2024-05-20T17:46:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26c92f0 0x563ef2a91520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1af3a0 con 0x563ef26b0d80 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1acbb0 con 0x563ef26d14d0 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbba8977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1aaa20 con 0x563ef26c92f0 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56420/0 (socket says 172.21.15.135:56420) 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 -- 172.21.15.135:0/950799551 learned_addr learned my addr 172.21.15.135:0/950799551 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb93fff640 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26c92f0 0x563ef2a91520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 -- 172.21.15.135:0/950799551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26c92f0 msgr2=0x563ef2a91520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26c92f0 0x563ef2a91520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 -- 172.21.15.135:0/950799551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 msgr2=0x563ef2a91a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 -- 172.21.15.135:0/950799551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ef2a922a0 con 0x563ef26b0d80 2024-05-20T17:46:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb9affd640 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0047e0 tx=0x7fbb8c0bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd443ff5228cf40 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb917fa640 1 -- 172.21.15.135:0/950799551 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0014e0 con 0x563ef26b0d80 2024-05-20T17:46:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb917fa640 1 -- 172.21.15.135:0/950799551 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563ef2a03a70 con 0x563ef26b0d80 2024-05-20T17:46:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.521+0000 7fbb917fa640 1 -- 172.21.15.135:0/950799551 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0016e0 con 0x563ef26b0d80 2024-05-20T17:46:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 -- 172.21.15.135:0/950799551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 msgr2=0x563ef2a970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0047e0 tx=0x7fbb8c0bb040 comp rx=0 tx=0).stop 2024-05-20T17:46:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 -- 172.21.15.135:0/950799551 shutdown_connections 2024-05-20T17:46:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26d14d0 0x563ef2a91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26c92f0 0x563ef2a91520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 --2- 172.21.15.135:0/950799551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2a970c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 -- 172.21.15.135:0/950799551 >> 172.21.15.135:0/950799551 conn(0x563ef26e6300 msgr2=0x563ef2a90e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 -- 172.21.15.135:0/950799551 shutdown_connections 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.522+0000 7fbba8977740 1 -- 172.21.15.135:0/950799551 wait complete. 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 -- start start 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 Processor -- start 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2aa4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2aa9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1ab070 con 0x563ef26b0d80 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1ac4e0 con 0x563ef26c92f0 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1ab740 con 0x563ef26d14d0 2024-05-20T17:46:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbba8977740 10 client.0 _ll_register_callbacks cb 0x7fbb940093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbb9affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56436/0 (socket says 172.21.15.135:56436) 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbb9affd640 1 -- 172.21.15.135:0/1593793851 learned_addr learned my addr 172.21.15.135:0/1593793851 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbb93fff640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2aa4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.523+0000 7fbb9b7fe640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2aa9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 -- 172.21.15.135:0/1593793851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 msgr2=0x563ef2aa9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2aa9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 -- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 msgr2=0x563ef2aa4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2aa4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 -- 172.21.15.135:0/1593793851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ef2aa9da0 con 0x563ef26b0d80 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb93fff640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2aa4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:46:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb9affd640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0cc640 tx=0x7fbb8c005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c2f8c999abc237 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0b3030 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8571+0+0 (secure 0 0 0) 0x7fbb8c099660 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ef2a03a70 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb8c0018e0 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbba8977740 10 client.16926 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563ef2a93ea0 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563ef2a03a70 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.524+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbb8c0ccce0 con 0x563ef26b0d80 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 10 client.16926 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 20 client.16926 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26f21b0 0x563ef2a941f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 4 client.16926 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:46:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ef29fddc0 con 0x563ef26f21b0 2024-05-20T17:46:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbb93fff640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26f21b0 0x563ef2a941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbb7affd640 10 client.16926 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.525+0000 7fbb93fff640 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26f21b0 0x563ef2a941f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=263e161e53446932 server_cookie=ac3699e3b88aa419 in_seq=0 out_seq=0 2024-05-20T17:46:07.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:07 smithi172 ceph-mon[36511]: pgmap v398: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2024-05-20T17:46:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:07 smithi135 ceph-mon[32027]: pgmap v398: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbb7affd640 1 -- 172.21.15.135:0/1593793851 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ef29fddc0 con 0x563ef26f21b0 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbb7affd640 10 client.16926 handle_command_reply: tid=0 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 client.16926 shutdown 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 msgr2=0x563ef2aa4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0cc640 tx=0x7fbb8c005cc0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 shutdown_connections 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ef26f21b0 0x563ef2a941f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.781+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ef26d14d0 0x563ef2aa9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbb7affd640 0 client.16926 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ef26c92f0 0x563ef2aa4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 1 --2- 172.21.15.135:0/1593793851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ef26b0d80 0x563ef2aa4a20 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 >> 172.21.15.135:0/1593793851 conn(0x563ef26e6300 msgr2=0x563ef2a91840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 shutdown_connections 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 1 -- 172.21.15.135:0/1593793851 wait complete. 2024-05-20T17:46:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.782+0000 7fbba8977740 20 client.16926 trim_cache size 0 max 16384 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 msgr2=0x7fbb880a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 0x7fbb880a5200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb94004af0 tx=0x7fbb94004a80 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 msgr2=0x7fbb9c1986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00d740 tx=0x7fbb8c00dc00 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 shutdown_connections 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fbb880a2cf0 0x7fbb880a5200 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb9c10c3a0 0x7fbb9c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb9c107a40 0x7fbb9c198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 --2- 172.21.15.135:0/928134018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb9c101b10 0x7fbb9c1986b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 >> 172.21.15.135:0/928134018 conn(0x7fbb9c0fd210 msgr2=0x7fbb9c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 shutdown_connections 2024-05-20T17:46:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:07.783+0000 7fbba19fe640 1 -- 172.21.15.135:0/928134018 wait complete. 2024-05-20T17:46:09.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:09 smithi160 ceph-mon[36261]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 214 op/s 2024-05-20T17:46:09.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:09 smithi172 ceph-mon[36511]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 214 op/s 2024-05-20T17:46:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:09 smithi135 ceph-mon[32027]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 214 op/s 2024-05-20T17:46:10.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:10 smithi172 ceph-mon[36511]: osdmap e101: 12 total, 12 up, 12 in 2024-05-20T17:46:10.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:10 smithi135 ceph-mon[32027]: osdmap e101: 12 total, 12 up, 12 in 2024-05-20T17:46:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:10 smithi160 ceph-mon[36261]: osdmap e101: 12 total, 12 up, 12 in 2024-05-20T17:46:11.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:11 smithi172 ceph-mon[36511]: pgmap v401: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-05-20T17:46:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:11 smithi135 ceph-mon[32027]: pgmap v401: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-05-20T17:46:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:11 smithi160 ceph-mon[36261]: pgmap v401: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-05-20T17:46:13.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:13 smithi172 ceph-mon[36511]: pgmap v402: 97 pgs: 16 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 260 op/s 2024-05-20T17:46:13.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:13 smithi135 ceph-mon[32027]: pgmap v402: 97 pgs: 16 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 260 op/s 2024-05-20T17:46:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:13 smithi160 ceph-mon[36261]: pgmap v402: 97 pgs: 16 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 55 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 260 op/s 2024-05-20T17:46:15.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:15 smithi172 ceph-mon[36511]: pgmap v403: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-05-20T17:46:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:15 smithi135 ceph-mon[32027]: pgmap v403: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-05-20T17:46:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:15 smithi160 ceph-mon[36261]: pgmap v403: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-05-20T17:46:17.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:17 smithi172 ceph-mon[36511]: pgmap v404: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 293 op/s 2024-05-20T17:46:17.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:17 smithi135 ceph-mon[32027]: pgmap v404: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 293 op/s 2024-05-20T17:46:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:17 smithi160 ceph-mon[36261]: pgmap v404: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 293 op/s 2024-05-20T17:46:19.558 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:19 smithi160 ceph-mon[36261]: pgmap v405: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 250 op/s 2024-05-20T17:46:19.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:19 smithi172 ceph-mon[36511]: pgmap v405: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 250 op/s 2024-05-20T17:46:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:19 smithi135 ceph-mon[32027]: pgmap v405: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 250 op/s 2024-05-20T17:46:20.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:46:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:46:20.109+0000 7f26a818c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-20T17:46:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.945+0000 7ffbccd68640 1 -- 172.21.15.135:0/495193814 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0319b0 con 0x7ffbc8109080 2024-05-20T17:46:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.945+0000 7ffbcffce640 1 -- 172.21.15.135:0/495193814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8109080 msgr2=0x7ffbc8109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.945+0000 7ffbcffce640 1 --2- 172.21.15.135:0/495193814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8109080 0x7ffbc8109490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009900 tx=0x7ffbbc02a4d0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 -- 172.21.15.135:0/495193814 shutdown_connections 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 --2- 172.21.15.135:0/495193814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 0x7ffbc811e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 --2- 172.21.15.135:0/495193814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8119770 0x7ffbc811bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 --2- 172.21.15.135:0/495193814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8109080 0x7ffbc8109490 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 -- 172.21.15.135:0/495193814 >> 172.21.15.135:0/495193814 conn(0x7ffbc806d780 msgr2=0x7ffbc806dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 -- 172.21.15.135:0/495193814 shutdown_connections 2024-05-20T17:46:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.946+0000 7ffbcffce640 1 -- 172.21.15.135:0/495193814 wait complete. 2024-05-20T17:46:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 Processor -- start 2024-05-20T17:46:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 -- start start 2024-05-20T17:46:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8109080 0x7ffbc81a8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 0x7ffbc81acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.947+0000 7ffbcffce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8121d30 con 0x7ffbc811c0d0 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcffce640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8121bb0 con 0x7ffbc8119770 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcffce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8121eb0 con 0x7ffbc8109080 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcdd6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8109080 0x7ffbc81a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:47516/0 (socket says 172.21.15.135:47516) 2024-05-20T17:46:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 -- 172.21.15.135:0/1394038868 learned_addr learned my addr 172.21.15.135:0/1394038868 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbce56b640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 0x7ffbc81acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 -- 172.21.15.135:0/1394038868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8109080 msgr2=0x7ffbc81a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8109080 0x7ffbc81a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 -- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 msgr2=0x7ffbc81acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 0x7ffbc81acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.948+0000 7ffbcd569640 1 -- 172.21.15.135:0/1394038868 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc81ad5f0 con 0x7ffbc8119770 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.949+0000 7ffbcd569640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800ba50 tx=0x7ffbb800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.949+0000 7ffbc6ffd640 1 -- 172.21.15.135:0/1394038868 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8019070 con 0x7ffbc8119770 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.949+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc81ad8e0 con 0x7ffbc8119770 2024-05-20T17:46:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.949+0000 7ffbc6ffd640 1 -- 172.21.15.135:0/1394038868 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb800cc10 con 0x7ffbc8119770 2024-05-20T17:46:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.949+0000 7ffbc6ffd640 1 -- 172.21.15.135:0/1394038868 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80076a0 con 0x7ffbc8119770 2024-05-20T17:46:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.953+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc8110f40 con 0x7ffbc8119770 2024-05-20T17:46:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.957+0000 7ffbd6e7c740 1 Processor -- start 2024-05-20T17:46:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.957+0000 7ffbd6e7c740 1 -- start start 2024-05-20T17:46:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c3c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba587c4d0 0x556ba5c3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ba5ba1340 con 0x556ba58742f0 2024-05-20T17:46:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556ba5b49290 con 0x556ba589d1b0 2024-05-20T17:46:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ba5b9d300 con 0x556ba587c4d0 2024-05-20T17:46:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbce56b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.962 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbce56b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:47526/0 (socket says 172.21.15.135:47526) 2024-05-20T17:46:20.962 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.958+0000 7ffbce56b640 1 -- 172.21.15.135:0/915004134 learned_addr learned my addr 172.21.15.135:0/915004134 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:20.962 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.959+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c3c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.960+0000 7ffbc6ffd640 1 -- 172.21.15.135:0/1394038868 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ffbb801c070 con 0x7ffbc8119770 2024-05-20T17:46:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.961+0000 7ffbcd569640 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba587c4d0 0x556ba5c3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.961+0000 7ffbc6ffd640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 0x7ffbb00a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.961+0000 7ffbc6ffd640 1 -- 172.21.15.135:0/1394038868 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7ffbb80ce9f0 con 0x7ffbc8119770 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 -- 172.21.15.135:0/915004134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba587c4d0 msgr2=0x556ba5c3cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba587c4d0 0x556ba5c3cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 -- 172.21.15.135:0/915004134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 msgr2=0x556ba5c3c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 -- 172.21.15.135:0/915004134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba5b6d8e0 con 0x556ba58742f0 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.962+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c3c5c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005940 tx=0x7ffbbc0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac3dde2172a7f16 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.963+0000 7ffbaffff640 1 -- 172.21.15.135:0/915004134 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc040070 con 0x556ba58742f0 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.963+0000 7ffbaffff640 1 -- 172.21.15.135:0/915004134 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbbc005020 con 0x556ba58742f0 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.963+0000 7ffbaffff640 1 -- 172.21.15.135:0/915004134 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc035040 con 0x556ba58742f0 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.964+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/915004134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 msgr2=0x556ba5c3c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.964+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c3c5c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005940 tx=0x7ffbbc0316e0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.965+0000 7ffbce56b640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 0x7ffbb00a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/915004134 shutdown_connections 2024-05-20T17:46:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba587c4d0 0x556ba5c3cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c3c5c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/915004134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/915004134 >> 172.21.15.135:0/915004134 conn(0x556ba5891300 msgr2=0x556ba5c38830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/915004134 shutdown_connections 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/915004134 wait complete. 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.966+0000 7ffbce56b640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 0x7ffbb00a5300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x556ba5c391f0 tx=0x7ffbc0004700 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 -- start start 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 Processor -- start 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c48600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c46590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ba5c49150 con 0x556ba587c4d0 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556ba5b5c790 con 0x556ba589d1b0 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ba5c492d0 con 0x556ba58742f0 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.967+0000 7ffbd6e7c740 10 client.0 _ll_register_callbacks cb 0x556ba5b97a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.968+0000 7ffbcd569640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c48600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.968+0000 7ffbcdd6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.968+0000 7ffbcdd6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:42412/0 (socket says 172.21.15.135:42412) 2024-05-20T17:46:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.968+0000 7ffbcdd6a640 1 -- 172.21.15.135:0/2034151115 learned_addr learned my addr 172.21.15.135:0/2034151115 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.968+0000 7ffbce56b640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 -- 172.21.15.135:0/2034151115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 msgr2=0x556ba5c480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 -- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 msgr2=0x556ba5c46590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c46590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 -- 172.21.15.135:0/2034151115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba58b5210 con 0x556ba587c4d0 2024-05-20T17:46:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbcd569640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c48600 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80cc190 tx=0x7ffbb809aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65a847287f4af6e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.969+0000 7ffbad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.970+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb809f310 con 0x556ba587c4d0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.970+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbbc005020 con 0x556ba587c4d0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.970+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7ffbb8097680 con 0x556ba587c4d0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.971+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffbb80a3bd0 con 0x556ba587c4d0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.971+0000 7ffbd6e7c740 10 client.16935 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.971+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ba5981620 con 0x556ba587c4d0 2024-05-20T17:46:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbbc005020 con 0x556ba587c4d0 2024-05-20T17:46:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ffbb80b9ca0 con 0x556ba587c4d0 2024-05-20T17:46:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbd6e7c740 10 client.16935 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbd6e7c740 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbd6e7c740 20 client.16935 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.972+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba585bd80 0x556ba5c58dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.973+0000 7ffbd6e7c740 4 client.16935 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:46:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.973+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ba5baea70 con 0x556ba585bd80 2024-05-20T17:46:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.977+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba585bd80 0x556ba5c58dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.980+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba585bd80 0x556ba5c58dd0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da045506bcc69925 server_cookie=8ace099a0e7aee70 in_seq=0 out_seq=0 2024-05-20T17:46:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.980+0000 7ffbad7fa640 10 client.16935 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.984+0000 7ffbad7fa640 1 -- 172.21.15.135:0/2034151115 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556ba5baea70 con 0x556ba585bd80 2024-05-20T17:46:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.984+0000 7ffbad7fa640 10 client.16935 handle_command_reply: tid=0 2024-05-20T17:46:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.984+0000 7ffbd6e7c740 1 client.16935 shutdown 2024-05-20T17:46:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.985+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 msgr2=0x556ba5c48600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.985+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c48600 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80cc190 tx=0x7ffbb809aed0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 shutdown_connections 2024-05-20T17:46:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba585bd80 0x556ba5c58dd0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c46590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c48600 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/2034151115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.990+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 >> 172.21.15.135:0/2034151115 conn(0x556ba5891300 msgr2=0x556ba5c3be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.991+0000 7ffbad7fa640 0 client.16935 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.991+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 shutdown_connections 2024-05-20T17:46:20.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.991+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/2034151115 wait complete. 2024-05-20T17:46:20.993 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:20.991+0000 7ffbd6e7c740 20 client.16935 trim_cache size 0 max 16384 2024-05-20T17:46:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.015+0000 7ffbd6e7c740 1 Processor -- start 2024-05-20T17:46:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.015+0000 7ffbd6e7c740 1 -- start start 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c5e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc81b7e40 con 0x556ba587c4d0 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc81b5650 con 0x556ba589d1b0 2024-05-20T17:46:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.016+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc810a3a0 con 0x556ba58742f0 2024-05-20T17:46:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.018+0000 7ffbcd569640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.018+0000 7ffbcd569640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52864/0 (socket says 172.21.15.135:52864) 2024-05-20T17:46:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.018+0000 7ffbcd569640 1 -- 172.21.15.135:0/618610751 learned_addr learned my addr 172.21.15.135:0/618610751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.019+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c5e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.019+0000 7ffbce56b640 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 -- 172.21.15.135:0/618610751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 msgr2=0x556ba5c5e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c5e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 -- 172.21.15.135:0/618610751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 msgr2=0x556ba5c3fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 -- 172.21.15.135:0/618610751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba5c492c0 con 0x556ba587c4d0 2024-05-20T17:46:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.020+0000 7ffbcd569640 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80a36a0 tx=0x7ffbb809b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c46ac081677dbae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.023+0000 7ffbaf7fe640 1 -- 172.21.15.135:0/618610751 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb807d020 con 0x556ba587c4d0 2024-05-20T17:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.024+0000 7ffbaf7fe640 1 -- 172.21.15.135:0/618610751 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb809f310 con 0x556ba587c4d0 2024-05-20T17:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.024+0000 7ffbaf7fe640 1 -- 172.21.15.135:0/618610751 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80a39a0 con 0x556ba587c4d0 2024-05-20T17:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.025+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/618610751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 msgr2=0x556ba5c5eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.025+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80a36a0 tx=0x7ffbb809b190 comp rx=0 tx=0).stop 2024-05-20T17:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.030+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/618610751 shutdown_connections 2024-05-20T17:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.030+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba589d1b0 0x556ba5c3fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.030+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba587c4d0 0x556ba5c5eb10 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.030+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/618610751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba58742f0 0x556ba5c5e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.030+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/618610751 >> 172.21.15.135:0/618610751 conn(0x556ba5891300 msgr2=0x556ba5c41770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.032+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/618610751 shutdown_connections 2024-05-20T17:46:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.034+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/618610751 wait complete. 2024-05-20T17:46:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.034+0000 7ffbd6e7c740 1 -- start start 2024-05-20T17:46:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.034+0000 7ffbd6e7c740 1 Processor -- start 2024-05-20T17:46:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c4b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba587c4d0 0x556ba5c4b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8118040 con 0x556ba58742f0 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8119490 con 0x556ba587c4d0 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc81186f0 con 0x556ba589d1b0 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.035+0000 7ffbd6e7c740 10 client.0 _ll_register_callbacks cb 0x7ffbbc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:42432/0 (socket says 172.21.15.135:42432) 2024-05-20T17:46:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 -- 172.21.15.135:0/4294531974 learned_addr learned my addr 172.21.15.135:0/4294531974 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 -- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba587c4d0 msgr2=0x556ba5c4b720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:46:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba587c4d0 0x556ba5c4b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 -- 172.21.15.135:0/4294531974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 msgr2=0x556ba5c4b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c4b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.036+0000 7ffbce56b640 1 -- 172.21.15.135:0/4294531974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba5cbf1b0 con 0x556ba589d1b0 2024-05-20T17:46:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.041+0000 7ffbce56b640 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbc003a850 tx=0x7ffbc0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955402152790d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.041+0000 7ffbad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:46:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.041+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030040 con 0x556ba589d1b0 2024-05-20T17:46:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.041+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ba5ba8dc0 con 0x556ba589d1b0 2024-05-20T17:46:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.043+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7ffbc0039b10 con 0x556ba589d1b0 2024-05-20T17:46:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.044+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffbc0039d10 con 0x556ba589d1b0 2024-05-20T17:46:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.044+0000 7ffbd6e7c740 10 client.26404 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.044+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ba5cc0470 con 0x556ba589d1b0 2024-05-20T17:46:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556ba5ba8dc0 con 0x556ba589d1b0 2024-05-20T17:46:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ffbc0043070 con 0x556ba589d1b0 2024-05-20T17:46:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 10 client.26404 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 10 client.26404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 20 client.26404 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba58311c0 0x556ba5cc2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 4 client.26404 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:46:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.045+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ba5b268e0 con 0x556ba58311c0 2024-05-20T17:46:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.047+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba58311c0 0x556ba5cc2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.051+0000 7ffbcdd6a640 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba58311c0 0x556ba5cc2d50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7203f884fd8b486 server_cookie=6f942db7143b9698 in_seq=0 out_seq=0 2024-05-20T17:46:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:21.051+0000 7ffbad7fa640 10 client.26404 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:21.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:21 smithi172 ceph-mon[36511]: pgmap v406: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-05-20T17:46:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:21 smithi135 ceph-mon[32027]: pgmap v406: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-05-20T17:46:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:21 smithi160 ceph-mon[36261]: pgmap v406: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbad7fa640 1 -- 172.21.15.135:0/4294531974 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ba5b268e0 con 0x556ba58311c0 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbad7fa640 10 client.26404 handle_command_reply: tid=0 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 client.26404 shutdown 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 msgr2=0x556ba5c4bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbc003a850 tx=0x7ffbc0004770 comp rx=0 tx=0).stop 2024-05-20T17:46:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 shutdown_connections 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x556ba58311c0 0x556ba5cc2d50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ba589d1b0 0x556ba5c4bc60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ba587c4d0 0x556ba5c4b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 --2- 172.21.15.135:0/4294531974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ba58742f0 0x556ba5c4b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 >> 172.21.15.135:0/4294531974 conn(0x556ba5891300 msgr2=0x556ba5c381f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbad7fa640 0 client.26404 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 shutdown_connections 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 1 -- 172.21.15.135:0/4294531974 wait complete. 2024-05-20T17:46:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.335+0000 7ffbd6e7c740 20 client.26404 trim_cache size 0 max 16384 2024-05-20T17:46:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:46:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:46:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:46:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:46:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.336+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 msgr2=0x7ffbb00a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.336+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 0x7ffbb00a5300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x556ba5c391f0 tx=0x7ffbc0004700 comp rx=0 tx=0).stop 2024-05-20T17:46:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.336+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 msgr2=0x7ffbc81a8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.336+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800ba50 tx=0x7ffbb800bf10 comp rx=0 tx=0).stop 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 shutdown_connections 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ffbb00a2df0 0x7ffbb00a5300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbc811c0d0 0x7ffbc81acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbc8119770 0x7ffbc81a8cf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 --2- 172.21.15.135:0/1394038868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc8109080 0x7ffbc81a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.337+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 >> 172.21.15.135:0/1394038868 conn(0x7ffbc806d780 msgr2=0x7ffbc8119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.338+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 shutdown_connections 2024-05-20T17:46:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:22.338+0000 7ffbcffce640 1 -- 172.21.15.135:0/1394038868 wait complete. 2024-05-20T17:46:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:23 smithi172 ceph-mon[36511]: pgmap v407: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-20T17:46:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:23 smithi135 ceph-mon[32027]: pgmap v407: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-20T17:46:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:23 smithi160 ceph-mon[36261]: pgmap v407: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-20T17:46:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:25 smithi172 ceph-mon[36511]: pgmap v408: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 839 KiB/s wr, 178 op/s 2024-05-20T17:46:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:25 smithi135 ceph-mon[32027]: pgmap v408: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 839 KiB/s wr, 178 op/s 2024-05-20T17:46:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:25 smithi160 ceph-mon[36261]: pgmap v408: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 839 KiB/s wr, 178 op/s 2024-05-20T17:46:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:27 smithi135 ceph-mon[32027]: pgmap v409: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 768 KiB/s wr, 140 op/s 2024-05-20T17:46:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:27 smithi160 ceph-mon[36261]: pgmap v409: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 768 KiB/s wr, 140 op/s 2024-05-20T17:46:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:27 smithi172 ceph-mon[36511]: pgmap v409: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 768 KiB/s wr, 140 op/s 2024-05-20T17:46:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:29 smithi135 ceph-mon[32027]: pgmap v410: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-05-20T17:46:29.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:29 smithi160 ceph-mon[36261]: pgmap v410: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-05-20T17:46:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:29 smithi172 ceph-mon[36511]: pgmap v410: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.1 MiB/s wr, 195 op/s 2024-05-20T17:46:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:31 smithi135 ceph-mon[32027]: pgmap v411: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 729 KiB/s wr, 168 op/s 2024-05-20T17:46:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:31 smithi160 ceph-mon[36261]: pgmap v411: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 729 KiB/s wr, 168 op/s 2024-05-20T17:46:31.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:31 smithi172 ceph-mon[36511]: pgmap v411: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 729 KiB/s wr, 168 op/s 2024-05-20T17:46:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:33 smithi135 ceph-mon[32027]: pgmap v412: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 730 KiB/s wr, 184 op/s 2024-05-20T17:46:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:33 smithi160 ceph-mon[36261]: pgmap v412: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 730 KiB/s wr, 184 op/s 2024-05-20T17:46:33.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:33 smithi172 ceph-mon[36511]: pgmap v412: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 730 KiB/s wr, 184 op/s 2024-05-20T17:46:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.481+0000 7f969ff45640 1 -- 172.21.15.135:0/4278029300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107eb0 msgr2=0x7f9698101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.481+0000 7f969ff45640 1 --2- 172.21.15.135:0/4278029300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107eb0 0x7f9698101b00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9688009900 tx=0x7f968802a410 comp rx=0 tx=0).stop 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 -- 172.21.15.135:0/4278029300 shutdown_connections 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 --2- 172.21.15.135:0/4278029300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969810e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 --2- 172.21.15.135:0/4278029300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107eb0 0x7f9698101b00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 --2- 172.21.15.135:0/4278029300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107a10 0x7f96981015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 -- 172.21.15.135:0/4278029300 >> 172.21.15.135:0/4278029300 conn(0x7f9698077160 msgr2=0x7f96980775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 -- 172.21.15.135:0/4278029300 shutdown_connections 2024-05-20T17:46:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.482+0000 7f969ff45640 1 -- 172.21.15.135:0/4278029300 wait complete. 2024-05-20T17:46:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 Processor -- start 2024-05-20T17:46:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 -- start start 2024-05-20T17:46:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 0x7f969819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107eb0 0x7f9698199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9698111d80 con 0x7f9698107a10 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9698111c00 con 0x7f9698107eb0 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969ff45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9698111f00 con 0x7f9698102170 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 0x7f969819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969dce1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 0x7f969819fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38518/0 (socket says 172.21.15.135:38518) 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.483+0000 7f969d4e0640 1 -- 172.21.15.135:0/3358387770 learned_addr learned my addr 172.21.15.135:0/3358387770 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107eb0 0x7f9698199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 -- 172.21.15.135:0/3358387770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107eb0 msgr2=0x7f9698199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107eb0 0x7f9698199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 -- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 msgr2=0x7f969819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 0x7f969819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 -- 172.21.15.135:0/3358387770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9698199d80 con 0x7f9698102170 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.484+0000 7f969dce1640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969819f4d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9698102700 tx=0x7f969400b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.485+0000 7f968effd640 1 -- 172.21.15.135:0/3358387770 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969401e070 con 0x7f9698102170 2024-05-20T17:46:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.485+0000 7f968effd640 1 -- 172.21.15.135:0/3358387770 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96940198f0 con 0x7f9698102170 2024-05-20T17:46:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.485+0000 7f968effd640 1 -- 172.21.15.135:0/3358387770 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694018730 con 0x7f9698102170 2024-05-20T17:46:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.487+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969819a010 con 0x7f9698102170 2024-05-20T17:46:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.487+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969810c490 con 0x7f9698102170 2024-05-20T17:46:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.491+0000 7f96a6df2740 1 Processor -- start 2024-05-20T17:46:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.491+0000 7f96a6df2740 1 -- start start 2024-05-20T17:46:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.491+0000 7f968effd640 1 -- 172.21.15.135:0/3358387770 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f9694019aa0 con 0x7f9698102170 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f391b0 0x55b1b12d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b1b123d340 con 0x55b1b0f184d0 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b1b11e5290 con 0x55b1b0f391b0 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.492+0000 7f96a6df2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b1b1239300 con 0x55b1b0f102f0 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f968effd640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 0x7f96840a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38524/0 (socket says 172.21.15.135:38524) 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 -- 172.21.15.135:0/785653947 learned_addr learned my addr 172.21.15.135:0/785653947 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f968effd640 1 -- 172.21.15.135:0/3358387770 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f96940d2ca0 con 0x7f9698102170 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 -- 172.21.15.135:0/785653947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 msgr2=0x55b1b12d85c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12d85c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 -- 172.21.15.135:0/785653947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f391b0 msgr2=0x55b1b12d8080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f391b0 0x55b1b12d8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.493+0000 7f969d4e0640 1 -- 172.21.15.135:0/785653947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b12098e0 con 0x55b1b0f184d0 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.494+0000 7f969d4e0640 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9688006010 tx=0x7f9688005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f6cd04fc412686 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.494+0000 7f9683fff640 1 -- 172.21.15.135:0/785653947 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688051070 con 0x55b1b0f184d0 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.494+0000 7f9683fff640 1 -- 172.21.15.135:0/785653947 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96880318f0 con 0x55b1b0f184d0 2024-05-20T17:46:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.494+0000 7f9683fff640 1 -- 172.21.15.135:0/785653947 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688035040 con 0x55b1b0f184d0 2024-05-20T17:46:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 -- 172.21.15.135:0/785653947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 msgr2=0x55b1b12d8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9688006010 tx=0x7f9688005dd0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 0x7f96840a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 -- 172.21.15.135:0/785653947 shutdown_connections 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12d8b00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 --2- 172.21.15.135:0/785653947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f391b0 0x55b1b12d8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.496+0000 7f96a6df2740 1 -- 172.21.15.135:0/785653947 >> 172.21.15.135:0/785653947 conn(0x55b1b0f2d300 msgr2=0x55b1b12d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.497+0000 7f96a6df2740 1 -- 172.21.15.135:0/785653947 shutdown_connections 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.497+0000 7f96a6df2740 1 -- 172.21.15.135:0/785653947 wait complete. 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.497+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 0x7f96840a5200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b1b12d51f0 tx=0x7f9690009500 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.497+0000 7f96a6df2740 1 -- start start 2024-05-20T17:46:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 Processor -- start 2024-05-20T17:46:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b1b12e5150 con 0x55b1b0f184d0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b1b11f8790 con 0x55b1b0f102f0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b1b12e52d0 con 0x55b1b0f391b0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.498+0000 7f96a6df2740 10 client.0 _ll_register_callbacks cb 0x55b1b1233a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:38088/0 (socket says 172.21.15.135:38088) 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 -- 172.21.15.135:0/3151426464 learned_addr learned my addr 172.21.15.135:0/3151426464 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969d4e0640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969dce1640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 -- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 msgr2=0x55b1b12e26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 -- 172.21.15.135:0/3151426464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 msgr2=0x55b1b12e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.499+0000 7f969e4e2640 1 -- 172.21.15.135:0/3151426464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b0f51210 con 0x55b1b0f391b0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.500+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9690005f40 tx=0x7f9690004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfef2f808075e26c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.500+0000 7f96817fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.500+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969000ed40 con 0x55b1b0f391b0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.500+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96880318f0 con 0x55b1b0f391b0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.500+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f9690026400 con 0x55b1b0f391b0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.501+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9690004820 con 0x55b1b0f391b0 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.501+0000 7f96a6df2740 10 client.26413 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.501+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1b101d620 con 0x55b1b0f391b0 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.501+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96880318f0 con 0x55b1b0f391b0 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f969002e790 con 0x55b1b0f391b0 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 10 client.26413 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 10 client.26413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 20 client.26413 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ef7d80 0x55b1b12fd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 4 client.26413 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:46:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1b124aa70 con 0x55b1b0ef7d80 2024-05-20T17:46:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.502+0000 7f969dce1640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ef7d80 0x55b1b12fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.503+0000 7f96817fa640 10 client.26413 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.503+0000 7f969dce1640 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ef7d80 0x55b1b12fd180 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9876cc42dcdfbc4d server_cookie=57e261abbf6ca077 in_seq=0 out_seq=0 2024-05-20T17:46:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96817fa640 1 -- 172.21.15.135:0/3151426464 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b1b124aa70 con 0x55b1b0ef7d80 2024-05-20T17:46:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96817fa640 10 client.26413 handle_command_reply: tid=0 2024-05-20T17:46:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 client.26413 shutdown 2024-05-20T17:46:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 msgr2=0x55b1b12f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9690005f40 tx=0x7f9690004ab0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 shutdown_connections 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ef7d80 0x55b1b12fd180 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12f0e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3151426464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 >> 172.21.15.135:0/3151426464 conn(0x55b1b0f2d300 msgr2=0x55b1b12d9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96817fa640 0 client.26413 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 shutdown_connections 2024-05-20T17:46:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 1 -- 172.21.15.135:0/3151426464 wait complete. 2024-05-20T17:46:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.517+0000 7f96a6df2740 20 client.26413 trim_cache size 0 max 16384 2024-05-20T17:46:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.541+0000 7f96a6df2740 1 Processor -- start 2024-05-20T17:46:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.541+0000 7f96a6df2740 1 -- start start 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.541+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.541+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f96a6df2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96981a6bb0 con 0x55b1b0f184d0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f96a6df2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9698071ec0 con 0x55b1b0f102f0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f96a6df2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f969806fd30 con 0x55b1b0f391b0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38536/0 (socket says 172.21.15.135:38536) 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 -- 172.21.15.135:0/3087777225 learned_addr learned my addr 172.21.15.135:0/3087777225 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969dce1640 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969e4e2640 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 -- 172.21.15.135:0/3087777225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 msgr2=0x55b1b12e42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12e42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 -- 172.21.15.135:0/3087777225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 msgr2=0x55b1b12e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 -- 172.21.15.135:0/3087777225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b12f7e60 con 0x55b1b0f184d0 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.542+0000 7f969d4e0640 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9688005640 tx=0x7f9688000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a81ddb5fdff8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.543+0000 7f96837fe640 1 -- 172.21.15.135:0/3087777225 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688065070 con 0x55b1b0f184d0 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.543+0000 7f96837fe640 1 -- 172.21.15.135:0/3087777225 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9688060b60 con 0x55b1b0f184d0 2024-05-20T17:46:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.543+0000 7f96837fe640 1 -- 172.21.15.135:0/3087777225 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688051070 con 0x55b1b0f184d0 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.544+0000 7f96a6df2740 1 -- 172.21.15.135:0/3087777225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 msgr2=0x55b1b12dcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.544+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9688005640 tx=0x7f9688000bc0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.545+0000 7f96a6df2740 1 -- 172.21.15.135:0/3087777225 shutdown_connections 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.545+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f391b0 0x55b1b12e42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.545+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f184d0 0x55b1b12dcd80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.545+0000 7f96a6df2740 1 --2- 172.21.15.135:0/3087777225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f102f0 0x55b1b12e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.545+0000 7f96a6df2740 1 -- 172.21.15.135:0/3087777225 >> 172.21.15.135:0/3087777225 conn(0x55b1b0f2d300 msgr2=0x55b1b12e3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.548+0000 7f96a6df2740 1 -- 172.21.15.135:0/3087777225 shutdown_connections 2024-05-20T17:46:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.552+0000 7f96a6df2740 1 -- 172.21.15.135:0/3087777225 wait complete. 2024-05-20T17:46:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.552+0000 7f96a6df2740 1 -- start start 2024-05-20T17:46:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.552+0000 7f96a6df2740 1 Processor -- start 2024-05-20T17:46:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12f7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f391b0 0x55b1b12f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9698070380 con 0x55b1b0f391b0 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f96980717f0 con 0x55b1b0f184d0 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9698070a50 con 0x55b1b0f102f0 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f96a6df2740 10 client.0 _ll_register_callbacks cb 0x7f9690009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f969d4e0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51284/0 (socket says 172.21.15.135:51284) 2024-05-20T17:46:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.553+0000 7f969d4e0640 1 -- 172.21.15.135:0/1446058271 learned_addr learned my addr 172.21.15.135:0/1446058271 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969dce1640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969d4e0640 1 -- 172.21.15.135:0/1446058271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 msgr2=0x55b1b12f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969d4e0640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969d4e0640 1 -- 172.21.15.135:0/1446058271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f391b0 msgr2=0x55b1b12f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969d4e0640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f391b0 0x55b1b12f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.554+0000 7f969d4e0640 1 -- 172.21.15.135:0/1446058271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b12f34b0 con 0x55b1b0f184d0 2024-05-20T17:46:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.555+0000 7f969d4e0640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f968802a930 tx=0x7f968802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ee44d8c61bfb55 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.555+0000 7f96817fa640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.555+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688070060 con 0x55b1b0f184d0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.556+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9688060b60 con 0x55b1b0f184d0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.556+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f968804d820 con 0x55b1b0f184d0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.556+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9688051070 con 0x55b1b0f184d0 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.556+0000 7f96a6df2740 10 client.26525 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.556+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1b13652a0 con 0x55b1b0f184d0 2024-05-20T17:46:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96880609b0 con 0x55b1b0f184d0 2024-05-20T17:46:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f968806b960 con 0x55b1b0f184d0 2024-05-20T17:46:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 10 client.26525 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 10 client.26525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 20 client.26525 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ecd1c0 0x55b1b1367500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 4 client.26525 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:46:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.557+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9688060b60 con 0x55b1b0ecd1c0 2024-05-20T17:46:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.559+0000 7f969dce1640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ecd1c0 0x55b1b1367500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.567+0000 7f96817fa640 10 client.26525 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:35.567+0000 7f969dce1640 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ecd1c0 0x55b1b1367500 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a995ad2a9e7b88 server_cookie=6e4f9a129edbba3e in_seq=0 out_seq=0 2024-05-20T17:46:35.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:35 smithi135 ceph-mon[32027]: pgmap v413: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 976 KiB/s wr, 178 op/s 2024-05-20T17:46:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:35 smithi160 ceph-mon[36261]: pgmap v413: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 976 KiB/s wr, 178 op/s 2024-05-20T17:46:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:35 smithi172 ceph-mon[36511]: pgmap v413: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 976 KiB/s wr, 178 op/s 2024-05-20T17:46:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:37 smithi135 ceph-mon[32027]: pgmap v414: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 730 KiB/s wr, 144 op/s 2024-05-20T17:46:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:37 smithi160 ceph-mon[36261]: pgmap v414: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 730 KiB/s wr, 144 op/s 2024-05-20T17:46:37.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:37 smithi172 ceph-mon[36511]: pgmap v414: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 730 KiB/s wr, 144 op/s 2024-05-20T17:46:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:39 smithi135 ceph-mon[32027]: pgmap v415: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 926 KiB/s wr, 167 op/s 2024-05-20T17:46:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:39 smithi160 ceph-mon[36261]: pgmap v415: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 926 KiB/s wr, 167 op/s 2024-05-20T17:46:39.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:39 smithi172 ceph-mon[36511]: pgmap v415: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 926 KiB/s wr, 167 op/s 2024-05-20T17:46:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96817fa640 1 -- 172.21.15.135:0/1446058271 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9688060b60 con 0x55b1b0ecd1c0 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96817fa640 10 client.26525 handle_command_reply: tid=0 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 client.26525 shutdown 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 msgr2=0x55b1b12f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f968802a930 tx=0x7f968802a410 comp rx=0 tx=0).stop 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 shutdown_connections 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55b1b0ecd1c0 0x55b1b1367500 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1b0f391b0 0x55b1b12f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1b0f184d0 0x55b1b12f2980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 --2- 172.21.15.135:0/1446058271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1b0f102f0 0x55b1b12f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 >> 172.21.15.135:0/1446058271 conn(0x55b1b0f2d300 msgr2=0x55b1b12e1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.497+0000 7f96817fa640 0 client.26525 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.498+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 shutdown_connections 2024-05-20T17:46:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.498+0000 7f96a6df2740 1 -- 172.21.15.135:0/1446058271 wait complete. 2024-05-20T17:46:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.498+0000 7f96a6df2740 20 client.26525 trim_cache size 0 max 16384 2024-05-20T17:46:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:46:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:46:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:46:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 msgr2=0x7f96840a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 0x7f96840a5200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b1b12d51f0 tx=0x7f9690009500 comp rx=0 tx=0).stop 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 msgr2=0x7f969819f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969819f4d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9698102700 tx=0x7f969400b690 comp rx=0 tx=0).stop 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 shutdown_connections 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f96840a2cf0 0x7f96840a5200 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9698107eb0 0x7f9698199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9698107a10 0x7f969819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 --2- 172.21.15.135:0/3358387770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9698102170 0x7f969819f4d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 >> 172.21.15.135:0/3358387770 conn(0x7f9698077160 msgr2=0x7f96980fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 shutdown_connections 2024-05-20T17:46:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:40.499+0000 7f969ff45640 1 -- 172.21.15.135:0/3358387770 wait complete. 2024-05-20T17:46:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:41 smithi135 ceph-mon[32027]: pgmap v416: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 790 KiB/s wr, 108 op/s 2024-05-20T17:46:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:41 smithi160 ceph-mon[36261]: pgmap v416: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 790 KiB/s wr, 108 op/s 2024-05-20T17:46:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:41 smithi172 ceph-mon[36511]: pgmap v416: 97 pgs: 21 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 38 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 790 KiB/s wr, 108 op/s 2024-05-20T17:46:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:43 smithi135 ceph-mon[32027]: pgmap v417: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 904 KiB/s wr, 137 op/s 2024-05-20T17:46:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:43 smithi160 ceph-mon[36261]: pgmap v417: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 904 KiB/s wr, 137 op/s 2024-05-20T17:46:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:43 smithi172 ceph-mon[36511]: pgmap v417: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 904 KiB/s wr, 137 op/s 2024-05-20T17:46:45.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:45 smithi135 ceph-mon[32027]: pgmap v418: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-05-20T17:46:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:45 smithi160 ceph-mon[36261]: pgmap v418: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-05-20T17:46:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:45 smithi172 ceph-mon[36511]: pgmap v418: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-05-20T17:46:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:47 smithi135 ceph-mon[32027]: pgmap v419: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 948 KiB/s wr, 144 op/s 2024-05-20T17:46:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:47 smithi160 ceph-mon[36261]: pgmap v419: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 948 KiB/s wr, 144 op/s 2024-05-20T17:46:47.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:47 smithi172 ceph-mon[36511]: pgmap v419: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 948 KiB/s wr, 144 op/s 2024-05-20T17:46:49.631 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:49 smithi172 ceph-mon[36511]: pgmap v420: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:46:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:49 smithi135 ceph-mon[32027]: pgmap v420: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:46:49.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:49 smithi160 ceph-mon[36261]: pgmap v420: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:46:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:51 smithi135 ceph-mon[32027]: pgmap v421: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-20T17:46:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:51 smithi160 ceph-mon[36261]: pgmap v421: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-20T17:46:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:51 smithi172 ceph-mon[36511]: pgmap v421: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-20T17:46:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.659+0000 7f2425080640 1 -- 172.21.15.135:0/797040447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 msgr2=0x7f24201173b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.659+0000 7f2425080640 1 --2- 172.21.15.135:0/797040447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 0x7f24201173b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2410009900 tx=0x7f241002a4d0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.663+0000 7f2425080640 1 -- 172.21.15.135:0/797040447 shutdown_connections 2024-05-20T17:46:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.663+0000 7f2425080640 1 --2- 172.21.15.135:0/797040447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.663+0000 7f2425080640 1 --2- 172.21.15.135:0/797040447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 0x7f24201173b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.663+0000 7f2425080640 1 --2- 172.21.15.135:0/797040447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2420109320 0x7f2420109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.665 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.663+0000 7f2425080640 1 -- 172.21.15.135:0/797040447 >> 172.21.15.135:0/797040447 conn(0x7f242006d780 msgr2=0x7f242006dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.665+0000 7f2425080640 1 -- 172.21.15.135:0/797040447 shutdown_connections 2024-05-20T17:46:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.665+0000 7f2425080640 1 -- 172.21.15.135:0/797040447 wait complete. 2024-05-20T17:46:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.666+0000 7f2425080640 1 Processor -- start 2024-05-20T17:46:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.666+0000 7f2425080640 1 -- start start 2024-05-20T17:46:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2420109320 0x7f2420111df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 0x7f2420112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f242011d820 con 0x7f2420117a20 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f242011d6a0 con 0x7f2420109320 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f2425080640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f242011d9a0 con 0x7f2420114f90 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f241f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f241f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41980/0 (socket says 172.21.15.135:41980) 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.667+0000 7f241f59e640 1 -- 172.21.15.135:0/2532814799 learned_addr learned my addr 172.21.15.135:0/2532814799 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 -- 172.21.15.135:0/2532814799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 msgr2=0x7f2420112330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 0x7f2420112330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 -- 172.21.15.135:0/2532814799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2420109320 msgr2=0x7f2420111df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2420109320 0x7f2420111df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 -- 172.21.15.135:0/2532814799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24201abe80 con 0x7f2420117a20 2024-05-20T17:46:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.668+0000 7f241f59e640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f241800eb10 tx=0x7f241800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.669+0000 7f2407fff640 1 -- 172.21.15.135:0/2532814799 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418004b20 con 0x7f2420117a20 2024-05-20T17:46:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.669+0000 7f2407fff640 1 -- 172.21.15.135:0/2532814799 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2418004cc0 con 0x7f2420117a20 2024-05-20T17:46:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.669+0000 7f2407fff640 1 -- 172.21.15.135:0/2532814799 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180107b0 con 0x7f2420117a20 2024-05-20T17:46:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.669+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24201ac170 con 0x7f2420117a20 2024-05-20T17:46:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.669+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24201ac670 con 0x7f2420117a20 2024-05-20T17:46:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.677+0000 7f242bffd740 1 Processor -- start 2024-05-20T17:46:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.677+0000 7f242bffd740 1 -- start start 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.677+0000 7f242bffd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f242bffd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce68f2f0 0x55edcea575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f2407fff640 1 -- 172.21.15.135:0/2532814799 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2418005000 con 0x7f2420117a20 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f242bffd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea57b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f242bffd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edce9bc340 con 0x55edce6b81b0 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f242bffd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55edce964290 con 0x55edce6974d0 2024-05-20T17:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.678+0000 7f242bffd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edce9b8300 con 0x55edce68f2f0 2024-05-20T17:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.679+0000 7f2407fff640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 0x7f24080a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.679+0000 7f241e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.679+0000 7f241e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41994/0 (socket says 172.21.15.135:41994) 2024-05-20T17:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.679+0000 7f241e59c640 1 -- 172.21.15.135:0/1117333800 learned_addr learned my addr 172.21.15.135:0/1117333800 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.679+0000 7f2407fff640 1 -- 172.21.15.135:0/2532814799 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f24180cfb50 con 0x7f2420117a20 2024-05-20T17:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.681+0000 7f241f59e640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 0x7f24080a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.682+0000 7f241f59e640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 0x7f24080a53d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24180a46f0 tx=0x7f2418009200 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.682+0000 7f241e59c640 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea57b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.682+0000 7f241ed9d640 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce68f2f0 0x55edcea575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 -- 172.21.15.135:0/1117333800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce68f2f0 msgr2=0x55edcea575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce68f2f0 0x55edcea575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 -- 172.21.15.135:0/1117333800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 msgr2=0x55edcea57b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea57b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 -- 172.21.15.135:0/1117333800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edce9888e0 con 0x55edce6b81b0 2024-05-20T17:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.683+0000 7f241e59c640 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2410005ab0 tx=0x7f2410005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912ac177d75eb523 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.684+0000 7f24057fa640 1 -- 172.21.15.135:0/1117333800 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410046070 con 0x55edce6b81b0 2024-05-20T17:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.684+0000 7f24057fa640 1 -- 172.21.15.135:0/1117333800 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2410031740 con 0x55edce6b81b0 2024-05-20T17:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.686+0000 7f242bffd740 1 -- 172.21.15.135:0/1117333800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 msgr2=0x55edcea57080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.686+0000 7f242bffd740 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2410005ab0 tx=0x7f2410005a00 comp rx=0 tx=0).stop 2024-05-20T17:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.687+0000 7f242bffd740 1 -- 172.21.15.135:0/1117333800 shutdown_connections 2024-05-20T17:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.687+0000 7f242bffd740 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea57b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.687+0000 7f242bffd740 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce68f2f0 0x55edcea575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.687+0000 7f242bffd740 1 --2- 172.21.15.135:0/1117333800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea57080 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.687+0000 7f242bffd740 1 -- 172.21.15.135:0/1117333800 >> 172.21.15.135:0/1117333800 conn(0x55edce6ac300 msgr2=0x55edcea53830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.693+0000 7f242bffd740 1 -- 172.21.15.135:0/1117333800 shutdown_connections 2024-05-20T17:46:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.693+0000 7f242bffd740 1 -- 172.21.15.135:0/1117333800 wait complete. 2024-05-20T17:46:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.694+0000 7f242bffd740 1 -- start start 2024-05-20T17:46:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.694+0000 7f242bffd740 1 Processor -- start 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce6974d0 0x55edcea635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edcea641a0 con 0x55edce6b81b0 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55edce977790 con 0x55edce68f2f0 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edcea64320 con 0x55edce6974d0 2024-05-20T17:46:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f242bffd740 10 client.0 _ll_register_callbacks cb 0x55edce9b2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f241e59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f241e59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:38760/0 (socket says 172.21.15.135:38760) 2024-05-20T17:46:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.695+0000 7f241e59c640 1 -- 172.21.15.135:0/794410694 learned_addr learned my addr 172.21.15.135:0/794410694 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241ed9d640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce6974d0 0x55edcea635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 -- 172.21.15.135:0/794410694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce6974d0 msgr2=0x55edcea635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce6974d0 0x55edcea635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 -- 172.21.15.135:0/794410694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 msgr2=0x55edcea61580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 -- 172.21.15.135:0/794410694 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edce6d0210 con 0x55edce68f2f0 2024-05-20T17:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.696+0000 7f241e59c640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2410009a20 tx=0x7f241002a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd873e859e55033 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.697+0000 7f2402ff5640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.697+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410046040 con 0x55edce68f2f0 2024-05-20T17:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.697+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f2410004250 con 0x55edce68f2f0 2024-05-20T17:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.697+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2410031740 con 0x55edce68f2f0 2024-05-20T17:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.698+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2410004450 con 0x55edce68f2f0 2024-05-20T17:46:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.699+0000 7f242bffd740 10 client.26534 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.699+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55edce79c620 con 0x55edce68f2f0 2024-05-20T17:46:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.699+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2410031740 con 0x55edce68f2f0 2024-05-20T17:46:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f24100046c0 con 0x55edce68f2f0 2024-05-20T17:46:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 10 client.26534 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 10 client.26534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 20 client.26534 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edce676d80 0x55edcea737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 4 client.26534 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:46:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.703+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edce9c9a70 con 0x55edce676d80 2024-05-20T17:46:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.705+0000 7f241ed9d640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edce676d80 0x55edcea737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.708 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:53 smithi135 ceph-mon[32027]: pgmap v422: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-05-20T17:46:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.708+0000 7f241ed9d640 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edce676d80 0x55edcea737e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b45b57fae07650a server_cookie=555cb61f1dffe01e in_seq=0 out_seq=0 2024-05-20T17:46:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.708+0000 7f2402ff5640 10 client.26534 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.709+0000 7f2402ff5640 1 -- 172.21.15.135:0/794410694 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55edce9c9a70 con 0x55edce676d80 2024-05-20T17:46:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.710+0000 7f2402ff5640 10 client.26534 handle_command_reply: tid=0 2024-05-20T17:46:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.710+0000 7f242bffd740 1 client.26534 shutdown 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.712+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 msgr2=0x55edcea63090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.712+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2410009a20 tx=0x7f241002a4d0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 shutdown_connections 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edce676d80 0x55edcea737e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce6974d0 0x55edcea635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 --2- 172.21.15.135:0/794410694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce68f2f0 0x55edcea63090 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2410009a20 tx=0x7f241002a4d0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 >> 172.21.15.135:0/794410694 conn(0x55edce6ac300 msgr2=0x55edcea56e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.713+0000 7f2402ff5640 0 client.26534 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.716+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 shutdown_connections 2024-05-20T17:46:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.719+0000 7f242bffd740 1 -- 172.21.15.135:0/794410694 wait complete. 2024-05-20T17:46:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.720+0000 7f242bffd740 20 client.26534 trim_cache size 0 max 16384 2024-05-20T17:46:53.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.749+0000 7f242bffd740 1 Processor -- start 2024-05-20T17:46:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 -- start start 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea53930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea76810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24201b7aa0 con 0x55edce6b81b0 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f24201b52b0 con 0x55edce6974d0 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f242bffd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f242010a3e0 con 0x55edce64c1c0 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f241ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f241ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42004/0 (socket says 172.21.15.135:42004) 2024-05-20T17:46:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.751+0000 7f241ed9d640 1 -- 172.21.15.135:0/3520680535 learned_addr learned my addr 172.21.15.135:0/3520680535 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241e59c640 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea53930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241e59c640 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea76810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 -- 172.21.15.135:0/3520680535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 msgr2=0x55edcea76810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea76810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 -- 172.21.15.135:0/3520680535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 msgr2=0x55edcea53930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea53930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 -- 172.21.15.135:0/3520680535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edce676fb0 con 0x55edce6b81b0 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.752+0000 7f241ed9d640 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55edcea547c0 tx=0x7f241400b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381ca52ee0cf898 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.753+0000 7f2404ff9640 1 -- 172.21.15.135:0/3520680535 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414005220 con 0x55edce6b81b0 2024-05-20T17:46:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.753+0000 7f2404ff9640 1 -- 172.21.15.135:0/3520680535 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2414013e20 con 0x55edce6b81b0 2024-05-20T17:46:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.754+0000 7f2404ff9640 1 -- 172.21.15.135:0/3520680535 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414005220 con 0x55edce6b81b0 2024-05-20T17:46:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.754+0000 7f242bffd740 1 -- 172.21.15.135:0/3520680535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 msgr2=0x55edcea5b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.754+0000 7f242bffd740 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55edcea547c0 tx=0x7f241400b570 comp rx=0 tx=0).stop 2024-05-20T17:46:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:53 smithi160 ceph-mon[36261]: pgmap v422: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-05-20T17:46:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 -- 172.21.15.135:0/3520680535 shutdown_connections 2024-05-20T17:46:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea76810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6b81b0 0x55edcea5b3e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 --2- 172.21.15.135:0/3520680535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6974d0 0x55edcea53930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 -- 172.21.15.135:0/3520680535 >> 172.21.15.135:0/3520680535 conn(0x55edce6ac300 msgr2=0x55edcea5acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 -- 172.21.15.135:0/3520680535 shutdown_connections 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 -- 172.21.15.135:0/3520680535 wait complete. 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 -- start start 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.755+0000 7f242bffd740 1 Processor -- start 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea75b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 0x55edcea76070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24201b37b0 con 0x55edce6974d0 2024-05-20T17:46:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f24201b4be0 con 0x55edce6b81b0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24201b3e40 con 0x55edce64c1c0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f242bffd740 10 client.0 _ll_register_callbacks cb 0x7f2410044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:38778/0 (socket says 172.21.15.135:38778) 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 -- 172.21.15.135:0/4186765005 learned_addr learned my addr 172.21.15.135:0/4186765005 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea75b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241ed9d640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 0x55edcea76070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 -- 172.21.15.135:0/4186765005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 msgr2=0x55edcea75b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea75b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 -- 172.21.15.135:0/4186765005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 msgr2=0x55edcea76070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:46:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 0x55edcea76070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241e59c640 1 -- 172.21.15.135:0/4186765005 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edcead9e50 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.756+0000 7f241ed9d640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 0x55edcea76070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f241e59c640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f241002a9f0 tx=0x7f2410005310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ef60d39dbee5f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f2402ff5640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410031740 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7f2410004250 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2414013e20 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2410004450 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f242bffd740 10 client.26540 fetch_fsmap learned FSMap version 30 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55edceadb070 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.757+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2414013e20 con 0x55edce6b81b0 2024-05-20T17:46:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2410003a70 con 0x55edce6b81b0 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 10 client.26540 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 10 client.26540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 20 client.26540 populate_metadata read hostname 'smithi135' 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edceadb480 0x55edceadd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 4 client.26540 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edce9c3dc0 con 0x55edceadb480 2024-05-20T17:46:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.758+0000 7f241ed9d640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edceadb480 0x55edceadd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:46:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.759+0000 7f2402ff5640 10 client.26540 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.759+0000 7f241ed9d640 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edceadb480 0x55edceadd8f0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30efa463466524c2 server_cookie=2d117c6179b48a36 in_seq=0 out_seq=0 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.823+0000 7f2402ff5640 1 -- 172.21.15.135:0/4186765005 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edce9c3dc0 con 0x55edceadb480 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.823+0000 7f2402ff5640 10 client.26540 handle_command_reply: tid=0 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.823+0000 7f242bffd740 1 client.26540 shutdown 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 msgr2=0x55edcead9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f241002a9f0 tx=0x7f2410005310 comp rx=0 tx=0).stop 2024-05-20T17:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 shutdown_connections 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55edceadb480 0x55edceadd8f0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55edce6b81b0 0x55edcead9910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edce6974d0 0x55edcea76070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 --2- 172.21.15.135:0/4186765005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce64c1c0 0x55edcea75b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 >> 172.21.15.135:0/4186765005 conn(0x55edce6ac300 msgr2=0x55edcea62c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f2402ff5640 0 client.26540 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.824+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 shutdown_connections 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f242bffd740 1 -- 172.21.15.135:0/4186765005 wait complete. 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f242bffd740 20 client.26540 trim_cache size 0 max 16384 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:46:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:46:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 msgr2=0x7f24080a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 0x7f24080a53d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24180a46f0 tx=0x7f2418009200 comp rx=0 tx=0).stop 2024-05-20T17:46:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 msgr2=0x7f2420112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:46:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.825+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f241800eb10 tx=0x7f241800c2d0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 shutdown_connections 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f24080a2ec0 0x7f24080a53d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2420117a20 0x7f2420112870 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2420114f90 0x7f2420112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 --2- 172.21.15.135:0/2532814799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2420109320 0x7f2420111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 >> 172.21.15.135:0/2532814799 conn(0x7f242006d780 msgr2=0x7f24201153a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 shutdown_connections 2024-05-20T17:46:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:46:53.826+0000 7f2425080640 1 -- 172.21.15.135:0/2532814799 wait complete. 2024-05-20T17:46:53.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:53 smithi172 ceph-mon[36511]: pgmap v422: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-05-20T17:46:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:55 smithi135 ceph-mon[32027]: pgmap v423: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:46:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:55 smithi160 ceph-mon[36261]: pgmap v423: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:46:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:55 smithi172 ceph-mon[36511]: pgmap v423: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:46:57.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:57 smithi135 ceph-mon[32027]: pgmap v424: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-05-20T17:46:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:57 smithi160 ceph-mon[36261]: pgmap v424: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-05-20T17:46:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:57 smithi172 ceph-mon[36511]: pgmap v424: 97 pgs: 13 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 53 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-05-20T17:46:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:46:59 smithi135 ceph-mon[32027]: pgmap v425: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:46:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:46:59 smithi160 ceph-mon[36261]: pgmap v425: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:46:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:46:59 smithi172 ceph-mon[36511]: pgmap v425: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:47:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:01 smithi135 ceph-mon[32027]: pgmap v426: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-05-20T17:47:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:01 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:47:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:01 smithi160 ceph-mon[36261]: pgmap v426: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-05-20T17:47:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:01 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:47:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:01 smithi172 ceph-mon[36511]: pgmap v426: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-05-20T17:47:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:01 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:47:02.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:02 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:47:02.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:02 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:47:02.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:02 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:47:02.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:02 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:47:02.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:02 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:47:02.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:02 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:47:02.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:02 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:47:02.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:02 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:47:02.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:02 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:47:03.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:03 smithi135 ceph-mon[32027]: pgmap v427: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 198 op/s 2024-05-20T17:47:03.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:03 smithi160 ceph-mon[36261]: pgmap v427: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 198 op/s 2024-05-20T17:47:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:03 smithi172 ceph-mon[36511]: pgmap v427: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 198 op/s 2024-05-20T17:47:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:05 smithi135 ceph-mon[32027]: pgmap v428: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-05-20T17:47:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:05 smithi160 ceph-mon[36261]: pgmap v428: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-05-20T17:47:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:05 smithi172 ceph-mon[36511]: pgmap v428: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-05-20T17:47:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 -- 172.21.15.135:0/559579339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674105980 msgr2=0x7fc674105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/559579339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674105980 0x7fc674105db0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc668009900 tx=0x7fc66802a410 comp rx=0 tx=0).stop 2024-05-20T17:47:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 -- 172.21.15.135:0/559579339 shutdown_connections 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/559579339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc674106440 0x7fc67410dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/559579339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674105980 0x7fc674105db0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/559579339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6741013f0 0x7fc674101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.965+0000 7fc67a9b5640 1 -- 172.21.15.135:0/559579339 >> 172.21.15.135:0/559579339 conn(0x7fc6740fc850 msgr2=0x7fc6740feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.966+0000 7fc67a9b5640 1 -- 172.21.15.135:0/559579339 shutdown_connections 2024-05-20T17:47:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.966+0000 7fc67a9b5640 1 -- 172.21.15.135:0/559579339 wait complete. 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.966+0000 7fc67a9b5640 1 Processor -- start 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.966+0000 7fc67a9b5640 1 -- start start 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6741013f0 0x7fc67406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc67406f580 0x7fc6741ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc674110c70 con 0x7fc674106440 2024-05-20T17:47:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc674110af0 con 0x7fc67406f580 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc67a9b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc674110df0 con 0x7fc6741013f0 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc673fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6741013f0 0x7fc67406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36302/0 (socket says 172.21.15.135:36302) 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 -- 172.21.15.135:0/4258832453 learned_addr learned my addr 172.21.15.135:0/4258832453 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc678f52640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc67406f580 0x7fc6741ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 -- 172.21.15.135:0/4258832453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6741013f0 msgr2=0x7fc67406eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6741013f0 0x7fc67406eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 -- 172.21.15.135:0/4258832453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc67406f580 msgr2=0x7fc6741ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.967+0000 7fc6737fe640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc67406f580 0x7fc6741ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc6737fe640 1 -- 172.21.15.135:0/4258832453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6741ae6b0 con 0x7fc674106440 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc6737fe640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc668006010 tx=0x7fc668003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc6717fa640 1 -- 172.21.15.135:0/4258832453 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66803f020 con 0x7fc674106440 2024-05-20T17:47:06.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6741ae940 con 0x7fc674106440 2024-05-20T17:47:06.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6741aedb0 con 0x7fc674106440 2024-05-20T17:47:06.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc6717fa640 1 -- 172.21.15.135:0/4258832453 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc668031ca0 con 0x7fc674106440 2024-05-20T17:47:06.972 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.968+0000 7fc6717fa640 1 -- 172.21.15.135:0/4258832453 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668035070 con 0x7fc674106440 2024-05-20T17:47:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 Processor -- start 2024-05-20T17:47:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 -- start start 2024-05-20T17:47:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcb72f0 0x56514007f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514007fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56513ffe4340 con 0x56513fce01b0 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56513ff8c290 con 0x56513fcbf4d0 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.972+0000 7fc681866740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56513ffe0300 con 0x56513fcb72f0 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36318/0 (socket says 172.21.15.135:36318) 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 -- 172.21.15.135:0/1298594544 learned_addr learned my addr 172.21.15.135:0/1298594544 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc673fff640 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcb72f0 0x56514007f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc6717fa640 1 -- 172.21.15.135:0/4258832453 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc668042020 con 0x7fc674106440 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 -- 172.21.15.135:0/1298594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcb72f0 msgr2=0x56514007f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcb72f0 0x56514007f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 -- 172.21.15.135:0/1298594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 msgr2=0x56514007fb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514007fb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 -- 172.21.15.135:0/1298594544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513ffb08e0 con 0x56513fce01b0 2024-05-20T17:47:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.973+0000 7fc678f52640 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00afb0 tx=0x7fc66c00a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d960bf2357ea6ba server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.974+0000 7fc65a7fc640 1 -- 172.21.15.135:0/1298594544 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c003c30 con 0x56513fce01b0 2024-05-20T17:47:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.974+0000 7fc65a7fc640 1 -- 172.21.15.135:0/1298594544 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc66c003dd0 con 0x56513fce01b0 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.974+0000 7fc6717fa640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 0x7fc65c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.974+0000 7fc65a7fc640 1 -- 172.21.15.135:0/1298594544 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00db10 con 0x56513fce01b0 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.974+0000 7fc6717fa640 1 -- 172.21.15.135:0/4258832453 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7fc6680ef420 con 0x7fc674106440 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 -- 172.21.15.135:0/1298594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 msgr2=0x56514007f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00afb0 tx=0x7fc66c00a610 comp rx=0 tx=0).stop 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 -- 172.21.15.135:0/1298594544 shutdown_connections 2024-05-20T17:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514007fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcb72f0 0x56514007f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 --2- 172.21.15.135:0/1298594544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x56514007f090 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc681866740 1 -- 172.21.15.135:0/1298594544 >> 172.21.15.135:0/1298594544 conn(0x56513fcd4300 msgr2=0x56514007b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.975+0000 7fc673fff640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 0x7fc65c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.976+0000 7fc673fff640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 0x7fc65c0a5280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x565140080440 tx=0x7fc664005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.976+0000 7fc681866740 1 -- 172.21.15.135:0/1298594544 shutdown_connections 2024-05-20T17:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.976+0000 7fc681866740 1 -- 172.21.15.135:0/1298594544 wait complete. 2024-05-20T17:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.977+0000 7fc681866740 1 -- start start 2024-05-20T17:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.977+0000 7fc681866740 1 Processor -- start 2024-05-20T17:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.977+0000 7fc681866740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 0x56514008b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514008b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x565140089630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56514008c1c0 con 0x56513fcb72f0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56513ff9f790 con 0x56513fcbf4d0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56514008c340 con 0x56513fce01b0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc681866740 10 client.0 _ll_register_callbacks cb 0x56513ffdaa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc673fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 0x56514008b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc673fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 0x56514008b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36334/0 (socket says 172.21.15.135:36334) 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc673fff640 1 -- 172.21.15.135:0/1043145392 learned_addr learned my addr 172.21.15.135:0/1043145392 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc678f52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x565140089630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514008b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 -- 172.21.15.135:0/1043145392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 msgr2=0x565140089630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x565140089630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 -- 172.21.15.135:0/1043145392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 msgr2=0x56514008b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 0x56514008b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.978+0000 7fc6737fe640 1 -- 172.21.15.135:0/1043145392 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513fcf8210 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6737fe640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514008b780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ecb10 tx=0x7fc6680b7460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc79037ae7c687 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6537fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680bb420 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc66c003dd0 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7fc6680ecd90 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc6680bb240 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc681866740 10 client.26549 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56513fdc4620 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.979+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc66c003dd0 con 0x56513fcbf4d0 2024-05-20T17:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc6680b7f50 con 0x56513fcbf4d0 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 10 client.26549 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 10 client.26549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 20 client.26549 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc9ed80 0x56514009bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 4 client.26549 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56513fff1a70 con 0x56513fc9ed80 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.980+0000 7fc673fff640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc9ed80 0x56514009bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.981+0000 7fc6537fe640 10 client.26549 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.981+0000 7fc673fff640 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc9ed80 0x56514009bc80 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adcfe897a23a61b server_cookie=2fdbe6a2dc96c882 in_seq=0 out_seq=0 2024-05-20T17:47:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.981+0000 7fc6537fe640 1 -- 172.21.15.135:0/1043145392 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56513fff1a70 con 0x56513fc9ed80 2024-05-20T17:47:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.981+0000 7fc6537fe640 10 client.26549 handle_command_reply: tid=0 2024-05-20T17:47:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.981+0000 7fc681866740 1 client.26549 shutdown 2024-05-20T17:47:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 msgr2=0x56514008b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514008b780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ecb10 tx=0x7fc6680b7460 comp rx=0 tx=0).stop 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 shutdown_connections 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc9ed80 0x56514009bc80 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x565140089630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcbf4d0 0x56514008b780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 --2- 172.21.15.135:0/1043145392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcb72f0 0x56514008b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc6537fe640 0 client.26549 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 >> 172.21.15.135:0/1043145392 conn(0x56513fcd4300 msgr2=0x565140080db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 shutdown_connections 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 1 -- 172.21.15.135:0/1043145392 wait complete. 2024-05-20T17:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:06.982+0000 7fc681866740 20 client.26549 trim_cache size 0 max 16384 2024-05-20T17:47:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 Processor -- start 2024-05-20T17:47:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 -- start start 2024-05-20T17:47:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 0x565140089280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x5651400897c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.005+0000 7fc681866740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b8080 con 0x56513fcbf4d0 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc681866740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b5890 con 0x56513fcb72f0 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc681866740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b3700 con 0x56513fce01b0 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc673fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 0x565140089280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc673fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:43232/0 (socket says 172.21.15.135:43232) 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc673fff640 1 -- 172.21.15.135:0/944784847 learned_addr learned my addr 172.21.15.135:0/944784847 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc678f52640 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x5651400897c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 -- 172.21.15.135:0/944784847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 msgr2=0x5651400897c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x5651400897c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 -- 172.21.15.135:0/944784847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 msgr2=0x56514008b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc6737fe640 1 -- 172.21.15.135:0/944784847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514008c0a0 con 0x56513fcbf4d0 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.006+0000 7fc673fff640 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.007+0000 7fc6737fe640 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 0x565140089280 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc6680b9b90 tx=0x7fc668000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c97cdb63227a24d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.007+0000 7fc659ffb640 1 -- 172.21.15.135:0/944784847 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680b7b80 con 0x56513fcbf4d0 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.007+0000 7fc659ffb640 1 -- 172.21.15.135:0/944784847 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6680bbfe0 con 0x56513fcbf4d0 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.007+0000 7fc659ffb640 1 -- 172.21.15.135:0/944784847 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680ecd90 con 0x56513fcbf4d0 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- 172.21.15.135:0/944784847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 msgr2=0x565140089280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 0x565140089280 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc6680b9b90 tx=0x7fc668000bc0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- 172.21.15.135:0/944784847 shutdown_connections 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fce01b0 0x5651400897c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fcbf4d0 0x565140089280 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 --2- 172.21.15.135:0/944784847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- 172.21.15.135:0/944784847 >> 172.21.15.135:0/944784847 conn(0x56513fcd4300 msgr2=0x565140088b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- 172.21.15.135:0/944784847 shutdown_connections 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- 172.21.15.135:0/944784847 wait complete. 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.008+0000 7fc681866740 1 -- start start 2024-05-20T17:47:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 Processor -- start 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x565140102010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b3d50 con 0x56513fce01b0 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b51c0 con 0x56513fcb72f0 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6741b4420 con 0x56513fcbf4d0 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc681866740 10 client.0 _ll_register_callbacks cb 0x7fc668005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc673fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc6737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc673fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:43242/0 (socket says 172.21.15.135:43242) 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc6737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:39710/0 (socket says 172.21.15.135:39710) 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc678f52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x565140102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.009+0000 7fc673fff640 1 -- 172.21.15.135:0/537105630 learned_addr learned my addr 172.21.15.135:0/537105630 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 -- 172.21.15.135:0/537105630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 msgr2=0x56514008eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 -- 172.21.15.135:0/537105630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 msgr2=0x565140102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x565140102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 -- 172.21.15.135:0/537105630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565140102550 con 0x56513fcb72f0 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc6737fe640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc678f52640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x565140102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc673fff640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc6640058a0 tx=0x7fc6640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0dd4a75bd2f45c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc6537fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66400fde0 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mon.2 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8615+0+0 (secure 0 0 0) 0x7fc66402f380 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.010+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6680bbfe0 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc66402f580 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 10 client.26555 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565140103840 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mon.2 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6680bbfe0 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mon.2 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc664023430 con 0x56513fcb72f0 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 10 client.26555 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 10 client.26555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 20 client.26555 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc741c0 0x565140106040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 4 client.26555 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:47:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.011+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56513ffebdc0 con 0x56513fc741c0 2024-05-20T17:47:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.012+0000 7fc6737fe640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc741c0 0x565140106040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.012+0000 7fc6537fe640 10 client.26555 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.012+0000 7fc6737fe640 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc741c0 0x565140106040 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4566239953bee302 server_cookie=36edf52da54024f1 in_seq=0 out_seq=0 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.037+0000 7fc6537fe640 1 -- 172.21.15.135:0/537105630 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56513ffebdc0 con 0x56513fc741c0 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.037+0000 7fc6537fe640 10 client.26555 handle_command_reply: tid=0 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.037+0000 7fc681866740 1 client.26555 shutdown 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 msgr2=0x56514008e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc6640058a0 tx=0x7fc6640046c0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 shutdown_connections 2024-05-20T17:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x56513fc741c0 0x565140106040 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc6537fe640 0 client.26555 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56513fce01b0 0x565140102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56513fcbf4d0 0x56514008eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 --2- 172.21.15.135:0/537105630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56513fcb72f0 0x56514008e970 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 >> 172.21.15.135:0/537105630 conn(0x56513fcd4300 msgr2=0x56514008ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 shutdown_connections 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 1 -- 172.21.15.135:0/537105630 wait complete. 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc681866740 20 client.26555 trim_cache size 0 max 16384 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:47:07.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 msgr2=0x7fc65c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.038+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 0x7fc65c0a5280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x565140080440 tx=0x7fc664005f90 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 msgr2=0x7fc67406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc668006010 tx=0x7fc668003c10 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 shutdown_connections 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc65c0a2d70 0x7fc65c0a5280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc67406f580 0x7fc6741ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674106440 0x7fc67406f040 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 --2- 172.21.15.135:0/4258832453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6741013f0 0x7fc67406eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 >> 172.21.15.135:0/4258832453 conn(0x7fc6740fc850 msgr2=0x7fc674104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 shutdown_connections 2024-05-20T17:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:07.039+0000 7fc67a9b5640 1 -- 172.21.15.135:0/4258832453 wait complete. 2024-05-20T17:47:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:07 smithi135 ceph-mon[32027]: pgmap v429: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:47:07.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:07 smithi160 ceph-mon[36261]: pgmap v429: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:47:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:07 smithi172 ceph-mon[36511]: pgmap v429: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 187 op/s 2024-05-20T17:47:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:09 smithi135 ceph-mon[32027]: pgmap v430: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-05-20T17:47:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:09 smithi160 ceph-mon[36261]: pgmap v430: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-05-20T17:47:09.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:09 smithi172 ceph-mon[36511]: pgmap v430: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-05-20T17:47:10.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:10 smithi135 ceph-mon[32027]: osdmap e102: 12 total, 12 up, 12 in 2024-05-20T17:47:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:10 smithi160 ceph-mon[36261]: osdmap e102: 12 total, 12 up, 12 in 2024-05-20T17:47:10.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:10 smithi172 ceph-mon[36511]: osdmap e102: 12 total, 12 up, 12 in 2024-05-20T17:47:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:11 smithi135 ceph-mon[32027]: pgmap v432: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-05-20T17:47:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:11 smithi160 ceph-mon[36261]: pgmap v432: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-05-20T17:47:11.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:11 smithi172 ceph-mon[36511]: pgmap v432: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-05-20T17:47:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:13 smithi160 ceph-mon[36261]: pgmap v433: 97 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 56 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 195 op/s 2024-05-20T17:47:13.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:13 smithi172 ceph-mon[36511]: pgmap v433: 97 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 56 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 195 op/s 2024-05-20T17:47:13.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:13 smithi135 ceph-mon[32027]: pgmap v433: 97 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 56 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 195 op/s 2024-05-20T17:47:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:15 smithi160 ceph-mon[36261]: pgmap v434: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-05-20T17:47:15.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:15 smithi172 ceph-mon[36511]: pgmap v434: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-05-20T17:47:15.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:15 smithi135 ceph-mon[32027]: pgmap v434: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-05-20T17:47:17.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:17 smithi160 ceph-mon[36261]: pgmap v435: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:47:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:17 smithi172 ceph-mon[36511]: pgmap v435: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:47:17.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:17 smithi135 ceph-mon[32027]: pgmap v435: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 198 op/s 2024-05-20T17:47:19.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:19 smithi160 ceph-mon[36261]: pgmap v436: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 183 op/s 2024-05-20T17:47:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:19 smithi160 ceph-mon[36261]: osdmap e103: 12 total, 12 up, 12 in 2024-05-20T17:47:19.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:19 smithi172 ceph-mon[36511]: pgmap v436: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 183 op/s 2024-05-20T17:47:19.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:19 smithi172 ceph-mon[36511]: osdmap e103: 12 total, 12 up, 12 in 2024-05-20T17:47:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:19 smithi135 ceph-mon[32027]: pgmap v436: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 183 op/s 2024-05-20T17:47:19.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:19 smithi135 ceph-mon[32027]: osdmap e103: 12 total, 12 up, 12 in 2024-05-20T17:47:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.207+0000 7f6b4a632640 1 -- 172.21.15.135:0/766308167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 msgr2=0x7f6b44109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.207+0000 7f6b4a632640 1 --2- 172.21.15.135:0/766308167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44109b90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009ca0 tx=0x7f6b3c02cb00 comp rx=0 tx=0).stop 2024-05-20T17:47:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 -- 172.21.15.135:0/766308167 shutdown_connections 2024-05-20T17:47:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 --2- 172.21.15.135:0/766308167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410e7d0 0x7f6b44115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 --2- 172.21.15.135:0/766308167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410dd10 0x7f6b4410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 --2- 172.21.15.135:0/766308167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44109b90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 -- 172.21.15.135:0/766308167 >> 172.21.15.135:0/766308167 conn(0x7f6b4406dc30 msgr2=0x7f6b4406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 -- 172.21.15.135:0/766308167 shutdown_connections 2024-05-20T17:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.209+0000 7f6b4a632640 1 -- 172.21.15.135:0/766308167 wait complete. 2024-05-20T17:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.211+0000 7f6b4a632640 1 Processor -- start 2024-05-20T17:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.211+0000 7f6b4a632640 1 -- start start 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410dd10 0x7f6b44113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44112d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45386/0 (socket says 172.21.15.135:45386) 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 0x7f6b4411fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44118ac0 con 0x7f6b44109780 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b43fff640 1 -- 172.21.15.135:0/343392004 learned_addr learned my addr 172.21.15.135:0/343392004 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44118940 con 0x7f6b4410dd10 2024-05-20T17:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.212+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44118c40 con 0x7f6b4410e7d0 2024-05-20T17:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.214+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 0x7f6b4411fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b437fe640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410dd10 0x7f6b44113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b48bcf640 1 -- 172.21.15.135:0/343392004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410dd10 msgr2=0x7f6b44113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410dd10 0x7f6b44113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b48bcf640 1 -- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 msgr2=0x7f6b44112d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44112d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.215+0000 7f6b48bcf640 1 -- 172.21.15.135:0/343392004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b441201d0 con 0x7f6b4410e7d0 2024-05-20T17:47:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.216+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 0x7f6b4411fbe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800b3e0 tx=0x7f6b3800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.220+0000 7f6b417fa640 1 -- 172.21.15.135:0/343392004 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38015020 con 0x7f6b4410e7d0 2024-05-20T17:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.220+0000 7f6b417fa640 1 -- 172.21.15.135:0/343392004 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38011d10 con 0x7f6b4410e7d0 2024-05-20T17:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.220+0000 7f6b417fa640 1 -- 172.21.15.135:0/343392004 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800f2e0 con 0x7f6b4410e7d0 2024-05-20T17:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.220+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b441204c0 con 0x7f6b4410e7d0 2024-05-20T17:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.220+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b44120960 con 0x7f6b4410e7d0 2024-05-20T17:47:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.230+0000 7f6b417fa640 1 -- 172.21.15.135:0/343392004 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f6b38018020 con 0x7f6b4410e7d0 2024-05-20T17:47:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.231+0000 7f6b515ba740 1 Processor -- start 2024-05-20T17:47:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.232+0000 7f6b417fa640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 0x7f6b2c0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.232+0000 7f6b417fa640 1 -- 172.21.15.135:0/343392004 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f6b380ceb10 con 0x7f6b4410e7d0 2024-05-20T17:47:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.234+0000 7f6b437fe640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 0x7f6b2c0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 -- start start 2024-05-20T17:47:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ff0605340 con 0x563ff02d82f0 2024-05-20T17:47:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563ff05ad290 con 0x563ff02e04d0 2024-05-20T17:47:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.235+0000 7f6b515ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ff0601300 con 0x563ff03011b0 2024-05-20T17:47:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.236+0000 7f6b437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.236+0000 7f6b437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45396/0 (socket says 172.21.15.135:45396) 2024-05-20T17:47:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.236+0000 7f6b437fe640 1 -- 172.21.15.135:0/3435164399 learned_addr learned my addr 172.21.15.135:0/3435164399 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.236+0000 7f6b43fff640 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.237+0000 7f6b437fe640 1 -- 172.21.15.135:0/3435164399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 msgr2=0x563ff06a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 -- 172.21.15.135:0/3435164399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 msgr2=0x563ff06a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 -- 172.21.15.135:0/3435164399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff05d18e0 con 0x563ff02d82f0 2024-05-20T17:47:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6b34018640 tx=0x7f6b34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19bd45694b76e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.238+0000 7f6b437fe640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 0x7f6b2c0a5410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b34016560 tx=0x7f6b34009870 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.239+0000 7f6b2a7fc640 1 -- 172.21.15.135:0/3435164399 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340175f0 con 0x563ff02d82f0 2024-05-20T17:47:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.239+0000 7f6b2a7fc640 1 -- 172.21.15.135:0/3435164399 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b34010040 con 0x563ff02d82f0 2024-05-20T17:47:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.239+0000 7f6b2a7fc640 1 -- 172.21.15.135:0/3435164399 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34021920 con 0x563ff02d82f0 2024-05-20T17:47:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.242+0000 7f6b515ba740 1 -- 172.21.15.135:0/3435164399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 msgr2=0x563ff06a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.242+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6b34018640 tx=0x7f6b34019000 comp rx=0 tx=0).stop 2024-05-20T17:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.247+0000 7f6b515ba740 1 -- 172.21.15.135:0/3435164399 shutdown_connections 2024-05-20T17:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.247+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.247+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a05c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.247+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3435164399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.247+0000 7f6b515ba740 1 -- 172.21.15.135:0/3435164399 >> 172.21.15.135:0/3435164399 conn(0x563ff02f5300 msgr2=0x563ff069c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.251+0000 7f6b515ba740 1 -- 172.21.15.135:0/3435164399 shutdown_connections 2024-05-20T17:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.252+0000 7f6b515ba740 1 -- 172.21.15.135:0/3435164399 wait complete. 2024-05-20T17:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.252+0000 7f6b515ba740 1 -- start start 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.252+0000 7f6b515ba740 1 Processor -- start 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02d82f0 0x563ff06ac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02e04d0 0x563ff06ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ff06ad150 con 0x563ff03011b0 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563ff05c0790 con 0x563ff02d82f0 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ff06ad2d0 con 0x563ff02e04d0 2024-05-20T17:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b515ba740 10 client.0 _ll_register_callbacks cb 0x563ff05fba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45402/0 (socket says 172.21.15.135:45402) 2024-05-20T17:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.253+0000 7f6b48bcf640 1 -- 172.21.15.135:0/3027130588 learned_addr learned my addr 172.21.15.135:0/3027130588 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.254+0000 7f6b48bcf640 1 -- 172.21.15.135:0/3027130588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02e04d0 msgr2=0x563ff06ac6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.254+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02e04d0 0x563ff06ac6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.254+0000 7f6b48bcf640 1 -- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02d82f0 msgr2=0x563ff06ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.254+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02d82f0 0x563ff06ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.254+0000 7f6b48bcf640 1 -- 172.21.15.135:0/3027130588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff0319210 con 0x563ff03011b0 2024-05-20T17:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.255+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6b38097a50 tx=0x7f6b3809b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd1a2195a8fbd56 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.255+0000 7f6b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b380b4060 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b34010040 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f6b380bb070 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b3809f0d0 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b515ba740 10 client.16998 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.261+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563ff03e5620 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b34010040 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b3809a4d0 con 0x563ff03011b0 2024-05-20T17:47:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 10 client.16998 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 20 client.16998 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02bfd80 0x563ff06bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 4 client.16998 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.262+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff0612a70 con 0x563ff02bfd80 2024-05-20T17:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.263+0000 7f6b43fff640 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02bfd80 0x563ff06bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.275+0000 7f6b43fff640 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02bfd80 0x563ff06bd030 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45d5503c57e134c server_cookie=3e8ab31a0dbf189d in_seq=0 out_seq=0 2024-05-20T17:47:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.276+0000 7f6b237fe640 10 client.16998 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.279+0000 7f6b237fe640 1 -- 172.21.15.135:0/3027130588 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563ff0612a70 con 0x563ff02bfd80 2024-05-20T17:47:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.279+0000 7f6b237fe640 10 client.16998 handle_command_reply: tid=0 2024-05-20T17:47:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.280+0000 7f6b515ba740 1 client.16998 shutdown 2024-05-20T17:47:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 msgr2=0x563ff06aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6b38097a50 tx=0x7f6b3809b8c0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 shutdown_connections 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02bfd80 0x563ff06bd030 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff06aa600 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02e04d0 0x563ff06ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 --2- 172.21.15.135:0/3027130588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02d82f0 0x563ff06ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.287+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 >> 172.21.15.135:0/3027130588 conn(0x563ff02f5300 msgr2=0x563ff069feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.288+0000 7f6b237fe640 0 client.16998 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.289+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 shutdown_connections 2024-05-20T17:47:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.292+0000 7f6b515ba740 1 -- 172.21.15.135:0/3027130588 wait complete. 2024-05-20T17:47:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.295+0000 7f6b515ba740 20 client.16998 trim_cache size 0 max 16384 2024-05-20T17:47:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.323+0000 7f6b515ba740 1 Processor -- start 2024-05-20T17:47:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.323+0000 7f6b515ba740 1 -- start start 2024-05-20T17:47:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.323+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.323+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b515ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c8d10 con 0x563ff02d82f0 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b515ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c6520 con 0x563ff02e04d0 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b515ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c4370 con 0x563ff03011b0 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45416/0 (socket says 172.21.15.135:45416) 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:38816/0 (socket says 172.21.15.135:38816) 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 -- 172.21.15.135:0/2587538528 learned_addr learned my addr 172.21.15.135:0/2587538528 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b437fe640 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 -- 172.21.15.135:0/2587538528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 msgr2=0x563ff06b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 -- 172.21.15.135:0/2587538528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 msgr2=0x563ff06a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.324+0000 7f6b48bcf640 1 -- 172.21.15.135:0/2587538528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff06acda0 con 0x563ff03011b0 2024-05-20T17:47:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.325+0000 7f6b48bcf640 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800bda0 tx=0x7f6b3809af80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fea73a152f1c5a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.328+0000 7f6b29ffb640 1 -- 172.21.15.135:0/2587538528 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b380b4020 con 0x563ff03011b0 2024-05-20T17:47:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.328+0000 7f6b29ffb640 1 -- 172.21.15.135:0/2587538528 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b380bb0b0 con 0x563ff03011b0 2024-05-20T17:47:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.328+0000 7f6b29ffb640 1 -- 172.21.15.135:0/2587538528 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b380976f0 con 0x563ff03011b0 2024-05-20T17:47:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 -- 172.21.15.135:0/2587538528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 msgr2=0x563ff06b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800bda0 tx=0x7f6b3809af80 comp rx=0 tx=0).stop 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 -- 172.21.15.135:0/2587538528 shutdown_connections 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff03011b0 0x563ff06b2af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 --2- 172.21.15.135:0/2587538528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff02d82f0 0x563ff06a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.330+0000 7f6b515ba740 1 -- 172.21.15.135:0/2587538528 >> 172.21.15.135:0/2587538528 conn(0x563ff02f5300 msgr2=0x563ff069fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.334+0000 7f6b515ba740 1 -- 172.21.15.135:0/2587538528 shutdown_connections 2024-05-20T17:47:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.334+0000 7f6b515ba740 1 -- 172.21.15.135:0/2587538528 wait complete. 2024-05-20T17:47:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.335+0000 7f6b515ba740 1 -- start start 2024-05-20T17:47:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.335+0000 7f6b515ba740 1 Processor -- start 2024-05-20T17:47:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 0x563ff06b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff07233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c49e0 con 0x563ff03011b0 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c5e50 con 0x563ff02e04d0 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441c50b0 con 0x563ff02d82f0 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.336+0000 7f6b515ba740 10 client.0 _ll_register_callbacks cb 0x7f6b38010870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.337+0000 7f6b437fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.337+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff07233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.337+0000 7f6b48bcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff07233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45422/0 (socket says 172.21.15.135:45422) 2024-05-20T17:47:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.337+0000 7f6b48bcf640 1 -- 172.21.15.135:0/1782075278 learned_addr learned my addr 172.21.15.135:0/1782075278 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.337+0000 7f6b43fff640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 0x563ff06b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.340+0000 7f6b43fff640 1 -- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 msgr2=0x563ff06b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.340+0000 7f6b43fff640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.340+0000 7f6b43fff640 1 -- 172.21.15.135:0/1782075278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 msgr2=0x563ff07233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.340+0000 7f6b43fff640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff07233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.340+0000 7f6b43fff640 1 -- 172.21.15.135:0/1782075278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff0723930 con 0x563ff02d82f0 2024-05-20T17:47:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.341+0000 7f6b43fff640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 0x563ff06b1800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f80 tx=0x7f6b3c02e810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91cf1c73a16fb4fe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.341+0000 7f6b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:47:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.341+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c02ed10 con 0x563ff02d82f0 2024-05-20T17:47:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.342+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b380bb0b0 con 0x563ff02d82f0 2024-05-20T17:47:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.342+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f6b3c02f430 con 0x563ff02d82f0 2024-05-20T17:47:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.343+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b3c02eeb0 con 0x563ff02d82f0 2024-05-20T17:47:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.347+0000 7f6b515ba740 10 client.26464 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.347+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563ff0724a60 con 0x563ff02d82f0 2024-05-20T17:47:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.347+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b380bb0b0 con 0x563ff02d82f0 2024-05-20T17:47:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.348+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b3c0485d0 con 0x563ff02d82f0 2024-05-20T17:47:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 10 client.26464 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 10 client.26464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 20 client.26464 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02951c0 0x563ff0727180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 4 client.26464 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.349+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ff060cdc0 con 0x563ff02951c0 2024-05-20T17:47:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.350+0000 7f6b437fe640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02951c0 0x563ff0727180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.350+0000 7f6b437fe640 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02951c0 0x563ff0727180 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332d04bad46fc6d9 server_cookie=3bd291638b44b1ec in_seq=0 out_seq=0 2024-05-20T17:47:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.350+0000 7f6b237fe640 10 client.26464 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:20.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:47:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:47:20.137+0000 7f26a818c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-20T17:47:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.537+0000 7f6b237fe640 1 -- 172.21.15.135:0/1782075278 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ff060cdc0 con 0x563ff02951c0 2024-05-20T17:47:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.537+0000 7f6b237fe640 10 client.26464 handle_command_reply: tid=0 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.537+0000 7f6b515ba740 1 client.26464 shutdown 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.537+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 msgr2=0x563ff06b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.537+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 0x563ff06b1800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f80 tx=0x7f6b3c02e810 comp rx=0 tx=0).stop 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 shutdown_connections 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x563ff02951c0 0x563ff0727180 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ff03011b0 0x563ff07233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563ff02e04d0 0x563ff06b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 --2- 172.21.15.135:0/1782075278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff02d82f0 0x563ff06b1800 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 >> 172.21.15.135:0/1782075278 conn(0x563ff02f5300 msgr2=0x563ff06a3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b237fe640 0 client.26464 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 shutdown_connections 2024-05-20T17:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 1 -- 172.21.15.135:0/1782075278 wait complete. 2024-05-20T17:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.538+0000 7f6b515ba740 20 client.26464 trim_cache size 0 max 16384 2024-05-20T17:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:47:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 msgr2=0x7f6b2c0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 0x7f6b2c0a5410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b34016560 tx=0x7f6b34009870 comp rx=0 tx=0).stop 2024-05-20T17:47:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 msgr2=0x7f6b4411fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 0x7f6b4411fbe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800b3e0 tx=0x7f6b3800b8a0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 shutdown_connections 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f6b2c0a2f00 0x7f6b2c0a5410 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4410e7d0 0x7f6b4411fbe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b4410dd10 0x7f6b44113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 --2- 172.21.15.135:0/343392004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b44109780 0x7f6b44112d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 >> 172.21.15.135:0/343392004 conn(0x7f6b4406dc30 msgr2=0x7f6b44113f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 shutdown_connections 2024-05-20T17:47:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:20.539+0000 7f6b4a632640 1 -- 172.21.15.135:0/343392004 wait complete. 2024-05-20T17:47:21.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:21 smithi172 ceph-mon[36511]: pgmap v438: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 186 op/s 2024-05-20T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:21 smithi135 ceph-mon[32027]: pgmap v438: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 186 op/s 2024-05-20T17:47:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:21 smithi160 ceph-mon[36261]: pgmap v438: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 186 op/s 2024-05-20T17:47:23.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:23 smithi172 ceph-mon[36511]: pgmap v439: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:47:23.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:23 smithi135 ceph-mon[32027]: pgmap v439: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:47:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:23 smithi160 ceph-mon[36261]: pgmap v439: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-05-20T17:47:25.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:25 smithi172 ceph-mon[36511]: pgmap v440: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:25.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:25 smithi135 ceph-mon[32027]: pgmap v440: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:25 smithi160 ceph-mon[36261]: pgmap v440: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:27.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:27 smithi172 ceph-mon[36511]: pgmap v441: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:27.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:27 smithi135 ceph-mon[32027]: pgmap v441: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:27 smithi160 ceph-mon[36261]: pgmap v441: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-05-20T17:47:29.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:29 smithi172 ceph-mon[36511]: pgmap v442: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-05-20T17:47:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:29 smithi135 ceph-mon[32027]: pgmap v442: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-05-20T17:47:29.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:29 smithi160 ceph-mon[36261]: pgmap v442: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-05-20T17:47:31.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:31 smithi172 ceph-mon[36511]: pgmap v443: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-05-20T17:47:31.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:31 smithi135 ceph-mon[32027]: pgmap v443: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-05-20T17:47:31.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:31 smithi160 ceph-mon[36261]: pgmap v443: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-05-20T17:47:33.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:33 smithi172 ceph-mon[36511]: pgmap v444: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-05-20T17:47:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 -- 172.21.15.135:0/1912118571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 msgr2=0x7f8e1c105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1912118571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c105dc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009860 tx=0x7f8e0c02a360 comp rx=0 tx=0).stop 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 -- 172.21.15.135:0/1912118571 shutdown_connections 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1912118571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c106450 0x7f8e1c10dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1912118571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c105dc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1912118571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c101400 0x7f8e1c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 -- 172.21.15.135:0/1912118571 >> 172.21.15.135:0/1912118571 conn(0x7f8e1c076860 msgr2=0x7f8e1c076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 -- 172.21.15.135:0/1912118571 shutdown_connections 2024-05-20T17:47:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.681+0000 7f8e2228d640 1 -- 172.21.15.135:0/1912118571 wait complete. 2024-05-20T17:47:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 Processor -- start 2024-05-20T17:47:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 -- start start 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 0x7f8e1c197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c106450 0x7f8e1c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c110c90 con 0x7f8e1c105990 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c110b10 con 0x7f8e1c101400 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.682+0000 7f8e2228d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c110e10 con 0x7f8e1c106450 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52700/0 (socket says 172.21.15.135:52700) 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 -- 172.21.15.135:0/1296871762 learned_addr learned my addr 172.21.15.135:0/1296871762 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e2082a640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c106450 0x7f8e1c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.686 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 0x7f8e1c197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 -- 172.21.15.135:0/1296871762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c106450 msgr2=0x7f8e1c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c106450 0x7f8e1c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 -- 172.21.15.135:0/1296871762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 msgr2=0x7f8e1c197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 0x7f8e1c197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e13fff640 1 -- 172.21.15.135:0/1296871762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c19c4d0 con 0x7f8e1c105990 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.683+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 0x7f8e1c197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e13fff640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005940 tx=0x7f8e0c033ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e19ffb640 1 -- 172.21.15.135:0/1296871762 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c037040 con 0x7f8e1c105990 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c19c760 con 0x7f8e1c105990 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c19cca0 con 0x7f8e1c105990 2024-05-20T17:47:33.687 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e19ffb640 1 -- 172.21.15.135:0/1296871762 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0c042070 con 0x7f8e1c105990 2024-05-20T17:47:33.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.684+0000 7f8e19ffb640 1 -- 172.21.15.135:0/1296871762 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c003850 con 0x7f8e1c105990 2024-05-20T17:47:33.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.687+0000 7f8e2920c740 1 Processor -- start 2024-05-20T17:47:33.688 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.687+0000 7f8e2920c740 1 -- start start 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f97661d340 con 0x55f9762f02f0 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f9765c5290 con 0x55f9762f84d0 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2920c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f976619300 con 0x55f9763191b0 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e19ffb640 1 -- 172.21.15.135:0/1296871762 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f8e0c0039f0 con 0x7f8e1c105990 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52710/0 (socket says 172.21.15.135:52710) 2024-05-20T17:47:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 -- 172.21.15.135:0/3841231270 learned_addr learned my addr 172.21.15.135:0/3841231270 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e2082a640 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 -- 172.21.15.135:0/3841231270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 msgr2=0x55f9766b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 -- 172.21.15.135:0/3841231270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 msgr2=0x55f9766b8b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766b8b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 -- 172.21.15.135:0/3841231270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9765e98e0 con 0x55f9762f02f0 2024-05-20T17:47:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.688+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8e04017bb0 tx=0x7f8e0400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d31808d2518a589 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e127fc640 1 -- 172.21.15.135:0/3841231270 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04025070 con 0x55f9762f02f0 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e127fc640 1 -- 172.21.15.135:0/3841231270 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0400aa10 con 0x55f9762f02f0 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e127fc640 1 -- 172.21.15.135:0/3841231270 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04020ac0 con 0x55f9762f02f0 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e19ffb640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 0x7f8e080a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e19ffb640 1 -- 172.21.15.135:0/1296871762 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f8e0c0eee20 con 0x7f8e1c105990 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.689+0000 7f8e2082a640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 0x7f8e080a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 -- 172.21.15.135:0/3841231270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 msgr2=0x55f9766b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2082a640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 0x7f8e080a5280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55f9766b51f0 tx=0x7f8e1400d040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8e04017bb0 tx=0x7f8e0400c760 comp rx=0 tx=0).stop 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 -- 172.21.15.135:0/3841231270 shutdown_connections 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766b85c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 --2- 172.21.15.135:0/3841231270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.690+0000 7f8e2920c740 1 -- 172.21.15.135:0/3841231270 >> 172.21.15.135:0/3841231270 conn(0x55f97630d300 msgr2=0x55f9766b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.691+0000 7f8e2920c740 1 -- 172.21.15.135:0/3841231270 shutdown_connections 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.691+0000 7f8e2920c740 1 -- 172.21.15.135:0/3841231270 wait complete. 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.691+0000 7f8e2920c740 1 -- start start 2024-05-20T17:47:33.694 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 Processor -- start 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766c2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9766c51b0 con 0x55f9762f02f0 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55f9765d8790 con 0x55f9762f84d0 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.692+0000 7f8e2920c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9766c5330 con 0x55f9763191b0 2024-05-20T17:47:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52716/0 (socket says 172.21.15.135:52716) 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 -- 172.21.15.135:0/176798308 learned_addr learned my addr 172.21.15.135:0/176798308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e2082a640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e2920c740 10 client.0 _ll_register_callbacks cb 0x55f976613a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 -- 172.21.15.135:0/176798308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 msgr2=0x55f9766c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 -- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 msgr2=0x55f9766c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 -- 172.21.15.135:0/176798308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f976331210 con 0x55f9762f02f0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8e04005890 tx=0x7f8e04020640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e672c1735643d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.693+0000 7f8dfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-20T17:47:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04025040 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f8e0400a530 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e0400aa10 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e0400a730 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8e2920c740 10 client.17016 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f9763fd620 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.694+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0400aa10 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8e04020800 con 0x55f9762f02f0 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 10 client.17016 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 10 client.17016 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 20 client.17016 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9762d7d80 0x55f9766d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 4 client.17016 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:47:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f97662aa70 con 0x55f9762d7d80 2024-05-20T17:47:33.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.695+0000 7f8e13fff640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9762d7d80 0x55f9766d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.696+0000 7f8dfb7fe640 10 client.17016 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:33.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.696+0000 7f8e13fff640 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9762d7d80 0x55f9766d4920 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a8f568d46ba2cc5 server_cookie=bb38090acad60b69 in_seq=0 out_seq=0 2024-05-20T17:47:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.697+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/176798308 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f97662aa70 con 0x55f9762d7d80 2024-05-20T17:47:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.697+0000 7f8dfb7fe640 10 client.17016 handle_command_reply: tid=0 2024-05-20T17:47:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.697+0000 7f8e2920c740 1 client.17016 shutdown 2024-05-20T17:47:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.697+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 msgr2=0x55f9766c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.697+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8e04005890 tx=0x7f8e04020640 comp rx=0 tx=0).stop 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 shutdown_connections 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9762d7d80 0x55f9766d4920 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8dfb7fe640 0 client.17016 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9763191b0 0x55f9766c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 --2- 172.21.15.135:0/176798308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c4090 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 >> 172.21.15.135:0/176798308 conn(0x55f97630d300 msgr2=0x55f9766b9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 shutdown_connections 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.698+0000 7f8e2920c740 1 -- 172.21.15.135:0/176798308 wait complete. 2024-05-20T17:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.699+0000 7f8e2920c740 20 client.17016 trim_cache size 0 max 16384 2024-05-20T17:47:33.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:33 smithi135 ceph-mon[32027]: pgmap v444: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-05-20T17:47:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.717+0000 7f8e2920c740 1 Processor -- start 2024-05-20T17:47:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.717+0000 7f8e2920c740 1 -- start start 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762d7d80 0x55f9766c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f84d0 0x55f9766da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc011230 con 0x55f9762f84d0 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc00ea40 con 0x55f9762d7d80 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e2920c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc00c890 con 0x55f9762f02f0 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e13fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e13fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53304/0 (socket says 172.21.15.135:53304) 2024-05-20T17:47:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.718+0000 7f8e13fff640 1 -- 172.21.15.135:0/2080194573 learned_addr learned my addr 172.21.15.135:0/2080194573 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 -- 172.21.15.135:0/2080194573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762d7d80 msgr2=0x55f9766c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762d7d80 0x55f9766c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 -- 172.21.15.135:0/2080194573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f84d0 msgr2=0x55f9766da4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f84d0 0x55f9766da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 -- 172.21.15.135:0/2080194573 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9766b7a50 con 0x55f9762f02f0 2024-05-20T17:47:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0bb0f0 tx=0x7f8e0c0b7040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fd8ef1d3723098 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.719+0000 7f8e11ffb640 1 -- 172.21.15.135:0/2080194573 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0bbaf0 con 0x55f9762f02f0 2024-05-20T17:47:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.720+0000 7f8e11ffb640 1 -- 172.21.15.135:0/2080194573 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0c0bb3f0 con 0x55f9762f02f0 2024-05-20T17:47:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.720+0000 7f8e11ffb640 1 -- 172.21.15.135:0/2080194573 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b7a60 con 0x55f9762f02f0 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 -- 172.21.15.135:0/2080194573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 msgr2=0x55f9766d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0bb0f0 tx=0x7f8e0c0b7040 comp rx=0 tx=0).stop 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 -- 172.21.15.135:0/2080194573 shutdown_connections 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f84d0 0x55f9766da4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762f02f0 0x55f9766d9fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2080194573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762d7d80 0x55f9766c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.721+0000 7f8e2920c740 1 -- 172.21.15.135:0/2080194573 >> 172.21.15.135:0/2080194573 conn(0x55f97630d300 msgr2=0x55f9766c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.722+0000 7f8e2920c740 1 -- 172.21.15.135:0/2080194573 shutdown_connections 2024-05-20T17:47:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.722+0000 7f8e2920c740 1 -- 172.21.15.135:0/2080194573 wait complete. 2024-05-20T17:47:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.722+0000 7f8e2920c740 1 -- start start 2024-05-20T17:47:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.723+0000 7f8e2920c740 1 Processor -- start 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.723+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.723+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.723+0000 7f8e2920c740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e2920c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc00cf00 con 0x55f9762f02f0 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e2920c740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc00e370 con 0x55f9762f84d0 2024-05-20T17:47:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e2920c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc00d5d0 con 0x55f9762d7d80 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e2920c740 10 client.0 _ll_register_callbacks cb 0x7f8e04023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:53310/0 (socket says 172.21.15.135:53310) 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 -- 172.21.15.135:0/2632696278 learned_addr learned my addr 172.21.15.135:0/2632696278 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e2082a640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 -- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 msgr2=0x55f9766c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 -- 172.21.15.135:0/2632696278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 msgr2=0x55f9766c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 -- 172.21.15.135:0/2632696278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9766c6790 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8e1bfff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400d010 tx=0x7f8e0400ab00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eda61b9cb25f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.724+0000 7f8dfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400a530 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e0c0bb3f0 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f8e04004070 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e04004310 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8e2920c740 10 client.26482 fetch_fsmap learned FSMap version 30 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.725+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f97673c710 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e04003ad0 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8e040304b0 con 0x55f9762d7d80 2024-05-20T17:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 10 client.26482 fetch_fsmap finished waiting for FSMap version 30 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 10 client.26482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 20 client.26482 populate_metadata read hostname 'smithi135' 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9763191b0 0x55f97673eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 4 client.26482 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 --> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8e0c0bb3f0 con 0x55f9763191b0 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.726+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9763191b0 0x55f97673eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.727+0000 7f8e13fff640 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9763191b0 0x55f97673eed0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3fb09289c43b8b9 server_cookie=7fc56f6d77190975 in_seq=0 out_seq=0 2024-05-20T17:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.727+0000 7f8dfb7fe640 10 client.26482 ms_handle_connect on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:33 smithi160 ceph-mon[36261]: pgmap v444: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-05-20T17:47:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8dfb7fe640 1 -- 172.21.15.135:0/2632696278 <== mds.0 v2:172.21.15.160:6838/1255615526 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8e0c0bb3f0 con 0x55f9763191b0 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8dfb7fe640 10 client.26482 handle_command_reply: tid=0 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 client.26482 shutdown 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 msgr2=0x55f9766ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400d010 tx=0x7f8e0400ab00 comp rx=0 tx=0).stop 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 shutdown_connections 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:6838/1255615526,v1:172.21.15.160:6839/1255615526] conn(0x55f9763191b0 0x55f97673eed0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9762f84d0 0x55f9766c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8dfb7fe640 0 client.26482 ms_handle_reset on v2:172.21.15.160:6838/1255615526 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9762f02f0 0x55f9766c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 --2- 172.21.15.135:0/2632696278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9762d7d80 0x55f9766ca8e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.898+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 >> 172.21.15.135:0/2632696278 conn(0x55f97630d300 msgr2=0x55f9766ba340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 shutdown_connections 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2920c740 1 -- 172.21.15.135:0/2632696278 wait complete. 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2920c740 20 client.26482 trim_cache size 0 max 16384 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-20T17:47:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 msgr2=0x7f8e080a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 0x7f8e080a5280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55f9766b51f0 tx=0x7f8e1400d040 comp rx=0 tx=0).stop 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 msgr2=0x7f8e1c197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005940 tx=0x7f8e0c033ae0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 shutdown_connections 2024-05-20T17:47:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f8e080a2d70 0x7f8e080a5280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c106450 0x7f8e1c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e1c105990 0x7f8e1c197bd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 --2- 172.21.15.135:0/1296871762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e1c101400 0x7f8e1c197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 >> 172.21.15.135:0/1296871762 conn(0x7f8e1c076860 msgr2=0x7f8e1c0ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 shutdown_connections 2024-05-20T17:47:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-20T17:47:33.899+0000 7f8e2228d640 1 -- 172.21.15.135:0/1296871762 wait complete. 2024-05-20T17:47:35.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:35 smithi172 ceph-mon[36511]: pgmap v445: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-20T17:47:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:35 smithi135 ceph-mon[32027]: pgmap v445: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-20T17:47:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:35 smithi160 ceph-mon[36261]: pgmap v445: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-20T17:47:37.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:37 smithi172 ceph-mon[36511]: pgmap v446: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-05-20T17:47:37.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:37 smithi135 ceph-mon[32027]: pgmap v446: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-05-20T17:47:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:37 smithi160 ceph-mon[36261]: pgmap v446: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-05-20T17:47:39.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:39 smithi172 ceph-mon[36511]: pgmap v447: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-05-20T17:47:39.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:39 smithi135 ceph-mon[32027]: pgmap v447: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-05-20T17:47:39.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:39 smithi160 ceph-mon[36261]: pgmap v447: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-05-20T17:47:41.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:41 smithi172 ceph-mon[36511]: pgmap v448: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 118 op/s 2024-05-20T17:47:41.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:41 smithi135 ceph-mon[32027]: pgmap v448: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 118 op/s 2024-05-20T17:47:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:41 smithi160 ceph-mon[36261]: pgmap v448: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 118 op/s 2024-05-20T17:47:42.696 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-05-20T17:47:42.697 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-20T17:47:43.105 DEBUG:teuthology.parallel:result is None 2024-05-20T17:47:43.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T17:47:43.156 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T17:47:43.156 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-20T17:47:43.169 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:47:43.180 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-20T17:47:43.195 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-20T17:47:43.195 INFO:teuthology.task.exec:Executing custom commands... 2024-05-20T17:47:43.195 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:47:43.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-20T17:47:43.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-20T17:47:43.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-20T17:47:43.403 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:43 smithi135 ceph-mon[32027]: pgmap v449: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1008 KiB/s wr, 127 op/s 2024-05-20T17:47:43.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 -- 172.21.15.135:0/279800986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 msgr2=0x7fad50105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 --2- 172.21.15.135:0/279800986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50105dc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fad4000aa10 tx=0x7fad4002b720 comp rx=0 tx=0).stop 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 -- 172.21.15.135:0/279800986 shutdown_connections 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 --2- 172.21.15.135:0/279800986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5010dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 --2- 172.21.15.135:0/279800986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50105dc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 --2- 172.21.15.135:0/279800986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 0x7fad50101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 -- 172.21.15.135:0/279800986 >> 172.21.15.135:0/279800986 conn(0x7fad50076860 msgr2=0x7fad50076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 -- 172.21.15.135:0/279800986 shutdown_connections 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.541+0000 7fad57e34640 1 -- 172.21.15.135:0/279800986 wait complete. 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.542+0000 7fad57e34640 1 Processor -- start 2024-05-20T17:47:43.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.542+0000 7fad57e34640 1 -- start start 2024-05-20T17:47:43.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 0x7fad50197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:43.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad50110c80 con 0x7fad50105990 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad50110b00 con 0x7fad50106450 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad57e34640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad50110e00 con 0x7fad50101400 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad563d1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad553cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad563d1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:52900/0 (socket says 172.21.15.135:52900) 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad563d1640 1 -- 172.21.15.135:0/1381661026 learned_addr learned my addr 172.21.15.135:0/1381661026 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.543+0000 7fad55bd0640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 0x7fad50197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 -- 172.21.15.135:0/1381661026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 msgr2=0x7fad50197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 0x7fad50197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 -- 172.21.15.135:0/1381661026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 msgr2=0x7fad5019be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5019be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 -- 172.21.15.135:0/1381661026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5019c480 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad553cf640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50197b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fad4000a960 tx=0x7fad40030c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4003f070 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5019c710 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad40003cd0 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5019cc20 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.544+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40036030 con 0x7fad50105990 2024-05-20T17:47:43.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.546+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5004f720 con 0x7fad50105990 2024-05-20T17:47:43.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.547+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fad40042070 con 0x7fad50105990 2024-05-20T17:47:43.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.549+0000 7fad46ffd640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 0x7fad3c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:43.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.549+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7fad400efb10 con 0x7fad50105990 2024-05-20T17:47:43.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.549+0000 7fad55bd0640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 0x7fad3c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:43.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.549+0000 7fad55bd0640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 0x7fad3c0a5350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009bd0 tx=0x7fad4c005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:43.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.553+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fad400bc020 con 0x7fad50105990 2024-05-20T17:47:43.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:43 smithi172 ceph-mon[36511]: pgmap v449: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1008 KiB/s wr, 127 op/s 2024-05-20T17:47:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:43 smithi160 ceph-mon[36261]: pgmap v449: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1008 KiB/s wr, 127 op/s 2024-05-20T17:47:43.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.898+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fad500fffd0 con 0x7fad3c0a2e40 2024-05-20T17:47:43.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.925+0000 7fad46ffd640 1 -- 172.21.15.135:0/1381661026 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fad500fffd0 con 0x7fad3c0a2e40 2024-05-20T17:47:43.927 INFO:teuthology.orchestra.run.smithi135.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-20T00:00:00", "created": "2024-05-20T17:33:25", "first": "2024-05-20T17:34:00", "last": "2024-05-20T17:47:00", "last_pruned": "2024-05-20T17:47:00", "created_count": 14, "pruned_count": 8, "active": true} 2024-05-20T17:47:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.928+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 msgr2=0x7fad3c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.928+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 0x7fad3c0a5350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009bd0 tx=0x7fad4c005f90 comp rx=0 tx=0).stop 2024-05-20T17:47:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.928+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 msgr2=0x7fad50197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.928+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50197b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fad4000a960 tx=0x7fad40030c60 comp rx=0 tx=0).stop 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 shutdown_connections 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fad3c0a2e40 0x7fad3c0a5350 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad50106450 0x7fad5019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad50105990 0x7fad50197b80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 --2- 172.21.15.135:0/1381661026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad50101400 0x7fad50197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 >> 172.21.15.135:0/1381661026 conn(0x7fad50076860 msgr2=0x7fad500ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 shutdown_connections 2024-05-20T17:47:43.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:43.929+0000 7fad57e34640 1 -- 172.21.15.135:0/1381661026 wait complete. 2024-05-20T17:47:43.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-20T17:47:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.160+0000 7fc157fff640 1 -- 172.21.15.135:0/2389312267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1500a0280 msgr2=0x7fc1500a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.160+0000 7fc157fff640 1 --2- 172.21.15.135:0/2389312267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1500a0280 0x7fc1500a26a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc14801a910 tx=0x7fc14803b450 comp rx=0 tx=0).stop 2024-05-20T17:47:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.164+0000 7fc157fff640 1 -- 172.21.15.135:0/2389312267 shutdown_connections 2024-05-20T17:47:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.164+0000 7fc157fff640 1 --2- 172.21.15.135:0/2389312267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1500a0280 0x7fc1500a26a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.164+0000 7fc157fff640 1 --2- 172.21.15.135:0/2389312267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc150095e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.164+0000 7fc157fff640 1 --2- 172.21.15.135:0/2389312267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc15009b920 0x7fc150095500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.164+0000 7fc157fff640 1 -- 172.21.15.135:0/2389312267 >> 172.21.15.135:0/2389312267 conn(0x7fc15000afe0 msgr2=0x7fc15000b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:44.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.167+0000 7fc157fff640 1 -- 172.21.15.135:0/2389312267 shutdown_connections 2024-05-20T17:47:44.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.167+0000 7fc157fff640 1 -- 172.21.15.135:0/2389312267 wait complete. 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.168+0000 7fc157fff640 1 Processor -- start 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.168+0000 7fc157fff640 1 -- start start 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc15009b920 0x7fc15012b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1500a0280 0x7fc15012bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1500a4c60 con 0x7fc150095a40 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1500a4ae0 con 0x7fc1500a0280 2024-05-20T17:47:44.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.169+0000 7fc157fff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1500a4de0 con 0x7fc15009b920 2024-05-20T17:47:44.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39280/0 (socket says 172.21.15.135:39280) 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 -- 172.21.15.135:0/2714025045 learned_addr learned my addr 172.21.15.135:0/2714025045 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc1567fc640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc15009b920 0x7fc15012b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 -- 172.21.15.135:0/2714025045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc15009b920 msgr2=0x7fc15012b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc15009b920 0x7fc15012b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 -- 172.21.15.135:0/2714025045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1500a0280 msgr2=0x7fc15012bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1500a0280 0x7fc15012bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.170+0000 7fc156ffd640 1 -- 172.21.15.135:0/2714025045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15012f6c0 con 0x7fc150095a40 2024-05-20T17:47:44.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.171+0000 7fc156ffd640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc158065400 tx=0x7fc158070820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:44.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.172+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158075590 con 0x7fc150095a40 2024-05-20T17:47:44.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.172+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc158075c10 con 0x7fc150095a40 2024-05-20T17:47:44.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.172+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158076c90 con 0x7fc150095a40 2024-05-20T17:47:44.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.173+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15012f9b0 con 0x7fc150095a40 2024-05-20T17:47:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.173+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15012fe80 con 0x7fc150095a40 2024-05-20T17:47:44.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.174+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150096bd0 con 0x7fc150095a40 2024-05-20T17:47:44.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.177+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fc15807d030 con 0x7fc150095a40 2024-05-20T17:47:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.177+0000 7fc13ffff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 0x7fc1400a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.178+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7fc158132610 con 0x7fc150095a40 2024-05-20T17:47:44.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.178+0000 7fc1567fc640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 0x7fc1400a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.185+0000 7fc1567fc640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 0x7fc1400a5340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1500a18f0 tx=0x7fc14c008040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:44.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.185+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc158084060 con 0x7fc150095a40 2024-05-20T17:47:44.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.537+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 --> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc1500028f0 con 0x7fc1400a2e30 2024-05-20T17:47:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.569+0000 7fc13ffff640 1 -- 172.21.15.135:0/2714025045 <== mgr.15306 v2:172.21.15.135:6800/4225131677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc1500028f0 con 0x7fc1400a2e30 2024-05-20T17:47:44.571 INFO:teuthology.orchestra.run.smithi135.stdout:/ 1m 6m3h 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 msgr2=0x7fc1400a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 0x7fc1400a5340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1500a18f0 tx=0x7fc14c008040 comp rx=0 tx=0).stop 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 msgr2=0x7fc15012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc158065400 tx=0x7fc158070820 comp rx=0 tx=0).stop 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 shutdown_connections 2024-05-20T17:47:44.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fc1400a2e30 0x7fc1400a5340 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1500a18f0 tx=0x7fc14c008040 comp rx=0 tx=0).stop 2024-05-20T17:47:44.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1500a0280 0x7fc15012bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc15009b920 0x7fc15012b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 --2- 172.21.15.135:0/2714025045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150095a40 0x7fc15012b360 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.573+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 >> 172.21.15.135:0/2714025045 conn(0x7fc15000afe0 msgr2=0x7fc15009c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:44.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.574+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 shutdown_connections 2024-05-20T17:47:44.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.575+0000 7fc157fff640 1 -- 172.21.15.135:0/2714025045 wait complete. 2024-05-20T17:47:44.594 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-20T17:47:44.604 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-20T17:47:44.604 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-20T17:47:44.605 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-20T17:47:44.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:47:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.791+0000 7fa551d6c640 1 -- 172.21.15.135:0/2507761141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 msgr2=0x7fa54c109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.791+0000 7fa551d6c640 1 --2- 172.21.15.135:0/2507761141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c109520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa544009be0 tx=0x7fa54402a6f0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.792+0000 7fa551d6c640 1 -- 172.21.15.135:0/2507761141 shutdown_connections 2024-05-20T17:47:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.792+0000 7fa551d6c640 1 --2- 172.21.15.135:0/2507761141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c109520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.792+0000 7fa551d6c640 1 --2- 172.21.15.135:0/2507761141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa54c10f270 0x7fa54c108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.792+0000 7fa551d6c640 1 --2- 172.21.15.135:0/2507761141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10e890 0x7fa54c10eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.792+0000 7fa551d6c640 1 -- 172.21.15.135:0/2507761141 >> 172.21.15.135:0/2507761141 conn(0x7fa54c06d580 msgr2=0x7fa54c06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:44.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.797+0000 7fa551d6c640 1 -- 172.21.15.135:0/2507761141 shutdown_connections 2024-05-20T17:47:44.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.797+0000 7fa551d6c640 1 -- 172.21.15.135:0/2507761141 wait complete. 2024-05-20T17:47:44.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 Processor -- start 2024-05-20T17:47:44.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 -- start start 2024-05-20T17:47:44.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa54c10e890 0x7fa54c1a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10f270 0x7fa54c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c113200 con 0x7fa54c10f270 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c113080 con 0x7fa54c109090 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.798+0000 7fa551d6c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c113380 con 0x7fa54c10e890 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:52928/0 (socket says 172.21.15.135:52928) 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 -- 172.21.15.135:0/858686841 learned_addr learned my addr 172.21.15.135:0/858686841 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa55156b640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10f270 0x7fa54c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 -- 172.21.15.135:0/858686841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa54c10e890 msgr2=0x7fa54c1a5cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa54c10e890 0x7fa54c1a5cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 -- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10f270 msgr2=0x7fa54c19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10f270 0x7fa54c19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:44.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.799+0000 7fa550d6a640 1 -- 172.21.15.135:0/858686841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c1a0030 con 0x7fa54c109090 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.800+0000 7fa550d6a640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa54000d950 tx=0x7fa54000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.800+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540017070 con 0x7fa54c109090 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.800+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c1a0320 con 0x7fa54c109090 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.801+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54c1ac600 con 0x7fa54c109090 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.802+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa540009c30 con 0x7fa54c109090 2024-05-20T17:47:44.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.802+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540017070 con 0x7fa54c109090 2024-05-20T17:47:44.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.802+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54c068b90 con 0x7fa54c109090 2024-05-20T17:47:44.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.805+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fa540004030 con 0x7fa54c109090 2024-05-20T17:47:44.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.805+0000 7fa549ffb640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 0x7fa53c0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:44.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.806+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7fa5400ced00 con 0x7fa54c109090 2024-05-20T17:47:44.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.806+0000 7fa54bfff640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 0x7fa53c0a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:44.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.807+0000 7fa54bfff640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 0x7fa53c0a54c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa54c10ce20 tx=0x7fa53801a270 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:44.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:44.812+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa54009b8c0 con 0x7fa54c109090 2024-05-20T17:47:45.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.135+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa54c1ac890 con 0x7fa54c109090 2024-05-20T17:47:45.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.138+0000 7fa549ffb640 1 -- 172.21.15.135:0/858686841 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+23358 (secure 0 0 0) 0x7fa54009b1c0 con 0x7fa54c109090 2024-05-20T17:47:45.140 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:47:45.140 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":103,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:47:18.246505+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2340719003":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2366951991":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6801/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6800/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3892403253":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3665782068":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":21,"length":1},{"begin":23,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 msgr2=0x7fa53c0a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 0x7fa53c0a54c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa54c10ce20 tx=0x7fa53801a270 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 msgr2=0x7fa54c1a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa54000d950 tx=0x7fa54000de10 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 shutdown_connections 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.141+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fa53c0a2fb0 0x7fa53c0a54c0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa54c10ce20 tx=0x7fa53801a270 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa54c10f270 0x7fa54c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa54c10e890 0x7fa54c1a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 --2- 172.21.15.135:0/858686841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa54c109090 0x7fa54c1a5780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 >> 172.21.15.135:0/858686841 conn(0x7fa54c06d580 msgr2=0x7fa54c0728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:45.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 shutdown_connections 2024-05-20T17:47:45.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.142+0000 7fa551d6c640 1 -- 172.21.15.135:0/858686841 wait complete. 2024-05-20T17:47:45.162 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:47:45.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:47:45.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.339+0000 7f9942710640 1 -- 172.21.15.135:0/2361113880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c106250 msgr2=0x7f993c106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.339+0000 7f9942710640 1 --2- 172.21.15.135:0/2361113880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c106250 0x7f993c106660 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9934009ca0 tx=0x7f993402a940 comp rx=0 tx=0).stop 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.343+0000 7f9942710640 1 -- 172.21.15.135:0/2361113880 shutdown_connections 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.343+0000 7f9942710640 1 --2- 172.21.15.135:0/2361113880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c106250 0x7f993c106660 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.343+0000 7f9942710640 1 --2- 172.21.15.135:0/2361113880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993c107dc0 0x7f993c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.343+0000 7f9942710640 1 --2- 172.21.15.135:0/2361113880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c1079b0 0x7f993c100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.343+0000 7f9942710640 1 -- 172.21.15.135:0/2361113880 >> 172.21.15.135:0/2361113880 conn(0x7f993c076830 msgr2=0x7f993c076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:45.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.345+0000 7f9942710640 1 -- 172.21.15.135:0/2361113880 shutdown_connections 2024-05-20T17:47:45.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.345+0000 7f9942710640 1 -- 172.21.15.135:0/2361113880 wait complete. 2024-05-20T17:47:45.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.346+0000 7f9942710640 1 Processor -- start 2024-05-20T17:47:45.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.346+0000 7f9942710640 1 -- start start 2024-05-20T17:47:45.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993c106250 0x7f993c10cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 0x7f993c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 0x7f993c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f993c1193e0 con 0x7f993c1079b0 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f993c119260 con 0x7f993c107dc0 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.347+0000 7f9942710640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f993c119560 con 0x7f993c106250 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.348+0000 7f9940cad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 0x7f993c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.348+0000 7f9940cad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 0x7f993c072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:52946/0 (socket says 172.21.15.135:52946) 2024-05-20T17:47:45.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.348+0000 7f9940cad640 1 -- 172.21.15.135:0/1604874163 learned_addr learned my addr 172.21.15.135:0/1604874163 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:45.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.348+0000 7f993b7fe640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 0x7f993c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:45.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.349+0000 7f993b7fe640 1 -- 172.21.15.135:0/1604874163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993c106250 msgr2=0x7f993c10cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.349+0000 7f993b7fe640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993c106250 0x7f993c10cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.349+0000 7f993b7fe640 1 -- 172.21.15.135:0/1604874163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 msgr2=0x7f993c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.349+0000 7f993b7fe640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 0x7f993c072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.349+0000 7f993b7fe640 1 -- 172.21.15.135:0/1604874163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c073030 con 0x7f993c1079b0 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.350+0000 7f993b7fe640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 0x7f993c10d0d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f992c00d6a0 tx=0x7f992c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.350+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c017070 con 0x7f993c1079b0 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.350+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f992c009820 con 0x7f993c1079b0 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.350+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c004ca0 con 0x7f993c1079b0 2024-05-20T17:47:45.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.351+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993c0732c0 con 0x7f993c1079b0 2024-05-20T17:47:45.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.351+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993c1139c0 con 0x7f993c1079b0 2024-05-20T17:47:45.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.352+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993c101ce0 con 0x7f993c1079b0 2024-05-20T17:47:45.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.356+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f992c0099d0 con 0x7f993c1079b0 2024-05-20T17:47:45.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.357+0000 7f99397fa640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 0x7f99240a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.357+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f992c0cec80 con 0x7f993c1079b0 2024-05-20T17:47:45.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.358+0000 7f993bfff640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 0x7f99240a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:45.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.360+0000 7f993bfff640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 0x7f99240a5390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f993000b410 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:45.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.366+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f992c004e40 con 0x7f993c1079b0 2024-05-20T17:47:45.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:45 smithi135 ceph-mon[32027]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:45 smithi135 ceph-mon[32027]: pgmap v450: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-05-20T17:47:45.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:45 smithi135 ceph-mon[32027]: from='client.17028 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/858686841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:47:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:45 smithi172 ceph-mon[36511]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:45 smithi172 ceph-mon[36511]: pgmap v450: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-05-20T17:47:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:45 smithi172 ceph-mon[36511]: from='client.17028 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/858686841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:47:45.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.701+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f993c1082e0 con 0x7f993c1079b0 2024-05-20T17:47:45.704 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:47:45.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.702+0000 7f99397fa640 1 -- 172.21.15.135:0/1604874163 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7f992c004e40 con 0x7f993c1079b0 2024-05-20T17:47:45.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 msgr2=0x7f99240a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 0x7f99240a5390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f993000b410 comp rx=0 tx=0).stop 2024-05-20T17:47:45.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 msgr2=0x7f993c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 0x7f993c10d0d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f992c00d6a0 tx=0x7f992c00db60 comp rx=0 tx=0).stop 2024-05-20T17:47:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 shutdown_connections 2024-05-20T17:47:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f99240a2e80 0x7f99240a5390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f993c107dc0 0x7f993c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f993c1079b0 0x7f993c10d0d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 --2- 172.21.15.135:0/1604874163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993c106250 0x7f993c10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.706+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 >> 172.21.15.135:0/1604874163 conn(0x7f993c076830 msgr2=0x7f993c104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.709+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 shutdown_connections 2024-05-20T17:47:45.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.709+0000 7f9942710640 1 -- 172.21.15.135:0/1604874163 wait complete. 2024-05-20T17:47:45.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:47:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:45 smithi160 ceph-mon[36261]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:45 smithi160 ceph-mon[36261]: pgmap v450: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-05-20T17:47:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:45 smithi160 ceph-mon[36261]: from='client.17028 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:47:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/858686841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:47:45.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.915+0000 7efc707d5640 1 -- 172.21.15.135:0/2570544746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 msgr2=0x7efc68109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:45.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.915+0000 7efc707d5640 1 --2- 172.21.15.135:0/2570544746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc68109b60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efc60005fd0 tx=0x7efc6002b370 comp rx=0 tx=0).stop 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.918+0000 7efc707d5640 1 -- 172.21.15.135:0/2570544746 shutdown_connections 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.918+0000 7efc707d5640 1 --2- 172.21.15.135:0/2570544746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6810e7a0 0x7efc68115f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.918+0000 7efc707d5640 1 --2- 172.21.15.135:0/2570544746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc6810dce0 0x7efc6810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.918+0000 7efc707d5640 1 --2- 172.21.15.135:0/2570544746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc68109b60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.918+0000 7efc707d5640 1 -- 172.21.15.135:0/2570544746 >> 172.21.15.135:0/2570544746 conn(0x7efc6806dc00 msgr2=0x7efc6806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:45.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.921+0000 7efc707d5640 1 -- 172.21.15.135:0/2570544746 shutdown_connections 2024-05-20T17:47:45.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.924+0000 7efc707d5640 1 -- 172.21.15.135:0/2570544746 wait complete. 2024-05-20T17:47:45.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.924+0000 7efc707d5640 1 Processor -- start 2024-05-20T17:47:45.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.925+0000 7efc707d5640 1 -- start start 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6810dce0 0x7efc6819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc6810e7a0 0x7efc681a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc681193a0 con 0x7efc68109750 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efc68119220 con 0x7efc6810e7a0 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc707d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc68119520 con 0x7efc6810dce0 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39340/0 (socket says 172.21.15.135:39340) 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 -- 172.21.15.135:0/3616362500 learned_addr learned my addr 172.21.15.135:0/3616362500 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 -- 172.21.15.135:0/3616362500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6810dce0 msgr2=0x7efc6819fb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6810dce0 0x7efc6819fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 -- 172.21.15.135:0/3616362500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc6810e7a0 msgr2=0x7efc681a0160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.926+0000 7efc6e571640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc6810e7a0 0x7efc681a0160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc6e571640 1 -- 172.21.15.135:0/3616362500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc681a0950 con 0x7efc68109750 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc6e571640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc600076a0 tx=0x7efc6000a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600336b0 con 0x7efc68109750 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc60042070 con 0x7efc68109750 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600044d0 con 0x7efc68109750 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc681b4a10 con 0x7efc68109750 2024-05-20T17:47:45.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.927+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc681b4e80 con 0x7efc68109750 2024-05-20T17:47:45.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.929+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c005290 con 0x7efc68109750 2024-05-20T17:47:45.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.932+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7efc60004670 con 0x7efc68109750 2024-05-20T17:47:45.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.933+0000 7efc5f7fe640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 0x7efc540a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:45.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.934+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7efc600ba000 con 0x7efc68109750 2024-05-20T17:47:45.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.935+0000 7efc6dd70640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 0x7efc540a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:45.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.936+0000 7efc6dd70640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 0x7efc540a52d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc681a1c70 tx=0x7efc6400b370 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:45.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:45.947+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efc600bc660 con 0x7efc68109750 2024-05-20T17:47:46.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.293+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efc4c005850 con 0x7efc68109750 2024-05-20T17:47:46.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.294+0000 7efc5f7fe640 1 -- 172.21.15.135:0/3616362500 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7efc600bbf60 con 0x7efc68109750 2024-05-20T17:47:46.296 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:47:46.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 msgr2=0x7efc540a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 0x7efc540a52d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc681a1c70 tx=0x7efc6400b370 comp rx=0 tx=0).stop 2024-05-20T17:47:46.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 msgr2=0x7efc681a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc600076a0 tx=0x7efc6000a440 comp rx=0 tx=0).stop 2024-05-20T17:47:46.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 shutdown_connections 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7efc540a2dc0 0x7efc540a52d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc6810e7a0 0x7efc681a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6810dce0 0x7efc6819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 --2- 172.21.15.135:0/3616362500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc68109750 0x7efc681a1710 secure :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc600076a0 tx=0x7efc6000a440 comp rx=0 tx=0).stop 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 >> 172.21.15.135:0/3616362500 conn(0x7efc6806dc00 msgr2=0x7efc6810cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 shutdown_connections 2024-05-20T17:47:46.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.300+0000 7efc707d5640 1 -- 172.21.15.135:0/3616362500 wait complete. 2024-05-20T17:47:46.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:47:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.506+0000 7f82a221b640 1 -- 172.21.15.135:0/2642247029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1063e0 msgr2=0x7f829c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.506+0000 7f82a221b640 1 --2- 172.21.15.135:0/2642247029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1063e0 0x7f829c1067f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f828c009900 tx=0x7f828c02a420 comp rx=0 tx=0).stop 2024-05-20T17:47:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.507+0000 7f82a221b640 1 -- 172.21.15.135:0/2642247029 shutdown_connections 2024-05-20T17:47:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.507+0000 7f82a221b640 1 --2- 172.21.15.135:0/2642247029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c106e10 0x7f829c1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.507+0000 7f82a221b640 1 --2- 172.21.15.135:0/2642247029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1063e0 0x7f829c1067f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.507+0000 7f82a221b640 1 --2- 172.21.15.135:0/2642247029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.507+0000 7f82a221b640 1 -- 172.21.15.135:0/2642247029 >> 172.21.15.135:0/2642247029 conn(0x7f829c0770b0 msgr2=0x7f829c0774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:46.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.509+0000 7f82a221b640 1 -- 172.21.15.135:0/2642247029 shutdown_connections 2024-05-20T17:47:46.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.510+0000 7f82a221b640 1 -- 172.21.15.135:0/2642247029 wait complete. 2024-05-20T17:47:46.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.511+0000 7f82a221b640 1 Processor -- start 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 -- start start 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c10c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c106e10 0x7f829c1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f829c06bfc0 con 0x7f829c1063e0 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f829c06be40 con 0x7f829c101990 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.516+0000 7f82a221b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f829c06c140 con 0x7f829c106e10 2024-05-20T17:47:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.518+0000 7f829affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:46.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.519+0000 7f829affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39360/0 (socket says 172.21.15.135:39360) 2024-05-20T17:47:46.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.519+0000 7f829affd640 1 -- 172.21.15.135:0/605670590 learned_addr learned my addr 172.21.15.135:0/605670590 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:46.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.519+0000 7f829b7fe640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c10c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:46.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.519+0000 7f829bfff640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c106e10 0x7f829c1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:46.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.520+0000 7f829b7fe640 1 -- 172.21.15.135:0/605670590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c106e10 msgr2=0x7f829c1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.520+0000 7f829b7fe640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c106e10 0x7f829c1079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.520+0000 7f829b7fe640 1 -- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 msgr2=0x7f829c10cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.520+0000 7f829b7fe640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.520+0000 7f829b7fe640 1 -- 172.21.15.135:0/605670590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c1081b0 con 0x7f829c101990 2024-05-20T17:47:46.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.522+0000 7f829affd640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:47:46.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.522+0000 7f829b7fe640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c10c5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f828400bd50 tx=0x7f828400be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:46.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.527+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284019070 con 0x7f829c101990 2024-05-20T17:47:46.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.527+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8284014920 con 0x7f829c101990 2024-05-20T17:47:46.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.527+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840129e0 con 0x7f829c101990 2024-05-20T17:47:46.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.527+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c1084a0 con 0x7f829c101990 2024-05-20T17:47:46.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.527+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c114300 con 0x7f829c101990 2024-05-20T17:47:46.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.531+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f828401c070 con 0x7f829c101990 2024-05-20T17:47:46.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.532+0000 7f8298ff9640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 0x7f827c0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:46.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.532+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f82840ceb90 con 0x7f829c101990 2024-05-20T17:47:46.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.532+0000 7f82927fc640 1 -- 172.21.15.135:0/605670590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8280005290 con 0x7f829c101990 2024-05-20T17:47:46.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.533+0000 7f829affd640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 0x7f827c0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.534+0000 7f829affd640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 0x7f827c0a5410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f829c100110 tx=0x7f828c02a920 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:46.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.538+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f828409b1b0 con 0x7f829c101990 2024-05-20T17:47:46.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:46 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1604874163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:46 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3616362500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:46 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1604874163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:46 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3616362500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:46 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1604874163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:46 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3616362500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:47:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.869+0000 7f82927fc640 1 -- 172.21.15.135:0/605670590 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8280005850 con 0x7f829c101990 2024-05-20T17:47:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.870+0000 7f8298ff9640 1 -- 172.21.15.135:0/605670590 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f828409f4b0 con 0x7f829c101990 2024-05-20T17:47:46.871 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:47:46.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.873+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 msgr2=0x7f827c0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.873+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 0x7f827c0a5410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f829c100110 tx=0x7f828c02a920 comp rx=0 tx=0).stop 2024-05-20T17:47:46.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.873+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 msgr2=0x7f829c10c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:46.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.873+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c10c5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f828400bd50 tx=0x7f828400be40 comp rx=0 tx=0).stop 2024-05-20T17:47:46.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 shutdown_connections 2024-05-20T17:47:46.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f827c0a2f00 0x7f827c0a5410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c106e10 0x7f829c1079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829c1063e0 0x7f829c10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 --2- 172.21.15.135:0/605670590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f829c101990 0x7f829c10c5e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 >> 172.21.15.135:0/605670590 conn(0x7f829c0770b0 msgr2=0x7f829c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 shutdown_connections 2024-05-20T17:47:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:46.875+0000 7f82a221b640 1 -- 172.21.15.135:0/605670590 wait complete. 2024-05-20T17:47:46.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-20T17:47:47.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.081+0000 7f0668fd7640 1 -- 172.21.15.135:0/344785835 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06540319b0 con 0x7f0664107d90 2024-05-20T17:47:47.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.082+0000 7f066c23d640 1 -- 172.21.15.135:0/344785835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 msgr2=0x7f0664101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:47.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.082+0000 7f066c23d640 1 --2- 172.21.15.135:0/344785835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f0664101010 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0654009900 tx=0x7f065402a4d0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.085+0000 7f066c23d640 1 -- 172.21.15.135:0/344785835 shutdown_connections 2024-05-20T17:47:47.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.085+0000 7f066c23d640 1 --2- 172.21.15.135:0/344785835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.085+0000 7f066c23d640 1 --2- 172.21.15.135:0/344785835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f0664101010 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.085+0000 7f066c23d640 1 --2- 172.21.15.135:0/344785835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0664107980 0x7f0664100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.085+0000 7f066c23d640 1 -- 172.21.15.135:0/344785835 >> 172.21.15.135:0/344785835 conn(0x7f06640fc7c0 msgr2=0x7f06640fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.088+0000 7f066c23d640 1 -- 172.21.15.135:0/344785835 shutdown_connections 2024-05-20T17:47:47.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.091+0000 7f066c23d640 1 -- 172.21.15.135:0/344785835 wait complete. 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 Processor -- start 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 -- start start 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664116420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0664107980 0x7f066410f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f066410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0664119510 con 0x7f0664107d90 2024-05-20T17:47:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0664119390 con 0x7f0664107980 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.095+0000 7f066c23d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0664119690 con 0x7f0664106220 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.096+0000 7f0669fd9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664116420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.096+0000 7f0669fd9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664116420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:33502/0 (socket says 172.21.15.135:33502) 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.096+0000 7f0669fd9640 1 -- 172.21.15.135:0/2931280940 learned_addr learned my addr 172.21.15.135:0/2931280940 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.096+0000 7f066a7da640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f066410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 -- 172.21.15.135:0/2931280940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 msgr2=0x7f0664116420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664116420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 -- 172.21.15.135:0/2931280940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0664107980 msgr2=0x7f066410f590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0664107980 0x7f066410f590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 -- 172.21.15.135:0/2931280940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664113f40 con 0x7f0664107d90 2024-05-20T17:47:47.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.097+0000 7f066a7da640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f066410fc10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f066000b3e0 tx=0x7f066000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:47.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.099+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660015020 con 0x7f0664107d90 2024-05-20T17:47:47.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.099+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0660011d10 con 0x7f0664107d90 2024-05-20T17:47:47.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.099+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000f2e0 con 0x7f0664107d90 2024-05-20T17:47:47.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.099+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0664114230 con 0x7f0664107d90 2024-05-20T17:47:47.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.099+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0664114730 con 0x7f0664107d90 2024-05-20T17:47:47.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.104+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0648005290 con 0x7f0664107d90 2024-05-20T17:47:47.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.108+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0660018020 con 0x7f0664107d90 2024-05-20T17:47:47.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.108+0000 7f065affd640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 0x7f06500a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:47:47.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.109+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8615+0+0 (secure 0 0 0) 0x7f06600cea90 con 0x7f0664107d90 2024-05-20T17:47:47.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.110+0000 7f0669fd9640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 0x7f06500a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:47:47.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.118+0000 7f0669fd9640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 0x7f06500a5410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0664110d90 tx=0x7f065c00b040 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:47:47.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.119+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f066001f020 con 0x7f0664107d90 2024-05-20T17:47:47.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.555+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f0648005850 con 0x7f0664107d90 2024-05-20T17:47:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.571+0000 7f065affd640 1 -- 172.21.15.135:0/2931280940 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740911 (secure 0 0 0) 0x7f066009b700 con 0x7f0664107d90 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "epoch": 25, 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "active_gid": 15306, 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "active_name": "x", 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addrs": { 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:47.584 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6800", 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 4225131677 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6801", 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 4225131677 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addr": "172.21.15.135:6801/4225131677", 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "active_change": "2024-05-20T17:33:19.780570+0000", 2024-05-20T17:47:47.585 INFO:teuthology.orchestra.run.smithi135.stdout: "active_mgr_features": 4540701547738038271, 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "available": true, 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "standbys": [ 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 24970, 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "z", 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540701547738038271, 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.587 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.588 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.589 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.590 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.591 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.594 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.595 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-20T17:47:47.596 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.597 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.598 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.599 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:47:47.601 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.602 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.604 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.605 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.606 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-20T17:47:47.607 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.608 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.609 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:47:47.610 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.611 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-20T17:47:47.612 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.613 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.614 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.615 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.617 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.618 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.619 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.620 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.621 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.622 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.623 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.624 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.625 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-20T17:47:47.626 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.627 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.628 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.629 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:47:47.632 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.634 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.635 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.636 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.637 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.638 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.639 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.640 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.641 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.642 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:47:47.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.644 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.645 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-20T17:47:47.646 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.647 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.648 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:47:47.649 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.650 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.651 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-20T17:47:47.652 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-20T17:47:47.653 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.655 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.656 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.657 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.658 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:47:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:47:47.660 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:47:47.661 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.662 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.663 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.664 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.665 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.667 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.668 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.669 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.670 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.671 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.672 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.673 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.675 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.676 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.677 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.678 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.679 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.680 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.681 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:47.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.683 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.684 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:47:47.685 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.686 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.687 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.689 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:47:47.690 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-20T17:47:47.691 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.692 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.694 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.695 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.696 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:47:47.697 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.698 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.699 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.700 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.701 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.703 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.704 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.706 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.710 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:47:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.712 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.714 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.715 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.716 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.717 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.718 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.719 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.720 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:47:47.721 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.723 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.724 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.725 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:47.726 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.727 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:47:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.731 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.733 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.734 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.735 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.736 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.737 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.738 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.739 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.740 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.741 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:47:47.743 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.744 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.746 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.748 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.749 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.750 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.751 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:47:47.752 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.753 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.755 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.756 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.757 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.758 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.760 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-20T17:47:47.761 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-20T17:47:47.762 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.764 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.765 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.766 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.767 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.768 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.769 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.770 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.771 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.772 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-20T17:47:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.775 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.776 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.777 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.778 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.780 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.781 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:47.782 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.783 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.784 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-20T17:47:47.785 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.787 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.788 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.789 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.790 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.791 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.792 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-20T17:47:47.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.794 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.795 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.796 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.797 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-20T17:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-20T17:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-20T17:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-20T17:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-20T17:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-20T17:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-20T17:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-20T17:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-20T17:47:47.834 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.835 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:47.837 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.838 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.839 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-20T17:47:47.840 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.841 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.842 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.843 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.844 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.845 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.846 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.848 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.849 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-20T17:47:47.851 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.852 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.853 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.855 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.856 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-20T17:47:47.858 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.859 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.860 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.861 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.862 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.863 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.866 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.867 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.869 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.870 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.871 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.874 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.875 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:47:47.876 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.877 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.878 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-20T17:47:47.879 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.880 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.881 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.882 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.883 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.884 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.885 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.886 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-20T17:47:47.887 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.888 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.889 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.891 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.892 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.894 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.895 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.896 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.897 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.898 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.899 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.901 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.902 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.903 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:47:47.904 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.905 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.907 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.908 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.909 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.910 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.911 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.912 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.913 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.914 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.915 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.916 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.917 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.918 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.919 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.920 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.922 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.923 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.924 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.925 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.926 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.927 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.928 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.929 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.930 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.931 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.932 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.933 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.934 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:47:47.935 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.936 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.937 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.938 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.939 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.940 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.941 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.942 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.943 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.944 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.945 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:47.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.947 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.948 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.950 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.951 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.952 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.953 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.954 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.955 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.956 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.957 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.958 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.959 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:47:47.960 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.961 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-20T17:47:47.962 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.963 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.964 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.965 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.966 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.967 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.968 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.969 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.971 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-20T17:47:47.972 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.974 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.975 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-20T17:47:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.978 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.979 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.980 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.981 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.982 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.985 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.986 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.987 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.988 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.989 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.991 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:47.992 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.993 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.994 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:47.995 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:47.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:47.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:47.998 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:47.999 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:47.999 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:47.999 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:47.999 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:47.999 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.001 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.001 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.001 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.002 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.002 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.002 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.003 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.003 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.003 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.003 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.003 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.005 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.005 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.006 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.006 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.006 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.006 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.006 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.007 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.008 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.008 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.008 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.008 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.008 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.009 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.010 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.010 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.010 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.010 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.011 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.012 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:47:48.013 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.014 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.015 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.016 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.017 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.018 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.019 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.020 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.021 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.022 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.023 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.024 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.025 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.026 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-20T17:47:48.027 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.028 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.029 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.031 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-20T17:47:48.032 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.034 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-20T17:47:48.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.037 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-20T17:47:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.039 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.040 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.041 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.045 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.046 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.047 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.048 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.049 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.050 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.051 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.052 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.053 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-20T17:47:48.054 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.055 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.057 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.058 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.059 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.060 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-20T17:47:48.061 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.062 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.063 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.064 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.065 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.066 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.068 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.069 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.070 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.071 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.072 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.073 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-20T17:47:48.074 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.075 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:47:48.076 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.077 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.078 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-20T17:47:48.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.081 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.082 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.083 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-20T17:47:48.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.085 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.089 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.090 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.092 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.093 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.094 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.095 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.096 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.097 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.098 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.099 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.100 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.101 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.103 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.104 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.105 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.106 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.107 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.108 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.109 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.110 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-20T17:47:48.112 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-05-20T17:47:48.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.115 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.116 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.117 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.118 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.119 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.121 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.123 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.124 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.126 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.127 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.128 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.129 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.131 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.132 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 25013, 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "y", 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540701547738038271, 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-20T17:47:48.133 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.134 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.135 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.136 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.137 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.139 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.142 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-20T17:47:48.143 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.144 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.145 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-20T17:47:48.146 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.147 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.148 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.149 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.150 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.151 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-20T17:47:48.153 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:48.154 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.155 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-20T17:47:48.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:47:48.159 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.160 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.161 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.163 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.164 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.165 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.166 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.168 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.169 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.171 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.172 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.174 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.175 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.176 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.177 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.178 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.181 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-20T17:47:48.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.184 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.185 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-05-20T17:47:48.186 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.187 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.190 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-20T17:47:48.191 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-20T17:47:48.193 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.194 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.195 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-20T17:47:48.196 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.197 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.198 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.199 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:47:48.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.201 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.202 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.204 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.205 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:47:48.206 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.209 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.209 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.209 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-20T17:47:48.209 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.209 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.210 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.211 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.212 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.214 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:47:48.215 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.216 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.217 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.218 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:47:48.219 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:47:48.220 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-20T17:47:48.221 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:47:48.223 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.225 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:47:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.228 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-20T17:47:48.231 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.232 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.233 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.234 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.235 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-20T17:47:48.236 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.237 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.238 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.239 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.240 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.241 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.242 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.243 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.244 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.247 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.248 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.249 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-20T17:47:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.251 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:47:48.252 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.253 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.255 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.256 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.258 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:47:48.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.260 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-20T17:47:48.261 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.263 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.264 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.265 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.266 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.267 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.268 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:47:48.269 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.270 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.271 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.272 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.275 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.278 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.279 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.281 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:47:48.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.283 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.284 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.285 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.287 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:47:48.288 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.290 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.291 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:47:48.292 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.293 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.294 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.295 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.296 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:47:48.297 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.298 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.299 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.300 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.301 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:47:48.302 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.303 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.304 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.305 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.306 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.308 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.309 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.310 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.312 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.313 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:47:48.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.317 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.318 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.319 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.323 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.324 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.325 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.326 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:47:48.327 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.333 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.334 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.335 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-20T17:47:48.336 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.337 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.338 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.339 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.340 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.342 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.343 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.344 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.345 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.346 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.347 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.348 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.349 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.350 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.351 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.352 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-20T17:47:48.353 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.354 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.355 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.356 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.357 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-20T17:47:48.358 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.359 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.361 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.362 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.363 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:48.364 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.365 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.366 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.367 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.368 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.369 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.370 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.371 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.372 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.373 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-20T17:47:48.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.377 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.378 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.379 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.380 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.381 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.383 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.384 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.385 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.387 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.388 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.389 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.390 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.391 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-20T17:47:48.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.395 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.396 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-20T17:47:48.397 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.398 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.399 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.401 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.402 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:47:48.405 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.406 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-20T17:47:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-20T17:47:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.415 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.416 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.417 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.418 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.419 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.420 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.421 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.424 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.425 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.426 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-20T17:47:48.427 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.429 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.430 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.432 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.433 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.434 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-20T17:47:48.435 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:47:48.436 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.437 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.438 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.439 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.440 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.441 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-20T17:47:48.442 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-20T17:47:48.443 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.444 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.445 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.446 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-20T17:47:48.447 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.448 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.449 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.451 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.452 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.453 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.454 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.455 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.456 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.457 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.458 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.459 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.460 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.461 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.462 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.464 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.465 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.467 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.468 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.469 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.471 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.472 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-20T17:47:48.473 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.474 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-20T17:47:48.475 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.476 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.478 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.480 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.481 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.496 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.497 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.499 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.500 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.501 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.502 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.503 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.504 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.505 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.506 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.507 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.508 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.509 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.510 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.511 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.513 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.514 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.515 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.516 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.517 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.518 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.519 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.519 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.519 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.519 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.519 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.520 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-20T17:47:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-20T17:47:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.522 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.523 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.523 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.523 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.523 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:47:48.524 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:47:48.524 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.524 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.524 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.524 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.526 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.527 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:48.528 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.529 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:48.530 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-20T17:47:48.531 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.532 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.533 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:48.534 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.535 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.536 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.537 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.538 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.539 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.540 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.541 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.542 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.543 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.544 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.545 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.546 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.547 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.548 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.549 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.550 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.551 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.552 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.553 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.554 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.555 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.556 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.557 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.558 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.559 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.560 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.561 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.562 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.564 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.566 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.567 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.568 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.569 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.571 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.574 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.575 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.576 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.577 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.578 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.579 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-20T17:47:48.580 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-20T17:47:48.581 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.582 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.583 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.584 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.585 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.586 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.587 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.588 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.589 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.590 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.591 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-20T17:47:48.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.594 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.595 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.596 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.597 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.598 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.599 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.601 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.602 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.603 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.604 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.605 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.606 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.608 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.610 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.613 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.614 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.615 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-20T17:47:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-20T17:47:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.617 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.618 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-20T17:47:48.619 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.623 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.625 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.626 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.627 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.628 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.630 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.631 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.632 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.633 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.634 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.635 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-20T17:47:48.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.637 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.638 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.639 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.640 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.641 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.642 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.643 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.645 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.646 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.647 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.648 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.651 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.652 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.653 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.654 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.655 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.658 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.659 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-20T17:47:48.660 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.661 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.662 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.663 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.664 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.665 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.666 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.667 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.668 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.669 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.670 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.671 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.673 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.674 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.675 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.677 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.678 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.679 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.681 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.682 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "modules": [ 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard", 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "iostat", 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "nfs", 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "restful", 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "snap_schedule" 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.683 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.684 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.685 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.687 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.688 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.689 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-20T17:47:48.690 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-20T17:47:48.691 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.692 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.693 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.696 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.697 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.698 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.699 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-20T17:47:48.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.702 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-20T17:47:48.703 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:47:48.704 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-20T17:47:48.705 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.706 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.707 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:47:48.708 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.709 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.712 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.713 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:47:48.715 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.716 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.717 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-20T17:47:48.718 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.719 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.720 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:47:48.721 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.722 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.723 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.724 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.725 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.726 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.730 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:47:48.731 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.732 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-05-20T17:47:48.733 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.735 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.736 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.737 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-20T17:47:48.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-20T17:47:48.739 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.740 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-20T17:47:48.742 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.743 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.744 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.745 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:47:48.746 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.747 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.748 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.749 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.750 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.751 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.752 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-20T17:47:48.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-05-20T17:47:48.755 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:47:48.756 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.757 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.758 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.759 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.760 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.761 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.763 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:47:48.764 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.765 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.766 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:47:48.768 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.769 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.771 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.772 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.773 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.774 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.775 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.776 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.777 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:47:48.778 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.779 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.782 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.783 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.784 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.785 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.786 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.787 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.788 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.789 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-20T17:47:48.790 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-20T17:47:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.792 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.793 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:47:48.794 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:47:48.795 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.796 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.797 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:47:48.798 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.799 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:47:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.801 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.802 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.803 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.804 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.805 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.806 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.807 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.808 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.809 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.810 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.811 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.812 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.813 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.815 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.817 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.818 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.819 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.821 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.822 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.823 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.824 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:47:48.825 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.826 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.828 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.829 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.830 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.831 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.832 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:47:48.833 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:47:48.834 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.836 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.837 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.838 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.839 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:47:48.840 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.841 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.842 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.843 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.844 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.845 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.846 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.847 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.848 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.850 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.851 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.852 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.853 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:47:48.854 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.856 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:47:48.857 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:47:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.859 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.861 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.862 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.863 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.864 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.865 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-20T17:47:48.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-20T17:47:48.867 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.868 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:47:48.869 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.870 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.871 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.872 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.873 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.874 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.875 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.876 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:47:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:48.882 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.883 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:48.884 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.885 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.886 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.887 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.888 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-20T17:47:48.889 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:48.890 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.891 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.892 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.893 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.895 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.896 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.897 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.898 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.899 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.900 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-20T17:47:48.901 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.903 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-20T17:47:48.904 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.905 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-20T17:47:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.911 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.912 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.913 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.914 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.915 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.917 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.918 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.919 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.920 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.922 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-20T17:47:48.922 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-20T17:47:48.922 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.922 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.923 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.924 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.924 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.924 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.924 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-20T17:47:48.925 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.926 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-20T17:47:48.928 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.928 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.928 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.928 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.930 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-20T17:47:48.931 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.932 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.932 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.932 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:47:48.932 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.932 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.933 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:47:48.934 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-20T17:47:48.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.936 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.938 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.939 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.940 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.941 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.942 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.943 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.945 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-20T17:47:48.946 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.947 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.948 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.949 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.950 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.951 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.952 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.953 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.954 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.955 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.956 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.957 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.958 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.959 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.962 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.963 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.964 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.966 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-20T17:47:48.967 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.968 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.969 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.970 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.972 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.973 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.974 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.976 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.977 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.978 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.979 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.980 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.981 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.982 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.984 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-20T17:47:48.985 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.986 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.987 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.988 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.989 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.990 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.991 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.992 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.993 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.994 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.995 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:48.997 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:48.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:48.999 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.000 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.002 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.003 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.004 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:47:49.005 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.006 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.007 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.009 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.010 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-20T17:47:49.011 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-20T17:47:49.012 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.014 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.015 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.016 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.017 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.018 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.019 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.020 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.022 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.023 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.024 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.025 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.026 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.027 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.028 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.029 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.031 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-20T17:47:49.032 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.034 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.035 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.036 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.039 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-20T17:47:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.042 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.044 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.045 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.047 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.048 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.049 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.050 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.051 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.052 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.053 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-20T17:47:49.054 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.055 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.056 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-20T17:47:49.057 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.059 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.060 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.061 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.062 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.064 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.065 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.066 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.067 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.068 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.069 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.071 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.073 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.074 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.075 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.076 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.077 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-20T17:47:49.078 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-20T17:47:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.082 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.083 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.085 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.086 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.087 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.088 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.089 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.090 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.092 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.093 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.094 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.095 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.096 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.098 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.099 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-20T17:47:49.101 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.102 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-20T17:47:49.104 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-20T17:47:49.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.106 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.108 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.109 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.111 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-20T17:47:49.113 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:47:49.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:47:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.116 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.118 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.119 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.123 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.124 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.125 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.126 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.127 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.128 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.129 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.131 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.132 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-20T17:47:49.133 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:49.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.136 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.138 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.139 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.140 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.141 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:47:49.142 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.143 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.144 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.146 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.147 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.149 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-20T17:47:49.150 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:49.151 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-20T17:47:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.156 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.158 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.159 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.160 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.161 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.162 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-20T17:47:49.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.168 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.170 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.171 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.174 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.175 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:47:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-20T17:47:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-20T17:47:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-20T17:47:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.190 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-20T17:47:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-20T17:47:49.192 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "services": { 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard": "https://172.21.15.135:8443/" 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "always_on_modules": { 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "octopus": [ 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-20T17:47:49.194 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "pacific": [ 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-20T17:47:49.195 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "quincy": [ 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-20T17:47:49.196 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "reef": [ 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-20T17:47:49.197 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "squid": [ 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-20T17:47:49.198 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "last_failure_osd_epoch": 88, 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "active_clients": [ 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1068178851 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.199 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "libcephsqlite", 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1005199067 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.200 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2634116764 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.201 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 3264294984 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 767252286 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 721083626 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-20T17:47:49.203 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:47 smithi172 ceph-mon[36511]: pgmap v451: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 971 KiB/s wr, 112 op/s 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:47 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/605670590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:48 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2931280940' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:47 smithi160 ceph-mon[36261]: pgmap v451: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 971 KiB/s wr, 112 op/s 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:47 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/605670590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:47:49.205 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:48 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2931280940' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 msgr2=0x7f06500a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 0x7f06500a5410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0664110d90 tx=0x7f065c00b040 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 msgr2=0x7f066410fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f066410fc10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f066000b3e0 tx=0x7f066000b8a0 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 shutdown_connections 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f06500a2f00 0x7f06500a5410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0664107d90 0x7f066410fc10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0664107980 0x7f066410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 --2- 172.21.15.135:0/2931280940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0664106220 0x7f0664116420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.580+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 >> 172.21.15.135:0/2931280940 conn(0x7f06640fc7c0 msgr2=0x7f06640fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:47:49.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.581+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 shutdown_connections 2024-05-20T17:47:49.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:47:47.581+0000 7f066c23d640 1 -- 172.21.15.135:0/2931280940 wait complete. 2024-05-20T17:47:49.213 DEBUG:tasks.check_counter:Getting stats from a 2024-05-20T17:47:49.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-20T17:47:49.214 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:47 smithi135 ceph-mon[32027]: pgmap v451: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 971 KiB/s wr, 112 op/s 2024-05-20T17:47:49.214 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:47 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/605670590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:47:49.214 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:48 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2931280940' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:47:49.652 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:47:49.656 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:49 smithi160 ceph-mon[36261]: pgmap v452: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 123 op/s 2024-05-20T17:47:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:49 smithi135 ceph-mon[32027]: pgmap v452: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 123 op/s 2024-05-20T17:47:49.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:49 smithi172 ceph-mon[36511]: pgmap v452: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 123 op/s 2024-05-20T17:47:51.448 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:51 smithi135 ceph-mon[32027]: pgmap v453: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 565 KiB/s wr, 88 op/s 2024-05-20T17:47:51.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:51 smithi160 ceph-mon[36261]: pgmap v453: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 565 KiB/s wr, 88 op/s 2024-05-20T17:47:51.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:51 smithi172 ceph-mon[36511]: pgmap v453: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 565 KiB/s wr, 88 op/s 2024-05-20T17:47:52.015 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:47:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:47:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-05-20T17:47:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-05-20T17:47:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001182363, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000231181, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:52.016 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:47:52.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 279, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 269, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1459360, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 165824, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-20T17:47:52.018 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.052960558, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.016646613, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.039621023, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.006025287, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 268, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.013638060, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000050888 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.019 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1459360, 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 165824 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:47:52.020 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 208, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3344, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 192272, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.015908231, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.010717964, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002704072, 2024-05-20T17:47:52.021 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 206, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.019510700, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000094712 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:52.022 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 192272 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-20T17:47:52.023 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:47:52.024 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-20T17:47:52.025 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 149017, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 31, 2024-05-20T17:47:52.026 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-20T17:47:52.027 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 281, 2024-05-20T17:47:52.028 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1420001, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 281, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 281, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1420001, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:52.029 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:47:52.713 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-05-20T17:47:52.714 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-05-20T17:47:52.714 DEBUG:tasks.check_counter:Getting stats from d 2024-05-20T17:47:52.715 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-20T17:47:53.173 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:47:53.641 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:53 smithi135 ceph-mon[32027]: pgmap v454: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 564 KiB/s wr, 77 op/s 2024-05-20T17:47:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:53 smithi160 ceph-mon[36261]: pgmap v454: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 564 KiB/s wr, 77 op/s 2024-05-20T17:47:53.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:53 smithi172 ceph-mon[36511]: pgmap v454: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 564 KiB/s wr, 77 op/s 2024-05-20T17:47:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:55 smithi135 ceph-mon[32027]: pgmap v455: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 569 KiB/s wr, 65 op/s 2024-05-20T17:47:55.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:55 smithi160 ceph-mon[36261]: pgmap v455: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 569 KiB/s wr, 65 op/s 2024-05-20T17:47:55.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:55 smithi172 ceph-mon[36511]: pgmap v455: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 569 KiB/s wr, 65 op/s 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:47:55.981 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001223941, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000298728, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:55.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 212, 2024-05-20T17:47:55.983 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3344, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 192976, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.016103767, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.011211413, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002376398, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 210, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.015012917, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000071490 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.984 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 192976 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 286, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 276, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1461328, 2024-05-20T17:47:55.985 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 169824, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.053257921, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.017811454, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.038758179, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.006113002, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 275, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.018902627, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000068736 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.986 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1461328, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 169824 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-20T17:47:55.987 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:47:55.988 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-20T17:47:55.989 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148977, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 30, 2024-05-20T17:47:55.990 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-20T17:47:55.991 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 288, 2024-05-20T17:47:55.992 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1420975, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 288, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 288, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1420975, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:47:55.993 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:47:56.861 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-20T17:47:56.861 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-20T17:47:56.861 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-20T17:47:56.862 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-20T17:47:56.862 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-20T17:47:56.862 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-20T17:47:56.862 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-20T17:47:56.862 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-05-20T17:47:56.862 DEBUG:tasks.check_counter:Getting stats from g 2024-05-20T17:47:56.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-20T17:47:57.274 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:47:57.618 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:57 smithi135 ceph-mon[32027]: pgmap v456: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 KiB/s wr, 38 op/s 2024-05-20T17:47:57.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:57 smithi160 ceph-mon[36261]: pgmap v456: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 KiB/s wr, 38 op/s 2024-05-20T17:47:57.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:57 smithi172 ceph-mon[36511]: pgmap v456: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 KiB/s wr, 38 op/s 2024-05-20T17:47:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:47:59 smithi135 ceph-mon[32027]: pgmap v457: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 KiB/s wr, 33 op/s 2024-05-20T17:47:59.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:47:59 smithi160 ceph-mon[36261]: pgmap v457: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 KiB/s wr, 33 op/s 2024-05-20T17:47:59.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:47:59 smithi172 ceph-mon[36511]: pgmap v457: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 KiB/s wr, 33 op/s 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-05-20T17:48:00.618 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001168565, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000239474, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.619 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 283, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 273, 2024-05-20T17:48:00.620 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1460512, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 167904, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.052123944, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.016991825, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.038669237, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.006053026, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 272, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.021785953, 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000080095 2024-05-20T17:48:00.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1460512, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 167904 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 209, 2024-05-20T17:48:00.622 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3344, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 192448, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.016050426, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.010879660, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002435338, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 207, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011922241, 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000057595 2024-05-20T17:48:00.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 192448 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-20T17:48:00.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:00.626 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:00.627 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148977, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 30, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:00.628 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-20T17:48:00.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 285, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1420585, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 285, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 285, 2024-05-20T17:48:00.630 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1420585, 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:48:00.631 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:48:01.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:01 smithi135 ceph-mon[32027]: pgmap v458: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-05-20T17:48:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:01 smithi160 ceph-mon[36261]: pgmap v458: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-05-20T17:48:01.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:01 smithi172 ceph-mon[36511]: pgmap v458: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-05-20T17:48:02.654 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:02 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:48:02.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:02 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:48:02.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:02 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-05-20T17:48:03.064 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-05-20T17:48:03.064 DEBUG:tasks.check_counter:Getting stats from j 2024-05-20T17:48:03.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-20T17:48:03.529 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:48:03.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:03 smithi135 ceph-mon[32027]: pgmap v459: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-20T17:48:03.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:03 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:48:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:03 smithi160 ceph-mon[36261]: pgmap v459: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-20T17:48:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:03 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:48:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:03 smithi172 ceph-mon[36511]: pgmap v459: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-20T17:48:03.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:03 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:48:04.653 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:04 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:48:04.654 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:04 smithi135 ceph-mon[32027]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:48:04.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:04 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:48:04.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:04 smithi160 ceph-mon[36261]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:48:04.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:04 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:48:04.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:04 smithi172 ceph-mon[36511]: from='mgr.15306 ' entity='mgr.x' 2024-05-20T17:48:05.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:05 smithi135 ceph-mon[32027]: pgmap v460: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-05-20T17:48:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:05 smithi160 ceph-mon[36261]: pgmap v460: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-05-20T17:48:05.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:05 smithi172 ceph-mon[36511]: pgmap v460: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-05-20T17:48:05.990 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-20T17:48:05.990 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 289, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 279, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1462144, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 171744, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.054466511, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.017212089, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.039112381, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.006290053, 2024-05-20T17:48:05.991 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 278, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.015374299, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000055303 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1462144, 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 171744 2024-05-20T17:48:05.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 213, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 320, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 193056, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.017542247, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.011850294, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002667652, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:05.993 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 210, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011644749, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000055451 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-20T17:48:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 193056 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3024, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 448, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.000857167, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000034006, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000796587, 2024-05-20T17:48:05.995 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000935806, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000311935 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.996 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:05.997 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:05.998 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:05.999 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148977, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 30, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-20T17:48:06.000 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-20T17:48:06.001 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 291, 2024-05-20T17:48:06.002 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1421365, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 291, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 291, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1421365, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-20T17:48:06.003 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-20T17:48:06.710 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-20T17:48:06.710 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-20T17:48:06.711 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-05-20T17:48:06.711 DEBUG:tasks.check_counter:Getting stats from b 2024-05-20T17:48:06.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-20T17:48:07.133 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:48:07.527 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:07 smithi160 ceph-mon[36261]: pgmap v461: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-20T17:48:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:07 smithi135 ceph-mon[32027]: pgmap v461: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-20T17:48:07.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:07 smithi172 ceph-mon[36511]: pgmap v461: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-20T17:48:09.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:09 smithi135 ceph-mon[32027]: pgmap v462: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-20T17:48:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:09 smithi160 ceph-mon[36261]: pgmap v462: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 76033, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 85564, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 94834923, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 373884332, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 148, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 8.115870894, 2024-05-20T17:48:09.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 3.426360635, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 2.737935867, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 2.212229655, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 85564, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 48.425599124, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000565957 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 93537, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.020005877, 2024-05-20T17:48:09.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000213 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1592496, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 186144 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 324900, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 602531, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 126743551, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 563102124, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 17, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 5, 2024-05-20T17:48:09.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 26.191037705, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 11.221267847, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 380.405111555, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 3.032411925, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 602528, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 142.380375122, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000236304 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 731204, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.154945934, 2024-05-20T17:48:09.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000211 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 105036784, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 311638784 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 75552, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 86590, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 76355116, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 355899177, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 25, 2024-05-20T17:48:09.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 7, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 8.055911968, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 2.724610722, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 2.387591394, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 3.103678459, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 86588, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 56.412683879, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000651506 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 82254, 2024-05-20T17:48:09.786 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.016083904, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000195 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 452400, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 143760 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-20T17:48:09.787 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 10632, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 208.694113167, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.019628866 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 54987, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 17.395397409, 2024-05-20T17:48:09.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000316354 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 182990, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 165990, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 165990, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4489.223586387, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.027045144 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-20T17:48:09.789 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 16981, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 374, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 1, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 10804, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 150, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 3, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 47811, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 33185, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 14431, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 195, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 403, 2024-05-20T17:48:09.790 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 192892, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 3, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 3, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 4, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 283882, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 241154, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 16842, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 763, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 178, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 420, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 140, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-20T17:48:09.791 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 227, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 149840, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 212, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 153137, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 2677, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 4, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 234, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 6, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 2677, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:09.792 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 92, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 5, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 87, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 2585, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 180, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 23439, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 75422, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 5, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 82745, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 42998, 2024-05-20T17:48:09.793 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 1844, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 70818 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 2564, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 4771, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 2579, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 3432, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 6572, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 190, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 33529, 2024-05-20T17:48:09.794 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 33339, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 5, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 227, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-20T17:48:09.795 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 156, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 9, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 213172, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 213047, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 213047, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 125, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 5, 2024-05-20T17:48:09.796 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 339, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 338, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 338, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 1, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 1, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 1, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 693595674, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 694226455, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4533, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 651.032801492, 2024-05-20T17:48:09.797 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.143620737 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 19338, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 185710, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 166372, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 1355, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 7209, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 5854, 2024-05-20T17:48:09.798 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 47811, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 294037, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 246226, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 3, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 100031, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 100028, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 328848, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 231828 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 196350, 2024-05-20T17:48:09.799 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 11384, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 182990, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 231, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 22998, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 34627, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 278.756552853, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.008050265 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2781, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 284.938848232, 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.102459132 2024-05-20T17:48:09.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.801 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 56483, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 3234.416815260, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.057263545 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-05-20T17:48:09.802 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000198989, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000198989 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.803 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.804 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:09.804 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.804 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.804 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 15, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.009011863, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000600790 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 240, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 10.156530471, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.042318876 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-20T17:48:09.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 15, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 19.534934884, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 1.302328992 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 7748, 2024-05-20T17:48:09.806 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 63.389003048, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.008181337 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1383, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 7.885974171, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005702078 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 34271, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 488.132423032, 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.014243308 2024-05-20T17:48:09.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-20T17:48:09.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 194, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 33.691862108, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.173669392 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 9, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.464166841, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.051574093 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.033859590, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005643265 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:09.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 7, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.019760105, 2024-05-20T17:48:09.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002822872 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.002019489, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000673163 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 28207, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 67.791625451, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002403361 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 2, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 5, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 3, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 2, 2024-05-20T17:48:09.813 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 5236, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 2618, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 870, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 240, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 240, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:09.814 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:09.815 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:09.816 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 2621760, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 19812, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 264, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 3, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:09.817 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8360, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 175, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 81416825, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 810389, 2024-05-20T17:48:09.818 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 116312, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 839398102, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 20, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 116312, 2024-05-20T17:48:09.819 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 116312, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 52177.099643747, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.448596014 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 116312, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 260972 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 116312, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 4952, 2024-05-20T17:48:09.820 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 111360, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 9364, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 59637, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 802, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 5337, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 602, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 150, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 34199, 2024-05-20T17:48:09.821 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 2701, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 119275, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-20T17:48:09.822 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 5, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-20T17:48:09.823 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 104, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 20, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-05-20T17:48:09.824 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 21688, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 1843, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 5369 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.825 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 41 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 10, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 33339, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 33339, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.826 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 476481, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 241114824, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 476481, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 476481, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 241114824, 2024-05-20T17:48:09.827 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:09.828 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 116312, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 843786740, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 116312, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 843786740, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:09.829 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 116312, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 116312, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 116312, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 116312, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.830 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 33339, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 4431687, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 33339, 2024-05-20T17:48:09.831 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 799, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 4431687, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x558a41d8e8f0": { 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 112, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:09.832 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 213172, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 690032151, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 213172, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4533, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 690032039, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:09.833 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:09.834 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.834 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:09.834 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-20T17:48:09.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:09 smithi172 ceph-mon[36511]: pgmap v462: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-20T17:48:10.706 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:10 smithi135 ceph-mon[32027]: osdmap e104: 12 total, 12 up, 12 in 2024-05-20T17:48:10.727 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:10 smithi160 ceph-mon[36261]: osdmap e104: 12 total, 12 up, 12 in 2024-05-20T17:48:10.791 INFO:tasks.check_counter:Daemon mds.b mds.exported=227 2024-05-20T17:48:10.791 INFO:tasks.check_counter:Daemon mds.b mds.imported=212 2024-05-20T17:48:10.791 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2564 2024-05-20T17:48:10.791 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=4771 2024-05-20T17:48:10.791 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-05-20T17:48:10.792 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=15 2024-05-20T17:48:10.792 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=9 2024-05-20T17:48:10.792 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=150 2024-05-20T17:48:10.792 DEBUG:tasks.check_counter:Getting stats from e 2024-05-20T17:48:10.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-20T17:48:10.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:10 smithi172 ceph-mon[36511]: osdmap e104: 12 total, 12 up, 12 in 2024-05-20T17:48:11.283 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:48:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:11 smithi135 ceph-mon[32027]: pgmap v464: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:11 smithi160 ceph-mon[36261]: pgmap v464: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:11.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:11 smithi172 ceph-mon[36511]: pgmap v464: 97 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:13.670 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:13 smithi160 ceph-mon[36261]: pgmap v465: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 2427, 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2428, 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 252394144, 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 771475, 2024-05-20T17:48:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.341766688, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.060037473, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.191447426, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.074035432, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2426, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.108732348, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000044819 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 942, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1153, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 214182181, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 837030, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 9, 2024-05-20T17:48:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 7, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.192010826, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.028757058, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.126135906, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.028999107, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1150, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.060911823, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000052966 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 538048 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1117, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1095, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 197700999, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 427910, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2024-05-20T17:48:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.213943047, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.031579287, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.161223943, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.026521044, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1095, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.049808040, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000045486 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1534848, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 177008 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6449, 2024-05-20T17:48:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.294459979, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000045659 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2024-05-20T17:48:13.679 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 88998, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 17040, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 71958, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 64655, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 1, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 1, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-05-20T17:48:13.680 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:48:13.681 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-05-20T17:48:13.682 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-05-20T17:48:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-20T17:48:13.684 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2024-05-20T17:48:13.685 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 176444, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 133, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 16, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-05-20T17:48:13.686 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 267815126, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 665707931, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 665700167, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 176444 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 30864, 2024-05-20T17:48:13.687 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 118808, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 87944, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 1002, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 3193, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 2191, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 88998, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 183813, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 94815, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 283108, 2024-05-20T17:48:13.688 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 215444 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-20T17:48:13.689 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.691 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:13.692 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-20T17:48:13.694 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.696 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:13.697 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.698 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.699 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:13.700 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 4, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 3, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-05-20T17:48:13.701 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 2234, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:13.702 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:13.703 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:13.704 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 1402728, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 31519, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8408, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 178, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:13.705 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 134624615, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 1203332, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-20T17:48:13.706 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 4155, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 21, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 3, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 4155, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4155, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 36.506461192, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.008786151 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4155, 2024-05-20T17:48:13.707 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4156 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 4155, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 4155, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 2609, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 1544, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-20T17:48:13.708 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-20T17:48:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-20T17:48:13.710 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 104, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 19, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 11, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 11, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-20T17:48:13.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.712 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:13.713 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 4482, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 663854344, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 4482, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4482, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 663854344, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.714 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4155, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 661599938, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4155, 2024-05-20T17:48:13.715 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 661599938, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4155, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 4155, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4155, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 4155, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:13.717 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x561f78e52b60": { 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:13.719 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:13.720 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-20T17:48:13.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:13 smithi172 ceph-mon[36511]: pgmap v465: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:13.867 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:13 smithi135 ceph-mon[32027]: pgmap v465: 97 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-20T17:48:14.445 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-05-20T17:48:14.445 DEBUG:tasks.check_counter:Getting stats from h 2024-05-20T17:48:14.446 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-20T17:48:14.967 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:48:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:15 smithi160 ceph-mon[36261]: pgmap v466: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:15.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:15 smithi172 ceph-mon[36511]: pgmap v466: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:15.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:15 smithi135 ceph-mon[32027]: pgmap v466: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:17.579 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:17 smithi160 ceph-mon[36261]: pgmap v467: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:17.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:17 smithi172 ceph-mon[36511]: pgmap v467: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:17.843 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-20T17:48:17.843 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:17.843 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 108606, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 96566, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 114658323, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 303794431, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 12, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 7.239449353, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 3.161023094, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 4.361920613, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.732060365, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 96571, 2024-05-20T17:48:17.844 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 12.352489802, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000127910 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 180125, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.033693181, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000187 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:17.845 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 12840, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 13097, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 6451219, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 178474751, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 15, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 8, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 2.008743551, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.811400753, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.248644756, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.857938323, 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:17.846 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 13094, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.853348995, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000217912 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 97, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000018386, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000189 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 6432, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 559888 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.847 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 325663, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 494575, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 132738532, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 478054387, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 19, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 8, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 20.697756417, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 9.394927404, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 794.047371025, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 1.154368943, 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:17.848 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 494568, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 74.376778745, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000150387 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 675998, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.133758400, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000197 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 121683584, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 263566560 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-20T17:48:17.849 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 10076, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 131.457351124, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.013046581 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.850 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 41125, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 12.819239997, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000311714 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 160234, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 154826, 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-05-20T17:48:17.851 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 154826, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4330.132377067, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.027967733 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 5394, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 445, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 1228, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 109, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 39523, 2024-05-20T17:48:17.852 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 5404, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 21107, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 13012, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 31801, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 119838, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 1, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 2, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 4, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 294035, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 228727, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 4972, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 1552, 2024-05-20T17:48:17.853 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 279, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 1672, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 228, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 94921, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 140, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 93462, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 1834, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 3303, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 69246880, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 6, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 1834, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 1834, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 175, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 22658, 2024-05-20T17:48:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 51812, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 77326, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 32870, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 1309, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 58933 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 2465, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 7187, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 4349, 2024-05-20T17:48:17.856 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 5554, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 3520, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 107, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 23803, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 23696, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-05-20T17:48:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 228, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 109, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 7, 2024-05-20T17:48:17.858 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 157052, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 70768, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 61451, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 95601, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 9317, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 225, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 97, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 84, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 141, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 8, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 13, 2024-05-20T17:48:17.859 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 164816064, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 577733690, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3793, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 204.317285686, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.053866935 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 23644, 2024-05-20T17:48:17.860 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 126215, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 102571, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 845, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 5695, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 4850, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 39523, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 191302, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 151779, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 2, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 66746, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 66744, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 341576, 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 223636 2024-05-20T17:48:17.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 180405, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 5978, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 160234, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 407, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 19121, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 22795, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 220.903548322, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.009690877 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.862 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 374, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 38.986716940, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.104242558 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 83590, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 3508.414531925, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.041971701 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-05-20T17:48:17.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000133936, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000133936 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.866 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 84, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 7.162591893, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.085268951 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-05-20T17:48:17.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 7117, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 51.778569995, 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.007275336 2024-05-20T17:48:17.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 807, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.567005440, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.003180923 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 22794, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 442.445452498, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.019410610 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:17.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 107, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 20.638433337, 2024-05-20T17:48:17.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.192882554 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-05-20T17:48:17.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-05-20T17:48:17.873 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 17157, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 37.235392781, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002170274 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:17.874 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 2, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 5, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 3, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 2, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 15865, 2024-05-20T17:48:17.875 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 7932, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 874, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:17.876 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:17.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:17.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 2030694, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 22663, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-20T17:48:17.879 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8408, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 178, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 83816081, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 800499, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:17.880 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 37522, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 604670810, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 37522, 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-05-20T17:48:17.881 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 37522, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 889.533826566, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.023706993 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 37522, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 45397 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 37522, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 4392, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 33130, 2024-05-20T17:48:17.882 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 246, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 2400, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 801, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 4601, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 437, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 109, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 23882, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-05-20T17:48:17.883 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1847, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 4800, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:17.884 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-05-20T17:48:17.885 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 104, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 19, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 3341, 2024-05-20T17:48:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2202, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 731 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.887 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 10, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 23696, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 23696, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:17.888 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 447105, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 198117552, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 447105, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 447105, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 198117552, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.889 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 37522, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 607797021, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 37522, 2024-05-20T17:48:17.890 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 607797021, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-05-20T17:48:17.891 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 37522, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 37522, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 37522, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 37522, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.892 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 23696, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 3177808, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 23696, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 803, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 3177808, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.893 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55c8793bcb60": { 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 157052, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 573539386, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 157052, 2024-05-20T17:48:17.894 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 3793, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 573539386, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:17.895 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-20T17:48:17.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:17 smithi135 ceph-mon[32027]: pgmap v467: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds.exported=228 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds.imported=140 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=2465 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=7187 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-20T17:48:18.786 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-20T17:48:18.787 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=109 2024-05-20T17:48:18.787 DEBUG:tasks.check_counter:Getting stats from k 2024-05-20T17:48:18.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-20T17:48:19.267 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:48:19.732 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:19 smithi160 ceph-mon[36261]: pgmap v468: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-05-20T17:48:19.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:19 smithi172 ceph-mon[36511]: pgmap v468: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-05-20T17:48:19.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:19 smithi135 ceph-mon[32027]: pgmap v468: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-05-20T17:48:20.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:20 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:48:20.164+0000 7f26a818c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-20T17:48:21.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:21 smithi160 ceph-mon[36261]: pgmap v469: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 288 B/s wr, 6 op/s 2024-05-20T17:48:21.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:21 smithi172 ceph-mon[36511]: pgmap v469: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 288 B/s wr, 6 op/s 2024-05-20T17:48:21.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:21 smithi135 ceph-mon[32027]: pgmap v469: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 288 B/s wr, 6 op/s 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 0, 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2, 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 0, 2024-05-20T17:48:22.531 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 4, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 0, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.001082336, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.000259571, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:22.532 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 298, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 286, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1466528, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 175392, 2024-05-20T17:48:22.533 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 2, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 1, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.052976910, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.015201629, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.040282573, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.006981610, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 286, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.021429826, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000074929 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.534 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1466528, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 175392 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 3, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 218, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 480, 2024-05-20T17:48:22.535 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 271984, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.012350544, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.007973752, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.001977914, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 215, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.019237698, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000089477 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:22.536 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 271984 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 0, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-05-20T17:48:22.537 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:22.538 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:22.539 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:22.540 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 148962, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 30, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 0, 2024-05-20T17:48:22.541 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 928, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 2, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:22.542 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 297, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1422042, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 297, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 297, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1422042, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-05-20T17:48:22.543 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-05-20T17:48:22.544 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-05-20T17:48:22.544 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:22.544 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-05-20T17:48:22.544 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-05-20T17:48:23.290 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-05-20T17:48:23.290 DEBUG:tasks.check_counter:Getting stats from c 2024-05-20T17:48:23.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-20T17:48:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:23 smithi160 ceph-mon[36261]: pgmap v470: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:48:23.733 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:48:23.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:23 smithi172 ceph-mon[36511]: pgmap v470: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:48:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:23 smithi135 ceph-mon[32027]: pgmap v470: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-20T17:48:25.703 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:25 smithi172 ceph-mon[36511]: pgmap v471: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:48:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:25 smithi160 ceph-mon[36261]: pgmap v471: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:48:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:25 smithi135 ceph-mon[32027]: pgmap v471: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-20T17:48:26.285 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-20T17:48:26.285 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:26.285 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2149, 2024-05-20T17:48:26.285 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2151, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 220932635, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 683392, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.316988970, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.057423996, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.169676400, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.071980745, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2149, 2024-05-20T17:48:26.286 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.096215753, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000044772 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.287 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1257, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1468, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 298147565, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 941580, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.271151058, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.032878114, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.192605808, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.035532349, 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:26.288 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1466, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.062952875, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000042941 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 543696 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.289 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1199, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1178, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 173746503, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 454979, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.203945668, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.041513837, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.133765348, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.031363088, 2024-05-20T17:48:26.290 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1177, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.057810153, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000049116 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1532528, 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 178000 2024-05-20T17:48:26.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6673, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.587456791, 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000237892 2024-05-20T17:48:26.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-20T17:48:26.293 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-05-20T17:48:26.294 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 124958, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 87166, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 37792, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 435, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-05-20T17:48:26.295 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:26.296 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:48:26.297 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.298 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-20T17:48:26.299 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-20T17:48:26.300 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 213172, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-20T17:48:26.301 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 60, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 693595674, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 694226455, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 694226343, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.302 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 213172 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 41458, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 183547, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 142089, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 1334, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 5229, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 3895, 2024-05-20T17:48:26.303 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 124958, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 285417, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 160459, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 338468, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215444 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-20T17:48:26.304 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.305 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.307 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.308 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.309 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-20T17:48:26.310 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.312 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.313 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:26.315 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:26.317 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 5, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 3, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 4, 2024-05-20T17:48:26.318 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3587, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:26.319 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:26.320 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:26.321 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 1798547, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 42236, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-20T17:48:26.322 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8408, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 178, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-20T17:48:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 184668107, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 1776886, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 4271, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-05-20T17:48:26.324 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 4271, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4271, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 29.526290065, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006913203 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4271, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4272 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 4271, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 4271, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2588, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1680, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-20T17:48:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-20T17:48:26.327 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-20T17:48:26.328 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 104, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 19, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 11, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 11, 2024-05-20T17:48:26.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-20T17:48:26.331 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 4601, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 692392863, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 4601, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4601, 2024-05-20T17:48:26.332 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 692392863, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:26.333 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4271, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 690119097, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4271, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 690119097, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4271, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 4271, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4271, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4271, 2024-05-20T17:48:26.335 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55b59aa3ec30": { 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:26.338 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:26.339 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:26.339 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.339 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:26.339 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-20T17:48:27.493 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-20T17:48:27.493 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-20T17:48:27.494 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-05-20T17:48:27.494 DEBUG:tasks.check_counter:Getting stats from f 2024-05-20T17:48:27.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-20T17:48:27.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:27 smithi160 ceph-mon[36261]: pgmap v472: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-20T17:48:27.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:27 smithi172 ceph-mon[36511]: pgmap v472: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-20T17:48:27.912 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:48:27.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:27 smithi135 ceph-mon[32027]: pgmap v472: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-20T17:48:29.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:29 smithi172 ceph-mon[36511]: pgmap v473: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-20T17:48:29.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:29 smithi135 ceph-mon[32027]: pgmap v473: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-20T17:48:30.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:29 smithi160 ceph-mon[36261]: pgmap v473: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-20T17:48:30.613 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-20T17:48:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1413, 2024-05-20T17:48:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1413, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 234217192, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 448574, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.244682912, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.030976641, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.163303908, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.039566911, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1412, 2024-05-20T17:48:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.045837739, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000032462 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 771, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 985, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 147021394, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 875157, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.146782984, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.026892705, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.088951738, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.023241053, 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 982, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.061786745, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000062919 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 630928 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2291, 2024-05-20T17:48:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2271, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 195091660, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 803032, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.330538744, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.065893982, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.179069646, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.080476034, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2270, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.095290864, 2024-05-20T17:48:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041978 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1532640, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 178480 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-20T17:48:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6454, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.213307688, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000033050 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-20T17:48:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-20T17:48:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 84394, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 17795, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 66599, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 58972, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-20T17:48:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-05-20T17:48:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:48:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-20T17:48:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-20T17:48:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 157052, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 141, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 14, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-20T17:48:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 164816064, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 577733690, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 577724459, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 157052 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 29552, 2024-05-20T17:48:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 121305, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 91753, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 818, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 3116, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 2298, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 84394, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 182731, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 98337, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 309232, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215444 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-20T17:48:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.634 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.636 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-20T17:48:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.637 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.638 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-20T17:48:30.639 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.640 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.641 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.642 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.643 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.644 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 5, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 3, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 4, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3588, 2024-05-20T17:48:30.646 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:30.647 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:30.648 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:30.649 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 1352079, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 30131, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8408, 2024-05-20T17:48:30.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 178, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 128094096, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 1218248, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-20T17:48:30.651 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 4141, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 4141, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4141, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 27.048346694, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006531839 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4141, 2024-05-20T17:48:30.652 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4142 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 4141, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 4141, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2611, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1528, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-20T17:48:30.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:30.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-20T17:48:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 104, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 19, 2024-05-20T17:48:30.656 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 11, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 11, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-20T17:48:30.657 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:30.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 4471, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 575908057, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 4471, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4471, 2024-05-20T17:48:30.659 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 575908057, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:30.660 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4141, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 573653656, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4141, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 573653656, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.661 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4141, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 4141, 2024-05-20T17:48:30.662 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4141, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4141, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:30.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:30.664 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55b340e42b60": { 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:30.665 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:30.666 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-20T17:48:31.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:31 smithi172 ceph-mon[36511]: pgmap v474: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-20T17:48:31.793 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-20T17:48:31.793 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-20T17:48:31.793 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-20T17:48:31.794 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-20T17:48:31.794 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-05-20T17:48:31.794 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-05-20T17:48:31.794 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-05-20T17:48:31.794 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-05-20T17:48:31.794 DEBUG:tasks.check_counter:Getting stats from i 2024-05-20T17:48:31.794 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-20T17:48:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:31 smithi135 ceph-mon[32027]: pgmap v474: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-20T17:48:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:31 smithi160 ceph-mon[36261]: pgmap v474: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-20T17:48:32.262 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:48:33.739 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:33 smithi172 ceph-mon[36511]: pgmap v475: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-20T17:48:33.739 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:33 smithi172 ceph-mon[36511]: osdmap e105: 12 total, 12 up, 12 in 2024-05-20T17:48:33.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:33 smithi135 ceph-mon[32027]: pgmap v475: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-20T17:48:33.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:33 smithi135 ceph-mon[32027]: osdmap e105: 12 total, 12 up, 12 in 2024-05-20T17:48:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:33 smithi160 ceph-mon[36261]: pgmap v475: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-20T17:48:34.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:33 smithi160 ceph-mon[36261]: osdmap e105: 12 total, 12 up, 12 in 2024-05-20T17:48:34.300 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-20T17:48:34.300 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 59710, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 62114, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 32502907, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 218410323, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 22, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 4.431264182, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.777827882, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 2.147937358, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.816533399, 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:34.301 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 62108, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.928976388, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000272573 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 84169, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.014410253, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000171 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1856, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 1712 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.302 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 62210, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 50356, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 81964039, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 260353287, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 4.497903295, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.760285709, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 2.338347229, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.909172333, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 50360, 2024-05-20T17:48:34.303 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.633335670, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000211146 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 81440, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.013226818, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000162 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1547312, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 442816 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 311908, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 499771, 2024-05-20T17:48:34.304 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 125096570, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 545678418, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 21.778197002, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 9.741836318, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 520.892241320, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.850818306, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 499768, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 72.426265263, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000144919 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.305 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 673069, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.132485731, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000196 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 113798432, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 273106064 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9521, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 148.381353439, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.015584639 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 48865, 2024-05-20T17:48:34.307 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 14.481960554, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000296366 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 169083, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 160485, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 160485, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3633.688725743, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.022641921 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-20T17:48:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 8582, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 565, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 1633, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 126, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 44917, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 6837, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 28235, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 9845, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 35147, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 110996, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-20T17:48:34.309 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 4, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 290663, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 247837, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 8093, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 974, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 239, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 1218, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-20T17:48:34.310 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 163, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 84206, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 266, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 82368, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 1135, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3303, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 69246880, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 1135, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:48:34.311 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 1135, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 427, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 24722, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 60389, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 78906, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 37116, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 1541, 2024-05-20T17:48:34.312 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 63219 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 2705, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 6685, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 3981, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 5070, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 4261, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 138, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 27917, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 27780, 2024-05-20T17:48:34.313 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 166, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-20T17:48:34.314 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 127, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 8, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 176444, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 88799, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 86031, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 90413, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 2768, 2024-05-20T17:48:34.315 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 255, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 127, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 122, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 133, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 8, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 5, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 267815126, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 665707931, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3600, 2024-05-20T17:48:34.316 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 268.276753299, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.074521320 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 25193, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 121235, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 96042, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 1029, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 5826, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 4797, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 44917, 2024-05-20T17:48:34.317 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 190089, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 145172, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 68304, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 68304, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 316960, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223636 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 186392, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 6117, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 169083, 2024-05-20T17:48:34.318 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 219, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 17880, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27390, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 248.349243524, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.009067150 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2461, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 144.545289062, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.058734371 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-20T17:48:34.319 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 74768, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2679.259370560, 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.035834305 2024-05-20T17:48:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-20T17:48:34.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 120, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.094768138, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.034123067 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7089, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 58.452910929, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008245579 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.325 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 989, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 8.291032368, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008383248 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27369, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 401.287683996, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014662124 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-20T17:48:34.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 137, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 35.218594248, 2024-05-20T17:48:34.327 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.257070031 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.328 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.329 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 20162, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 54.189832918, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002687721 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.331 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 3, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-05-20T17:48:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 13266, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 13266, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 812, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:34.335 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 2320304, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 24716, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-20T17:48:34.336 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8392, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 177, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 91835448, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 927746, 2024-05-20T17:48:34.337 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 45564, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 701313065, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 28, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 45564, 2024-05-20T17:48:34.338 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 45564, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1915.723718143, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.042044678 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 45564, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 62489 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 45564, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 4118, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 41446, 2024-05-20T17:48:34.339 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 500, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 6413, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 768, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 4373, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 410, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 1, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 123, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 28013, 2024-05-20T17:48:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1149, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 12826, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:48:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-20T17:48:34.342 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 105, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 20, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-20T17:48:34.343 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 4170, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2780, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 963 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 4 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.344 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 10, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 10, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 27780, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 27780, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:34.345 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 433824, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 185683887, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 433824, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 433824, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 185683887, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 45564, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 705027635, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 45564, 2024-05-20T17:48:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 705027635, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-20T17:48:34.348 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 45564, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 45564, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 45564, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 45564, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:48:34.349 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 27780, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 3779660, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 27780, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 771, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3779660, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.350 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55f0cd1ec8f0": { 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 176444, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 661513627, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 176444, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3600, 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 661513627, 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:34.352 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-20T17:48:35.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:35 smithi172 ceph-mon[36511]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:35.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:35 smithi135 ceph-mon[32027]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:36.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:35 smithi160 ceph-mon[36261]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 34 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds.exported=163 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds.imported=266 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2705 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=6685 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-20T17:48:36.015 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=126 2024-05-20T17:48:36.015 DEBUG:tasks.check_counter:Getting stats from l 2024-05-20T17:48:36.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-20T17:48:36.468 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:48:37.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:37 smithi172 ceph-mon[36511]: pgmap v478: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:37.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:37 smithi135 ceph-mon[32027]: pgmap v478: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:38.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:37 smithi160 ceph-mon[36261]: pgmap v478: 97 pgs: 22 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 35 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:48:39.319 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.001122872, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000281863, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.320 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 300, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 290, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1465760, 2024-05-20T17:48:39.321 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 178480, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.053508149, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.015736216, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.040297789, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.007022955, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 289, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.016980097, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000058754 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1465760, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 178480 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 7, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 224, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3504, 2024-05-20T17:48:39.323 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 273136, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.013567501, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.008536952, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.002487766, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 222, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.026225434, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000118132 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3504, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 273136 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-20T17:48:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:48:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:48:39.327 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-20T17:48:39.328 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 147930, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 28, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:48:39.329 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 928, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-20T17:48:39.330 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 303, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1423459, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 303, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-20T17:48:39.331 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 303, 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1423459, 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-20T17:48:39.332 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-20T17:48:39.580 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:39 smithi172 ceph-mon[36511]: pgmap v479: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:39.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:39 smithi135 ceph-mon[32027]: pgmap v479: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-05-20T17:48:40.003 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-05-20T17:48:40.004 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-20T17:48:40.015 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-20T17:48:40.015 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:48:40.016 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:48:40.016 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:39 smithi160 ceph-mon[36261]: pgmap v479: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:40.039 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:48:40.039 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:48:40.098 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:48:40.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 -- 172.21.15.135:0/2559187650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f472810c330 msgr2=0x7f472810e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 --2- 172.21.15.135:0/2559187650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f472810c330 0x7f472810e750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4720009ca0 tx=0x7f472002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 -- 172.21.15.135:0/2559187650 shutdown_connections 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 --2- 172.21.15.135:0/2559187650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f472810c330 0x7f472810e750 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 --2- 172.21.15.135:0/2559187650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4728101aa0 0x7f4728101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 --2- 172.21.15.135:0/2559187650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47281079d0 0x7f4728101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 -- 172.21.15.135:0/2559187650 >> 172.21.15.135:0/2559187650 conn(0x7f47280770c0 msgr2=0x7f4728077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 -- 172.21.15.135:0/2559187650 shutdown_connections 2024-05-20T17:48:40.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.304+0000 7f472d60d640 1 -- 172.21.15.135:0/2559187650 wait complete. 2024-05-20T17:48:40.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.305+0000 7f472d60d640 1 Processor -- start 2024-05-20T17:48:40.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 -- start start 2024-05-20T17:48:40.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 0x7f4728110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 0x7f4728110580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4728112de0 con 0x7f472810c330 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4728112c60 con 0x7f4728101aa0 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f472d60d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4728112f60 con 0x7f47281079d0 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f4726ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f4726ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:42870/0 (socket says 172.21.15.135:42870) 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f4726ffd640 1 -- 172.21.15.135:0/600751483 learned_addr learned my addr 172.21.15.135:0/600751483 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f47267fc640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 0x7f4728110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.306+0000 7f47277fe640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 0x7f4728110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 -- 172.21.15.135:0/600751483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 msgr2=0x7f4728111b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 -- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 msgr2=0x7f4728110580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 0x7f4728110580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 -- 172.21.15.135:0/600751483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4728110da0 con 0x7f47281079d0 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f4726ffd640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47277fe640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 0x7f4728110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.307+0000 7f47267fc640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 0x7f4728110000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f472806b4a0 tx=0x7f471c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.308+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c00cd00 con 0x7f47281079d0 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.308+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f471c010910 con 0x7f47281079d0 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.308+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c00cd00 con 0x7f47281079d0 2024-05-20T17:48:40.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.310+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47281ac160 con 0x7f47281079d0 2024-05-20T17:48:40.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.310+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47281ac630 con 0x7f47281079d0 2024-05-20T17:48:40.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.312+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4728102c80 con 0x7f47281079d0 2024-05-20T17:48:40.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.313+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f471c010ac0 con 0x7f47281079d0 2024-05-20T17:48:40.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.313+0000 7f470ffff640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 0x7f47100a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.314+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7f471c00cb00 con 0x7f47281079d0 2024-05-20T17:48:40.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.314+0000 7f4726ffd640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 0x7f47100a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.315+0000 7f4726ffd640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 0x7f47100a5610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47180095f0 tx=0x7f4718005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:40.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.323+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f471c09c030 con 0x7f47281079d0 2024-05-20T17:48:40.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.628+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f472802d2a0 con 0x7f47281079d0 2024-05-20T17:48:40.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.631+0000 7f470ffff640 1 -- 172.21.15.135:0/600751483 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+23383 (secure 0 0 0) 0x7f471c09b930 con 0x7f47281079d0 2024-05-20T17:48:40.633 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:48:40.633 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":105,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:48:33.272154+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2340719003":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2366951991":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6801/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6800/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3892403253":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3665782068":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:48:40.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.634+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 msgr2=0x7f47100a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.634+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 0x7f47100a5610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47180095f0 tx=0x7f4718005f90 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.634+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 msgr2=0x7f4728110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.634+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 0x7f4728110000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f472806b4a0 tx=0x7f471c00ee50 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 shutdown_connections 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f47100a3100 0x7f47100a5610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f472810c330 0x7f4728110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47281079d0 0x7f4728110000 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 --2- 172.21.15.135:0/600751483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4728101aa0 0x7f4728111b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 >> 172.21.15.135:0/600751483 conn(0x7f47280770c0 msgr2=0x7f4728103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:40.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 shutdown_connections 2024-05-20T17:48:40.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.635+0000 7f472d60d640 1 -- 172.21.15.135:0/600751483 wait complete. 2024-05-20T17:48:40.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:26:32.946212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:31:11.991069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:31:13.334572+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:48:40.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:48:40.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.825+0000 7feaf9206640 1 -- 172.21.15.135:0/555209586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf41079d0 msgr2=0x7feaf4101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.825+0000 7feaf9206640 1 --2- 172.21.15.135:0/555209586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf41079d0 0x7feaf4101560 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feae4009900 tx=0x7feae402a410 comp rx=0 tx=0).stop 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 -- 172.21.15.135:0/555209586 shutdown_connections 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 --2- 172.21.15.135:0/555209586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf410c330 0x7feaf410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 --2- 172.21.15.135:0/555209586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4101aa0 0x7feaf4101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 --2- 172.21.15.135:0/555209586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf41079d0 0x7feaf4101560 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 -- 172.21.15.135:0/555209586 >> 172.21.15.135:0/555209586 conn(0x7feaf40770b0 msgr2=0x7feaf40774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:40.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 -- 172.21.15.135:0/555209586 shutdown_connections 2024-05-20T17:48:40.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.826+0000 7feaf9206640 1 -- 172.21.15.135:0/555209586 wait complete. 2024-05-20T17:48:40.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.827+0000 7feaf9206640 1 Processor -- start 2024-05-20T17:48:40.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.827+0000 7feaf9206640 1 -- start start 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf9206640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf9206640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf41079d0 0x7feaf4197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf9206640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf410c330 0x7feaf4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf9206640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4111ce0 con 0x7feaf4101aa0 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58466/0 (socket says 172.21.15.135:58466) 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf2d9d640 1 -- 172.21.15.135:0/3444757838 learned_addr learned my addr 172.21.15.135:0/3444757838 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.828+0000 7feaf9206640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4111b60 con 0x7feaf41079d0 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf9206640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4111e60 con 0x7feaf410c330 2024-05-20T17:48:40.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf359e640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf410c330 0x7feaf4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf259c640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf41079d0 0x7feaf4197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf2d9d640 1 -- 172.21.15.135:0/3444757838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf410c330 msgr2=0x7feaf4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf2d9d640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf410c330 0x7feaf4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf2d9d640 1 -- 172.21.15.135:0/3444757838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf41079d0 msgr2=0x7feaf4197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf2d9d640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf41079d0 0x7feaf4197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:40.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.829+0000 7feaf2d9d640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf41abea0 con 0x7feaf4101aa0 2024-05-20T17:48:40.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.830+0000 7feaf2d9d640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feae4006010 tx=0x7feae40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.832+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae403f030 con 0x7feaf4101aa0 2024-05-20T17:48:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.832+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feae4003ad0 con 0x7feaf4101aa0 2024-05-20T17:48:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.832+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4035070 con 0x7feaf4101aa0 2024-05-20T17:48:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.833+0000 7feaf9206640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf41ac130 con 0x7feaf4101aa0 2024-05-20T17:48:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.833+0000 7feaf9206640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41ac5d0 con 0x7feaf4101aa0 2024-05-20T17:48:40.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.836+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4102c80 con 0x7feaf4101aa0 2024-05-20T17:48:40.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.838+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7feae4042030 con 0x7feaf4101aa0 2024-05-20T17:48:40.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.839+0000 7feadbfff640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 0x7feadc0a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:40.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.839+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7feae40ef830 con 0x7feaf4101aa0 2024-05-20T17:48:40.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.840+0000 7feaf259c640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 0x7feadc0a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:40.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.842+0000 7feaf259c640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 0x7feadc0a53e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaf410d610 tx=0x7feae8005f90 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:40.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:40.848+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feae40bc380 con 0x7feaf4101aa0 2024-05-20T17:48:41.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.163+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feaf41988e0 con 0x7feaf4101aa0 2024-05-20T17:48:41.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.164+0000 7feadbfff640 1 -- 172.21.15.135:0/3444757838 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7feae40bbc80 con 0x7feaf4101aa0 2024-05-20T17:48:41.172 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-20T17:48:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 msgr2=0x7feadc0a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 0x7feadc0a53e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaf410d610 tx=0x7feae8005f90 comp rx=0 tx=0).stop 2024-05-20T17:48:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 msgr2=0x7feaf4197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feae4006010 tx=0x7feae40040c0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 shutdown_connections 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7feadc0a2ed0 0x7feadc0a53e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf410c330 0x7feaf4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf41079d0 0x7feaf4197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 --2- 172.21.15.135:0/3444757838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101aa0 0x7feaf4197540 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 >> 172.21.15.135:0/3444757838 conn(0x7feaf40770b0 msgr2=0x7feaf4068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.168+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 shutdown_connections 2024-05-20T17:48:41.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.169+0000 7fead9ffb640 1 -- 172.21.15.135:0/3444757838 wait complete. 2024-05-20T17:48:41.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.353+0000 7f59e71e3640 1 -- 172.21.15.135:0/49679463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0107a00 msgr2=0x7f59e01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.353+0000 7f59e71e3640 1 --2- 172.21.15.135:0/49679463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0107a00 0x7f59e01015e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009900 tx=0x7f59cc02a410 comp rx=0 tx=0).stop 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.355+0000 7f59e71e3640 1 -- 172.21.15.135:0/49679463 shutdown_connections 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.355+0000 7f59e71e3640 1 --2- 172.21.15.135:0/49679463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.356+0000 7f59e71e3640 1 --2- 172.21.15.135:0/49679463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0101b20 0x7f59e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.356+0000 7f59e71e3640 1 --2- 172.21.15.135:0/49679463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0107a00 0x7f59e01015e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.356+0000 7f59e71e3640 1 -- 172.21.15.135:0/49679463 >> 172.21.15.135:0/49679463 conn(0x7f59e00770c0 msgr2=0x7f59e0077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:41.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.359+0000 7f59e71e3640 1 -- 172.21.15.135:0/49679463 shutdown_connections 2024-05-20T17:48:41.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.360+0000 7f59e71e3640 1 -- 172.21.15.135:0/49679463 wait complete. 2024-05-20T17:48:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 Processor -- start 2024-05-20T17:48:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 -- start start 2024-05-20T17:48:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 0x7f59e0117550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 0x7f59e0117ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e011d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59e0110c90 con 0x7f59e0101b20 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59e0110b10 con 0x7f59e010c360 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e71e3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59e0110e10 con 0x7f59e0107a00 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 0x7f59e0117ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59e5780640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e011d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 0x7f59e0117ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:50720/0 (socket says 172.21.15.135:50720) 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.361+0000 7f59dffff640 1 -- 172.21.15.135:0/2341912551 learned_addr learned my addr 172.21.15.135:0/2341912551 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:41.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e4f7f640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 0x7f59e0117550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 -- 172.21.15.135:0/2341912551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 msgr2=0x7f59e0117ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 0x7f59e0117ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 -- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 msgr2=0x7f59e0117550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 0x7f59e0117550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 -- 172.21.15.135:0/2341912551 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e011da60 con 0x7f59e010c360 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e4f7f640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 0x7f59e0117550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.362+0000 7f59e5780640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e011d260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59d800be20 tx=0x7f59d800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.363+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8019070 con 0x7f59e010c360 2024-05-20T17:48:41.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.363+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e0112760 con 0x7f59e010c360 2024-05-20T17:48:41.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.363+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d8014920 con 0x7f59e010c360 2024-05-20T17:48:41.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.363+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e0112cd0 con 0x7f59e010c360 2024-05-20T17:48:41.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.364+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d801d950 con 0x7f59e010c360 2024-05-20T17:48:41.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.365+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e0068cc0 con 0x7f59e010c360 2024-05-20T17:48:41.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.367+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f59d801c070 con 0x7f59e010c360 2024-05-20T17:48:41.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.368+0000 7f59ddffb640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 0x7f59d00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.368+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7f59d80ceb90 con 0x7f59e010c360 2024-05-20T17:48:41.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.370+0000 7f59e4f7f640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 0x7f59d00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.371+0000 7f59e4f7f640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 0x7f59d00a5210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc005a20 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.379+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f59d809b200 con 0x7f59e010c360 2024-05-20T17:48:41.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.680+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59e0105ec0 con 0x7f59e010c360 2024-05-20T17:48:41.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.681+0000 7f59ddffb640 1 -- 172.21.15.135:0/2341912551 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) ==== 104+0+11 (secure 0 0 0) 0x7f59d809f500 con 0x7f59e010c360 2024-05-20T17:48:41.682 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-20T17:48:41.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.683+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 msgr2=0x7f59d00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.683+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 0x7f59d00a5210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc005a20 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.683+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 msgr2=0x7f59e011d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e011d260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59d800be20 tx=0x7f59d800bf10 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 shutdown_connections 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f59d00a2d00 0x7f59d00a5210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e010c360 0x7f59e011d260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e0107a00 0x7f59e0117ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 --2- 172.21.15.135:0/2341912551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59e0101b20 0x7f59e0117550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 >> 172.21.15.135:0/2341912551 conn(0x7f59e00770c0 msgr2=0x7f59e0103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 shutdown_connections 2024-05-20T17:48:41.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.684+0000 7f59e71e3640 1 -- 172.21.15.135:0/2341912551 wait complete. 2024-05-20T17:48:41.705 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:48:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:41 smithi172 ceph-mon[36511]: pgmap v480: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:41 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/600751483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:41.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:41 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/3444757838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:48:41.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.880+0000 7fb93e79d640 1 -- 172.21.15.135:0/1400582803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93810d260 msgr2=0x7fb93810f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.880+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1400582803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93810d260 0x7fb93810f680 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb930009ca0 tx=0x7fb93002a8e0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.882+0000 7fb93e79d640 1 -- 172.21.15.135:0/1400582803 shutdown_connections 2024-05-20T17:48:41.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.882+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1400582803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93810d260 0x7fb93810f680 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.882+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1400582803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938100ea0 0x7fb9381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.882+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1400582803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb938108960 0x7fb938100960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.882+0000 7fb93e79d640 1 -- 172.21.15.135:0/1400582803 >> 172.21.15.135:0/1400582803 conn(0x7fb938076730 msgr2=0x7fb938076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:41.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.883+0000 7fb93e79d640 1 -- 172.21.15.135:0/1400582803 shutdown_connections 2024-05-20T17:48:41.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.884+0000 7fb93e79d640 1 -- 172.21.15.135:0/1400582803 wait complete. 2024-05-20T17:48:41.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.884+0000 7fb93e79d640 1 Processor -- start 2024-05-20T17:48:41.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.884+0000 7fb93e79d640 1 -- start start 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 0x7fb938197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 0x7fb93819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb938110b30 con 0x7fb938100ea0 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9381109b0 con 0x7fb938108960 2024-05-20T17:48:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93e79d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb938110cb0 con 0x7fb93810d260 2024-05-20T17:48:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93d79b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93d79b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58492/0 (socket says 172.21.15.135:58492) 2024-05-20T17:48:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93d79b640 1 -- 172.21.15.135:0/1787566461 learned_addr learned my addr 172.21.15.135:0/1787566461 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93cf9a640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 0x7fb938197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.885+0000 7fb93df9c640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 0x7fb93819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 -- 172.21.15.135:0/1787566461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 msgr2=0x7fb93819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 0x7fb93819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 -- 172.21.15.135:0/1787566461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 msgr2=0x7fb938197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 0x7fb938197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 -- 172.21.15.135:0/1787566461 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93819c290 con 0x7fb938100ea0 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93cf9a640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 0x7fb938197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:48:41.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93df9c640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 0x7fb93819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb93d79b640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b470 tx=0x7fb92800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928015020 con 0x7fb938100ea0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb928011d70 con 0x7fb938100ea0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.886+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92800f340 con 0x7fb938100ea0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.887+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93819c580 con 0x7fb938100ea0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.887+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93819ca80 con 0x7fb938100ea0 2024-05-20T17:48:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.888+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb938068fe0 con 0x7fb938100ea0 2024-05-20T17:48:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.890+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fb928018020 con 0x7fb938100ea0 2024-05-20T17:48:41.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.890+0000 7fb92e7fc640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 0x7fb9240a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:41.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.891+0000 7fb93cf9a640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 0x7fb9240a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:41.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.891+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7fb9280cedd0 con 0x7fb938100ea0 2024-05-20T17:48:41.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.891+0000 7fb93cf9a640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 0x7fb9240a9610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb93810e760 tx=0x7fb93400b390 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:41.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:41.899+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb93819ca80 con 0x7fb938100ea0 2024-05-20T17:48:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:41 smithi135 ceph-mon[32027]: pgmap v480: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:41 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/600751483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:41.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:41 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/3444757838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:41 smithi160 ceph-mon[36261]: pgmap v480: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:41 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/600751483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:42.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:41 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/3444757838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.194+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb938106d50 con 0x7fb938100ea0 2024-05-20T17:48:42.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.195+0000 7fb92e7fc640 1 -- 172.21.15.135:0/1787566461 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) ==== 100+0+11 (secure 0 0 0) 0x7fb92801f020 con 0x7fb938100ea0 2024-05-20T17:48:42.196 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-20T17:48:42.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 msgr2=0x7fb9240a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 0x7fb9240a9610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb93810e760 tx=0x7fb93400b390 comp rx=0 tx=0).stop 2024-05-20T17:48:42.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 msgr2=0x7fb938197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b470 tx=0x7fb92800b930 comp rx=0 tx=0).stop 2024-05-20T17:48:42.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 shutdown_connections 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fb9240a7100 0x7fb9240a9610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb93810d260 0x7fb93819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938108960 0x7fb938197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 --2- 172.21.15.135:0/1787566461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb938100ea0 0x7fb938197430 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 >> 172.21.15.135:0/1787566461 conn(0x7fb938076730 msgr2=0x7fb938103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 shutdown_connections 2024-05-20T17:48:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.198+0000 7fb93e79d640 1 -- 172.21.15.135:0/1787566461 wait complete. 2024-05-20T17:48:42.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:48:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.373+0000 7fe538bd5640 1 -- 172.21.15.135:0/2980064816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 msgr2=0x7fe534101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.373+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2980064816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe534101eb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe528009900 tx=0x7fe52802a410 comp rx=0 tx=0).stop 2024-05-20T17:48:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 -- 172.21.15.135:0/2980064816 shutdown_connections 2024-05-20T17:48:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2980064816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe53410c330 0x7fe53410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2980064816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe534101eb0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2980064816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5341079d0 0x7fe534101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 -- 172.21.15.135:0/2980064816 >> 172.21.15.135:0/2980064816 conn(0x7fe5340770b0 msgr2=0x7fe5340774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:42.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 -- 172.21.15.135:0/2980064816 shutdown_connections 2024-05-20T17:48:42.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.374+0000 7fe538bd5640 1 -- 172.21.15.135:0/2980064816 wait complete. 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 Processor -- start 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 -- start start 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5341079d0 0x7fe53410b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe53410c330 0x7fe5341a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe534110a00 con 0x7fe534101aa0 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe534110880 con 0x7fe53410c330 2024-05-20T17:48:42.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe538bd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe534110b80 con 0x7fe5341079d0 2024-05-20T17:48:42.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe53259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:42.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe53259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58502/0 (socket says 172.21.15.135:58502) 2024-05-20T17:48:42.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe53259c640 1 -- 172.21.15.135:0/2456944358 learned_addr learned my addr 172.21.15.135:0/2456944358 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.375+0000 7fe531d9b640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5341079d0 0x7fe53410b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe532d9d640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe53410c330 0x7fe5341a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 -- 172.21.15.135:0/2456944358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5341079d0 msgr2=0x7fe53410b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5341079d0 0x7fe53410b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 -- 172.21.15.135:0/2456944358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe53410c330 msgr2=0x7fe5341a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe53410c330 0x7fe5341a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 -- 172.21.15.135:0/2456944358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5341a4c20 con 0x7fe534101aa0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe53259c640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00ea50 tx=0x7fe52c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00cdc0 con 0x7fe534101aa0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe52c005020 con 0x7fe534101aa0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5341a4f10 con 0x7fe534101aa0 2024-05-20T17:48:42.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.376+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0226a0 con 0x7fe534101aa0 2024-05-20T17:48:42.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.377+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341a5430 con 0x7fe534101aa0 2024-05-20T17:48:42.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.378+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe534102c80 con 0x7fe534101aa0 2024-05-20T17:48:42.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.382+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe52c005540 con 0x7fe534101aa0 2024-05-20T17:48:42.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.383+0000 7fe5237fe640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 0x7fe51c0a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:42.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.383+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7fe52c0e0730 con 0x7fe534101aa0 2024-05-20T17:48:42.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.383+0000 7fe531d9b640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 0x7fe51c0a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:42.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.384+0000 7fe531d9b640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 0x7fe51c0a5310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe528004770 tx=0x7fe528005fd0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:42.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.387+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe52c027030 con 0x7fe534101aa0 2024-05-20T17:48:42.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.703+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe534069f50 con 0x7fe534101aa0 2024-05-20T17:48:42.704 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2340719003 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2366951991 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/3106262554 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/3106262554 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2777149070 2024-05-21T17:24:06.618654+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2727321726 2024-05-21T17:24:06.618654+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/45942653 2024-05-21T17:24:06.618654+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/700489570 2024-05-21T17:23:40.271295+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3892403253 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2923289945 2024-05-21T17:23:40.271295+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/45942653 2024-05-21T17:24:06.618654+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/3053430682 2024-05-21T17:23:40.271295+0000 2024-05-20T17:48:42.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/3053430682 2024-05-21T17:23:40.271295+0000 2024-05-20T17:48:42.706 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3033784790 2024-05-21T17:23:40.271295+0000 2024-05-20T17:48:42.706 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3665782068 2024-05-21T17:33:19.780332+0000 2024-05-20T17:48:42.706 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3446450726 2024-05-21T17:24:06.618654+0000 2024-05-20T17:48:42.706 INFO:teuthology.orchestra.run.smithi135.stderr:listed 16 entries 2024-05-20T17:48:42.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.704+0000 7fe5237fe640 1 -- 172.21.15.135:0/2456944358 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v105) ==== 81+0+957 (secure 0 0 0) 0x7fe52c0acc30 con 0x7fe534101aa0 2024-05-20T17:48:42.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 msgr2=0x7fe51c0a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 0x7fe51c0a5310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe528004770 tx=0x7fe528005fd0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 msgr2=0x7fe53410b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:42.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00ea50 tx=0x7fe52c00ef10 comp rx=0 tx=0).stop 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 shutdown_connections 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe51c0a2e00 0x7fe51c0a5310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe53410c330 0x7fe5341a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5341079d0 0x7fe53410b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 --2- 172.21.15.135:0/2456944358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe534101aa0 0x7fe53410b250 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:42.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 >> 172.21.15.135:0/2456944358 conn(0x7fe5340770b0 msgr2=0x7fe534100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:42.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 shutdown_connections 2024-05-20T17:48:42.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:42.707+0000 7fe538bd5640 1 -- 172.21.15.135:0/2456944358 wait complete. 2024-05-20T17:48:42.723 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:48:42.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:42.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:48:42.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2341912551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.807 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:42 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1787566461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.808 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T17:48:42.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:42.808 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:48:42.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2341912551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:42 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1787566461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:48:42.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:42.858 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-20T17:48:42.907 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:48:42.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:42.908 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:48:42.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:42.992 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-20T17:48:43.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2341912551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:48:43.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:42 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1787566461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:48:43.092 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-20T17:48:43.092 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-20T17:48:43.092 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:48:43.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19605 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/46af6d4a1f4b0cdb576c99d7a2e815f58725de602f57225493ddcab9a53f12cf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/46af6d4a1f4b0cdb576c99d7a2e815f58725de602f57225493ddcab9a53f12cf/diff,workdir=/var/lib/containers/storage/overlay/46af6d4a1f4b0cdb576c99d7a2e815f58725de602f57225493ddcab9a53f12cf/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c286aa19cc9ed1e156ed3e5dfd7e79790f1d157b28453dbe886c04afbd75a9c5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/c286aa19cc9ed1e156ed3e5dfd7e79790f1d157b28453dbe886c04afbd75a9c5/diff,workdir=/var/lib/containers/storage/overlay/c286aa19cc9ed1e156ed3e5dfd7e79790f1d157b28453dbe886c04afbd75a9c5/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/96e515699e3b887c3a75216cffad4206c1142979bb566fd8da99805385978339/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/96e515699e3b887c3a75216cffad4206c1142979bb566fd8da99805385978339/diff,workdir=/var/lib/containers/storage/overlay/96e515699e3b887c3a75216cffad4206c1142979bb566fd8da99805385978339/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/39223b06480ac613b1dcc25e2971b6f93781544a7e9e7c90520e7cb344dddcfd/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/39223b06480ac613b1dcc25e2971b6f93781544a7e9e7c90520e7cb344dddcfd/diff,workdir=/var/lib/containers/storage/overlay/39223b06480ac613b1dcc25e2971b6f93781544a7e9e7c90520e7cb344dddcfd/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/13c6e5ea406465c8336f5d9a2f148c1f9ca089cf9b45743193ea65a462d91da8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/13c6e5ea406465c8336f5d9a2f148c1f9ca089cf9b45743193ea65a462d91da8/diff,workdir=/var/lib/containers/storage/overlay/13c6e5ea406465c8336f5d9a2f148c1f9ca089cf9b45743193ea65a462d91da8/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dac1cb64b2947481722bdb1d8d1a4038749e142e31d7e50079c4f9d92ab91ef8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/dac1cb64b2947481722bdb1d8d1a4038749e142e31d7e50079c4f9d92ab91ef8/diff,workdir=/var/lib/containers/storage/overlay/dac1cb64b2947481722bdb1d8d1a4038749e142e31d7e50079c4f9d92ab91ef8/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9afb0613bd8a530949e76e5e142213a4ad927e27f49f98907e28dbbdd0844456/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/9afb0613bd8a530949e76e5e142213a4ad927e27f49f98907e28dbbdd0844456/diff,workdir=/var/lib/containers/storage/overlay/9afb0613bd8a530949e76e5e142213a4ad927e27f49f98907e28dbbdd0844456/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0b953dc9fe149f0d8d0a6d76f1aaa2d10c2635561528de9b0a6bef3925793915/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/0b953dc9fe149f0d8d0a6d76f1aaa2d10c2635561528de9b0a6bef3925793915/diff,workdir=/var/lib/containers/storage/overlay/0b953dc9fe149f0d8d0a6d76f1aaa2d10c2635561528de9b0a6bef3925793915/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d26b45ce7e24286837276d9fcd7c9acb8e9897d54d7cd89cb105a820fd471327/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/d26b45ce7e24286837276d9fcd7c9acb8e9897d54d7cd89cb105a820fd471327/diff,workdir=/var/lib/containers/storage/overlay/d26b45ce7e24286837276d9fcd7c9acb8e9897d54d7cd89cb105a820fd471327/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c578badbb845a15d3a8b5ab3cd1c32842869b1ac5e11b828911f9f4782703bc7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MZUBUYSRMYGETZLOJUAEFOCE7V:/var/lib/containers/storage/overlay/l/PTSYMXSGFIKU3SM6DGDXCDAYA3,upperdir=/var/lib/containers/storage/overlay/c578badbb845a15d3a8b5ab3cd1c32842869b1ac5e11b828911f9f4782703bc7/diff,workdir=/var/lib/containers/storage/overlay/c578badbb845a15d3a8b5ab3cd1c32842869b1ac5e11b828911f9f4782703bc7/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 2024-05-20T17:48:43.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:43.147 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-20T17:48:43.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:48:43.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-20T17:48:43.276 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-05-20T17:48:43.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:48:43.278 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-20T17:48:43.290 INFO:tasks.cephadm:Teardown begin 2024-05-20T17:48:43.290 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:48:43.290 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:48:43.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.529+0000 7f0d9e214640 1 -- 172.21.15.135:0/3475420261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 msgr2=0x7f0d98109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:43.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.529+0000 7f0d9e214640 1 --2- 172.21.15.135:0/3475420261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d98109470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c01a910 tx=0x7f0d8c03b4e0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.537+0000 7f0d9e214640 1 -- 172.21.15.135:0/3475420261 shutdown_connections 2024-05-20T17:48:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.537+0000 7f0d9e214640 1 --2- 172.21.15.135:0/3475420261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d9811e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.537+0000 7f0d9e214640 1 --2- 172.21.15.135:0/3475420261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 0x7f0d9811bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.537+0000 7f0d9e214640 1 --2- 172.21.15.135:0/3475420261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d98109470 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.537+0000 7f0d9e214640 1 -- 172.21.15.135:0/3475420261 >> 172.21.15.135:0/3475420261 conn(0x7f0d9806d760 msgr2=0x7f0d9806dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:43.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.545+0000 7f0d9e214640 1 -- 172.21.15.135:0/3475420261 shutdown_connections 2024-05-20T17:48:43.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.549+0000 7f0d9e214640 1 -- 172.21.15.135:0/3475420261 wait complete. 2024-05-20T17:48:43.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.549+0000 7f0d9e214640 1 Processor -- start 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 -- start start 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d981153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 0x7f0d98115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d98115e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98113940 con 0x7f0d98109060 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981137c0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.552+0000 7f0d9e214640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98113ac0 con 0x7f0d98119770 2024-05-20T17:48:43.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.555+0000 7f0d977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d981153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:43.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.555+0000 7f0d977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d981153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58524/0 (socket says 172.21.15.135:58524) 2024-05-20T17:48:43.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.555+0000 7f0d977fe640 1 -- 172.21.15.135:0/1737820016 learned_addr learned my addr 172.21.15.135:0/1737820016 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:43.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.557+0000 7f0d97fff640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d98115e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:43.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.557+0000 7f0d96ffd640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 0x7f0d98115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:43.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.564+0000 7f0d97fff640 1 -- 172.21.15.135:0/1737820016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 msgr2=0x7f0d98115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:43.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.564+0000 7f0d97fff640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 0x7f0d98115930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.564+0000 7f0d97fff640 1 -- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 msgr2=0x7f0d981153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:43.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.564+0000 7f0d97fff640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d981153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:43.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.564+0000 7f0d97fff640 1 -- 172.21.15.135:0/1737820016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d981abfa0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.567+0000 7f0d97fff640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d98115e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e970 tx=0x7f0d8800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:43.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.571+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800ccc0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.571+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d88005020 con 0x7f0d9811c0d0 2024-05-20T17:48:43.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.571+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88004a00 con 0x7f0d9811c0d0 2024-05-20T17:48:43.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.573+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d981ac170 con 0x7f0d9811c0d0 2024-05-20T17:48:43.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.573+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d981ac610 con 0x7f0d9811c0d0 2024-05-20T17:48:43.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.576+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d84005290 con 0x7f0d9811c0d0 2024-05-20T17:48:43.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.584+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f0d88004ba0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.585+0000 7f0d94ff9640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 0x7f0d800a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:43.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.585+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7f0d880cf3a0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.586+0000 7f0d977fe640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 0x7f0d800a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:43.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.586+0000 7f0d977fe640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 0x7f0d800a5410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000c00 tx=0x7f0d8c01a5d0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:43.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:43.594+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0d8809bef0 con 0x7f0d9811c0d0 2024-05-20T17:48:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:43 smithi135 ceph-mon[32027]: pgmap v481: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:43 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2456944358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:48:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:43 smithi172 ceph-mon[36511]: pgmap v481: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:43 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2456944358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:48:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:43 smithi160 ceph-mon[36261]: pgmap v481: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-20T17:48:44.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:43 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2456944358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:48:44.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.018+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d84005850 con 0x7f0d9811c0d0 2024-05-20T17:48:44.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.020+0000 7f0d94ff9640 1 -- 172.21.15.135:0/1737820016 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11895 (secure 0 0 0) 0x7f0d8809b7f0 con 0x7f0d9811c0d0 2024-05-20T17:48:44.021 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:48:44.021 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:39:06.432873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":72,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":72,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:48:44.021 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 30 2024-05-20T17:48:44.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.027+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 msgr2=0x7f0d800a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.027+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 0x7f0d800a5410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000c00 tx=0x7f0d8c01a5d0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.027+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 msgr2=0x7f0d98115e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.027+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d98115e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e970 tx=0x7f0d8800ee30 comp rx=0 tx=0).stop 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 shutdown_connections 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f0d800a2f00 0x7f0d800a5410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9811c0d0 0x7f0d98115e70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d98119770 0x7f0d98115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 --2- 172.21.15.135:0/1737820016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d98109060 0x7f0d981153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 >> 172.21.15.135:0/1737820016 conn(0x7f0d9806d760 msgr2=0x7f0d98119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:44.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 shutdown_connections 2024-05-20T17:48:44.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.028+0000 7f0d9e214640 1 -- 172.21.15.135:0/1737820016 wait complete. 2024-05-20T17:48:44.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:48:44.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.230+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/789148653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c74119770 msgr2=0x7f1c7411bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.230+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/789148653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c74119770 0x7f1c7411bb90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009900 tx=0x7f1c6802a490 comp rx=0 tx=0).stop 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/789148653 shutdown_connections 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/789148653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7411c0d0 0x7f1c7411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/789148653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c74119770 0x7f1c7411bb90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/789148653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74109060 0x7f1c74109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/789148653 >> 172.21.15.135:0/789148653 conn(0x7f1c7406d760 msgr2=0x7f1c7406dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:44.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/789148653 shutdown_connections 2024-05-20T17:48:44.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.233+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/789148653 wait complete. 2024-05-20T17:48:44.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.234+0000 7f1c7aa5a640 1 Processor -- start 2024-05-20T17:48:44.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 -- start start 2024-05-20T17:48:44.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74109060 0x7f1c741191e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 0x7f1c74112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c74121ce0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c74121b60 con 0x7f1c74119770 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.235+0000 7f1c7aa5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c74121e60 con 0x7f1c74109060 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c737fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 0x7f1c74112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58534/0 (socket says 172.21.15.135:58534) 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c737fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 0x7f1c74112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:42954/0 (socket says 172.21.15.135:42954) 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 -- 172.21.15.135:0/1928833162 learned_addr learned my addr 172.21.15.135:0/1928833162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c73fff640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74109060 0x7f1c741191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 -- 172.21.15.135:0/1928833162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74109060 msgr2=0x7f1c741191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74109060 0x7f1c741191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 -- 172.21.15.135:0/1928833162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 msgr2=0x7f1c74112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 0x7f1c74112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.236+0000 7f1c78ff7640 1 -- 172.21.15.135:0/1928833162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c74116d00 con 0x7f1c7411c0d0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.237+0000 7f1c78ff7640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009fd0 tx=0x7f1c6400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.238+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64011830 con 0x7f1c7411c0d0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.238+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c64016070 con 0x7f1c7411c0d0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.238+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400f2e0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.238+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c74116ff0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.238+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c741174c0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.240+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c60005290 con 0x7f1c7411c0d0 2024-05-20T17:48:44.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.243+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f1c640119d0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.244+0000 7f1c717fa640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 0x7f1c5c0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.244+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7f1c640ce8d0 con 0x7f1c7411c0d0 2024-05-20T17:48:44.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.250+0000 7f1c73fff640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 0x7f1c5c0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.252+0000 7f1c73fff640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 0x7f1c5c0a5410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c74113b50 tx=0x7f1c6c0094f0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.254+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c6409b530 con 0x7f1c7411c0d0 2024-05-20T17:48:44.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.627+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c60005850 con 0x7f1c7411c0d0 2024-05-20T17:48:44.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.628+0000 7f1c717fa640 1 -- 172.21.15.135:0/1928833162 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11895 (secure 0 0 0) 0x7f1c6409ae30 con 0x7f1c7411c0d0 2024-05-20T17:48:44.629 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:48:44.630 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/185728746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":185728746},{"type":"v1","addr":"172.21.15.135:6835","nonce":185728746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/456498361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":456498361},{"type":"v1","addr":"172.21.15.135:6837","nonce":456498361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2845322204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2845322204},{"type":"v1","addr":"172.21.15.135:6839","nonce":2845322204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/2294779524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":2294779524},{"type":"v1","addr":"172.21.15.135:6841","nonce":2294779524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2047222973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2047222973},{"type":"v1","addr":"172.21.15.172:6833","nonce":2047222973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3469044918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3469044918},{"type":"v1","addr":"172.21.15.160:6833","nonce":3469044918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:31:14.132666+0000","modified":"2024-05-20T17:39:06.432873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24523,"mds_2":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/3094095088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3094095088},{"type":"v1","addr":"172.21.15.172:6835","nonce":3094095088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/4160320010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4160320010},{"type":"v1","addr":"172.21.15.160:6835","nonce":4160320010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/3276473516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3276473516},{"type":"v1","addr":"172.21.15.172:6837","nonce":3276473516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":72,"addr":"172.21.15.160:6837/320557399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":320557399},{"type":"v1","addr":"172.21.15.160:6837","nonce":320557399}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":72,"addr":"172.21.15.172:6839/380136788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":380136788},{"type":"v1","addr":"172.21.15.172:6839","nonce":380136788}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6839/1255615526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1255615526},{"type":"v1","addr":"172.21.15.160:6839","nonce":1255615526}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24521,24523,24560]},"id":1}]} 2024-05-20T17:48:44.630 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 30 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 msgr2=0x7f1c5c0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 0x7f1c5c0a5410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c74113b50 tx=0x7f1c6c0094f0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 msgr2=0x7f1c74112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009fd0 tx=0x7f1c6400b8e0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 shutdown_connections 2024-05-20T17:48:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f1c5c0a2f00 0x7f1c5c0a5410 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7411c0d0 0x7f1c74112a20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c74119770 0x7f1c74112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 --2- 172.21.15.135:0/1928833162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74109060 0x7f1c741191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 >> 172.21.15.135:0/1928833162 conn(0x7f1c7406d760 msgr2=0x7f1c74119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 shutdown_connections 2024-05-20T17:48:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.632+0000 7f1c7aa5a640 1 -- 172.21.15.135:0/1928833162 wait complete. 2024-05-20T17:48:44.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:48:44.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f28653fb640 1 -- 172.21.15.135:0/1073110886 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c009b40 con 0x7f28601079d0 2024-05-20T17:48:44.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 -- 172.21.15.135:0/1073110886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28601079d0 msgr2=0x7f2860101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 --2- 172.21.15.135:0/1073110886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28601079d0 0x7f2860101560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f285c0108e0 tx=0x7f285c02e2e0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 -- 172.21.15.135:0/1073110886 shutdown_connections 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 --2- 172.21.15.135:0/1073110886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 0x7f286010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 --2- 172.21.15.135:0/1073110886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2860101aa0 0x7f2860101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 --2- 172.21.15.135:0/1073110886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28601079d0 0x7f2860101560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.813+0000 7f2868661640 1 -- 172.21.15.135:0/1073110886 >> 172.21.15.135:0/1073110886 conn(0x7f28600770c0 msgr2=0x7f2860077500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.814+0000 7f2865bfc640 1 --2- 172.21.15.135:0/1073110886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2860101aa0 0x7f2860101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:48:44.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.814+0000 7f2868661640 1 -- 172.21.15.135:0/1073110886 shutdown_connections 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.816+0000 7f2868661640 1 -- 172.21.15.135:0/1073110886 wait complete. 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.817+0000 7f2868661640 1 Processor -- start 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.817+0000 7f2868661640 1 -- start start 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28601079d0 0x7f28600736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 0x7f286006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2860119490 con 0x7f28601079d0 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2860119310 con 0x7f286010c330 2024-05-20T17:48:44.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2868661640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2860119610 con 0x7f286006cd20 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2866bfe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.818+0000 7f2866bfe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.135:50790/0 (socket says 172.21.15.135:50790) 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 -- 172.21.15.135:0/948703730 learned_addr learned my addr 172.21.15.135:0/948703730 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2865bfc640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 0x7f286006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 -- 172.21.15.135:0/948703730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 msgr2=0x7f286006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 0x7f286006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 -- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28601079d0 msgr2=0x7f28600736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28601079d0 0x7f28600736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.819+0000 7f2866bfe640 1 -- 172.21.15.135:0/948703730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28600713a0 con 0x7f286006cd20 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.820+0000 7f2866bfe640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f285800eaa0 tx=0x7f285800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.820+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800cdb0 con 0x7f286006cd20 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.820+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2858005020 con 0x7f286006cd20 2024-05-20T17:48:44.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.820+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28580116b0 con 0x7f286006cd20 2024-05-20T17:48:44.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.821+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2860071690 con 0x7f286006cd20 2024-05-20T17:48:44.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.821+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2860071b60 con 0x7f286006cd20 2024-05-20T17:48:44.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.822+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2860102c80 con 0x7f286006cd20 2024-05-20T17:48:44.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.825+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2858005560 con 0x7f286006cd20 2024-05-20T17:48:44.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.826+0000 7f28577fe640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 0x7f284c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:44.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.826+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7f28580cfe70 con 0x7f286006cd20 2024-05-20T17:48:44.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.826+0000 7f28663fd640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 0x7f284c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:44.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.827+0000 7f28663fd640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 0x7f284c0a5360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f285c010670 tx=0x7f285c009ed0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:44.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:44 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1737820016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:44.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:44.832+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f285801f020 con 0x7f286006cd20 2024-05-20T17:48:44.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:44 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1737820016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:44 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1737820016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.127+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2860069f50 con 0x7f286006cd20 2024-05-20T17:48:45.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.130+0000 7f28577fe640 1 -- 172.21.15.135:0/948703730 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+23383 (secure 0 0 0) 0x7f2858016030 con 0x7f286006cd20 2024-05-20T17:48:45.131 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-20T17:48:45.132 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":105,"fsid":"76c4e726-16cd-11ef-bc9a-c7b262605968","created":"2024-05-20T17:23:02.934506+0000","modified":"2024-05-20T17:48:33.272154+0000","last_up_change":"2024-05-20T17:30:23.202522+0000","last_in_change":"2024-05-20T17:30:03.865447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:26:32.946212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:31:11.991069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:31:13.334572+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2c2f64d8-041a-4069-ac15-ee66c1c8566e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6803","nonce":2987635953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6805","nonce":2987635953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6809","nonce":2987635953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2987635953},{"type":"v1","addr":"172.21.15.135:6807","nonce":2987635953}]},"public_addr":"172.21.15.135:6803/2987635953","cluster_addr":"172.21.15.135:6805/2987635953","heartbeat_back_addr":"172.21.15.135:6809/2987635953","heartbeat_front_addr":"172.21.15.135:6807/2987635953","state":["exists","up"]},{"osd":1,"uuid":"b6293c0f-9f2a-42bc-9625-0b20b435ccad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2448318206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2448318206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2448318206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2448318206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2448318206}]},"public_addr":"172.21.15.160:6801/2448318206","cluster_addr":"172.21.15.160:6803/2448318206","heartbeat_back_addr":"172.21.15.160:6807/2448318206","heartbeat_front_addr":"172.21.15.160:6805/2448318206","state":["exists","up"]},{"osd":2,"uuid":"70accd73-e32c-49e3-b39e-57fe0ec0feeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6801","nonce":1279158957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6803","nonce":1279158957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6807","nonce":1279158957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1279158957},{"type":"v1","addr":"172.21.15.172:6805","nonce":1279158957}]},"public_addr":"172.21.15.172:6801/1279158957","cluster_addr":"172.21.15.172:6803/1279158957","heartbeat_back_addr":"172.21.15.172:6807/1279158957","heartbeat_front_addr":"172.21.15.172:6805/1279158957","state":["exists","up"]},{"osd":3,"uuid":"2b46ffe6-ac15-448e-b812-4c6971b5f472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6811","nonce":3128080158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6813","nonce":3128080158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6817","nonce":3128080158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3128080158},{"type":"v1","addr":"172.21.15.135:6815","nonce":3128080158}]},"public_addr":"172.21.15.135:6811/3128080158","cluster_addr":"172.21.15.135:6813/3128080158","heartbeat_back_addr":"172.21.15.135:6817/3128080158","heartbeat_front_addr":"172.21.15.135:6815/3128080158","state":["exists","up"]},{"osd":4,"uuid":"29001f18-bab2-47ab-b41e-20cdb7f07e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6809","nonce":3098243466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6811","nonce":3098243466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6815","nonce":3098243466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3098243466},{"type":"v1","addr":"172.21.15.160:6813","nonce":3098243466}]},"public_addr":"172.21.15.160:6809/3098243466","cluster_addr":"172.21.15.160:6811/3098243466","heartbeat_back_addr":"172.21.15.160:6815/3098243466","heartbeat_front_addr":"172.21.15.160:6813/3098243466","state":["exists","up"]},{"osd":5,"uuid":"cc6409a5-0a57-4e8a-8022-5a724f80b78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6809","nonce":1955442624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6811","nonce":1955442624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6815","nonce":1955442624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1955442624},{"type":"v1","addr":"172.21.15.172:6813","nonce":1955442624}]},"public_addr":"172.21.15.172:6809/1955442624","cluster_addr":"172.21.15.172:6811/1955442624","heartbeat_back_addr":"172.21.15.172:6815/1955442624","heartbeat_front_addr":"172.21.15.172:6813/1955442624","state":["exists","up"]},{"osd":6,"uuid":"c5a64e7c-1cd9-4642-89a7-1912095262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6819","nonce":4265227752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6821","nonce":4265227752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6825","nonce":4265227752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4265227752},{"type":"v1","addr":"172.21.15.135:6823","nonce":4265227752}]},"public_addr":"172.21.15.135:6819/4265227752","cluster_addr":"172.21.15.135:6821/4265227752","heartbeat_back_addr":"172.21.15.135:6825/4265227752","heartbeat_front_addr":"172.21.15.135:6823/4265227752","state":["exists","up"]},{"osd":7,"uuid":"ab9e3e44-dbb7-4321-9527-b5973b470ca7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6817","nonce":350268889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6819","nonce":350268889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6823","nonce":350268889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":350268889},{"type":"v1","addr":"172.21.15.160:6821","nonce":350268889}]},"public_addr":"172.21.15.160:6817/350268889","cluster_addr":"172.21.15.160:6819/350268889","heartbeat_back_addr":"172.21.15.160:6823/350268889","heartbeat_front_addr":"172.21.15.160:6821/350268889","state":["exists","up"]},{"osd":8,"uuid":"ac3346f2-6419-4db2-95e0-78374b3cf793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6817","nonce":695820543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6819","nonce":695820543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6823","nonce":695820543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":695820543},{"type":"v1","addr":"172.21.15.172:6821","nonce":695820543}]},"public_addr":"172.21.15.172:6817/695820543","cluster_addr":"172.21.15.172:6819/695820543","heartbeat_back_addr":"172.21.15.172:6823/695820543","heartbeat_front_addr":"172.21.15.172:6821/695820543","state":["exists","up"]},{"osd":9,"uuid":"5a7483eb-245c-4c6c-91f5-8b41e6de11ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6827","nonce":1712068572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6829","nonce":1712068572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6833","nonce":1712068572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1712068572},{"type":"v1","addr":"172.21.15.135:6831","nonce":1712068572}]},"public_addr":"172.21.15.135:6827/1712068572","cluster_addr":"172.21.15.135:6829/1712068572","heartbeat_back_addr":"172.21.15.135:6833/1712068572","heartbeat_front_addr":"172.21.15.135:6831/1712068572","state":["exists","up"]},{"osd":10,"uuid":"216e927a-b7f6-447d-86ae-fdad237ebf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6825","nonce":1618218869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6827","nonce":1618218869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6831","nonce":1618218869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1618218869},{"type":"v1","addr":"172.21.15.160:6829","nonce":1618218869}]},"public_addr":"172.21.15.160:6825/1618218869","cluster_addr":"172.21.15.160:6827/1618218869","heartbeat_back_addr":"172.21.15.160:6831/1618218869","heartbeat_front_addr":"172.21.15.160:6829/1618218869","state":["exists","up"]},{"osd":11,"uuid":"293fc85d-ffca-4069-9a9c-980c69ba701d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6825","nonce":3648204338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6827","nonce":3648204338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6831","nonce":3648204338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3648204338},{"type":"v1","addr":"172.21.15.172:6829","nonce":3648204338}]},"public_addr":"172.21.15.172:6825/3648204338","cluster_addr":"172.21.15.172:6827/3648204338","heartbeat_back_addr":"172.21.15.172:6831/3648204338","heartbeat_front_addr":"172.21.15.172:6829/3648204338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:25:42.213304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:06.589603+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:30.251137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:26:55.706306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:20.799161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:27:45.562875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:11.989670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:28:38.042545+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:02.824138+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:29.650169+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:29:56.372616+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:30:21.965238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2340719003":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2366951991":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6801/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:6800/3106262554":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2777149070":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/2727321726":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6800/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:0/700489570":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3892403253":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/2923289945":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6801/45942653":"2024-05-21T17:24:06.618654+0000","172.21.15.135:6801/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:6800/3053430682":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3033784790":"2024-05-21T17:23:40.271295+0000","172.21.15.135:0/3665782068":"2024-05-21T17:33:19.780332+0000","172.21.15.135:0/3446450726":"2024-05-21T17:24:06.618654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:48:45.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 msgr2=0x7f284c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 0x7f284c0a5360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f285c010670 tx=0x7f285c009ed0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 msgr2=0x7f286006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f285800eaa0 tx=0x7f285800ef60 comp rx=0 tx=0).stop 2024-05-20T17:48:45.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 shutdown_connections 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f284c0a2e50 0x7f284c0a5360 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286006cd20 0x7f286006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f286010c330 0x7f286006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 --2- 172.21.15.135:0/948703730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28601079d0 0x7f28600736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 >> 172.21.15.135:0/948703730 conn(0x7f28600770c0 msgr2=0x7f2860103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 shutdown_connections 2024-05-20T17:48:45.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.133+0000 7f2868661640 1 -- 172.21.15.135:0/948703730 wait complete. 2024-05-20T17:48:45.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 -- 172.21.15.135:0/4068363200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2501079f0 msgr2=0x7ff250101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 --2- 172.21.15.135:0/4068363200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2501079f0 0x7ff250101580 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff240009900 tx=0x7ff24002c620 comp rx=0 tx=0).stop 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 -- 172.21.15.135:0/4068363200 shutdown_connections 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 --2- 172.21.15.135:0/4068363200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff25010c350 0x7ff25010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 --2- 172.21.15.135:0/4068363200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff250101ac0 0x7ff250101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 --2- 172.21.15.135:0/4068363200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2501079f0 0x7ff250101580 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 -- 172.21.15.135:0/4068363200 >> 172.21.15.135:0/4068363200 conn(0x7ff250077130 msgr2=0x7ff250077570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:45.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 -- 172.21.15.135:0/4068363200 shutdown_connections 2024-05-20T17:48:45.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.312+0000 7ff256965640 1 -- 172.21.15.135:0/4068363200 wait complete. 2024-05-20T17:48:45.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 Processor -- start 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 -- start start 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250101ac0 0x7ff250197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2501079f0 0x7ff250197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff250110c00 con 0x7ff25010c350 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff250110a80 con 0x7ff2501079f0 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.313+0000 7ff256965640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff250110d80 con 0x7ff250101ac0 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58566/0 (socket says 172.21.15.135:58566) 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 -- 172.21.15.135:0/2691181743 learned_addr learned my addr 172.21.15.135:0/2691181743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff24f7fe640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2501079f0 0x7ff250197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 -- 172.21.15.135:0/2691181743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250101ac0 msgr2=0x7ff250197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250101ac0 0x7ff250197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 -- 172.21.15.135:0/2691181743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2501079f0 msgr2=0x7ff250197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2501079f0 0x7ff250197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 -- 172.21.15.135:0/2691181743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25019c360 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.314+0000 7ff254f02640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff24800eaa0 tx=0x7ff24800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.315+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24800cdb0 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.315+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25019c650 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.315+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501a83e0 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.315+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff248011470 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.315+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24801f060 con 0x7ff25010c350 2024-05-20T17:48:45.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.316+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23c005290 con 0x7ff25010c350 2024-05-20T17:48:45.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.318+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7ff248004a40 con 0x7ff25010c350 2024-05-20T17:48:45.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.319+0000 7ff24d7fa640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 0x7ff2380a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.319+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8631+0+0 (secure 0 0 0) 0x7ff2480cf5f0 con 0x7ff25010c350 2024-05-20T17:48:45.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.320+0000 7ff24ffff640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 0x7ff2380a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.321+0000 7ff24ffff640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 0x7ff2380a5210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff24000e4b0 tx=0x7ff240000bc0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:45.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.327+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff248016030 con 0x7ff25010c350 2024-05-20T17:48:45.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.684+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff23c005580 con 0x7ff25010c350 2024-05-20T17:48:45.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.688+0000 7ff24d7fa640 1 -- 172.21.15.135:0/2691181743 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7ff248016030 con 0x7ff25010c350 2024-05-20T17:48:45.689 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:48:45.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.691+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 msgr2=0x7ff2380a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.691+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 0x7ff2380a5210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff24000e4b0 tx=0x7ff240000bc0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.691+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 msgr2=0x7ff25019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.691+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff24800eaa0 tx=0x7ff24800ef60 comp rx=0 tx=0).stop 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 shutdown_connections 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7ff2380a2d00 0x7ff2380a5210 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff25010c350 0x7ff25019bd20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2501079f0 0x7ff250197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 --2- 172.21.15.135:0/2691181743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250101ac0 0x7ff250197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 >> 172.21.15.135:0/2691181743 conn(0x7ff250077130 msgr2=0x7ff250103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 shutdown_connections 2024-05-20T17:48:45.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.693+0000 7ff256965640 1 -- 172.21.15.135:0/2691181743 wait complete. 2024-05-20T17:48:45.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:48:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-mon[36511]: pgmap v482: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 189 B/s wr, 6 op/s 2024-05-20T17:48:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1928833162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/948703730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.849 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-mon[36261]: pgmap v482: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 189 B/s wr, 6 op/s 2024-05-20T17:48:45.849 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1928833162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.849 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/948703730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 -- 172.21.15.135:0/1926723993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c109330 msgr2=0x7f2d7c109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 --2- 172.21.15.135:0/1926723993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c109330 0x7f2d7c109740 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009900 tx=0x7f2d7802a410 comp rx=0 tx=0).stop 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 -- 172.21.15.135:0/1926723993 shutdown_connections 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 --2- 172.21.15.135:0/1926723993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c10e380 0x7f2d7c115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 --2- 172.21.15.135:0/1926723993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 0x7f2d7c10dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 --2- 172.21.15.135:0/1926723993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c109330 0x7f2d7c109740 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 -- 172.21.15.135:0/1926723993 >> 172.21.15.135:0/1926723993 conn(0x7f2d7c075050 msgr2=0x7f2d7c075460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:45.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 -- 172.21.15.135:0/1926723993 shutdown_connections 2024-05-20T17:48:45.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.858+0000 7f2d84006640 1 -- 172.21.15.135:0/1926723993 wait complete. 2024-05-20T17:48:45.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 Processor -- start 2024-05-20T17:48:45.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 -- start start 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c109330 0x7f2d7c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 0x7f2d7c1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c119430 con 0x7f2d7c10e380 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1192b0 con 0x7f2d7c10d8c0 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d84006640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1195b0 con 0x7f2d7c109330 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.859+0000 7f2d825a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d815a1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 0x7f2d7c1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58572/0 (socket says 172.21.15.135:58572) 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 -- 172.21.15.135:0/4199646352 learned_addr learned my addr 172.21.15.135:0/4199646352 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d81da2640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c109330 0x7f2d7c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 -- 172.21.15.135:0/4199646352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c109330 msgr2=0x7f2d7c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c109330 0x7f2d7c19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 -- 172.21.15.135:0/4199646352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 msgr2=0x7f2d7c1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 0x7f2d7c1a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 -- 172.21.15.135:0/4199646352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c1a4bb0 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d825a3640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400db20 tx=0x7f2d7400df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74017070 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.860+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c1a4ea0 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.861+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d74003e50 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.861+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c1a53f0 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.861+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740104c0 con 0x7f2d7c10e380 2024-05-20T17:48:45.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.862+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c068290 con 0x7f2d7c10e380 2024-05-20T17:48:45.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.864+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f2d74003970 con 0x7f2d7c10e380 2024-05-20T17:48:45.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.865+0000 7f2d72ffd640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 0x7f2d680a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:45.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.865+0000 7f2d81da2640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 0x7f2d680a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:45.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.865+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8861+0+0 (secure 0 0 0) 0x7f2d740cf4a0 con 0x7f2d7c10e380 2024-05-20T17:48:45.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.865+0000 7f2d81da2640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 0x7f2d680a5210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d78000c00 tx=0x7f2d78009560 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:45.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:45.869+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d7409bf70 con 0x7f2d7c10e380 2024-05-20T17:48:45.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:45 smithi135 ceph-mon[32027]: pgmap v482: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 189 B/s wr, 6 op/s 2024-05-20T17:48:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1928833162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:45 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/948703730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:48:45.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:48:45.685+0000 7f8e8f65d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:48:46.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.201+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2d7c1a1120 con 0x7f2d7c10e380 2024-05-20T17:48:46.256 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.256 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.256 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: starting mds.e at 2024-05-20T17:48:46.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.257 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.257 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: starting mds.b at 2024-05-20T17:48:46.257 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.257 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.257 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:48:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: starting mds.h at 2024-05-20T17:48:46.330 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.330 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.330 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: starting mds.f at 2024-05-20T17:48:46.331 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.331 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.331 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: starting mds.i at 2024-05-20T17:48:46.331 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: ignoring --setuser ceph since I am not root 2024-05-20T17:48:46.332 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: ignoring --setgroup ceph since I am not root 2024-05-20T17:48:46.332 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:48:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: starting mds.c at 2024-05-20T17:48:46.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.697+0000 7f2d72ffd640 1 -- 172.21.15.135:0/4199646352 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f2d7409b870 con 0x7f2d7c10e380 2024-05-20T17:48:46.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 msgr2=0x7f2d680a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:46.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 0x7f2d680a5210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d78000c00 tx=0x7f2d78009560 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 msgr2=0x7f2d7c1a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400db20 tx=0x7f2d7400df20 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 shutdown_connections 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f2d680a2d00 0x7f2d680a5210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d7c10e380 0x7f2d7c1a45f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c10d8c0 0x7f2d7c1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 --2- 172.21.15.135:0/4199646352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c109330 0x7f2d7c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 >> 172.21.15.135:0/4199646352 conn(0x7f2d7c075050 msgr2=0x7f2d7c106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 shutdown_connections 2024-05-20T17:48:46.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.699+0000 7f2d84006640 1 -- 172.21.15.135:0/4199646352 wait complete. 2024-05-20T17:48:46.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: osdmap e106: 12 total, 12 up, 12 in 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-20T17:48:46.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:46 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:48:46.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.876+0000 7fe3737ea640 1 -- 172.21.15.135:0/1652277266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c101aa0 msgr2=0x7fe36c101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.876+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1652277266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c101aa0 0x7fe36c101eb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00fb10 tx=0x7fe35c02e570 comp rx=0 tx=0).stop 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.876+0000 7fe3737ea640 1 -- 172.21.15.135:0/1652277266 shutdown_connections 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.876+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1652277266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c10e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.877+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1652277266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c101aa0 0x7fe36c101eb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.877+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1652277266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c1079d0 0x7fe36c101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.877+0000 7fe3737ea640 1 -- 172.21.15.135:0/1652277266 >> 172.21.15.135:0/1652277266 conn(0x7fe36c0770b0 msgr2=0x7fe36c0774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.877+0000 7fe3737ea640 1 -- 172.21.15.135:0/1652277266 shutdown_connections 2024-05-20T17:48:46.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.877+0000 7fe3737ea640 1 -- 172.21.15.135:0/1652277266 wait complete. 2024-05-20T17:48:46.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 Processor -- start 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 -- start start 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 0x7fe36c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c110be0 con 0x7fe36c1079d0 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c110a60 con 0x7fe36c101aa0 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe3737ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c110d60 con 0x7fe36c10c330 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe371586640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe371586640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:43004/0 (socket says 172.21.15.135:43004) 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe371586640 1 -- 172.21.15.135:0/1282861181 learned_addr learned my addr 172.21.15.135:0/1282861181 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:46.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe370d85640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 0x7fe36c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.878+0000 7fe371d87640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 -- 172.21.15.135:0/1282861181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 msgr2=0x7fe36c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 -- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 msgr2=0x7fe36c197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 0x7fe36c197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 -- 172.21.15.135:0/1282861181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c19c400 con 0x7fe36c101aa0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe370d85640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 0x7fe36c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371d87640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe371586640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe36800d770 tx=0x7fe36800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368017070 con 0x7fe36c101aa0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36c19c6f0 con 0x7fe36c101aa0 2024-05-20T17:48:46.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe368009c30 con 0x7fe36c101aa0 2024-05-20T17:48:46.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36800f620 con 0x7fe36c101aa0 2024-05-20T17:48:46.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.879+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36c1a4070 con 0x7fe36c101aa0 2024-05-20T17:48:46.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.881+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe36c069f50 con 0x7fe36c101aa0 2024-05-20T17:48:46.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.882+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7fe36801a070 con 0x7fe36c101aa0 2024-05-20T17:48:46.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.883+0000 7fe3627fc640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 0x7fe3580a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:46.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.883+0000 7fe370d85640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 0x7fe3580a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:46.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.883+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8861+0+0 (secure 0 0 0) 0x7fe3680cf390 con 0x7fe36c101aa0 2024-05-20T17:48:46.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.884+0000 7fe370d85640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 0x7fe3580a5210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe35c006010 tx=0x7fe35c000bc0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:46.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:46.894+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe368009de0 con 0x7fe36c101aa0 2024-05-20T17:48:46.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:48:46.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: osdmap e106: 12 total, 12 up, 12 in 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-20T17:48:46.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:46 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/2691181743' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: osdmap e106: 12 total, 12 up, 12 in 2024-05-20T17:48:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-20T17:48:47.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:46 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:48:47.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.175+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe36c105e90 con 0x7fe36c101aa0 2024-05-20T17:48:47.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.707+0000 7fe3627fc640 1 -- 172.21.15.135:0/1282861181 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7fe36809b810 con 0x7fe36c101aa0 2024-05-20T17:48:47.709 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:48:47.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 msgr2=0x7fe3580a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 0x7fe3580a5210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe35c006010 tx=0x7fe35c000bc0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 msgr2=0x7fe36c1975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe36800d770 tx=0x7fe36800dc30 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 shutdown_connections 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7fe3580a2d00 0x7fe3580a5210 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe36c10c330 0x7fe36c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe36c1079d0 0x7fe36c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 --2- 172.21.15.135:0/1282861181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101aa0 0x7fe36c1975a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.710+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 >> 172.21.15.135:0/1282861181 conn(0x7fe36c0770b0 msgr2=0x7fe36c103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.711+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 shutdown_connections 2024-05-20T17:48:47.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.711+0000 7fe3737ea640 1 -- 172.21.15.135:0/1282861181 wait complete. 2024-05-20T17:48:47.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:48:47.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.941+0000 7f452b4e7640 1 -- 172.21.15.135:0/254275384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f452410c330 msgr2=0x7f452410e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.941+0000 7f452b4e7640 1 --2- 172.21.15.135:0/254275384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f452410c330 0x7f452410e750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f451c009be0 tx=0x7f451c02a6e0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.943+0000 7f452b4e7640 1 -- 172.21.15.135:0/254275384 shutdown_connections 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.943+0000 7f452b4e7640 1 --2- 172.21.15.135:0/254275384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f452410c330 0x7f452410e750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.943+0000 7f452b4e7640 1 --2- 172.21.15.135:0/254275384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4524101aa0 0x7f4524101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.943+0000 7f452b4e7640 1 --2- 172.21.15.135:0/254275384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45241079d0 0x7f4524101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.943+0000 7f452b4e7640 1 -- 172.21.15.135:0/254275384 >> 172.21.15.135:0/254275384 conn(0x7f45240770b0 msgr2=0x7f45240774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:47.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.949+0000 7f452b4e7640 1 -- 172.21.15.135:0/254275384 shutdown_connections 2024-05-20T17:48:47.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.949+0000 7f452b4e7640 1 -- 172.21.15.135:0/254275384 wait complete. 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 Processor -- start 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 -- start start 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 0x7f45241127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4524110b80 con 0x7f452410c330 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4524110a00 con 0x7f45241079d0 2024-05-20T17:48:47.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f452b4e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4524110d00 con 0x7f4524101aa0 2024-05-20T17:48:47.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.950+0000 7f4528a82640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:47.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.951+0000 7f4529283640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 0x7f45241127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:47.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.951+0000 7f4529a84640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:47.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.951+0000 7f4529a84640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58600/0 (socket says 172.21.15.135:58600) 2024-05-20T17:48:47.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.951+0000 7f4529a84640 1 -- 172.21.15.135:0/1975585892 learned_addr learned my addr 172.21.15.135:0/1975585892 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-20T17:48:47.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.951+0000 7f4528a82640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:43028/0 (socket says 172.21.15.135:43028) 2024-05-20T17:48:47.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 -- 172.21.15.135:0/1975585892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 msgr2=0x7f45241127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 0x7f45241127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 -- 172.21.15.135:0/1975585892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 msgr2=0x7f4524112d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 -- 172.21.15.135:0/1975585892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45241a5df0 con 0x7f452410c330 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529a84640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f451c034040 tx=0x7f451c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4528a82640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f4529283640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 0x7f45241127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.952+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c041020 con 0x7f452410c330 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.953+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45241a6080 con 0x7f452410c330 2024-05-20T17:48:47.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.953+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45241a6570 con 0x7f452410c330 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: pgmap v484: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: Cluster is now healthy 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6834/2735219232,v1:172.21.15.172:6835/2735219232] up:boot 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6836/2120091764,v1:172.21.15.172:6838/2120091764] up:boot 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.172:6837/3100040144,v1:172.21.15.172:6839/3100040144] up:boot 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6834/1533726841,v1:172.21.15.160:6835/1533726841] up:boot 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6838/581202161,v1:172.21.15.160:6839/581202161] up:boot 2024-05-20T17:48:47.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: mds.? [v2:172.21.15.160:6836/3118266319,v1:172.21.15.160:6837/3118266319] up:boot 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: fsmap 12 up:standby 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1282861181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:47.956 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:47 smithi135 ceph-mon[32027]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:47.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.953+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451c037040 con 0x7f452410c330 2024-05-20T17:48:47.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.953+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c036070 con 0x7f452410c330 2024-05-20T17:48:47.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.955+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4508005290 con 0x7f452410c330 2024-05-20T17:48:47.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.959+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 137965+0+0 (secure 0 0 0) 0x7f451c044020 con 0x7f452410c330 2024-05-20T17:48:47.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.960+0000 7f45167fc640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 0x7f45100a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:48:47.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.960+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8307+0+0 (secure 0 0 0) 0x7f451c0efef0 con 0x7f452410c330 2024-05-20T17:48:47.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.965+0000 7f4529283640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 0x7f45100a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:48:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.971+0000 7f4529283640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 0x7f45100a53e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4518005fd0 tx=0x7f451800b5f0 comp rx=0 tx=0).ready entity=mgr.15306 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:48:47.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:47.975+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f451c04b020 con 0x7f452410c330 2024-05-20T17:48:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: pgmap v484: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-20T17:48:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: Cluster is now healthy 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6834/2735219232,v1:172.21.15.172:6835/2735219232] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6836/2120091764,v1:172.21.15.172:6838/2120091764] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.172:6837/3100040144,v1:172.21.15.172:6839/3100040144] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6834/1533726841,v1:172.21.15.160:6835/1533726841] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6838/581202161,v1:172.21.15.160:6839/581202161] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: mds.? [v2:172.21.15.160:6836/3118266319,v1:172.21.15.160:6837/3118266319] up:boot 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: fsmap 12 up:standby 2024-05-20T17:48:48.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1282861181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:48.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:47 smithi160 ceph-mon[36261]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:48.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: pgmap v484: 97 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 47 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-20T17:48:48.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:48:48.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:48:48.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: Cluster is now healthy 2024-05-20T17:48:48.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/4199646352' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6834/2735219232,v1:172.21.15.172:6835/2735219232] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6836/2120091764,v1:172.21.15.172:6838/2120091764] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.172:6837/3100040144,v1:172.21.15.172:6839/3100040144] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6834/1533726841,v1:172.21.15.160:6835/1533726841] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6838/581202161,v1:172.21.15.160:6839/581202161] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: mds.? [v2:172.21.15.160:6836/3118266319,v1:172.21.15.160:6837/3118266319] up:boot 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: fsmap 12 up:standby 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='mgr.15306 172.21.15.135:0/3142170901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:48:48.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1282861181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:48.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:47 smithi172 ceph-mon[36511]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:48.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.278+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4508005580 con 0x7f452410c330 2024-05-20T17:48:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.711+0000 7f45167fc640 1 -- 172.21.15.135:0/1975585892 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7f451c0bcb80 con 0x7f452410c330 2024-05-20T17:48:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-05-20T17:48:48.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 msgr2=0x7f45100a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:48.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 0x7f45100a53e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4518005fd0 tx=0x7f451800b5f0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 msgr2=0x7f45241a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:48:48.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f451c034040 tx=0x7f451c003ce0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 shutdown_connections 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:6800/4225131677,v1:172.21.15.135:6801/4225131677] conn(0x7f45100a2ed0 0x7f45100a53e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f452410c330 0x7f45241a5800 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45241079d0 0x7f4524112d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 --2- 172.21.15.135:0/1975585892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524101aa0 0x7f45241127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 >> 172.21.15.135:0/1975585892 conn(0x7f45240770b0 msgr2=0x7f4524103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 shutdown_connections 2024-05-20T17:48:48.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-20T17:48:48.714+0000 7f452b4e7640 1 -- 172.21.15.135:0/1975585892 wait complete. 2024-05-20T17:48:48.735 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:48:48.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:48:48.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:48:48.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:48 smithi172 ceph-mon[36511]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:48.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:48 smithi172 ceph-mon[36511]: osdmap e107: 12 total, 12 up, 12 in 2024-05-20T17:48:48.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:48 smithi172 ceph-mon[36511]: pgmap v486: 65 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 15 active+clean; 883 MiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:48:48.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:48 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:48.963 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-20T17:48:48.963 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:48:48.984 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:48:49.002 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:48:49.005 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:48 smithi160 ceph-mon[36261]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:49.005 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:48 smithi160 ceph-mon[36261]: osdmap e107: 12 total, 12 up, 12 in 2024-05-20T17:48:49.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:48 smithi160 ceph-mon[36261]: pgmap v486: 65 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 15 active+clean; 883 MiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:48:49.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:48 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:49.017 INFO:tasks.cephadm:Stopping all daemons... 2024-05-20T17:48:49.018 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-20T17:48:49.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a 2024-05-20T17:48:49.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:48 smithi135 ceph-mon[32027]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:49.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:48 smithi135 ceph-mon[32027]: osdmap e107: 12 total, 12 up, 12 in 2024-05-20T17:48:49.054 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:48 smithi135 ceph-mon[32027]: pgmap v486: 65 pgs: 16 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 15 active+clean; 883 MiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:48:49.054 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:48 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:48:49.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:49 smithi135 systemd[1]: Stopping Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:49 smithi160 ceph-mon[36261]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:50.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:49 smithi160 ceph-mon[36261]: osdmap e108: 12 total, 12 up, 12 in 2024-05-20T17:48:50.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:49 smithi172 ceph-mon[36511]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:50.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:49 smithi172 ceph-mon[36511]: osdmap e108: 12 total, 12 up, 12 in 2024-05-20T17:48:50.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:49 smithi135 ceph-mon[32027]: from='client.? 172.21.15.135:0/1975585892' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:48:50.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:49 smithi135 ceph-mon[32027]: osdmap e108: 12 total, 12 up, 12 in 2024-05-20T17:48:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:48:50.376+0000 7f8e94e68700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:48:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a[32022]: 2024-05-20T17:48:50.376+0000 7f8e94e68700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-20T17:48:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:50 smithi135 podman[96108]: 2024-05-20 17:48:50.484487166 +0000 UTC m=+1.166973144 container died 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:48:52.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 podman[96108]: 2024-05-20 17:48:52.244282241 +0000 UTC m=+2.926768220 container cleanup 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:48:52.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 bash[96108]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a 2024-05-20T17:48:52.725 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service' 2024-05-20T17:48:52.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 podman[96119]: 2024-05-20 17:48:52.489664314 +0000 UTC m=+2.000291686 container remove 4e20ba46cad57cc4463a9892005bdc33504dc44ae49e524302ab36ef5e4d9ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, ceph=True) 2024-05-20T17:48:52.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-20T17:48:52.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 systemd[1]: Stopped Ceph mon.a for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:48:52.788 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 20 17:48:52 smithi135 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.a.service: Consumed 25.974s CPU time. 2024-05-20T17:48:52.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:48:52.814 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-20T17:48:52.814 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-20T17:48:52.814 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.b 2024-05-20T17:48:53.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:52 smithi160 systemd[1]: Stopping Ceph mon.b for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-b[36256]: 2024-05-20T17:48:53.660+0000 7f79c6132700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:48:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-b[36256]: 2024-05-20T17:48:53.660+0000 7f79c6132700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-20T17:48:54.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:53 smithi160 podman[72567]: 2024-05-20 17:48:53.773683178 +0000 UTC m=+0.401792231 container died d69df5f96247e24e5e965cf33a61f5641b8dd5a4684d24347542178d9478271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:48:54.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:54 smithi160 podman[72567]: 2024-05-20 17:48:54.16120431 +0000 UTC m=+0.789313348 container cleanup d69df5f96247e24e5e965cf33a61f5641b8dd5a4684d24347542178d9478271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-b, ceph=True, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD) 2024-05-20T17:48:54.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:May 20 17:48:54 smithi160 bash[72567]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-b 2024-05-20T17:48:54.580 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.b.service' 2024-05-20T17:48:54.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:48:54.709 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-20T17:48:54.709 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-20T17:48:54.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.c 2024-05-20T17:48:55.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:54 smithi172 systemd[1]: Stopping Ceph mon.c for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:55.358 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-c[36494]: 2024-05-20T17:48:55.102+0000 7fe19de06700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:48:55.358 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-c[36494]: 2024-05-20T17:48:55.102+0000 7fe19de06700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-20T17:48:55.709 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:55 smithi172 podman[74675]: 2024-05-20 17:48:55.357903808 +0000 UTC m=+0.383505934 container died f67153ce685b9b4e8ab5b2e835e44d6f5f236c26d3a66a22e64f496e0ff36fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True) 2024-05-20T17:48:56.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:55 smithi172 podman[74675]: 2024-05-20 17:48:55.70966714 +0000 UTC m=+0.735269287 container cleanup f67153ce685b9b4e8ab5b2e835e44d6f5f236c26d3a66a22e64f496e0ff36fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-05-20T17:48:56.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:May 20 17:48:55 smithi172 bash[74675]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mon-c 2024-05-20T17:48:56.142 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mon.c.service' 2024-05-20T17:48:56.186 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:48:56.187 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-20T17:48:56.187 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-20T17:48:56.187 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x 2024-05-20T17:48:56.517 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 systemd[1]: Stopping Ceph mgr.x for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:56.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:48:56.515+0000 7f270d3b5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:48:56.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x[32256]: 2024-05-20T17:48:56.515+0000 7f270d3b5700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-20T17:48:56.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 podman[96229]: 2024-05-20 17:48:56.548149421 +0000 UTC m=+0.164571785 container died 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x, ceph=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-20T17:48:57.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 podman[96229]: 2024-05-20 17:48:56.950118473 +0000 UTC m=+0.566540836 container cleanup 572bd28b43035884dba98744796e9681909785a4c65fc64100f8dd77a0a2aecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240514) 2024-05-20T17:48:57.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 20 17:48:56 smithi135 bash[96229]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-x 2024-05-20T17:48:57.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.x.service' 2024-05-20T17:48:57.763 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:48:57.764 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-20T17:48:57.764 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-20T17:48:57.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.y 2024-05-20T17:48:58.113 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:48:57 smithi160 systemd[1]: Stopping Ceph mgr.y for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:58.392 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:48:58 smithi160 podman[72687]: 2024-05-20 17:48:58.113397116 +0000 UTC m=+0.153831175 container died 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-20T17:48:58.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:48:58 smithi160 podman[72687]: 2024-05-20 17:48:58.491168307 +0000 UTC m=+0.531602375 container cleanup 306ef2f4149b13b8aa2712ed59abcbcdb260ab5d44431974a39c86a5d556f834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:48:58.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:May 20 17:48:58 smithi160 bash[72687]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-y 2024-05-20T17:48:58.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.y.service' 2024-05-20T17:48:58.967 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:48:58.967 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-20T17:48:58.967 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-20T17:48:58.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.z 2024-05-20T17:48:59.295 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:48:59 smithi172 systemd[1]: Stopping Ceph mgr.z for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:48:59.579 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:48:59 smithi172 podman[74798]: 2024-05-20 17:48:59.295025286 +0000 UTC m=+0.143935273 container died 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-20T17:48:59.960 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:48:59 smithi172 podman[74798]: 2024-05-20 17:48:59.698506862 +0000 UTC m=+0.547416798 container cleanup 868f8ca09fd1fd57064baac03221a1b3d401acaeb7472b99470930dbb96483b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-05-20T17:48:59.960 INFO:journalctl@ceph.mgr.z.smithi172.stdout:May 20 17:48:59 smithi172 bash[74798]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mgr-z 2024-05-20T17:49:00.142 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mgr.z.service' 2024-05-20T17:49:00.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:00.177 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-20T17:49:00.178 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-20T17:49:00.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.0 2024-05-20T17:49:00.488 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:00 smithi135 systemd[1]: Stopping Ceph osd.0 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:00.953 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0[44459]: 2024-05-20T17:49:00.487+0000 7fedc710e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:00.954 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0[44459]: 2024-05-20T17:49:00.487+0000 7fedc710e700 -1 osd.0 108 *** Got signal Terminated *** 2024-05-20T17:49:00.954 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0[44459]: 2024-05-20T17:49:00.487+0000 7fedc710e700 -1 osd.0 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:06.360 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:06 smithi135 podman[96350]: 2024-05-20 17:49:06.061625586 +0000 UTC m=+5.681026723 container died 0b6372f2b19d9b6213073b23b4213417fa778ab2d5bf28f58652aceb251d8ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:49:06.704 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:06 smithi135 podman[96350]: 2024-05-20 17:49:06.463757989 +0000 UTC m=+6.083159120 container cleanup 0b6372f2b19d9b6213073b23b4213417fa778ab2d5bf28f58652aceb251d8ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-20T17:49:06.704 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:06 smithi135 bash[96350]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0 2024-05-20T17:49:07.090 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:06 smithi135 podman[96367]: 2024-05-20 17:49:06.761226533 +0000 UTC m=+0.698301043 container remove 0b6372f2b19d9b6213073b23b4213417fa778ab2d5bf28f58652aceb251d8ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:07.386 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:06.992367907 +0000 UTC m=+0.017468846 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:07.387 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:07.127856934 +0000 UTC m=+0.152957852 container create 720197970ea151a0e630bc6b6f0a3e6c319b19f1d8d9a227e3f8d737282ae018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS) 2024-05-20T17:49:07.387 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:07.386564968 +0000 UTC m=+0.411665889 container init 720197970ea151a0e630bc6b6f0a3e6c319b19f1d8d9a227e3f8d737282ae018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-20T17:49:07.679 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:07.390062678 +0000 UTC m=+0.415163596 container start 720197970ea151a0e630bc6b6f0a3e6c319b19f1d8d9a227e3f8d737282ae018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5) 2024-05-20T17:49:07.679 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:07.486070236 +0000 UTC m=+0.511171173 container attach 720197970ea151a0e630bc6b6f0a3e6c319b19f1d8d9a227e3f8d737282ae018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0) 2024-05-20T17:49:07.953 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 20 17:49:07 smithi135 podman[96457]: 2024-05-20 17:49:07.679473042 +0000 UTC m=+0.704573976 container died 720197970ea151a0e630bc6b6f0a3e6c319b19f1d8d9a227e3f8d737282ae018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-05-20T17:49:08.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.0.service' 2024-05-20T17:49:08.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:08.440 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-20T17:49:08.441 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-20T17:49:08.441 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.1 2024-05-20T17:49:08.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:08 smithi160 systemd[1]: Stopping Ceph osd.1 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:09.256 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1[40851]: 2024-05-20T17:49:08.761+0000 7f454a79d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:09.256 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1[40851]: 2024-05-20T17:49:08.761+0000 7f454a79d700 -1 osd.1 108 *** Got signal Terminated *** 2024-05-20T17:49:09.256 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1[40851]: 2024-05-20T17:49:08.761+0000 7f454a79d700 -1 osd.1 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:14.586 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:14 smithi160 podman[72811]: 2024-05-20 17:49:14.282541273 +0000 UTC m=+5.652981249 container died fb86de8a3f382032028f7d9968e5bd1da26e4fb3368f2145ee1d50f0b34b363d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2) 2024-05-20T17:49:14.964 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:14 smithi160 podman[72811]: 2024-05-20 17:49:14.687165021 +0000 UTC m=+6.057604945 container cleanup fb86de8a3f382032028f7d9968e5bd1da26e4fb3368f2145ee1d50f0b34b363d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-20T17:49:14.964 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:14 smithi160 bash[72811]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1 2024-05-20T17:49:15.256 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:14 smithi160 podman[72827]: 2024-05-20 17:49:14.963766191 +0000 UTC m=+0.668471027 container remove fb86de8a3f382032028f7d9968e5bd1da26e4fb3368f2145ee1d50f0b34b363d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-20T17:49:15.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:15 smithi160 podman[72916]: 2024-05-20 17:49:15.219079456 +0000 UTC m=+0.017174143 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:15.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:15 smithi160 podman[72916]: 2024-05-20 17:49:15.339659808 +0000 UTC m=+0.137754489 container create 2befa8247e935d48a19121770eb78203511180cbd7033072f16231edb31b809c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-05-20T17:49:16.506 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:16 smithi160 podman[72916]: 2024-05-20 17:49:16.226576727 +0000 UTC m=+1.024671390 container init 2befa8247e935d48a19121770eb78203511180cbd7033072f16231edb31b809c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:16.506 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:16 smithi160 podman[72916]: 2024-05-20 17:49:16.230561106 +0000 UTC m=+1.028655782 container start 2befa8247e935d48a19121770eb78203511180cbd7033072f16231edb31b809c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, ceph=True) 2024-05-20T17:49:16.842 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:16 smithi160 podman[72916]: 2024-05-20 17:49:16.535136479 +0000 UTC m=+1.333231153 container attach 2befa8247e935d48a19121770eb78203511180cbd7033072f16231edb31b809c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-05-20T17:49:17.110 INFO:journalctl@ceph.osd.1.smithi160.stdout:May 20 17:49:16 smithi160 podman[72916]: 2024-05-20 17:49:16.888203647 +0000 UTC m=+1.686298321 container died 2befa8247e935d48a19121770eb78203511180cbd7033072f16231edb31b809c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD) 2024-05-20T17:49:17.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.1.service' 2024-05-20T17:49:17.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:17.661 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-20T17:49:17.661 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-20T17:49:17.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.2 2024-05-20T17:49:17.963 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:17 smithi172 systemd[1]: Stopping Ceph osd.2 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:18.329 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2[41648]: 2024-05-20T17:49:17.961+0000 7f1b0def9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:18.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2[41648]: 2024-05-20T17:49:17.961+0000 7f1b0def9700 -1 osd.2 108 *** Got signal Terminated *** 2024-05-20T17:49:18.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2[41648]: 2024-05-20T17:49:17.961+0000 7f1b0def9700 -1 osd.2 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:23.882 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:23 smithi172 podman[74921]: 2024-05-20 17:49:23.587649478 +0000 UTC m=+5.737519299 container died cfe7793c034ab4deac2ea6fe429dde8b1d36f192347d6a0a12826a22063b9b8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-05-20T17:49:24.207 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:23 smithi172 podman[74921]: 2024-05-20 17:49:23.970984337 +0000 UTC m=+6.120854150 container cleanup cfe7793c034ab4deac2ea6fe429dde8b1d36f192347d6a0a12826a22063b9b8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:49:24.207 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:23 smithi172 bash[74921]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2 2024-05-20T17:49:24.557 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[74938]: 2024-05-20 17:49:24.231322153 +0000 UTC m=+0.640640760 container remove cfe7793c034ab4deac2ea6fe429dde8b1d36f192347d6a0a12826a22063b9b8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:24.829 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[75038]: 2024-05-20 17:49:24.557138411 +0000 UTC m=+0.114750274 container create b1e69aef87a1b900f771a1dba8ec03e26f59cc976ec1eff8d69eb0f3cbccded4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:49:24.829 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[75038]: 2024-05-20 17:49:24.461029377 +0000 UTC m=+0.018641250 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:24.830 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[75038]: 2024-05-20 17:49:24.801510202 +0000 UTC m=+0.359122064 container init b1e69aef87a1b900f771a1dba8ec03e26f59cc976ec1eff8d69eb0f3cbccded4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-20T17:49:24.830 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[75038]: 2024-05-20 17:49:24.80477686 +0000 UTC m=+0.362388722 container start b1e69aef87a1b900f771a1dba8ec03e26f59cc976ec1eff8d69eb0f3cbccded4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514) 2024-05-20T17:49:25.330 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:24 smithi172 podman[75038]: 2024-05-20 17:49:24.935295856 +0000 UTC m=+0.492907726 container attach b1e69aef87a1b900f771a1dba8ec03e26f59cc976ec1eff8d69eb0f3cbccded4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:49:25.746 INFO:journalctl@ceph.osd.2.smithi172.stdout:May 20 17:49:25 smithi172 podman[75038]: 2024-05-20 17:49:25.345587217 +0000 UTC m=+0.903199079 container died b1e69aef87a1b900f771a1dba8ec03e26f59cc976ec1eff8d69eb0f3cbccded4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:26.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.2.service' 2024-05-20T17:49:26.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:26.138 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-20T17:49:26.139 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-20T17:49:26.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.3 2024-05-20T17:49:26.452 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:26 smithi135 systemd[1]: Stopping Ceph osd.3 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:26.703 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:26 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:49:26.450+0000 7f452e977700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:26.703 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:26 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:49:26.450+0000 7f452e977700 -1 osd.3 108 *** Got signal Terminated *** 2024-05-20T17:49:26.704 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:26 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:49:26.450+0000 7f452e977700 -1 osd.3 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:27.329 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:27.015+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:27.330 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:26.874+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:27.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:27.027+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:27.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:27.573+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:28.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:27.813+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:28.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:27.990+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:28.329 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:27.876+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:28.330 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:28.045+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:28.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:28.561+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:29.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:28 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:28.859+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:29.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:29 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:29.016+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:29.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:28.978+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:29.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:28.806+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:29.329 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:28.891+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:29.330 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:29.057+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:29.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:29.519+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:30.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:29 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:29.819+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:30.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:30.008+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:30.255 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:29 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:29.830+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:30.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:29 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:29.987+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:30.329 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:29.895+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:30.330 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:30.069+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:30.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:30.542+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:31.203 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3[51378]: 2024-05-20T17:49:30.742+0000 7f4526f25700 -1 osd.3 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:05.118580+0000 front 2024-05-20T17:49:05.118548+0000 (oldest deadline 2024-05-20T17:49:29.818842+0000) 2024-05-20T17:49:31.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:30.864+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:31.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:30 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:30.966+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:31.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:30 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:30.782+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:31.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:30 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:30.954+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:31.329 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:30.876+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:31.329 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:31.043+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:31.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:31.519+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:32.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:31 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:31.872+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:32.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:31 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:31.923+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:32.204 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:32 smithi135 podman[96577]: 2024-05-20 17:49:32.03908694 +0000 UTC m=+5.701833093 container died c79634ef9d4429c5c6da21e645d904c8caee08fa5afcebe0f6cb1151965fee19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:49:32.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:31 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:31.785+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:32.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:31 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:31.906+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:32.329 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:31.850+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:32.329 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:32.072+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:32.703 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:32 smithi135 podman[96577]: 2024-05-20 17:49:32.434527884 +0000 UTC m=+6.097274025 container cleanup c79634ef9d4429c5c6da21e645d904c8caee08fa5afcebe0f6cb1151965fee19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-20T17:49:32.704 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:32 smithi135 bash[96577]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3 2024-05-20T17:49:32.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:32.490+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:33.006 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:32 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:32.905+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:33.006 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:32 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:32.745+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:33.052 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:32 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:32.920+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:33.052 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:32 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:32.939+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:33.052 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:32 smithi135 podman[96594]: 2024-05-20 17:49:32.710903349 +0000 UTC m=+0.673379928 container remove c79634ef9d4429c5c6da21e645d904c8caee08fa5afcebe0f6cb1151965fee19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:33.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:32.855+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:33.331 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:32.955268814 +0000 UTC m=+0.017869163 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:33.331 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:33.078700221 +0000 UTC m=+0.141300549 container create 7918758bf0774871d5b2b50be4b6c40de23aaad91443ea265016ec9d575bc361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:33.331 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:33.331153816 +0000 UTC m=+0.393754164 container init 7918758bf0774871d5b2b50be4b6c40de23aaad91443ea265016ec9d575bc361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:33.535 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:33.117+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:33.629 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:33.334938036 +0000 UTC m=+0.397538373 container start 7918758bf0774871d5b2b50be4b6c40de23aaad91443ea265016ec9d575bc361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-20T17:49:33.629 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:33.422798794 +0000 UTC m=+0.485399139 container attach 7918758bf0774871d5b2b50be4b6c40de23aaad91443ea265016ec9d575bc361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:33.828 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:33.534+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:33.943 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 20 17:49:33 smithi135 podman[96679]: 2024-05-20 17:49:33.629750263 +0000 UTC m=+0.692350608 container died 7918758bf0774871d5b2b50be4b6c40de23aaad91443ea265016ec9d575bc361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-3-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-20T17:49:34.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:33.828+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:34.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:33.944+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:34.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:33 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:33.954+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:34.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:33 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:33.781+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:34.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:33 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:33.916+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:34.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.3.service' 2024-05-20T17:49:34.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:34.327 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-20T17:49:34.328 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-20T17:49:34.328 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.4 2024-05-20T17:49:34.491 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:34.156+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:34.634 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:34 smithi160 systemd[1]: Stopping Ceph osd.4 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:34.787 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:34.526+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:34.959 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:34.632+0000 7f0c8f498700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:34.959 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:34.633+0000 7f0c8f498700 -1 osd.4 108 *** Got signal Terminated *** 2024-05-20T17:49:34.959 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:34.633+0000 7f0c8f498700 -1 osd.4 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:34.960 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:34.765+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:35.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:34.786+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:35.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:34 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:34.910+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:35.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:34 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:34.965+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:35.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:34 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:34.958+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:35.565 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:35.184+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:35.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:35.564+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:35.829 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:35.740+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:36.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:35.941+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:36.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:35.913+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:36.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:35 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:35.913+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:36.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:35.802+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:36.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:35 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:35.995+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:36.566 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:36 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:36.138+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:36.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:36 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:36.367+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:36.829 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:36 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:36.784+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:36.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:36 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:36.565+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:36.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:36 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:36.565+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:37.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:36.899+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:37.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:36.933+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:37.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:36 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:36.933+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:37.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:36 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:36.782+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:37.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:36 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:36.978+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:37.542 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:37 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:37.143+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:37.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:37.337+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:37.796 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:37 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:37.541+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:37.796 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:37 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:37.541+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:38.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:37 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:37.795+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:38.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:37.941+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:38.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:37.941+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:38.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:37.977+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:38.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:37 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:37.977+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:38.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:37 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:37.803+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:38.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:38.014+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:38.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:38.014+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:38.546 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:38 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:38.158+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:38.756 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:38.295+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:38.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:38 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:38.545+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:38.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:38 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:38.545+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:39.015 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:38 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4[47338]: 2024-05-20T17:49:38.762+0000 7f0c87a46700 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.404777+0000 front 2024-05-20T17:49:01.404803+0000 (oldest deadline 2024-05-20T17:49:27.304936+0000) 2024-05-20T17:49:39.111 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:38 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:38.835+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:39.111 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:38 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:38.835+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:39.343 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:39.015+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:39.343 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:39.015+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:39.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:38.964+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:39.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:38.964+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:39.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:38.970+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:39.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:38 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:38.970+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:39.518 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:39 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:39.110+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:39.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:39.343+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:39.813 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:39 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:39.517+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:39.814 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:39 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:39.517+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:40.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:39 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:39.813+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:40.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:39 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:39.813+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:40.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:39.966+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:40.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:39 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:39.966+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:40.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:40 smithi160 podman[73040]: 2024-05-20 17:49:40.046692968 +0000 UTC m=+5.530869735 container stop 528511516de50c5a99922f06892580f925cabcd693eac827e58099dec27116f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4, ceph=True, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:49:40.256 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:40 smithi160 podman[73040]: 2024-05-20 17:49:40.072300003 +0000 UTC m=+5.556476768 container died 528511516de50c5a99922f06892580f925cabcd693eac827e58099dec27116f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-20T17:49:40.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:39.994+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:40.454 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:39.994+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:40.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:39.985+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:40.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:39.985+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:40.490 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:40.124+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:40.490 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:40.124+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:40.718 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:40 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:40.339+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:40.719 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:40 smithi160 podman[73040]: 2024-05-20 17:49:40.467057335 +0000 UTC m=+5.951234102 container cleanup 528511516de50c5a99922f06892580f925cabcd693eac827e58099dec27116f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:40.719 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:40 smithi160 bash[73040]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4 2024-05-20T17:49:40.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:40.489+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:40.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:40.489+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:41.006 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:40 smithi160 podman[73056]: 2024-05-20 17:49:40.718568513 +0000 UTC m=+0.661683600 container remove 528511516de50c5a99922f06892580f925cabcd693eac827e58099dec27116f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux ) 2024-05-20T17:49:41.006 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:40 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:40.967+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:41.006 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:40 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:40.967+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:41.155 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:40.854+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:41.155 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:40 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:40.854+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:41.355 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:40.986733825 +0000 UTC m=+0.017332861 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:41.355 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:41.111217626 +0000 UTC m=+0.141816662 container create 79f63b4e254fbf29381f903db55e233baed747b8eff4281c9fb523c93abd2d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-20T17:49:41.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:40.979+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:41.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:40.979+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:41.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:40.977+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:41.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:40 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:40.977+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:41.491 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:41.154+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:41.491 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:41.154+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:41.660 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:41 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:41.354+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:41.661 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:41.364205568 +0000 UTC m=+0.394804608 container init 79f63b4e254fbf29381f903db55e233baed747b8eff4281c9fb523c93abd2d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-05-20T17:49:41.661 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:41.367473643 +0000 UTC m=+0.398072687 container start 79f63b4e254fbf29381f903db55e233baed747b8eff4281c9fb523c93abd2d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:41.661 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:41.464014468 +0000 UTC m=+0.494613524 container attach 79f63b4e254fbf29381f903db55e233baed747b8eff4281c9fb523c93abd2d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:41.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:41.490+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:41.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:41.490+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:41.969 INFO:journalctl@ceph.osd.4.smithi160.stdout:May 20 17:49:41 smithi160 podman[73146]: 2024-05-20 17:49:41.660988251 +0000 UTC m=+0.691587291 container died 79f63b4e254fbf29381f903db55e233baed747b8eff4281c9fb523c93abd2d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=) 2024-05-20T17:49:42.197 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:41.835+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:42.197 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:41 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:41.835+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:42.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:41 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:41.968+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:42.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:41 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:41.968+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:42.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:41 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:41.939+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:42.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:41 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:41.939+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:42.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:41 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:41.969+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:42.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:41 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:41.969+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:42.361 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.4.service' 2024-05-20T17:49:42.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:42.399 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-20T17:49:42.400 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-20T17:49:42.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.5 2024-05-20T17:49:42.513 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 systemd[1]: Stopping Ceph osd.5 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:42.513 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:42.196+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:42.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:42.196+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:42.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:42 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:42.399+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:42.512+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:42.512+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:42.707+0000 7f14f065a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:42.707+0000 7f14f065a700 -1 osd.5 108 *** Got signal Terminated *** 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:42.707+0000 7f14f065a700 -1 osd.5 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:42.824+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:42.825 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:42 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:42.824+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:43.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:42.963+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:43.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:42.963+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:43.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:42.915+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:43.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:42.915+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:43.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:42 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:42.987+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:43.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:42 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:42.987+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:43.527 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:43.227+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:43.527 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:43.227+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:43.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:43 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:43.441+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:43.816 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:43.527+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:43.816 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:43.527+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:44.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:43.816+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:44.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:43 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:43.816+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:44.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:43.937+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:44.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:43.937+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:44.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:43.919+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:44.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:43 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:43.919+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:44.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:43 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:43.993+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:44.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:43 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:43.994+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:44.484 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:44.208+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:44.485 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:44.208+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:44.756 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:44 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:44.414+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:44.779 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:44.483+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:44.779 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:44.484+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:45.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:44.778+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:45.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:44 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:44.778+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:45.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:44 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:44.892+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:45.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:44 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:44.892+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:45.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:44 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:44.958+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:45.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:44 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:44.958+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:45.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:44 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:44.958+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:45.450 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:45.025+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:45.451 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:45.025+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:45.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:45.233+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:45.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:45.233+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:45.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:45.479+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:45.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:45.479+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:45.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:45 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:45.450+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:46.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:45.789+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:46.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:45.789+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:46.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:45 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:45.789+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.538268+0000 front 2024-05-20T17:49:22.538091+0000 (oldest deadline 2024-05-20T17:49:44.838216+0000) 2024-05-20T17:49:46.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:45.937+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:46.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:45.937+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:46.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:45.937+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:46.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:45.998+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:46.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:45.998+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:46.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:45 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:45.998+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:46.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:46 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:46.004+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:46.255 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:46 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:46.005+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:46.256 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:46 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:46.005+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:46.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:46.218+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:46.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:46.218+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:46.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:46.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:46.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:46.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:46.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:46.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:46.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:46 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:46.487+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:47.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:46.810+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:01.634080+0000 front 2024-05-20T17:49:01.634200+0000 (oldest deadline 2024-05-20T17:49:26.334129+0000) 2024-05-20T17:49:47.080 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:46.810+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.636542+0000 front 2024-05-20T17:49:12.636562+0000 (oldest deadline 2024-05-20T17:49:37.936589+0000) 2024-05-20T17:49:47.080 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:46 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5[48572]: 2024-05-20T17:49:46.810+0000 7f14ecc10700 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.538268+0000 front 2024-05-20T17:49:22.538091+0000 (oldest deadline 2024-05-20T17:49:44.838216+0000) 2024-05-20T17:49:47.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:46 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:46.964+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:47.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:46 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:46.964+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:47.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:46 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:46.964+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:47.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:47.047+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:47.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:47.047+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:47.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:47.047+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:47.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:47 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:47.053+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:47.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:47 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:47.053+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:47.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:47 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:47.053+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:47.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:47 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:47.239+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:47.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:47 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:47.239+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:47.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:47 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:47.407+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:47.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:47 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:47.407+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:47.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:47 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:47.407+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:48.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:47 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:47.534+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:48.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:47 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:47.534+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:48.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:47.952+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:48.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:47.952+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:48.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:47 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:47.952+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:48.062+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:48.062+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:48.062+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:48.419 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:48 smithi172 podman[75147]: 2024-05-20 17:49:48.141751422 +0000 UTC m=+5.550118950 container died 0cc34a7257eff8be951a0e16c6607eb981d61198d3a40e517b232afb83e236f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0) 2024-05-20T17:49:48.419 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:48.207+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:48.419 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:48.207+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:48.419 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:48.207+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:48.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:48.007+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:48.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:48.007+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:48.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:48.007+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:48.701 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:48 smithi172 podman[75147]: 2024-05-20 17:49:48.466626527 +0000 UTC m=+5.874994052 container cleanup 0cc34a7257eff8be951a0e16c6607eb981d61198d3a40e517b232afb83e236f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:49:48.702 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:48 smithi172 bash[75147]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5 2024-05-20T17:49:48.702 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:48.419+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:48.702 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:48.419+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:48.702 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:48 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:48.419+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:49.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:48.536+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:49.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:48 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:48.536+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:49.079 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:48 smithi172 podman[75162]: 2024-05-20 17:49:48.701727223 +0000 UTC m=+0.556529355 container remove 0cc34a7257eff8be951a0e16c6607eb981d61198d3a40e517b232afb83e236f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:49:49.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:48.907+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:49.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:48.907+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:49.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:48 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:48.907+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:49.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:49.081+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:49.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:49.081+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:49.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:49.081+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:49.372 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:49.252+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:49.373 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:49.252+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:49.373 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:49.252+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:49.373 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.020881863 +0000 UTC m=+0.017312994 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:49.373 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.136050567 +0000 UTC m=+0.132481683 container create e76962552eaff6c582ed45ae4a63c003be6bd5b458677c291bf2c8cb8b64b94f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:49:49.374 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.372555856 +0000 UTC m=+0.368986982 container init e76962552eaff6c582ed45ae4a63c003be6bd5b458677c291bf2c8cb8b64b94f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-20T17:49:49.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:49 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:49.035+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:49.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:49 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:49.035+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:49.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:49 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:49.035+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:49.666 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.375687577 +0000 UTC m=+0.372118705 container start e76962552eaff6c582ed45ae4a63c003be6bd5b458677c291bf2c8cb8b64b94f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, io.buildah.version=1.33.5) 2024-05-20T17:49:49.667 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.4719619 +0000 UTC m=+0.468393030 container attach e76962552eaff6c582ed45ae4a63c003be6bd5b458677c291bf2c8cb8b64b94f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:49:49.667 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:49.389+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:49.667 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:49.389+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:49.667 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:49 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:49.389+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:50.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:49 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:49.573+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:50.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:49 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:49.573+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:50.017 INFO:journalctl@ceph.osd.5.smithi172.stdout:May 20 17:49:49 smithi172 podman[75256]: 2024-05-20 17:49:49.666733873 +0000 UTC m=+0.663165001 container died e76962552eaff6c582ed45ae4a63c003be6bd5b458677c291bf2c8cb8b64b94f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-20T17:49:50.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:49.892+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:50.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:49.892+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:50.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:49 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:49.892+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:50.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:50.044+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:50.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:50.044+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:50.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:50.044+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:50.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.5.service' 2024-05-20T17:49:50.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:50.357 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-20T17:49:50.357 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-20T17:49:50.357 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.6 2024-05-20T17:49:50.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:50 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:50.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:50.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:50 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:50.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:50.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:50 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:50.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:50.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:50.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:50.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:50.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:50.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:50.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:50.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:50.273+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:50.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:50.273+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:50.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:50 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:50.273+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:50.703 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 systemd[1]: Stopping Ceph osd.6 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:51.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:50 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:50.556+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:51.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:50 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:50.556+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:51.086 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.770+0000 7f4c71792700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:51.087 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.770+0000 7f4c71792700 -1 osd.6 108 *** Got signal Terminated *** 2024-05-20T17:49:51.087 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.770+0000 7f4c71792700 -1 osd.6 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:51.087 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.898+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:51.087 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.898+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:51.087 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:50 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:50.898+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:51.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:51.085+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:51.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:51.085+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:51.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:51.086+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:51.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:51 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:51.025+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:51.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:51 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:51.025+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:51.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:51 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:51.025+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:51.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:51.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:51.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:51.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:51.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:51.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:51.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:51.301+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:51.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:51.301+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:51.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:51 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:51.301+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:52.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:51 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:51.535+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:52.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:51 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:51.535+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:52.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:51.938+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:52.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:51.938+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:52.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:51.938+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:52.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:52.086+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:52.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:52.086+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:52.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:52.086+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:52.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:52 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:52.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:52.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:52 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:52.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:52.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:52 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:52.034+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:52.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:52.459+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:52.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:52.459+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:52.580 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:52.459+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:52.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:52.309+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:52.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:52.309+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:52.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:52 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:52.309+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:53.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:52 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:52.562+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:53.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:52 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:52.562+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:53.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:52.893+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:53.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:52.893+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:53.204 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:52 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:52.893+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:53.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:53.127+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:53.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:53.127+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:53.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:53.127+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:53.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:53.024+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:53.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:53.024+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:53.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:53.024+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:53.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:53.470+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:53.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:53.470+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:53.579 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:53.470+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:53.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:53.328+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:53.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:53.328+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:53.580 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:53 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:53.328+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:54.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:53.590+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:54.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:53.590+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:54.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:53 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:53.590+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:54.176 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:53.872+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:54.176 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:53.872+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:54.176 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:53 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:53.872+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:54.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:54.176+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:54.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:54.176+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:54.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:54.176+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:54.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:54.062+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:54.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:54.062+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:54.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:54.062+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:54.464+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:54.464+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:54.464+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:54.372+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:54.372+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:54.759 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:54 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:54.372+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:55.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:54.553+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:55.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:54.553+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:55.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:54 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:54.553+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:55.161 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:54.825+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.360557+0000 front 2024-05-20T17:49:03.360349+0000 (oldest deadline 2024-05-20T17:49:28.060578+0000) 2024-05-20T17:49:55.161 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:54.825+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.561804+0000 front 2024-05-20T17:49:11.561693+0000 (oldest deadline 2024-05-20T17:49:37.461702+0000) 2024-05-20T17:49:55.161 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:54.825+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:19.663665+0000 front 2024-05-20T17:49:19.663687+0000 (oldest deadline 2024-05-20T17:49:44.963697+0000) 2024-05-20T17:49:55.161 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:54 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6[57886]: 2024-05-20T17:49:54.825+0000 7f4c6dd48700 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:28.365546+0000 front 2024-05-20T17:49:28.365477+0000 (oldest deadline 2024-05-20T17:49:54.265471+0000) 2024-05-20T17:49:55.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:55 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:55.161+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:55.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:55 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:55.161+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:55.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:55 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:55.161+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:55.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:55.067+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:55.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:55.067+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:55.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:55.067+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:55.701 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:55.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:55.702 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:55.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:55.702 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:55.421+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:55.702 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:55.386+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:55.702 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:55.386+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:55.702 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:55 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:55.386+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:56.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:55.561+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:56.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:55.561+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:56.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:55.561+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:56.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:56 smithi135 podman[96796]: 2024-05-20 17:49:56.255857723 +0000 UTC m=+5.702260325 container died 9b643cfeb3fa8e991a229f9c610653f225075948950ed570c9ad29651103bc1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514) 2024-05-20T17:49:56.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:56 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:56.163+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:56.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:56 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:56.163+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:56.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:56 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:56.163+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:56.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:56.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:56.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:56.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:56.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:56.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:56.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:56.436+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:56.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:56.436+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:56.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:56.436+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:56.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:56.453+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:56.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:56.453+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:56.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:56.453+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:56.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:56 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:56.453+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:49:56.921 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:56 smithi135 podman[96796]: 2024-05-20 17:49:56.662496454 +0000 UTC m=+6.108899091 container cleanup 9b643cfeb3fa8e991a229f9c610653f225075948950ed570c9ad29651103bc1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux ) 2024-05-20T17:49:56.921 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:56 smithi135 bash[96796]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6 2024-05-20T17:49:57.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:56.520+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:57.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:56.520+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:57.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:56 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:56.520+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:57.203 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:56 smithi135 podman[96812]: 2024-05-20 17:49:56.921910972 +0000 UTC m=+0.664517355 container remove 9b643cfeb3fa8e991a229f9c610653f225075948950ed570c9ad29651103bc1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-20T17:49:57.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:57.157+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:57.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:57.157+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:57.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:57.157+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:57.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:57 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:57.157+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:49:57.289 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:57.118+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:57.289 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:57.118+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:57.289 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:57.118+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:57.289 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:57.118+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:49:57.517 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.142466625 +0000 UTC m=+0.017164265 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:49:57.517 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.273247018 +0000 UTC m=+0.147944645 container create bf09832578e04af5ed3aab60fd51e874c7c6f61629d3e5ef0dea05c91b0a4d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-20T17:49:57.517 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.517181387 +0000 UTC m=+0.391879008 container init bf09832578e04af5ed3aab60fd51e874c7c6f61629d3e5ef0dea05c91b0a4d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2) 2024-05-20T17:49:57.819 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.520515087 +0000 UTC m=+0.395212714 container start bf09832578e04af5ed3aab60fd51e874c7c6f61629d3e5ef0dea05c91b0a4d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-05-20T17:49:57.819 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.617275132 +0000 UTC m=+0.491972756 container attach bf09832578e04af5ed3aab60fd51e874c7c6f61629d3e5ef0dea05c91b0a4d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:57.478+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:57.478+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:57.478+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:57.412+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:57.412+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:57.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:57.412+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:57.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:57 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:57.412+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:49:58.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:57.558+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:58.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:57.558+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:58.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:57 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:57.558+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:58.120 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 20 17:49:57 smithi135 podman[96899]: 2024-05-20 17:49:57.819482234 +0000 UTC m=+0.694179865 container died bf09832578e04af5ed3aab60fd51e874c7c6f61629d3e5ef0dea05c91b0a4d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux ) 2024-05-20T17:49:58.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:58 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:58.119+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:58.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:58 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:58.119+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:58.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:58 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:58.119+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:58.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:58 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:58.119+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:49:58.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:58.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:58.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:58.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:58.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:58.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:58.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:58.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:49:58.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.6.service' 2024-05-20T17:49:58.557 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:49:58.557 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-20T17:49:58.557 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-20T17:49:58.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.7 2024-05-20T17:49:58.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:58.527+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:58.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:58.527+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:58.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:58.527+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:58.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:58.448+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:58.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:58.448+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:58.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:58.448+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:58.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:58 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:58.448+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:49:58.862 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.516+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.516+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.516+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 systemd[1]: Stopping Ceph osd.7 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.862+0000 7ff2c6609700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.862+0000 7ff2c6609700 -1 osd.7 108 *** Got signal Terminated *** 2024-05-20T17:49:58.863 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:58 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:58.862+0000 7ff2c6609700 -1 osd.7 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:49:59.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:59.107+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:49:59.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:59.107+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:49:59.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:59.107+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:49:59.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:49:59 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:49:59.107+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:49:59.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:59.154+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:49:59.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:59.154+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:49:59.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:59.154+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:49:59.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:49:59.154+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:49:59.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:59.493+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:49:59.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:59.493+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:49:59.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:49:59.493+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:49:59.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:59.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:49:59.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:59.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:49:59.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:59.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:49:59.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:49:59 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:49:59.433+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:00.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:59.530+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:50:00.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:59.530+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:50:00.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:49:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:49:59.530+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:50:00.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:00.101+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:00.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:00.101+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:00.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:00.101+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:00.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:00 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:00.101+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:00.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:00.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:00.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:00.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:00.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:00.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:00.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:00.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:00.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:00.427+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:00.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:00.427+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:00.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:00.427+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:00.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:00.427+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:00.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:00.511+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:00.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:00.511+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:00.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:00.511+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:00.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:00 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:00.511+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:01.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:00.578+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:50:01.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:00.578+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:50:01.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:00 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:00.578+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:50:01.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:01.124+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:01.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:01.124+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:01.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:01.124+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:01.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:01 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:01.124+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:01.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:01.115+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:01.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:01.115+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:01.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:01.115+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:01.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:01.115+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:01.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:01.513+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:01.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:01.513+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:01.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:01.513+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:01.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:01.513+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:01.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:01.456+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:01.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:01.456+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:01.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:01.456+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:01.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:01.456+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:01.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:01 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:01.456+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:02.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:01.570+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:50:02.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:01.570+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:50:02.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:01.570+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:50:02.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:01 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:01.570+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.735869+0000 front 2024-05-20T17:49:38.735926+0000 (oldest deadline 2024-05-20T17:50:01.035959+0000) 2024-05-20T17:50:02.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:02.112+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:02.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:02.112+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:02.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:02.112+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:02.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:02 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:02.113+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:02.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:02.107+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:02.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:02.107+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:02.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:02.107+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:02.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:02.107+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:02.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:02.512+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:02.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:02.512+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:02.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:02.512+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:02.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:02.512+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:02.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:02.491+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:02.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:02.491+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:02.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:02.491+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:02.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:02.491+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:02.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:02 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:02.491+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:03.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:02.599+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:50:03.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:02.599+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:50:03.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:02.599+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:50:03.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:02 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:02.599+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.735869+0000 front 2024-05-20T17:49:38.735926+0000 (oldest deadline 2024-05-20T17:50:01.035959+0000) 2024-05-20T17:50:03.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:03.147+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:03.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:03.147+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:03.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:03.147+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:03.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:03 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:03.147+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:03.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:03.127+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:03.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:03.127+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:03.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:03.127+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:03.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:03.127+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:03.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:03.479+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:03.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:03.479+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:03.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:03.479+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:03.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:03.479+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:03.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:03.528+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:03.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:03.528+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:03.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:03.528+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:03.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:03.528+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:03.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:03 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:03.528+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:04.005 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:03.567+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.131732+0000 front 2024-05-20T17:49:13.131653+0000 (oldest deadline 2024-05-20T17:49:36.031698+0000) 2024-05-20T17:50:04.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:03.567+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:21.233581+0000 front 2024-05-20T17:49:21.233741+0000 (oldest deadline 2024-05-20T17:49:46.533585+0000) 2024-05-20T17:50:04.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:03.567+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.234633+0000 front 2024-05-20T17:49:31.234594+0000 (oldest deadline 2024-05-20T17:49:53.534502+0000) 2024-05-20T17:50:04.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7[54010]: 2024-05-20T17:50:03.567+0000 7ff2c2bbf700 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.735869+0000 front 2024-05-20T17:49:38.735926+0000 (oldest deadline 2024-05-20T17:50:01.035959+0000) 2024-05-20T17:50:04.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:04.196+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:04.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:04.196+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:04.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:04.196+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:04.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:04 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:04.196+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:04.478 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:04 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:04.139+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:04.479 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:04 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:04.139+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:04.479 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:04 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:04.139+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:04.479 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:04 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:04.139+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:04.479 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:04 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:04.139+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:04.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:04 smithi160 podman[73265]: 2024-05-20 17:50:04.478936131 +0000 UTC m=+5.739862428 container died b40b8d620a00fdbf035f9b41c617ebe02df8b70e3925987103256db7d5a351fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-20T17:50:04.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:04.469+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:04.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:04.469+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:04.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:04.469+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:04.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:04.469+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:04.829 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:04.572+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:04.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:04.572+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:04.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:04.572+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:04.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:04.572+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:04.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:04 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:04.572+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:05.146 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:04 smithi160 podman[73265]: 2024-05-20 17:50:04.878620004 +0000 UTC m=+6.139546301 container cleanup b40b8d620a00fdbf035f9b41c617ebe02df8b70e3925987103256db7d5a351fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5) 2024-05-20T17:50:05.146 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:04 smithi160 bash[73265]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7 2024-05-20T17:50:05.476 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73281]: 2024-05-20 17:50:05.146427217 +0000 UTC m=+0.662746227 container remove b40b8d620a00fdbf035f9b41c617ebe02df8b70e3925987103256db7d5a351fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240514) 2024-05-20T17:50:05.476 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:05 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:05.165+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:05.476 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:05 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:05.165+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:05.477 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:05 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:05.165+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:05.477 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:05 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:05.165+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:05.477 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:05 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:05.165+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:05.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:05.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:05.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:05.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:05.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:05.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:05.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:05 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:05.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:05.755 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.378797871 +0000 UTC m=+0.017452184 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:50:05.756 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.505738131 +0000 UTC m=+0.144392424 container create b097d66ed37a209dc3482660b904c13a4e3d0c1f26def43c941a81a69ecfffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-20T17:50:05.756 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.708006714 +0000 UTC m=+0.346661018 container init b097d66ed37a209dc3482660b904c13a4e3d0c1f26def43c941a81a69ecfffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:50:05.756 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.710986169 +0000 UTC m=+0.349640475 container start b097d66ed37a209dc3482660b904c13a4e3d0c1f26def43c941a81a69ecfffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:05.508+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:05.508+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:05.508+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:05.508+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:05.594+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:05.594+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:05.594+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:05.773 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:05.594+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:05.774 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:05 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:05.594+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:06.024 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.791446402 +0000 UTC m=+0.430100745 container attach b097d66ed37a209dc3482660b904c13a4e3d0c1f26def43c941a81a69ecfffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-20T17:50:06.024 INFO:journalctl@ceph.osd.7.smithi160.stdout:May 20 17:50:05 smithi160 podman[73372]: 2024-05-20 17:50:05.998211989 +0000 UTC m=+0.636866294 container died b097d66ed37a209dc3482660b904c13a4e3d0c1f26def43c941a81a69ecfffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-20T17:50:06.344 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:06 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:06.174+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:06.344 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:06 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:06.174+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:06.344 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:06 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:06.174+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:06.345 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:06 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:06.174+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:06.345 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:06 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:06.174+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:06.605 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:06.263+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:06.605 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:06.263+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:06.605 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:06.263+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:06.605 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:06 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:06.263+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:06.672 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.7.service' 2024-05-20T17:50:06.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:06.709 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-20T17:50:06.709 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-20T17:50:06.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.8 2024-05-20T17:50:06.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:06.530+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:06.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:06.530+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:06.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:06.530+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:06.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:06.530+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:06.578+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:06.578+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:06.578+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:06.578+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:06.578+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:06.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:06 smithi172 systemd[1]: Stopping Ceph osd.8 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:07.329 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.027+0000 7fa937613700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:07.329 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.027+0000 7fa937613700 -1 osd.8 108 *** Got signal Terminated *** 2024-05-20T17:50:07.329 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.027+0000 7fa937613700 -1 osd.8 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:50:07.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:07.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:07.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:07.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:07.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:07.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:07.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:07.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:07.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:07.125+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:07.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:07 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:07.298+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:07.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:07 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:07.298+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:07.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:07 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:07.298+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:07.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:07 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:07.298+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:07.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:07.543+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:07.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:07.543+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:07.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:07.543+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:07.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:07.543+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:07.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.614+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:07.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.614+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:07.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.614+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:07.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.614+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:07.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:07 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:07.614+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:08.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:08.148+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:08.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:08.148+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:08.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:08.148+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:08.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:08.148+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:08.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:08 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:08.148+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:08.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:08 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:08.289+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:08.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:08 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:08.289+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:08.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:08 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:08.289+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:08.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:08 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:08.289+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:08.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:08.552+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:08.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:08.552+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:08.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:08.552+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:08.552+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:08.626+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:08.626+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:08.626+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:08.626+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:08.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:08 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:08.626+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:09.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:09.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:09.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:09.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:09.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:09.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:09 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:09.100+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:09.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:09 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:09.283+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:09.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:09 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:09.283+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:09.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:09 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:09.283+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:09.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:09 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:09.283+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:10.082 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:09.589+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:10.082 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:09.589+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:10.082 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:09.589+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:10.082 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:09.589+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:10.082 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:10.083 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:10.083 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:10.083 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:10.083 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:10.083 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:09 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:09.658+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:44.842623+0000 front 2024-05-20T17:49:44.842640+0000 (oldest deadline 2024-05-20T17:50:09.443462+0000) 2024-05-20T17:50:10.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:10.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:10.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:10.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:10.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:10.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:10 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:10.080+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:10.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:10 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:10.260+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:10.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:10 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:10.260+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:10.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:10 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:10.260+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:10.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:10 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:10.260+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:10.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:10 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:10.260+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:11.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:10.591+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:11.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:10.591+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:11.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:10.591+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:10.591+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:11.080 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:10 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:10.662+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:44.842623+0000 front 2024-05-20T17:49:44.842640+0000 (oldest deadline 2024-05-20T17:50:09.443462+0000) 2024-05-20T17:50:11.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:11.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:11.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:11.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:11.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:11.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:11 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:11.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:11.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:11 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:11.277+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:11.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:11 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:11.277+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:11.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:11 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:11.277+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:11.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:11 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:11.277+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:11.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:11 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:11.277+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:11.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:11.574+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:11.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:11.574+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:11.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:11.574+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:11.574+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:11.574+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.635092+0000 front 2024-05-20T17:49:03.635176+0000 (oldest deadline 2024-05-20T17:49:27.135000+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:12.237137+0000 front 2024-05-20T17:49:12.237152+0000 (oldest deadline 2024-05-20T17:49:35.737166+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.739185+0000 front 2024-05-20T17:49:22.739131+0000 (oldest deadline 2024-05-20T17:49:45.639345+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.440931+0000 front 2024-05-20T17:49:31.440972+0000 (oldest deadline 2024-05-20T17:49:55.540772+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:35.541350+0000 front 2024-05-20T17:49:35.541234+0000 (oldest deadline 2024-05-20T17:50:00.841192+0000) 2024-05-20T17:50:11.830 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:11 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8[55091]: 2024-05-20T17:50:11.681+0000 7fa933bc9700 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:44.842623+0000 front 2024-05-20T17:49:44.842640+0000 (oldest deadline 2024-05-20T17:50:09.443462+0000) 2024-05-20T17:50:12.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:12.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:12.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:12.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:12.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:12.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:12 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:12.106+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:12.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:12.281+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:12.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:12.281+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:12.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:12.281+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:12.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:12.281+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:12.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:12 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:12.281+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:12.821 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:12 smithi172 podman[75374]: 2024-05-20 17:50:12.515136868 +0000 UTC m=+5.605353582 container died 9cfdf66136d7ea01c79a182078b4c0417a2b1f4ba3cdb1061ca27c150341b61e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-20T17:50:12.822 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:12.620+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:12.822 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:12.620+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:12.822 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:12.620+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:12.822 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:12.620+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:12.822 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:12.620+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:13.079 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:12 smithi172 podman[75374]: 2024-05-20 17:50:12.911611914 +0000 UTC m=+6.001828619 container cleanup 9cfdf66136d7ea01c79a182078b4c0417a2b1f4ba3cdb1061ca27c150341b61e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-20T17:50:13.079 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:12 smithi172 bash[75374]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8 2024-05-20T17:50:13.488 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75389]: 2024-05-20 17:50:13.163079326 +0000 UTC m=+0.639869157 container remove 9cfdf66136d7ea01c79a182078b4c0417a2b1f4ba3cdb1061ca27c150341b61e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS) 2024-05-20T17:50:13.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:13.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:13.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:13.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:13.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:13.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:13 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:13.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:13.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:13.251+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:13.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:13.251+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:13.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:13.251+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:13.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:13.251+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:13.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:13 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:13.251+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75479]: 2024-05-20 17:50:13.39059819 +0000 UTC m=+0.017788324 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75479]: 2024-05-20 17:50:13.66404916 +0000 UTC m=+0.291239289 container create c1e18941081b6e6d88fa2a3615277ffcce113208369b83191735a6f90e4bda00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8-deactivate, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:13.664+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:13.664+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:13.664+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:13.664+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:13.776 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:13 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:13.665+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:14.079 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75479]: 2024-05-20 17:50:13.86653424 +0000 UTC m=+0.493724370 container init c1e18941081b6e6d88fa2a3615277ffcce113208369b83191735a6f90e4bda00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:50:14.079 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75479]: 2024-05-20 17:50:13.86970999 +0000 UTC m=+0.496900119 container start c1e18941081b6e6d88fa2a3615277ffcce113208369b83191735a6f90e4bda00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.license=GPLv2) 2024-05-20T17:50:14.079 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:13 smithi172 podman[75479]: 2024-05-20 17:50:13.96646321 +0000 UTC m=+0.593653352 container attach c1e18941081b6e6d88fa2a3615277ffcce113208369b83191735a6f90e4bda00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:50:14.350 INFO:journalctl@ceph.osd.8.smithi172.stdout:May 20 17:50:14 smithi172 podman[75479]: 2024-05-20 17:50:14.166253943 +0000 UTC m=+0.793444072 container died c1e18941081b6e6d88fa2a3615277ffcce113208369b83191735a6f90e4bda00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-05-20T17:50:14.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:14.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:14.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:14.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:14.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:14.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:14 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:14.138+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:14.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.8.service' 2024-05-20T17:50:14.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:14.211+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:14.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:14.211+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:14.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:14.211+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:14.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:14.211+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:14.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:14.211+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:14.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:14.734 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-20T17:50:14.734 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-20T17:50:14.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.9 2024-05-20T17:50:15.056 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:14 smithi135 systemd[1]: Stopping Ceph osd.9 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:15.056 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.056+0000 7f96b7021700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:15.057 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.056+0000 7f96b7021700 -1 osd.9 108 *** Got signal Terminated *** 2024-05-20T17:50:15.057 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.056+0000 7f96b7021700 -1 osd.9 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:50:15.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:14.684+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:15.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:14.684+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:15.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:14.684+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:15.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:14.684+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:15.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:14 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:14.684+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:15.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.181+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:15.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.181+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:15.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.181+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:15.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.181+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:15.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:15 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:15.181+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:15.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:15.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:15.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:15.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:15.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:15.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:15 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:15.147+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:16.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:15.641+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:16.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:15.641+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:16.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:15.641+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:16.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:15.641+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:16.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:15.641+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:16.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:16.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:16.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:16.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:16.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:16.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:16 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:16.143+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:16.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:16.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:16.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:16.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:16.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:16.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:16.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:16.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:16.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:16 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:16.223+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:17.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:16.615+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:17.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:16.615+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:17.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:16.615+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:17.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:16.615+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:17.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:16 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:16.615+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:17.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:17.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:17.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:17.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:17.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:17.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:17.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:17 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:17.189+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:17.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:17.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:17.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:17.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:17.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:17.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:17 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:17.259+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:53.334202+0000 front 2024-05-20T17:49:53.334170+0000 (oldest deadline 2024-05-20T17:50:16.834347+0000) 2024-05-20T17:50:18.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:18.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:18.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:18.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:18.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:18.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:17 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:17.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:18.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:18.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:18 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:18.155+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:18.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:18.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:18.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:18.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:18.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:18.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:18 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:18.246+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:53.334202+0000 front 2024-05-20T17:49:53.334170+0000 (oldest deadline 2024-05-20T17:50:16.834347+0000) 2024-05-20T17:50:18.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:18.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:18.829 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:18.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:18.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:18.830 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:18.544+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:19 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:19.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:19.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:04.825677+0000 front 2024-05-20T17:49:04.825928+0000 (oldest deadline 2024-05-20T17:49:28.925870+0000) 2024-05-20T17:50:19.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:08.926501+0000 front 2024-05-20T17:49:08.926390+0000 (oldest deadline 2024-05-20T17:49:35.327357+0000) 2024-05-20T17:50:19.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.628562+0000 front 2024-05-20T17:49:20.628494+0000 (oldest deadline 2024-05-20T17:49:44.728592+0000) 2024-05-20T17:50:19.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:30.030039+0000 front 2024-05-20T17:49:30.029915+0000 (oldest deadline 2024-05-20T17:49:57.030567+0000) 2024-05-20T17:50:19.703 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:45.232522+0000 front 2024-05-20T17:49:45.232440+0000 (oldest deadline 2024-05-20T17:50:09.932484+0000) 2024-05-20T17:50:19.704 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:19 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9[64571]: 2024-05-20T17:50:19.230+0000 7f96af5cf700 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:53.334202+0000 front 2024-05-20T17:49:53.334170+0000 (oldest deadline 2024-05-20T17:50:16.834347+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:20.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:19 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:19.584+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:20.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:20.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:20.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:20.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:20.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:20.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:20.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:20 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:20.144+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:20.831 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:20 smithi135 podman[97018]: 2024-05-20 17:50:20.514741545 +0000 UTC m=+5.582469574 container died 5824f28cc4e60e8131ffdeadbc42efb51196d05eef4d4f81a6e6d79a656e1aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:21.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:20 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:20.626+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:21.139 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:20 smithi135 podman[97018]: 2024-05-20 17:50:20.930710043 +0000 UTC m=+5.998438064 container cleanup 5824f28cc4e60e8131ffdeadbc42efb51196d05eef4d4f81a6e6d79a656e1aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-20T17:50:21.140 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:20 smithi135 bash[97018]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9 2024-05-20T17:50:21.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97035]: 2024-05-20 17:50:21.140312228 +0000 UTC m=+0.623196605 container remove 5824f28cc4e60e8131ffdeadbc42efb51196d05eef4d4f81a6e6d79a656e1aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-05-20T17:50:21.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:21.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:21 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:21.149+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:21.835 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97120]: 2024-05-20 17:50:21.456521844 +0000 UTC m=+0.017375893 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:50:21.836 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97120]: 2024-05-20 17:50:21.574432975 +0000 UTC m=+0.135287016 container create 9acb1e6528126cdb1f96ef878125c088882c0665bcd548421ec6ded3b2992e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:50:22.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:22.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:22.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:22.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:22.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:22.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:21 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:21.655+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:22.131 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97120]: 2024-05-20 17:50:21.835665296 +0000 UTC m=+0.396519348 container init 9acb1e6528126cdb1f96ef878125c088882c0665bcd548421ec6ded3b2992e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:50:22.131 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97120]: 2024-05-20 17:50:21.839363101 +0000 UTC m=+0.400217153 container start 9acb1e6528126cdb1f96ef878125c088882c0665bcd548421ec6ded3b2992e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-20T17:50:22.131 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:21 smithi135 podman[97120]: 2024-05-20 17:50:21.918490923 +0000 UTC m=+0.479344979 container attach 9acb1e6528126cdb1f96ef878125c088882c0665bcd548421ec6ded3b2992e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:50:22.399 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 20 17:50:22 smithi135 podman[97120]: 2024-05-20 17:50:22.131776322 +0000 UTC m=+0.692630373 container died 9acb1e6528126cdb1f96ef878125c088882c0665bcd548421ec6ded3b2992e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-20T17:50:22.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:22.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:22.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:22.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:22.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:22.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:22.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:22.123+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:22.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.9.service' 2024-05-20T17:50:22.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:22.758 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-20T17:50:22.759 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-20T17:50:22.759 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.10 2024-05-20T17:50:23.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:23.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:23.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:23.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:23.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:23.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:22.676+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:23.117 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:22 smithi160 systemd[1]: Stopping Ceph osd.10 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:23.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.117+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.288+0000 7fc68968f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.288+0000 7fc68968f700 -1 osd.10 108 *** Got signal Terminated *** 2024-05-20T17:50:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:23 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:23.288+0000 7fc68968f700 -1 osd.10 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:50:23.980 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:23.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:23.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:23.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:23.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:23.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:23 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:23.667+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:24.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:24.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:24.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:24.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:24.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:24.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:24.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:24 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:24.157+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:25.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:24 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:24.634+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:25.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:25 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:25.110+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:26.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:25 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:25.654+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:26.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:26 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:26.113+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:27.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:27.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:26 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:26.700+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:27.406 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:27.407 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:27 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:27.078+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:28.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:28.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:27 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:27.672+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:28.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:03.640966+0000 front 2024-05-20T17:49:03.640989+0000 (oldest deadline 2024-05-20T17:49:26.540957+0000) 2024-05-20T17:50:28.505 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:11.142804+0000 front 2024-05-20T17:49:11.142828+0000 (oldest deadline 2024-05-20T17:49:37.543430+0000) 2024-05-20T17:50:28.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:20.945468+0000 front 2024-05-20T17:49:20.945431+0000 (oldest deadline 2024-05-20T17:49:45.045441+0000) 2024-05-20T17:50:28.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-20T17:49:31.447337+0000 front 2024-05-20T17:49:31.447329+0000 (oldest deadline 2024-05-20T17:49:56.147467+0000) 2024-05-20T17:50:28.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:38.949055+0000 front 2024-05-20T17:49:38.949090+0000 (oldest deadline 2024-05-20T17:50:03.649279+0000) 2024-05-20T17:50:28.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:47.150585+0000 front 2024-05-20T17:49:47.150722+0000 (oldest deadline 2024-05-20T17:50:08.250526+0000) 2024-05-20T17:50:28.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10[60576]: 2024-05-20T17:50:28.086+0000 7fc685c45700 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:51.752109+0000 front 2024-05-20T17:49:51.751903+0000 (oldest deadline 2024-05-20T17:50:16.451713+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:29.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:29.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:28 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:28.648+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:29.156 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:28 smithi160 podman[73478]: 2024-05-20 17:50:28.867293637 +0000 UTC m=+5.908638193 container died 28515380afa72dba0ac52558af1fe3b906d416b8e047c352cf4bd76dcff6848f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514) 2024-05-20T17:50:29.498 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:29 smithi160 podman[73478]: 2024-05-20 17:50:29.288663231 +0000 UTC m=+6.330007786 container cleanup 28515380afa72dba0ac52558af1fe3b906d416b8e047c352cf4bd76dcff6848f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:50:29.498 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:29 smithi160 bash[73478]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10 2024-05-20T17:50:29.755 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:29 smithi160 podman[73495]: 2024-05-20 17:50:29.498418089 +0000 UTC m=+0.623487672 container remove 28515380afa72dba0ac52558af1fe3b906d416b8e047c352cf4bd76dcff6848f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-20T17:50:30.076 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:29 smithi160 podman[73582]: 2024-05-20 17:50:29.727595682 +0000 UTC m=+0.016983921 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:50:30.076 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:29 smithi160 podman[73582]: 2024-05-20 17:50:29.849460369 +0000 UTC m=+0.138848626 container create 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-05-20T17:50:30.076 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:30 smithi160 podman[73582]: 2024-05-20 17:50:30.076724626 +0000 UTC m=+0.366112854 container init 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:30.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:29 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:29.608+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:30.372 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:30 smithi160 podman[73582]: 2024-05-20 17:50:30.079851811 +0000 UTC m=+0.369240047 container start 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-20T17:50:30.372 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:30 smithi160 podman[73582]: 2024-05-20 17:50:30.176577537 +0000 UTC m=+0.465965791 container attach 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, ceph=True) 2024-05-20T17:50:30.670 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:30 smithi160 podman[73582]: 2024-05-20 17:50:30.372622899 +0000 UTC m=+0.662011134 container died 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:50:30.921 INFO:journalctl@ceph.osd.10.smithi160.stdout:May 20 17:50:30 smithi160 podman[73608]: 2024-05-20 17:50:30.904578465 +0000 UTC m=+0.523084439 container remove 5b55a5444e8f42862f465b4dd05ca2d5ab066c4c8083f9fa9d8eb515e2e4c69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-10-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-20T17:50:30.925 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.10.service' 2024-05-20T17:50:30.963 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:30.963 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-20T17:50:30.963 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-20T17:50:30.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.11 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:30.990 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:30 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:30.613+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:31.272 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 systemd[1]: Stopping Ceph osd.11 for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:31.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.271+0000 7f6601ef4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:31.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.271+0000 7f6601ef4700 -1 osd.11 108 *** Got signal Terminated *** 2024-05-20T17:50:31.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.271+0000 7f6601ef4700 -1 osd.11 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:50:32.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:32.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:32.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:32.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:32.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:32.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:32.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:31 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:31.638+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:33.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:33.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:33.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:33.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:33.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:33.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:33.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:32 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:32.677+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:34.037 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:34.038 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:33 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:33.724+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:35.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:35.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:35.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:35.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:35.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:35.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:35.080 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:34 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:34.745+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-20T17:49:00.160447+0000 front 2024-05-20T17:49:00.160406+0000 (oldest deadline 2024-05-20T17:49:26.060453+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-05-20T17:49:13.463446+0000 front 2024-05-20T17:49:13.463246+0000 (oldest deadline 2024-05-20T17:49:39.363348+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-05-20T17:49:22.765026+0000 front 2024-05-20T17:49:22.765058+0000 (oldest deadline 2024-05-20T17:49:47.465233+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-05-20T17:49:37.466773+0000 front 2024-05-20T17:49:37.466843+0000 (oldest deadline 2024-05-20T17:50:00.366615+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-05-20T17:49:46.267583+0000 front 2024-05-20T17:49:46.267564+0000 (oldest deadline 2024-05-20T17:50:10.967526+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-20T17:49:50.968027+0000 front 2024-05-20T17:49:50.968078+0000 (oldest deadline 2024-05-20T17:50:16.868061+0000) 2024-05-20T17:50:36.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:35 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11[62087]: 2024-05-20T17:50:35.783+0000 7f65fe4aa700 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-05-20T17:50:03.770004+0000 front 2024-05-20T17:50:03.769974+0000 (oldest deadline 2024-05-20T17:50:24.869853+0000) 2024-05-20T17:50:37.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:36 smithi172 podman[75596]: 2024-05-20 17:50:36.82635653 +0000 UTC m=+5.660611990 container died fd64d626d04b43865034a34dcf396804929a8081630819e5712fdfe2ec53bd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-20T17:50:37.365 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:37 smithi172 podman[75596]: 2024-05-20 17:50:37.163665961 +0000 UTC m=+5.997921416 container cleanup fd64d626d04b43865034a34dcf396804929a8081630819e5712fdfe2ec53bd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-20T17:50:37.365 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:37 smithi172 bash[75596]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11 2024-05-20T17:50:37.781 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:37 smithi172 podman[75612]: 2024-05-20 17:50:37.36472328 +0000 UTC m=+0.538462876 container remove fd64d626d04b43865034a34dcf396804929a8081630819e5712fdfe2ec53bd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True) 2024-05-20T17:50:38.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:37 smithi172 podman[75700]: 2024-05-20 17:50:37.782224948 +0000 UTC m=+0.111008262 container create 70cc415fd104b1a61f79a145fcae2b735e29a2193e5da9844adfe1508770fe95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-20T17:50:38.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:37 smithi172 podman[75700]: 2024-05-20 17:50:37.688533382 +0000 UTC m=+0.017316666 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:50:38.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:38 smithi172 podman[75700]: 2024-05-20 17:50:38.018088219 +0000 UTC m=+0.346871495 container init 70cc415fd104b1a61f79a145fcae2b735e29a2193e5da9844adfe1508770fe95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:50:38.079 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:38 smithi172 podman[75700]: 2024-05-20 17:50:38.021559751 +0000 UTC m=+0.350343031 container start 70cc415fd104b1a61f79a145fcae2b735e29a2193e5da9844adfe1508770fe95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514) 2024-05-20T17:50:38.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:38 smithi172 podman[75700]: 2024-05-20 17:50:38.084271182 +0000 UTC m=+0.413054458 container attach 70cc415fd104b1a61f79a145fcae2b735e29a2193e5da9844adfe1508770fe95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_CLEAN=True) 2024-05-20T17:50:38.579 INFO:journalctl@ceph.osd.11.smithi172.stdout:May 20 17:50:38 smithi172 podman[75700]: 2024-05-20 17:50:38.309795443 +0000 UTC m=+0.638578715 container died 70cc415fd104b1a61f79a145fcae2b735e29a2193e5da9844adfe1508770fe95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:50:38.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@osd.11.service' 2024-05-20T17:50:38.966 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:38.966 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-20T17:50:38.967 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-20T17:50:38.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.a 2024-05-20T17:50:39.332 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:39 smithi135 systemd[1]: Stopping Ceph mds.a for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:39.703 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a[71189]: 2024-05-20T17:50:39.331+0000 7f1184b65700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:39.703 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:39 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a[71189]: 2024-05-20T17:50:39.331+0000 7f1184b65700 -1 mds.a *** got signal Terminated *** 2024-05-20T17:50:41.157 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:40 smithi135 podman[97240]: 2024-05-20 17:50:40.85032819 +0000 UTC m=+1.687370511 container died 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:50:41.453 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:41 smithi135 podman[97240]: 2024-05-20 17:50:41.215009662 +0000 UTC m=+2.052051930 container cleanup 4c0dbf90428a4c1d7e378070df0d816dba7b1450623548fd41353a63b74f938c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:50:41.453 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 20 17:50:41 smithi135 bash[97240]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-a 2024-05-20T17:50:41.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.a.service' 2024-05-20T17:50:41.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:41.685 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-20T17:50:41.685 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-20T17:50:41.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.d 2024-05-20T17:50:42.203 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:41 smithi135 systemd[1]: Stopping Ceph mds.d for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:42.203 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d[70243]: 2024-05-20T17:50:42.010+0000 7fc7fb340700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:42.203 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:42 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d[70243]: 2024-05-20T17:50:42.010+0000 7fc7fb340700 -1 mds.d *** got signal Terminated *** 2024-05-20T17:50:45.528 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:45 smithi135 podman[97374]: 2024-05-20 17:50:45.228002456 +0000 UTC m=+3.322760765 container died b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-20T17:50:45.870 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:45 smithi135 podman[97374]: 2024-05-20 17:50:45.644253508 +0000 UTC m=+3.739011812 container cleanup b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514) 2024-05-20T17:50:45.870 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:45 smithi135 bash[97374]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d 2024-05-20T17:50:46.124 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 20 17:50:45 smithi135 podman[97386]: 2024-05-20 17:50:45.870397588 +0000 UTC m=+0.644774081 container remove b7d6c4e94fa702d4ab2b70764e6914ae10ba10df616320fdddb93ce4b23672ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-05-20T17:50:46.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.d.service' 2024-05-20T17:50:46.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:46.161 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-20T17:50:46.161 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-20T17:50:46.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.g 2024-05-20T17:50:46.453 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:46 smithi135 systemd[1]: Stopping Ceph mds.g for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:46.953 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:46 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g[70847]: 2024-05-20T17:50:46.489+0000 7fe934d33700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:46.953 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:46 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g[70847]: 2024-05-20T17:50:46.489+0000 7fe934d33700 -1 mds.g *** got signal Terminated *** 2024-05-20T17:50:50.365 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:50 smithi135 podman[97495]: 2024-05-20 17:50:50.104527882 +0000 UTC m=+3.723707612 container died 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-20T17:50:50.703 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:50 smithi135 podman[97495]: 2024-05-20 17:50:50.472831194 +0000 UTC m=+4.092010912 container cleanup 9d90ca9a09f593771a3f6baca4df4d0867afeb200c6645f3e86565c7ab365976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:50:50.703 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 20 17:50:50 smithi135 bash[97495]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-g 2024-05-20T17:50:51.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.g.service' 2024-05-20T17:50:51.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:51.081 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-20T17:50:51.081 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-20T17:50:51.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.j 2024-05-20T17:50:51.385 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:51 smithi135 systemd[1]: Stopping Ceph mds.j for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:51.703 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j[69895]: 2024-05-20T17:50:51.384+0000 7fb8565bd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:51.703 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:51 smithi135 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j[69895]: 2024-05-20T17:50:51.384+0000 7fb8565bd700 -1 mds.j *** got signal Terminated *** 2024-05-20T17:50:54.685 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:54 smithi135 podman[97617]: 2024-05-20 17:50:54.253418646 +0000 UTC m=+2.957440711 container died 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-20T17:50:54.953 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:54 smithi135 podman[97617]: 2024-05-20 17:50:54.768100718 +0000 UTC m=+3.472122775 container cleanup 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:50:54.953 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:54 smithi135 bash[97617]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j 2024-05-20T17:50:55.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.j.service' 2024-05-20T17:50:55.219 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:54 smithi135 podman[97630]: 2024-05-20 17:50:54.960789317 +0000 UTC m=+0.705463694 container remove 2ce3f63b2cbe8f885d81cbd9239b10205884b935fcc236e4461d88c729cee8b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-20T17:50:55.219 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:55 smithi135 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.j.service: Deactivated successfully. 2024-05-20T17:50:55.220 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:55 smithi135 systemd[1]: Stopped Ceph mds.j for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:50:55.220 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 20 17:50:55 smithi135 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.j.service: Consumed 1.137s CPU time. 2024-05-20T17:50:55.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:55.230 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-20T17:50:55.231 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-20T17:50:55.231 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.b 2024-05-20T17:50:55.521 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:55 smithi160 systemd[1]: Stopping Ceph mds.b for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:56.005 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: 2024-05-20T17:50:55.520+0000 7f2dc3fa2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:56.005 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:55 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b[66217]: 2024-05-20T17:50:55.520+0000 7f2dc3fa2700 -1 mds.b *** got signal Terminated *** 2024-05-20T17:50:58.188 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:57 smithi160 podman[73686]: 2024-05-20 17:50:57.906003134 +0000 UTC m=+2.484828289 container died e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True) 2024-05-20T17:50:58.505 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:58 smithi160 podman[73686]: 2024-05-20 17:50:58.296924395 +0000 UTC m=+2.875749550 container cleanup e8963aa90051802daa9473dac462b18fec883396b314495a826063a5ffdc7cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-20T17:50:58.505 INFO:journalctl@ceph.mds.b.smithi160.stdout:May 20 17:50:58 smithi160 bash[73686]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-b 2024-05-20T17:50:58.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.b.service' 2024-05-20T17:50:58.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:50:58.746 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-20T17:50:58.746 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-20T17:50:58.746 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.e 2024-05-20T17:50:59.005 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:50:58 smithi160 systemd[1]: Stopping Ceph mds.e for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:50:59.505 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:50:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: 2024-05-20T17:50:59.067+0000 7f92fa34b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:50:59.505 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:50:59 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e[65607]: 2024-05-20T17:50:59.067+0000 7f92fa34b700 -1 mds.e *** got signal Terminated *** 2024-05-20T17:51:02.234 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:01 smithi160 podman[73807]: 2024-05-20 17:51:01.931232363 +0000 UTC m=+2.973245112 container died 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-05-20T17:51:02.493 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 podman[73807]: 2024-05-20 17:51:02.317515512 +0000 UTC m=+3.359528259 container cleanup 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-20T17:51:02.493 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 bash[73807]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e 2024-05-20T17:51:02.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.e.service' 2024-05-20T17:51:02.755 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 podman[73830]: 2024-05-20 17:51:02.494048487 +0000 UTC m=+0.559843948 container remove 743de2d8c9f65bac242f0124f4ae949f3c25cb644bf22e9e4dbc77d49486b1dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-e, org.label-schema.build-date=20240514, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-20T17:51:02.755 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.e.service: Deactivated successfully. 2024-05-20T17:51:02.755 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 systemd[1]: Stopped Ceph mds.e for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:51:02.755 INFO:journalctl@ceph.mds.e.smithi160.stdout:May 20 17:51:02 smithi160 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.e.service: Consumed 52.766s CPU time. 2024-05-20T17:51:02.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:02.775 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-20T17:51:02.776 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-20T17:51:02.776 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.h 2024-05-20T17:51:03.088 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:02 smithi160 systemd[1]: Stopping Ceph mds.h for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:03.505 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:51:03.088+0000 7fb704e0b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:03.505 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:03 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h[65909]: 2024-05-20T17:51:03.088+0000 7fb704e0b700 -1 mds.h *** got signal Terminated *** 2024-05-20T17:51:06.255 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:05 smithi160 podman[73938]: 2024-05-20 17:51:05.91495057 +0000 UTC m=+2.923760461 container died d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-20T17:51:06.588 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:06 smithi160 podman[73938]: 2024-05-20 17:51:06.371234246 +0000 UTC m=+3.380044132 container cleanup d6aa6a030ad88381f05cb97dea22120eb3d062579c667d3522b486ec23eb26f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-20T17:51:06.588 INFO:journalctl@ceph.mds.h.smithi160.stdout:May 20 17:51:06 smithi160 bash[73938]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-h 2024-05-20T17:51:06.812 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.h.service' 2024-05-20T17:51:06.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:06.845 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-20T17:51:06.845 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-20T17:51:06.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.k 2024-05-20T17:51:07.225 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:06 smithi160 systemd[1]: Stopping Ceph mds.k for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:07.505 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k[65290]: 2024-05-20T17:51:07.225+0000 7fbb48c2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:07.505 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:07 smithi160 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k[65290]: 2024-05-20T17:51:07.225+0000 7fbb48c2f700 -1 mds.k *** got signal Terminated *** 2024-05-20T17:51:11.506 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:11 smithi160 podman[74058]: 2024-05-20 17:51:11.233262721 +0000 UTC m=+4.157314027 container died 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-20T17:51:11.883 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:11 smithi160 podman[74058]: 2024-05-20 17:51:11.607876739 +0000 UTC m=+4.531928033 container cleanup 9364cc18c20f8a12dcdec80e89fdb8105b0163eae9eff5759dacc14d83c1e763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-05-20T17:51:11.883 INFO:journalctl@ceph.mds.k.smithi160.stdout:May 20 17:51:11 smithi160 bash[74058]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-k 2024-05-20T17:51:12.001 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.k.service' 2024-05-20T17:51:12.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:12.033 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-20T17:51:12.033 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-20T17:51:12.033 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.c 2024-05-20T17:51:12.327 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:12 smithi172 systemd[1]: Stopping Ceph mds.c for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:12.578 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: 2024-05-20T17:51:12.327+0000 7fe2bb2bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:12.579 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:12 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c[67525]: 2024-05-20T17:51:12.327+0000 7fe2bb2bc700 -1 mds.c *** got signal Terminated *** 2024-05-20T17:51:14.178 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:13 smithi172 podman[75804]: 2024-05-20 17:51:13.888994445 +0000 UTC m=+1.663552124 container died e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-20T17:51:14.570 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:14 smithi172 podman[75804]: 2024-05-20 17:51:14.269228046 +0000 UTC m=+2.043785731 container cleanup e5895e855f37c2c9840f9911cc5bc5f061408588330b27a1ee7e833f8bdff6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-20T17:51:14.570 INFO:journalctl@ceph.mds.c.smithi172.stdout:May 20 17:51:14 smithi172 bash[75804]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-c 2024-05-20T17:51:14.735 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.c.service' 2024-05-20T17:51:14.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:14.770 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-20T17:51:14.770 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-20T17:51:14.771 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.f 2024-05-20T17:51:15.099 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:14 smithi172 systemd[1]: Stopping Ceph mds.f for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:15.579 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: 2024-05-20T17:51:15.098+0000 7f7fcf74e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:15.579 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:15 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f[67222]: 2024-05-20T17:51:15.098+0000 7f7fcf74e700 -1 mds.f *** got signal Terminated *** 2024-05-20T17:51:18.160 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:17 smithi172 podman[75936]: 2024-05-20 17:51:17.885274311 +0000 UTC m=+2.899259649 container died 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-20T17:51:18.481 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:18 smithi172 podman[75936]: 2024-05-20 17:51:18.26461253 +0000 UTC m=+3.278597861 container cleanup 28c8345983d5a0e378fba65ec9ceaa5a178e924ca6cc76f02d0e33bbab9db5dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-20T17:51:18.482 INFO:journalctl@ceph.mds.f.smithi172.stdout:May 20 17:51:18 smithi172 bash[75936]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-f 2024-05-20T17:51:18.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.f.service' 2024-05-20T17:51:18.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:18.651 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-20T17:51:18.651 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-20T17:51:18.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.i 2024-05-20T17:51:18.829 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:18 smithi172 systemd[1]: Stopping Ceph mds.i for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:19.328 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:51:18.967+0000 7f5173b03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:19.329 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:18 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i[67825]: 2024-05-20T17:51:18.967+0000 7f5173b03700 -1 mds.i *** got signal Terminated *** 2024-05-20T17:51:22.144 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:21 smithi172 podman[76059]: 2024-05-20 17:51:21.887741577 +0000 UTC m=+3.019277239 container died e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True) 2024-05-20T17:51:22.418 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 podman[76059]: 2024-05-20 17:51:22.226138945 +0000 UTC m=+3.357674596 container cleanup e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-05-20T17:51:22.418 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 bash[76059]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i 2024-05-20T17:51:22.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.i.service' 2024-05-20T17:51:22.679 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 podman[76073]: 2024-05-20 17:51:22.419034323 +0000 UTC m=+0.524766990 container remove e71018bbef41a56ac5d0afc1799924593050fb13af33233abe2b0e9a4e4376d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-i, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:51:22.680 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.i.service: Deactivated successfully. 2024-05-20T17:51:22.680 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 systemd[1]: Stopped Ceph mds.i for 76c4e726-16cd-11ef-bc9a-c7b262605968. 2024-05-20T17:51:22.680 INFO:journalctl@ceph.mds.i.smithi172.stdout:May 20 17:51:22 smithi172 systemd[1]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.i.service: Consumed 8min 33.642s CPU time. 2024-05-20T17:51:22.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:22.691 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-20T17:51:22.691 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-20T17:51:22.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.l 2024-05-20T17:51:22.988 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:22 smithi172 systemd[1]: Stopping Ceph mds.l for 76c4e726-16cd-11ef-bc9a-c7b262605968... 2024-05-20T17:51:23.329 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l[66906]: 2024-05-20T17:51:22.988+0000 7fdfa4507700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:51:23.329 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:22 smithi172 ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l[66906]: 2024-05-20T17:51:22.988+0000 7fdfa4507700 -1 mds.l *** got signal Terminated *** 2024-05-20T17:51:24.643 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:24 smithi172 podman[76181]: 2024-05-20 17:51:24.379681801 +0000 UTC m=+1.471872000 container died 9cac0e586578aab323c81eccc2990c9f4c6a532321f663aca32888f787e6f063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-20T17:51:25.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:24 smithi172 podman[76181]: 2024-05-20 17:51:24.755566734 +0000 UTC m=+1.847756976 container cleanup 9cac0e586578aab323c81eccc2990c9f4c6a532321f663aca32888f787e6f063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:51:25.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:May 20 17:51:24 smithi172 bash[76181]: ceph-76c4e726-16cd-11ef-bc9a-c7b262605968-mds-l 2024-05-20T17:51:25.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-76c4e726-16cd-11ef-bc9a-c7b262605968@mds.l.service' 2024-05-20T17:51:25.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:51:25.207 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-20T17:51:25.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:51:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:51:27.857 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:51:28.047 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:51:30.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:51:30.954 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T17:51:33.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:51:33.424 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:51:33.456 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:51:33.481 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-20T17:51:33.483 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi135/crash 2024-05-20T17:51:33.484 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:51:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:51:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:51:33.514 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi160/crash 2024-05-20T17:51:33.515 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:51:33.555 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:51:33.555 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:51:33.557 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi172/crash 2024-05-20T17:51:33.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:51:33.611 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:51:33.611 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:51:33.612 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-20T17:51:33.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-20T17:51:33.653 INFO:tasks.cephadm:Compressing logs... 2024-05-20T17:51:33.654 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:51:33.696 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:51:33.699 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:51:33.720 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:51:33.720 INFO:teuthology.orchestra.run.smithi135.stderr:: No such file or directory 2024-05-20T17:51:33.721 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:51:33.722 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.g.log 2024-05-20T17:51:33.722 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.j.log 2024-05-20T17:51:33.722 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.3.log 2024-05-20T17:51:33.722 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.0.log 2024-05-20T17:51:33.722 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.j.log: /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.x.log 2024-05-20T17:51:33.724 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.a.log 2024-05-20T17:51:33.724 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.6.log 2024-05-20T17:51:33.724 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.a.log: 90.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:51:33.726 INFO:teuthology.orchestra.run.smithi135.stderr: 94.6% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.j.log.gz 2024-05-20T17:51:33.727 INFO:teuthology.orchestra.run.smithi135.stderr: 94.6% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.g.log.gz 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.a.log 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr: 84.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.d.log 2024-05-20T17:51:33.730 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.9.log 2024-05-20T17:51:33.734 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.a.log.gz 2024-05-20T17:51:33.735 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:51:33.736 INFO:teuthology.orchestra.run.smithi135.stderr: 94.5% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.d.log.gz 2024-05-20T17:51:33.743 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-20T17:51:33.743 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:51:33.743 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:51:33.743 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.7.log 2024-05-20T17:51:33.743 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.b.log 2024-05-20T17:51:33.744 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.9.log: 91.0% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.4.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.1.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.y.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.h.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.10.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.e.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:51:33.747 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.b.log 2024-05-20T17:51:33.748 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.k.log 2024-05-20T17:51:33.748 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.2.log 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.f.log 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log: /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:51:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.5.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.c.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.c.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.z.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.i.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.z.log: -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.11.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.8.log 2024-05-20T17:51:33.752 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:51:33.753 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.l.log 2024-05-20T17:51:33.753 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:51:33.753 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:51:33.796 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 84.0% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:51:33.865 INFO:teuthology.orchestra.run.smithi160.stderr: 92.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.y.log.gz 2024-05-20T17:51:33.895 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:51:33.956 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 83.9% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:51:33.978 INFO:teuthology.orchestra.run.smithi172.stderr: 90.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:51:34.012 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:51:34.014 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.x.log.gz 2024-05-20T17:51:34.062 INFO:teuthology.orchestra.run.smithi172.stderr: 94.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.l.log.gz 2024-05-20T17:51:34.077 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:51:34.078 INFO:teuthology.orchestra.run.smithi160.stderr: 94.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.k.log.gz 2024-05-20T17:51:34.093 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:51:34.155 INFO:teuthology.orchestra.run.smithi160.stderr: 91.3% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:51:34.194 INFO:teuthology.orchestra.run.smithi172.stderr: 92.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mgr.z.log.gz 2024-05-20T17:51:34.265 INFO:teuthology.orchestra.run.smithi160.stderr: 90.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:51:34.304 INFO:teuthology.orchestra.run.smithi160.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:51:34.682 INFO:teuthology.orchestra.run.smithi135.stderr: 90.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.a.log.gz 2024-05-20T17:51:43.625 INFO:teuthology.orchestra.run.smithi172.stderr: 91.9% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.c.log.gz 2024-05-20T17:51:45.067 INFO:teuthology.orchestra.run.smithi160.stderr: 91.9% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mon.b.log.gz 2024-05-20T17:52:00.607 INFO:teuthology.orchestra.run.smithi172.stderr: 94.9% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.c.log.gz 2024-05-20T17:52:04.407 INFO:teuthology.orchestra.run.smithi135.stderr: 91.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.9.log.gz 2024-05-20T17:52:18.250 INFO:teuthology.orchestra.run.smithi135.stderr: 91.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.6.log.gz 2024-05-20T17:52:22.187 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.0.log.gz 2024-05-20T17:52:26.830 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.3.log.gz 2024-05-20T17:52:26.832 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-20T17:52:26.832 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m53.121s 2024-05-20T17:52:26.832 INFO:teuthology.orchestra.run.smithi135.stderr:user 2m52.294s 2024-05-20T17:52:26.832 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m5.483s 2024-05-20T17:53:02.504 INFO:teuthology.orchestra.run.smithi172.stderr: 95.0% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.f.log.gz 2024-05-20T17:54:57.064 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.2.log.gz 2024-05-20T17:56:00.064 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.8.log.gz 2024-05-20T17:56:31.263 INFO:teuthology.orchestra.run.smithi160.stderr: 95.0% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.e.log.gz 2024-05-20T17:57:59.975 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.11.log.gz 2024-05-20T17:58:12.762 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.5.log.gz 2024-05-20T17:58:23.412 INFO:teuthology.orchestra.run.smithi160.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.7.log.gz 2024-05-20T17:59:48.957 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.10.log.gz 2024-05-20T18:00:10.688 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.i.log.gz 2024-05-20T18:00:10.689 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-05-20T18:00:10.689 INFO:teuthology.orchestra.run.smithi172.stderr:real 8m36.978s 2024-05-20T18:00:10.689 INFO:teuthology.orchestra.run.smithi172.stderr:user 5m42.217s 2024-05-20T18:00:10.690 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m13.823s 2024-05-20T18:00:54.337 INFO:teuthology.orchestra.run.smithi160.stderr: 91.2% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.4.log.gz 2024-05-20T18:02:27.538 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-osd.1.log.gz 2024-05-20T18:05:50.067 INFO:teuthology.orchestra.run.smithi160.stderr: 93.6% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.h.log.gz 2024-05-20T18:06:26.336 INFO:teuthology.orchestra.run.smithi160.stderr: 93.4% -- replaced with /var/log/ceph/76c4e726-16cd-11ef-bc9a-c7b262605968/ceph-mds.b.log.gz 2024-05-20T18:06:26.338 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-05-20T18:06:26.338 INFO:teuthology.orchestra.run.smithi160.stderr:real 14m52.626s 2024-05-20T18:06:26.338 INFO:teuthology.orchestra.run.smithi160.stderr:user 8m44.366s 2024-05-20T18:06:26.338 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m21.166s 2024-05-20T18:06:26.339 INFO:tasks.cephadm:Archiving logs... 2024-05-20T18:06:26.340 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi135/log 2024-05-20T18:06:26.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T18:06:58.129 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi160/log 2024-05-20T18:06:58.130 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T18:08:20.968 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi172/log 2024-05-20T18:08:20.969 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T18:09:18.397 INFO:tasks.cephadm:Removing cluster... 2024-05-20T18:09:18.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force 2024-05-20T18:09:18.590 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T18:09:19.144 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force 2024-05-20T18:09:19.361 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T18:09:20.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 76c4e726-16cd-11ef-bc9a-c7b262605968 --force 2024-05-20T18:09:20.469 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 76c4e726-16cd-11ef-bc9a-c7b262605968 2024-05-20T18:09:21.159 INFO:tasks.cephadm:Removing cephadm ... 2024-05-20T18:09:21.159 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T18:09:21.179 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T18:09:21.213 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T18:09:21.231 INFO:tasks.cephadm:Teardown complete 2024-05-20T18:09:21.232 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-20T18:09:21.243 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-20T18:09:21.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T18:09:21.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T18:09:21.257 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T18:09:21.375 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-20T18:09:21.388 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-20T18:09:21.388 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T18:09:21.391 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T18:09:21.394 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T18:09:21.406 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-20T18:09:21.407 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-20T18:09:21.408 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-20T18:09:21.410 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T18:09:21.410 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-20T18:09:21.411 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 41 +1123us[+1119us] +/- 69ms 2024-05-20T18:09:21.411 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -2102us[-2100us] +/- 52ms 2024-05-20T18:09:21.411 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1588us[+1590us] +/- 68ms 2024-05-20T18:09:21.411 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +1089us[+1091us] +/- 69ms 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -2128us[-2128us] +/- 52ms 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1541us[+1543us] +/- 68ms 2024-05-20T18:09:21.438 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 40 +1135us[+1136us] +/- 69ms 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -2078us[-2076us] +/- 52ms 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1588us[+1589us] +/- 68ms 2024-05-20T18:09:21.439 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T18:09:21.439 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-20T18:09:21.450 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-20T18:09:21.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-20T18:09:21.484 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T18:09:21.566 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T18:09:21.668 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T18:09:21.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T18:09:21.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:21.795 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T18:09:21.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:21.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T18:09:21.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:21.852 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-20T18:09:21.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-20T18:09:21.933 INFO:teuthology.task.internal:Duration was 3237.663836 seconds 2024-05-20T18:09:21.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-20T18:09:21.958 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-20T18:09:21.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T18:09:21.962 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T18:09:21.965 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T18:09:22.003 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T18:09:22.028 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T18:09:22.035 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T18:09:22.373 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-20T18:09:22.373 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-20T18:09:22.373 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T18:09:22.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-05-20T18:09:22.397 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T18:09:22.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-05-20T18:09:22.424 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T18:09:22.453 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-20T18:09:22.453 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T18:09:22.457 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T18:09:22.466 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T18:09:22.521 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-20T18:09:22.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T18:09:22.527 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T18:09:22.542 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T18:09:22.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-20T18:09:22.945 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-20T18:09:22.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T18:09:22.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T18:09:23.005 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T18:09:23.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-20T18:09:23.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.082 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.103 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-20T18:09:23.110 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-05-20T18:09:23.115 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-05-20T18:09:23.148 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:23.178 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:23.193 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:09:23.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:09:23.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-20T18:09:23.244 INFO:teuthology.task.internal:Transferring archived files... 2024-05-20T18:09:23.246 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi135 2024-05-20T18:09:23.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T18:09:23.374 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi160 2024-05-20T18:09:23.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T18:09:23.525 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715632/remote/smithi172 2024-05-20T18:09:23.525 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T18:09:24.426 INFO:teuthology.task.internal:Removing archive directory... 2024-05-20T18:09:24.426 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T18:09:24.429 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T18:09:24.432 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T18:09:24.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-20T18:09:24.760 INFO:teuthology.task.internal:Not uploading archives. 2024-05-20T18:09:24.760 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-20T18:09:25.040 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-20T18:09:25.041 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T18:09:25.044 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T18:09:25.048 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T18:09:25.060 INFO:teuthology.orchestra.run.smithi135.stdout: 266028 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 18:09 /home/ubuntu/cephtest 2024-05-20T18:09:25.063 INFO:teuthology.orchestra.run.smithi160.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 18:09 /home/ubuntu/cephtest 2024-05-20T18:09:25.066 INFO:teuthology.orchestra.run.smithi172.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 18:09 /home/ubuntu/cephtest 2024-05-20T18:09:25.068 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-20T18:09:25.661 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-20T18:09:25.967 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} duration: 3237.66383600235 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-05-20T18:09:25.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T18:09:26.061 INFO:teuthology.run:FAIL